TY - GEN
T1 - Assessing the appropriateness of using Markov decision processes for RF spectrum management
AU - Meier, John
AU - Karaus, Benjamin
AU - Sistla, Sreeharsha
AU - Tidwell, Terry
AU - Chamberlain, Roger D.
AU - Gill, Christopher
PY - 2013
Y1 - 2013
N2 - The stochastic nature of wireless communication suggests a Markov Decision Process (MDP) as a formalism for identifying and evaluating spectrum control policies. However, in practice numerous factors influence the success or failure of a transmission, so that the applicability of particular MDP models to real spectrum management problems must itself be examined. This paper presents a series of model validation studies in which correspondence between an MDP model and a discrete-event simulation (DES) model is evaluated. We test several hypotheses that together provide a foundation and an exemplar for the idea of using MDPs to guide management of shared spectrum. We conclude that there is sufficient similarity between the performance predictions made by the MDP model and the DES model that MDPs can be used effectively to determine spectrum control policies.
AB - The stochastic nature of wireless communication suggests a Markov Decision Process (MDP) as a formalism for identifying and evaluating spectrum control policies. However, in practice numerous factors influence the success or failure of a transmission, so that the applicability of particular MDP models to real spectrum management problems must itself be examined. This paper presents a series of model validation studies in which correspondence between an MDP model and a discrete-event simulation (DES) model is evaluated. We test several hypotheses that together provide a foundation and an exemplar for the idea of using MDPs to guide management of shared spectrum. We conclude that there is sufficient similarity between the performance predictions made by the MDP model and the DES model that MDPs can be used effectively to determine spectrum control policies.
KW - discrete-event simulation (des)
KW - markov decision process (mdp)
KW - spectrum allocation
UR - https://www.scopus.com/pages/publications/84889650529
U2 - 10.1145/2507924.2507942
DO - 10.1145/2507924.2507942
M3 - Conference contribution
AN - SCOPUS:84889650529
SN - 9781450323536
T3 - MSWiM 2013 - Proceedings of the 16th ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems
SP - 41
EP - 48
BT - MSWiM 2013 - Proceedings of the 16th ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems
T2 - 16th ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems, MSWiM 2013
Y2 - 3 November 2013 through 8 November 2013
ER -