"Non UBC"@en .
"DSpace"@en .
"Grand Clement, Julien"@en .
"2019-07-18T08:17:57Z"@en .
"2019-01-18T09:08"@en .
"Markov decision processes (MDPs) are a common approach to model dynamic optimization problems in many applications. However, in most real world problems, the model parameters that are estimated from noisy observations are uncertain, and the optimal policy for the nominal parameter values might be highly sensitive to even small perturbations in the parameters leading to significantly suboptimal outcomes.\nWe consider a robust approach where the uncertainty in probability transitions is modeled as an adversarial selection from\nan uncertainty set. Most prior work considers the case where uncertainty on parameters related to different states is unrelated and the \n adversary is allowed to select worst possible realization for each state unrelated to others, potentially leading to highly conservative solutions. On the other hand, the case of general uncertainty sets is known to be intractable. We consider a factor model for probability transitions where the transition probability is a linear function of a factor matrix that is uncertain and belongs to a factor matrix uncertainty\nset. This a significantly less conservative approach to modeling uncertainty in probability transitions while allowing to model dependence between probability transitions across different states. We show that under a certain rectangularity assumption, we can efficiently compute the optimal robust policy under the factor matrix uncertainty model. We also present a computational study to demonstrate the usefulness\nof our approach."@en .
"https://circle.library.ubc.ca/rest/handle/2429/71046?expand=metadata"@en .
"41.0"@en .
"video/mp4"@en .
""@en .
"Author affiliation: Columbia University"@en .
"Banff (Alta.)"@en .
"10.14288/1.0379915"@en .
"eng"@en .
"Unreviewed"@en .
"Vancouver : University of British Columbia Library"@en .
"Banff International Research Station for Mathematical Innovation and Discovery"@en .
"Attribution-NonCommercial-NoDerivatives 4.0 International"@en .
"http://creativecommons.org/licenses/by-nc-nd/4.0/"@en .
"Graduate"@en .
"BIRS Workshop Lecture Videos (Banff, Alta)"@en .
"Mathematics"@en .
"Operations research, mathematical programming"@en .
"Computer science"@en .
"Applied computer science"@en .
"Robust Markov Decision Processes: Beyond Rectangularity"@en .
"Moving Image"@en .
"http://hdl.handle.net/2429/71046"@en .