Paul A. Crook "Learning in a State of Confusion: Employing active perception and reinforcement learning in partially observable worlds" published June 2007 by University of Edinburgh, College of Science and Engineering, School of Informatics. Abstract and full electronic version of thesis can be found in the Edinburgh Research Archive at http://hdl.handle.net/1842/1471. This is a persistent URL which should always resolve to my thesis, i.e. you can safely cite it.
Slides from a talk that I gave at the IDSIA institute (in Switzerland) give a summary of my PhD work.