Makoto Otsuka
Research
Adaptive construction of an efficient state space for a reinforcement learning agent
Publications
-
Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya
Free-energy-based Reinforcement Learning in a Partially Observable Environment
11th European Symposium on Artificial Neural Networks (ESANN 2010), Bruges, Belgium. April 23-25, 2010 -
Makoto Otsuka
Goal-oriented Representation of the External World: a Free-energy-based Approach
Ph.D. thesis. Nara Institute of Science and Technology, Ikoma, Nara, March 2010
pdf -
Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya
Reward-dependent sensory coding in free-energy-based reinforcement learning
Neural Network World., 19, 597-610, 2009 -
Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya
Task-dependent distributed representation of latent states in free-energy-based reinforcement learning (Japanese)
IEICE Neurocomputing Workshop, NC2008-29, 91-96. Okinawa, Japan, June 26-27, 2008. -
Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya
Robust Population Coding in Free-energy-based Reinforcement Learning
The 18th International Conference on Artificial Neural Networks, ICANN 2008 Prague, Czech Republic, September 3-6, 2008 - Makoto Otsuka, Action-Oriented State Coding by Neighbourhood Component Analysis (Japanese). Master thesis. Nara Institute of Science and Technology, Ikoma, Nara, March 2007
-
Makoto Otsuka, Eiji Uchibe, Kenji Doya
Action-Oriented State Coding by Neighbourhood Component Analysis
IEICE technical report. Neurocomputing Vol.106, No.588(20070307) pp. 185-190, NC2006-149 Tamagawa University, March 14, 2007
Bibliography
- Academic Background
- 2003: University of California, Los Angeles (UCLA), BA (psychology, cognitive science) 0li>
- 2007: Nara Institute of Science and Technology (NAIST), Graduate School of Information Science, MA (engineering)
- 2010: Nara Institute of Science and Technology (NAIST), Graduate School of Information Science, Ph.D. (engineering)
- Other Research Experiences
- 2006/03 - 2010/03 : Okinawa Institute of Science and Technology (OIST), Neural Computation Unit, Research Assistant
- 2010/04 - present : Okinawa Institute of Science and Technology (OIST), Neural Computation Unit, Postdoc Researcher
Awards
back