Main menu

Login
Username:

Password:


Lost Password?

Register now!

Language




Makoto Otsuka



Research

Adaptive construction of an efficient state space for a reinforcement learning agent


Publications

  • Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya
    Free-energy-based Reinforcement Learning in a Partially Observable Environment
    11th European Symposium on Artificial Neural Networks (ESANN 2010), Bruges, Belgium. April 23-25, 2010
  • Makoto Otsuka
    Goal-oriented Representation of the External World: a Free-energy-based Approach
    Ph.D. thesis. Nara Institute of Science and Technology, Ikoma, Nara, March 2010
    pdf
  • Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya
    Reward-dependent sensory coding in free-energy-based reinforcement learning
    Neural Network World., 19, 597-610, 2009
  • Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya
    Task-dependent distributed representation of latent states in free-energy-based reinforcement learning (Japanese)
    IEICE Neurocomputing Workshop, NC2008-29, 91-96. Okinawa, Japan, June 26-27, 2008.
  • Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya
    Robust Population Coding in Free-energy-based Reinforcement Learning
    The 18th International Conference on Artificial Neural Networks, ICANN 2008 Prague, Czech Republic, September 3-6, 2008
  • Makoto Otsuka, Action-Oriented State Coding by Neighbourhood Component Analysis (Japanese). Master thesis. Nara Institute of Science and Technology, Ikoma, Nara, March 2007
  • Makoto Otsuka, Eiji Uchibe, Kenji Doya
    Action-Oriented State Coding by Neighbourhood Component Analysis
    IEICE technical report. Neurocomputing Vol.106, No.588(20070307) pp. 185-190, NC2006-149 Tamagawa University, March 14, 2007


Bibliography

  • Academic Background
    • 2003: University of California, Los Angeles (UCLA), BA (psychology, cognitive science)
    • 2007: Nara Institute of Science and Technology (NAIST), Graduate School of Information Science, MA (engineering)
    • 2010: Nara Institute of Science and Technology (NAIST), Graduate School of Information Science, Ph.D. (engineering)
  • Other Research Experiences
    • 2006/03 - 2010/03 : Okinawa Institute of Science and Technology (OIST), Neural Computation Unit, Research Assistant
    • 2010/04 - present : Okinawa Institute of Science and Technology (OIST), Neural Computation Unit, Postdoc Researcher


Awards

  • IEEE Computational Intelligence Society Japan Chapter, Young Researcher Award 2008

  • back