# Reinforcment learning using NuPIC(.core)

**URL:** <https://discourse.numenta.org/t/reinforcment-learning-using-nupic-core/3780>\
**Category:** Engineering\
**Created:** [April 16, 2018, 2:11pm UTC](https://discourse.numenta.org/t/reinforcment-learning-using-nupic-core/3780 "2018-04-16T14:11:13Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![momiji](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/momiji/32/3719_2.png) [@momiji](https://discourse.numenta.org/u/momiji)\
**Post date:** [April 16, 2018, 2:56pm UTC](https://discourse.numenta.org/t/reinforcment-learning-using-nupic-core/3780/2 "2018-04-16T14:56:29Z")

</div>

Hmm a tricky one, and discussed previously:

> [@A testcase of HTM with reinforcement learning](https://discourse.numenta.org/t/a-testcase-of-htm-with-reinforcement-learning/762/2):
>
> The problem that you’re describing is a sensorimotor and goal-oriented behavior problem. Sensorimotor means that the snake must model changes that it observes that are caused by its own actions, as opposed to external changes that it passively observes. Goal-oriented behavior means the snake must additionally drive motor commands in pursuit of some goals. In your case, there are positive and negative signals and the snake must learn to drive sequences of motor commands to get to the positive r…

and here in a more biological detail:

> [@Exploring Reinforcement Learning in HTM](https://discourse.numenta.org/t/exploring-reinforcement-learning-in-htm/1545):
>
> I have been working on a test to implement reinforcement learning using HTM concepts. I am still debugging some problems (with the implementation, not necessarily with the theory itself) so I am not ready to release the code just yet. But I thought I would discuss the approach I am using, and maybe get some feedback and ideas. There are a few aspects which are not biologically feasible, but I am hoping some useful information might be distilled from this exercise. When I refer to Layer X “pro…

There is also a recent MSc thesis which attempted to tie HTM with reinforcement learning:

[http://studentnet.cs.manchester.ac.uk/resources/library/3rd-year-projects/2016/antonio.sanchezgomez.pdf](http://studentnet.cs.manchester.ac.uk/resources/library/3rd-year-projects/2016/antonio.sanchezgomez.pdf)

I’m also interested in giving it a go, just need to find some time.

M

---

_[View the full topic](https://discourse.numenta.org/t/reinforcment-learning-using-nupic-core/3780)._