# Esperanto NLP using HTM and my findings

**URL:** <https://discourse.numenta.org/t/esperanto-nlp-using-htm-and-my-findings/4289>\
**Category:** Engineering\
**Created:** [August 1, 2018, 12:08am UTC](https://discourse.numenta.org/t/esperanto-nlp-using-htm-and-my-findings/4289 "2018-08-01T00:08:09Z")\
**Posts on this page:** 1\
**Showing post:** 60

<div class="post-metadata">

**Author:** ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Post date:** [November 29, 2018, 4:37pm UTC](https://discourse.numenta.org/t/esperanto-nlp-using-htm-and-my-findings/4289/60 "2018-11-29T16:37:05Z")

</div>

From a philosophy point of view RNNs are the closest “traditional neural network” to HTM in terms of what it does and how you structure problems.

As a HTM hobbyist it may be very helpful to become familiar with RNN technology. One of the areas where RNNs have seen success is in NLP (Natural Language Processing). I don’t think that it is necessary to mindlessly copy what RNNS are doing so much as a way to identify and think about the tasks in language processing when using a predictive system.

I just got these in my latest dispatch from my Medium daily digest:

> **[Recurrent Neural Networks for Language Understanding](https://towardsdatascience.com/recurrent-neural-networks-for-language-understanding-10c649f8ac15)**
>
> An introduction of Recurrent Neural Networks in the context of NLP.

> **[Dissecting BERT Part 1: The Encoder](https://medium.com/dissecting-bert/dissecting-bert-part-1-d3c3d495cdb3)**
>
> This is Part 1/2 of Understanding BERT written jointly by Miguel Romero and Francisco Ingham. If you already understand the Encoder…

[https://medium.com/analytics-vidhya/recurrent-neural-networks-the-powerhouse-of-language-modeling-f292c918b879](https://medium.com/analytics-vidhya/recurrent-neural-networks-the-powerhouse-of-language-modeling-f292c918b879)

But really - this stuff is everywhere; Google “RNN nlp” for a cornucopia of information on this topic.  
Perhaps an overwhelming amount. That said - I would rather have too much than too little.

A pointer to posts in a related thread:

> [@Words to SDR?](https://discourse.numenta.org/t/words-to-sdr/3660/28):
>
> Thank you for your thoughtful reply. I agree - syllables are a stand-in for phonemes. For the bystander watching this exchange: [https://en.wikipedia.org/wiki/Phoneme](https://en.wikipedia.org/wiki/Phoneme) When I was working with the AVOS company (Assistive technology for the visually impaired) I became very interested in speech IO and the production of speech sounds. I discovered that the sounds of speech are an artifact of the kinds of sounds that the human speech production hardware was capable of making. Please examine the ch…

and

> [@Words to SDR?](https://discourse.numenta.org/t/words-to-sdr/3660/29):
>
> I travel extensively for my job and have been doing so since the early 1990s. This included frequent visits to China and it became useful to learn Mandarin Chinese. I used the Pimsleur course and eventually was able to function on my own in day-to-day interactions. Immersion in the language and culture really drives this home. I can read and write a bit but my tones are terrible. I understand what you are saying about Chinese stroke order and character formation. I am struck that in Chinese ma…

---

_[View the full topic](https://discourse.numenta.org/t/esperanto-nlp-using-htm-and-my-findings/4289)._