Hi all. I have been messing with NLP using Temporal Memory in the weekends. I coded up a simple program with and made it to learn the structure of Esperanto sentences. (I’m testing with Esperanto because the language itself is regular and has obvious features.) And my results are… not surprising. …

I am wondering about the same. In the long run it should come back, I think it really is a must-have feature.

Hmm, first time hearing about a phoneme level NLP… I think they are the same in Esperanto (It would be an interesting problem for natural languages). Esperanto has a definite mapping from phonemes to characters. a is always a, d͡ʒ is always g, o-i is always oj… Character level NLP is phoneme level …

You’re right. That unique mapping is one of the features that make Esperanto easy to learn. But, for example, don’t you think that it would be easier to learn “mi mangas polmon” phoneme by phoneme than character by character? Only to normalize our understanding, what I mean by phoneme would result …

Ahhhh… Thanks for clearing my misunderstanding. That is a great idea! Learning by phonemes/syllables should be way easier then character by character. And a lot more nature. Sounds like a unique and fun challenge. I’m in!

There is an older thread that I just bumped up that is very relevant to this thread. I added a post to that thread that is also applies to the current consideration of the letter/syllable/word choice. [image] Words to SDR? Engineering There are a large number of people t…

I hacked up a voting system during the weekends with 16 TMs. It is a bust. When HTM is asked to predict what is after Estas multajn pomo. HTM predicts Estas multaj pomo ke la viro kajn polindan sensonis al lia. Still not predicting -jn that it should be predicting. Randomlly generated text is stil…

Have you tried to do it with a RNN to see if that works?

[image] marty1885: I hacked up a voting system during the weekends with 16 TMs. It is a bust. I’m curious what your overall strategy looks like for this. I assume multiple regions trained on different data, all predicting next letter, and voting is for what will be the next letter? If so, I…

[image] Paul_Lamb: This system thus requires a layer to represent something more abstract than the features (letters) that it is constructed from. This layer could be representing words, phrases, or sentences for example. There is not currently a working algorithm to form these more abstract “o…

[image] Bitking: When it comes to language there is no example I can point to where a system forms internal models of functional language by “just listening.” There is always a teacher. The closest thing that I am aware of is semantic folding. The problem with the original algorithm (as desc…

Esperanto NLP using HTM and my findings

Engineering

rhyolight November 26, 2018, 6:08pm 55

See:

Topic		Replies	Views
Another HTM test implementation Engineering	18	1764	April 24, 2017
Playing Rock, Paper, Scissors with HTM, Take 2 Applications sequence-memory	19	1409	October 9, 2019
Lexicon Induction From Temporal Structure Numenta Theory sdrs , representation	44	3516	January 4, 2018
Extrapolating and interpolating quantities with HTM Numenta Theory question , cortical-columns , representation , minicolumns	13	641	February 15, 2023
HLC 2020 12 01 Prediction of novelty Community	22	1291	December 4, 2020

Esperanto NLP using HTM and my findings

Related topics