Does anyone have a word to SDR encoder?

Easiest place to get word SDRs is cortical.io

Paul, yes, that is prefect. Thanks.

Is it safe to say that the cortical.io encoder works on data that’s exclusively in the form of words? So, all semantic information that is encoded pertains to the resulting space of words?

[image] abshej: Is it safe to say that the cortical.io encoder works on data that’s exclusively in the form of words? So, all semantic information that is encoded pertains to the resulting space of words? Yes. In their implementation of semantic folding, semantics are distilled by first defi…

Thanks. Are there any known encoders that use other techniques to convert words to SDRs?

In case you haven’t seen it: [image] NLP Projects NuPIC Below are a list of projects using NuPIC for Natural Language Processing. Fluent A platform for building language / NLP-based applications using NuPIC and Cortical.IO . Linguist From Chetan Surpur, details here . Nu…

There is also GloVe from Stanford University. https://nlp.stanford.edu/projects/glove/ "GloVe is an unsupervised learning algorithm for obtaining vector representations for words. Training is performed on aggregated global word-word co-occurrence statistics from a corpus, and the resulting represe…

Interesting. They also use semantic information obtained from an archive of words. Although the essential aspect is probabilities, footprint of word occurrences is again the central theme.

[image] abshej: footprint of word occurrences is again the central theme Out of curiosity - how else does a human learn semantics if not from word proximity? Meaning from context is still word proximity. Explanation in teaching is at its core also word proximity. I see the basic mechanism …

If you mean language learning mechanisms other than word occurrences then I would say associative learning where in symbols are constantly associated with growing list of patterns on the go. Word occurrences can help build relationships among learned patterns and hence relate symbols that way.

Words to SDR?

Engineering

rhyolight March 21, 2018, 3:37pm 7

In case you haven’t seen it:

Topic		Replies	Views
How get SDR of word Engineering	37	1497	May 17, 2018
Questions regarding SDR encoding Engineering	9	3452	September 14, 2016
Future development of fork + how 'far behind' are we? NuPIC Community Fork question , community , development	9	1378	September 2, 2020
TBT theory and symbol representation Numenta Theory	37	1549	November 1, 2021
Commonality of language - self emergent learning Lounge question	40	2543	April 14, 2022

Words to SDR?

Related topics