Hi, Does the brain use billions of parameters (analogous to deep learning) to model things? Or is it very efficient that it only uses relatively few parameters? Are there any known evidences? Reason I asked is that I’d like to get inputs about whether using billions or gazillions of parameters (re…

Ok, a bit (or byte?) of gas on fire, this one is too recent to be already on “classical” search engines: https://www.reddit.com/r/artificial/comments/10ddg8j/i_got_chatgpt_to_create_a_new_joke_i_would_never/ Notice also this comment: Know about homonyms Find a question that makes sense in sense…

[image] neel_g: I’ve asked thrice now for any sources/citations saying they are search engines despite me quoting several about how they learn circuits and algorithms. There is nothing wrong with that, per se. Search is how you do generalization: finding similarity among items, that can then …

Part of the issue here is that the phrase “search engine” is incredibly vague. Definition: a search engine is an algorithm that takes a key and returns a list of related values. By this definition the hippocampus/cortex is a search engine. What sets both NN’s and the brain apart from search engin…

[image] dmac: What counts as “novel and interesting” is a very subjective and human issue. Let me take subjectivity out of it. Search shouldn’t just return a list of related items, it should compute the relationship. Which includes differences among items and items to template. These differen…

[image] dmac: Part of the issue here is that the phrase “search engine” is incredibly vague. I think the issue is that there are statements here that assert and generalize something but use/cite using a specialization or a special instance to prove the generalization. For example, NNs are no…

A search engine is a piece of software that takes some kind of input (text, picture, etc), searches a trove of documents obtained from the Web (or similar source) and returns those with various kinds of similarity. The brain is not a search engine, and NNs do not on their own produce outputs there …

[image] david.pfx: A search engine is a piece of software that takes some kind of input (text, picture, etc), searches a trove of documents obtained from the Web (or similar source) and returns those with various kinds of similarity. If I may ask, what is the point of comparing sophisticated …

As I understand it, GPT searches its corpus for words and phrases, and the context around them. Then it assembles them according to what it finds, into text. The billions of parameters are equivalent to a multi-dimensional space, and the search is for words and phrases found along some dimension. I…

[image] Jose_Cueto: I am a bit of disagreement with the “indexed search engine” though. AFAIK NN’s don’t index their solutions nor their search spaces. [image] Jose_Cueto: … It wasn’t constructed based on a mathematical search algorithm. Yeah, that “indexed” has to use some relaxed sem…

[image] david.pfx: We build models of language, so we know how a sentence will end. Ditto for music. IMO this is the one big missing link, and until it is found there will never be AGI. I would expand a bit that “mental models” are products of our “intelligence”, only with our (or animals’ at…

Is billions of parameters (or more) the only solution?

Engineering

Topic		Replies	Views
Google DeepMind claims they're close to achieving human-level AI Science	214	5672	December 25, 2024
An ode to biological principles Lounge	28	1450	September 23, 2023
Intelligence is embarrassingly simple General Neuroscience	31	1830	August 24, 2023
Random question about point neurons vs biological ones Community	21	924	May 23, 2025
Why do members here think DL-based methods can't achieve AGI? Numenta Theory question , community	182	8504	May 23, 2026

Is billions of parameters (or more) the only solution?

Related topics