I think maybe it is time for you to think a little about nature. I have a theory that the brain looks for increasing novelty in order to pattern novel information and that increasingly complex behaviour is initiated to learn about the environment. If that were true then there would be a biological imperative to learn. I think if you look at natural systems you will see a pattern of self organizing behaviour emerges. There is a growing body of evidence that suggests that plants learn. What would happen if we designed an encoder to take action potential signals from a plant and simply looked for patterns that we could try to correlate with time lapsed plant behaviour. Would it pattern basic learning?
One other thing…I think there might be a fundamental law of nature…we could call it the law of increasing novelty… sort of like entropy that drives learning in all biology…did I pique your interest?
One last thing… if my theory of increasing novelty bears any sort of fruit the fact that my idea might be somewhat novel might require some consideration. See my previous post emotional logic control of behaviour based learning.
Sorry… The thoughts keep coming…it occurs to me that you guys have done a fabulous job of unraveling the most complex thing nature has ever produced…but have you thought about how nature’s simpler things might be trying to do the same things in more manageable chunks. Plant behaviours happen on a long time scale and this might slow things down a little for a machine that’s learning. It might give us the time to actually see what’s happening. It would be sort of akin to how I think kids should pull apart a small engine before they start to fully comprehend a car.
Do you have any articles/videos or such about this you’d recommend? Is it some sort of stimulus -> chemical response learning? For example, something chomps a leaf so it releases a defensive chemical, and it learns to release that chemical when the insect starts walking on the leaf, perhaps?
As I understand it, plants use chemical/hormonal processes to control their behavior, so rather than action potentials like neurons use, you’d have to use something else for the encoder. If there is a substitute for action potentials which you can correlate with behavior, you might find something interesting like a general learning mechanism, but I’m not sure plants would evolve that because they could probably just use a bunch of specific strategies to deal with each situation.
In my opinion, organisms like plants, bacteria, and simple animals like worms probably don’t use mechanisms which can be applied to other things.
But for most animals, I agree. There are probably some mechanisms which are universal for animal intelligence. By studying insect brains and bird brains, for example, you could probably figure out which mechanisms of intelligence are universal and which are just specializations.
I bet if neuroscience chose to study insect brains in so much detail rather than mammal brains, we would have a much easier time creating AI, or at least laying the foundations (object recognition, memory, etc.) if insects don’t have general intelligence.
Still, there is so much more information about the cortex than about non-mammal brains. It has taken so much research to start understanding the cortex. From what I’ve seen, we’re a long way from understanding non-mammal brains in enough detail to theorize about their mechanisms of intelligence. I think we’ll probably solve general AI before studying other brains in detail, and then use non-mammal brains to further enhance AI and behavior.
A colleague of mine is experimenting with behavior driven encoders for a potential thesis direction. I can put you in contact with him if you’d like.
The search for common laws and principles of learning in nature is something the HTM community takes very seriously. The notion of a common cortical algorithm is an example.
Ok a few things… i think all animal brains work on an algorithm which searches for increasing novelty…next the plant behaviour thing is summed up nicely by a cbc (canadian broadcasting corporation) documentary on the nature of things… sorry…i didn’t include a link as i don’t think it is available for free outside canada but i think a google search would probably turn something up. Third…think globally …i mean …if nature figured something out once it probably recycled it in higher and higher animals…i see the same process of concept formation and object recognition at work in my dog as that at work in my own mind. Finally…I should let you know that my primary goal here is to discover human learning algorithms for the optimization of human learning. As a result I have chosen to study the link between emotion and behaviour…and before you get turned off by the word emotion…I think you should know I think that emotions are fundamental to learning…I’m not sure how you implement it in machine learning, but essentially I think that human or animal emotions are a critical piece which is being overlooked. If emotions drive behaviour…and I think they do! Then emotions are the algorithm that drives behavioural learning and this would be key. I think emotions are the breadcrumb trail of learning. Just like we need to have an egocentric and allocentric model of the world…we also need a map of the learning that went into discovering semantically similar objects or ideas…otherwise we would have to learn about a similar object or idea from scratch each time. Think about a ball…probably you are thinking about balls that are round, spherical, they bounce and roll and probably they are fun! All of the first few attributes are physical but the last…in the case of humans…is the current state of learning about spherical objects called balls. What if I gave you a bowling ball or a cannon ball. Now all of A sudden you are confronted with something semantically similar to a ball…but it doesn’t bounce nicely and if you drop it on your foot or it is lobbed over your castle wall it is not fun and does not exhibit the properties associated with a ball…your emotional response to this will drive your behavioural interaction with this New ball but it picks up where your last interactions left off rather than trying to construct a new model of a dissimilar ball…One which is not so fun or which requires a new definition of fun…if you’re the one lobbing cannon balls and they are doing what you expect…then it’s probably a new way of having fun with a new kind of ball. In this way I think emotional response or attitude to concepts or ideas could be viewed as almost like GPS way points along a complicated route which could have many permutations or combinations which eventually arrive at the same point. If you are confronted with something new or unexpected do you go all the way back to the beginning or do you just go back to the last known position along that route. Like I said…I’m just trying to figure out how people learn…if this idea is as big as I think it is then just throw me a bone later on when you figure it out…in the mean time…I would love to hear from someone who can really explain spatial pooling and specifically why it’s called that…I have some ideas but would like to hear from you all first…thanks jake
Cbc did a great doc on smarty plants… also Stefano mancuso? Could be misspelled…did a great Ted on it…long time ago now he has probably got your encoder worked out already…just plug and play …as far as laws of nature and stuff, I’m pretty sure it’s there but I lack the labs, free time and math skills to work it out…I will deal with theories I can experiment with in my classroom… I’ll leave the proof to people like you…of course let me know if I was sort of right. I have a hunch that things are not as complicated as you might think and that once you find it it will also apply to worms and even single cellular life…just a hunch but maybe it starts a conversation with people way more qualified than me.
To be clear, my opinion is no more valid than your’s. I’ll check out those videos when I have time, but if you can encode it in a similar way to neurons, much of what I wrote in my previous reply is probably wrong.