Skip to main content

Learning and Intelligence

Additional thoughts on learning and intelligence


In previous posts I've looked at the idea that learning is the process of connecting responses to stimulus, and that the actual way that learning happens in animals is essentially a form of data compression. If we think of learning like this, then we should ask how the data compression works, what process or rules does it follow if any? The key to good data compression is to find patterns in the data and take advantage of that, and the world we live in comes ready made with rules that govern how it works, the physical laws of the universe. It would seem that it would be possible for our brains to take advantage of this to compress responses to stimuli efficiently, and that that process could have the beneficial side effect of making the prediction of physical processes easier. The learning process would not only be encoding individual responses, but also patterns in those responses and the rules that determine what shape those patterns take.

What would the role be of the intelligent parts of the brain if the brain was already naturally adapted to learning and predicting the physical world? Well, there's one part of the world that, at least to a first approximation, doesn't appear to follow simple physical laws, and that's animals. I'm not claiming that the laws of physics and chemistry don't govern animal behavior, but they're layered in such complex systems that it's not immediately obvious how to use those laws to make predictions. Making physical predictions about simple physical objects, or even relatively complex structures like trees or rivers is fairly straightforward. Simple applications of momentum, friction, gravity, etc. are enough to learn how most objects in the world will behave, but animal behavior is governed by a set of rules that's essentially indecipherable for a single individual. One area that makes learning and predicting this kind of behavior particularly difficult is that reactions can happen over huge time spans. If you push a rock it'll move and maybe keep moving for a bit, but if you push an animal the reaction is unpredictable and the reaction might change over minutes, hours, days or even longer. The intelligent parts of the brain are good at finding patterns in complex situations without a lot of repeated exposure, it may be that they're evolutionary advantageous for dealing with animal interactions.

We can imagine the brain of early humans, primates or even earlier animals trying to learn appropriate reactions to stimulus from both their inanimate and animal surroundings. A system that works well for learning one kind system is unlikely to be adapted to learning about the other. Instead it makes more sense to have two different kinds of systems interacting, with each specializing in a particular kind of problem. Learning might have been fine for simple animals that were trying to survive in a mostly inanimate environment, but as other animals started to become an important factor than having the ability to intelligently process those interactions would be much more useful. If intelligence is the ability to make comparisons, we could see how comparing predictions to observations or comparing different memories of similar situations would be useful in figuring out complex animal behavior. In essence the best reason for humans to become more intelligent in that they had to interact with other intelligent animals, including other intelligent humans.

Popular posts from this blog

Intelligence

Typical Definition of Intelligence : the ability to acquire and apply knowledge and skills. Wikipedia Definition: the ability to perceive information, and to retain it as knowledge to be applied towards adaptive behaviors within an environment or context. Proposed Definition: A measure of the ability to make comparisons To define intelligence what typically happens is that we start with intelligent behavior, which essentially just means acting like a human. Animals that act more like us are more intelligent, and things that act less like us are less intelligent. People who can solve the kinds of problems humans can solve, but can solve them faster or can solve more difficult versions are deemed to be more intelligent. Then, working backwards, we assume there's some quality of 'intelligence' that causes or enables this kind of behavior. One of the biggest problems with this very vague definition of intelligence is that it's hard to nail down. Is someo...

Animal learning as data compression

Instead of the more general kind of learning , let's look at what kind of qualities animal learning has, what mechanisms actually make brains work. I think that there's undoubtedly at least part of our brains (and other animal brains) that work this way. They connect stimulus to response and are able to be adapted over time, which would qualify as a form or learning. If we accept that learning is an unconscious way of storing stimulus and response pairs, then we can think of the different ways that could be accomplished. We can imagine a very simple animal that just has one set of sensory receptors and each individual receptor is simply hardwired to stimulate a particular response - when triggered it flees light for example. And we can imagine more and more of these simple 1-to-1 sensory-to-response connections being made, each working independently of each other. Eventually though for animals with a lot of detailed senses and a lot of possible responses, they would end up wi...