Can you tell if a piece of fruit is ripe or overripe by sight alone? While dark bananas or green oranges obviously fail the optimal ripeness test, most of the time we need to employ other senses to help us decide. Squeezing, smelling, thumping, or tasting can help determine if the fruit is suitable for eating now, needs to ripen a bit or be tossed onto the compost heap.
Most of us take for granted this ability of our brains to mesh information from multiple senses into a cohesive whole. It doesn't take a heck of a lot of human intelligence to do this neural juggling act effortlessly, without having to think about it. No need to go back to fruit school each time we pack our lunch.
But even the most sophisticated intelligent machines struggle when it comes to perceiving and adapting to their environments. They can be reprogrammed to accomplish this sensory fusion, but that kind of defeats the idea of adaptability (and makes for lots of programming overtime, too.)
A group of European scientists have taken on the challenge of investigating how to teach intelligent machines perceive and adapt to their environments by simultaneously using multiple senses. (See Biology inspires perceptive machines. for a somewhat technical summary of their doings.)
The article details how the scientific team based its modeling on a sophisticated type of neural network based on something called spiking neurons. The team believes these types of circuits process information kind of like a biological brain might. And, if I'm reading it right, these types of circuits exploit a kind of neural plasticity:
Similarly, adaptation is another aspect of the biological model, known as plasticity, where data flows through new routes in the brain to add further resources to data capture. If repeated over time, this plasticity becomes learning, where well-travelled routes through the brain become established and reinforce the information that passes.
So, looks like theres lots of work to be done before the singularity arrives and we begin sending our intelligent agents out for fresh fruit.
For a take on the idea of machine perception and motion (among other things), have a look at Why Robots Fall Down.