Compression and Integration: Goals

This section is a first pass at exploring evolutionary goals and constraints that might affect how information integration, as well as information compression might have developed

In the previous chapters we explored the input for visual perception (pixellated 2D images, with colour depth). We also explored the output for action, in the form of specifications for muscle tension for each muscle, at the rate of 1000 per second.

The two information streams have to meet and interact, to maximize the success rate of action using perception.

• Action must use vision to improve the success rate over 'blind' action
• Adaptation of action to the current circumstances is likely the main way that use of vision can increase the success rate of action sequences

We also explored how the storage of experience in the form of images and actions might support basic learning

• We realized that the comparison of present experiences with stored experiences might be part of the process of learning from experience and of selecting appropriate action
• Goal setting, comparison: e.g. matching a present sensation of hunger against a previous experience of hunger that is followed by satiating hunger
• selection: finding an action sequence with a similar starting context that appeared to be most successful in leading to a successful outcome

We saw that storing 'raw' data in the nerve cells of the brain did not allow storing enough visual and action experience

• We realized that the storage of 'raw' visual experiences is severely limited, and that some form of compression is required
• We realized that the storage of 'raw' action is severely limited, and that some form of decompression from a more compact representation of action is required
• compression / decompression are likely candidates for information processing functionality in the brain
• The following chapters focus on compression and decompression as it applies to vision and action.

We saw the limitations in simply and exactly mimicking past action

• We realized that the action needs to be adapted to fit the context and the environment