Section 1:  Asking the right question about the basis for language comprehension and learning
Introduction	5
Chapter 1:  Discovering the right question to investigate	6
Chapter 2:  Experimentation based on social-engineering	12
Chapter 3:  Thought and action: the mental and the physical	16
Chapter 4:  Feelings and action	17
Chapter 5:  Body and mind, the missing link	17
Chapter 6:  The research paradigm – experimentation & validation	19
Chapter 7:  The research paradigm – modeling information content, flow, and processing	21
Chapter 8:  Notes & comments – status & future plans	24

Section 2:  A simplified model of the mechanical and optical hardware common to most vertebrates: the interface to the world and ‘shared reality’ via action and vision
Introduction:  summary of previous sections	5
Chapter 1:  A simple mechanical model for vertebrates	6
Chapter 2:  Optics for vertebrates:  converting images into information	14
Chapter 3:  Hearing machinery:  converting sound into information	16
Chapter 4:  Hardware for perceiving touch, smell, taste, and other senses – including proprioception	18

Section 3:  A simplified ‘information processing hardware’ model for vertebrates:  to control action and to integrate vision
Introduction:  summary of previous sections	4
Chapter 1:  Hardware for information processing -- hard-wired brains and the analogy with the evolution of computers	5
Chapter 2:  Brain-based information processing	7
Chapter 3:  The brain as a process control system	8
Chapter 4:  Integrating vision with the brain-based process control system	12

Section 4:  A simplified software and data model for vertebrates: an inner language to control action and to integrate vision
Introduction:  summary of previous sections	4
Chapter 1:  Using an ‘inner language’ for the  instructions to control action	5
Chapter 2:  Adding vision to language-based action	7
Chapter 3:  Integrating the output of vision into the instructions for action sequences	7
Chapter 4:  Geometry and time in action sequences	12
Chapter 5:  The functionality of the ‘inner language’	14

Section 5:  Improving information processing in improving action for increased survivability and reproduction
Introduction:  summary of previous sections	4
Chapter 1:  Evolution and information processing	5
Chapter 2:  Improving mechanical and sensory hardware through evolution	6
Chapter 3:  Improving information processing hardware architectures and functionality through evolution	8
Chapter 4:  The evolution of ‘inner language’ functionality	9

Section 6:  Improving information processing in improving action for increased survivability and reproduction: prediction and basic learning
Introduction:  summary of previous sections	4
Chapter 1:  remembering and predicting action sequences	5
Chapter 2:  basic ‘solo’ learning	8
Chapter 3:  trial and error learning, exploration, and experimentation	11
Chapter 4:  play	12

Section 7:  Improving information processing in improving action for increased survivability and reproduction: social learning and dual channel evolution
Introduction:  summary of previous sections	4
Chapter 1:  social learning and apprenticeship learning	5
Chapter 2:  social learning, apprenticeship learning, and the inner language	5
Chapter 3:  the significance of parenting and apprentice training methods for evolution	7
Chapter 4:  dual channel evolution	8



Expanded TOC

Section 1:  Asking the right question about the basis for language comprehension and learning
Introduction	5
Chapter 1:  Discovering the right question to investigate	6
Topic 1:  complexity versus chaos: evolution	6
Topic 2:  evolution and learning	6
Topic 3:  Learning and forgetting is like evolution and the second law of thermodynamics	7
Topic 4:  structures -- complexity and information content	7
Topic 5:  information content for innate functions and instincts	7
Topic 6:  complexity and information content	8
Topic 7:  investigating where theories come from	8
Topic 8:  measuring the information content of theories	9
Topic 9:  exploring computer-simulated language comprehension	9
Topic 10:  separating the thesis contribution from programming implementation	10
Topic 11:  verification, falsification, and the Turing test	11
Topic 12:  wrong question:  search for a universal theory of language comprehension	12
Chapter 2:  Experimentation based on social-engineering	12
Topic 1:  social-engineering with language and learning – letting students play with the language and logic in my model as a learning tool	12
Topic 2:  learning from instructions, copying, and experimentation	13
Topic 3:  knowledge engineering, expert systems, computer-aided work	15
Topic 4:  knowledge, language, and tasks – metaphors for successful applications	15
Topic 5:  knowledge engineering vs. task re-engineering	16
Topic 6:  Language learning and task learning	16
Chapter 3:  Thought and action: the mental and the physical	16
Topic 1:  language comprehension as a mental activity	16
Topic 2:  reactive and predictive learning	17
Chapter 4:  Feelings and action	17
Topic 1:  feelings as motivator and selector of actions	17
Chapter 5:  Body and mind, the missing link	17
Topic 1:  my dream about finding the ‘missing link’	17
Topic 2:  the ‘missing link’ – connecting mental controls to observable physical action	18
Topic 3:  the ‘missing link’ – connecting observable physical action and objects to mental descriptions	18
Topic 4:  the mind - growing up in a submarine	18
Chapter 6:  The research paradigm – experimentation & validation	19
Topic 1:  computational equivalence	19
Topic 2:  minimalist feasibility	20
Topic 3:  empirical validation -- comparing simulated inner-language-based action with observable action	21
Chapter 7:  The research paradigm – modeling information content, flow, and processing	21
Topic 1:  complexity and information content	21
Topic 2:  layering and information content	22
Topic 3:  layering, compression, and information storage capacity	22
Topic 4:  layering and information flow	22
Topic 5:  layering and information processing	23
Topic 6:  learning and the evolution of layering	23
Chapter 8:  Notes & comments – status & future plans	24
Topic 1:  present work and future plans	24
Topic 2:  notes	24

Section 2:  A simplified model of the mechanical and optical hardware common to most vertebrates: the interface to the world and ‘shared reality’ via action and vision
Introduction:  summary of previous sections	4
Chapter 1:  A simple mechanical model for vertebrates	5
Topic 1:  model-variant for humans illustrating common mechanical components	5
Topic 2:  A stick-figure representation of the model for humans with joints and rigid bone structures	6
Topic 3:  coordinated locomotion for humans with the mechanical components of the model	8
Topic 4:  a simple mechanical model of joints, powered by muscles that are controlled by neurons	10
Topic 5:  the eyeball as a specialized mechanical joint	11
Topic 6:  the hardware and mechanics of hearing	12
Chapter 2:  Optics for vertebrates:  converting images into information	13
Topic 1:  the hardware of the eye	13
Topic 2:  the eye as a video camera:  raster scan image acquisition	13
Topic 3:  converting a fast sequence of raster scan images to a relatively steady or slow moving 2D and 3D vector representation of recognized objects	14
Topic 4:  2D and 3D scalable vector images	15
Chapter 3:  Hearing machinery:  converting sound into information	15
Topic 1:  2 stage analog to digital conversion	15
Topic 2:  The geometry of sound:  extracting meaning	16
Chapter 4:  Hardware for perceiving touch, smell, taste, and other senses – including proprioception	17
Topic 1:  touch and force feedback – and conversion into information	17
Topic 2:  balance and a sense of up and down – and conversion into information	17
Topic 3:  smell and taste – and conversion into information	17

Section 3:  A simplified ‘information processing hardware’ model for vertebrates:  to control action and to integrate vision
 Introduction:  summary of previous sections	4
Chapter 1:  Hardware for information processing -- hard-wired brains and the analogy with the evolution of computers	5
Topic 1:  hard-wired brains and learning	5
Topic 2:  computers as analogous to human thinking	5
Topic 3:  brains as analogous to computers	5
Topic 4:  actions and learning in a von Neumann brain	7
Chapter 2:  Brain-based information processing	7
Topic 1:  action, perception, and information processing	7
Topic 2:  evolution and information processing	8
Chapter 3:  The brain as a process control system	8
Topic 1:  controlling action with a process control system	8
Topic 2:  local control of action with programmable logic controllers	9
Topic 3:  coordinating low-level control of joint rotations	11
Topic 4:  high-level control of coordinated action	11
Chapter 4:  Integrating vision with the brain-based process control system	12
Topic 1:  managing the direction and focus of vision as actions controlled with a process control system	12
Topic 2:  converting the video signal from the eye	12

Section 4:  A simplified software and data model for vertebrates: an inner language to control action and to integrate vision
 Introduction:  summary of previous sections	4
Chapter 1:  Using an ‘inner language’ for the  instructions to control action	5
Topic 1:  the representation of instructions for the control processors	5
Topic 2:  Ballet choreography as model for instructions	5
Topic 3:  using an ‘inner’ choreography as programming language to control physical action from inside the body	6
Chapter 2:  Adding vision to language-based action	7
Topic 1:  integrating perception to improve the action	7
Topic 2:  information processing for visual perception	7
Chapter 3:  Integrating the output of vision into the instructions for action sequences	7
Topic 1:  the relationship between perception and action	7
Topic 2:  using vision to control mimicking action	8
Topic 3:  translating the information from vision to control mimicking action	10
Topic 4:  making the output of vision usable for inclusion into choreographic instructions	11
Topic 5: the interface of visual perception and action	11
Topic 6:  investigating how the output of visual perception might help to control action	12
Topic 7:  the range of visually-controlled mimicry across vertebrates	12
Chapter 4:  Geometry and time in action sequences	12
Topic 1:  “All the world’s a stage” -- extending choreographic instructions to detailed specification of movement	13
Topic 2:  working with geometry: scaling, rotating, and translating vector images to allow comparisons and recognition	14
Topic 3:  the management of time for choreography and for detailed specification of movement	14
Chapter 5:  The functionality of the ‘inner language’	14
Topic 1:  if … then … conditions in instructions for integrating vision	14
Topic 2:  the ‘inner’ language as a programming language	15
Topic 3:  the functionality of the ‘inner’ programming language	15
Topic 4:  nesting, the embedding of clauses within clauses	15
Topic 5:  reuse of program code – function calls and subroutines	15
Topic 6:  use of geometric information: directions	16
Topic 7:  use of geometric information: shapes	16

Section 5:  Improving information processing in improving action for increased survivability and reproduction
 Introduction:  summary of previous sections	4
Chapter 1:  Evolution and information processing	5
Topic 1:  a definition of evolution:  From Wikipedia, the free encyclopedia	5
Topic 2:  evolution-related benefits from improved information processing capabilities	5
Topic 3:  traits and capacities not considered:  only information processing capabilities are included in this investigation	6
Chapter 2:  Improving mechanical and sensory hardware through evolution	6
Topic 1:  bone capacity and capability	6
Topic 2:  joint capacity and capability	6
Topic 3:  muscle capacity and capability	7
Topic 4:  sensor capacity and capability	7
Topic 5:  vision capacity and capability	7
Topic 6:  hearing capacity and capability	7
Chapter 3:  Improving information processing hardware architectures and functionality through evolution	8
Topic 1:  information processing architectures and trade-offs	8
Topic 2:  processing capacity and capability	8
Topic 3:  memory and other data storage capacity and capability	8
Topic 4:  information transmission capacity and capability	9
Chapter 4:  The evolution of ‘inner language’ functionality	9
Topic 1:  instructions for more and more complex and coordinated actions	9
Topic 2:  more variety and clarity in references to visual information	10
Topic 3:  more complex and more diverse conditionality	10
Topic 4:  more complex and more indirect references (e.g. indexical)	10
Topic 5:  plans and memories: descriptions of future and past action	10
Topic 6:  hypothetical and counterfactual descriptions	10
Topic 7:  imaginative and playful actions that do not correspond with present reality but appear to be make believe	10

Section 6:  Improving information processing in improving action for increased survivability and reproduction: prediction and basic learning
Introduction:  summary of previous sections	4
Chapter 1:  remembering and predicting action sequences	5
Topic 1: action sequences for plans, memory and prediction	5
Topic 2:  steps for using the fastest action following the shortest path	7
Topic 3:  the role of language in predicting and planning	8
Chapter 2:  basic ‘solo’ learning	8
Topic 1: Wikipedia on learning	8
Topic 2: Wikipedia on Pavlov's experiment	9
Topic 3: learning and action sequences	10
Topic 4: solo learning and social learning	10
Chapter 3:  trial and error learning, exploration, and experimentation	11
Topic 1: trial and error learning:  randomization, measurement & selection, and memorization (with reuse & benefits)	11
Chapter 4:  play	12
Topic 1: Wikipedia – working definitions	12
Topic 2:  play and learning	14

Section 7:  Improving information processing in improving action for increased survivability and reproduction: social learning and dual channel evolution
Introduction:  summary of previous sections	4
Chapter 1:  social learning and apprenticeship learning	5
Topic 1:  learning with others	5
Topic 2:  learning from others	5
Topic 3:  mixed mode learning	5
Chapter 2:  social learning, apprenticeship learning, and the inner language	5
Topic 1:  visual tracking to inner language to mimicking action	5
Topic 2:  memory and delayed execution of action sequences	6
Topic 3:  imitation and other forms of vision-based social learning across vertebrates	7
Chapter 3:  the significance of parenting and apprentice training methods for evolution	7
Topic 1:  parenting methods and survival	7
Topic 2:  local adaptations (evolution) of instructions for social learning	7
Topic 3:  rereleasing animals in the wild, and survival	7
Chapter 4:  dual channel evolution	8
Topic 1:  the mix of genetics and learning in developing good parenting methods	8
Topic 2:  language use as a local adaptation that helps survival by aiding collaborations and other strategies for survival	8