Reasoning isn’t innate to organic networks either. It’s a byproduct of pattern matching generalizing to wider stimuli and recognizing the differences. Convolutional networks don’t memorize every breed of cat, they recognize the patterns (features) that define them. Reasoning is an extension of this. I can’t push a string and I can’t unscramble an egg are also patterns, the pattern of unreciprocal or irreversible relationships. Extending these to new situations is applied reasoning. Same idea as transformer models creating new poems in styles not common before, generalize patterns to new situations. Question is how do we train to accommodate generalization without detracting from accuracy and how do we replicate neuroplasticity in a digital network.
Reasoning isn’t innate to organic networks either. It’s a byproduct of pattern matching generalizing to wider stimuli and recognizing the differences. Convolutional networks don’t memorize every breed of cat, they recognize the patterns (features) that define them. Reasoning is an extension of this. I can’t push a string and I can’t unscramble an egg are also patterns, the pattern of unreciprocal or irreversible relationships. Extending these to new situations is applied reasoning. Same idea as transformer models creating new poems in styles not common before, generalize patterns to new situations. Question is how do we train to accommodate generalization without detracting from accuracy and how do we replicate neuroplasticity in a digital network.