Westermann, G. and Miranda, E. R. Integrating Perception and Production in a Neural Network Model. Proceedings of the 7th Neural Computationa and Psychology Workshop, 2002 UK World Scientific.

Sony CSL authors: Eduardo Miranda, Gert Westermann


We present a neural network model that integrates between motor commands and their associated perceived sounds in speech production. The model is based on simple, neurobiologically plausible mechanisms. In modelling the development of vowels in an infantś babbling phase, perceptual and action prototypes develop concurrently. When the model is exposed to "external" vowels, the perceptual prototypes develop to coincide with external sounds, leading to language-specific categorical perception. The model develops motor mirror neurons that are activated when their associated sounds are perceived, and it learns to imitate vowels based on its own production of these vowels. We suggest an extension of the model to account for visual mirror neurons.

Keywords: speech, speech synthesis, origins of language, robot, artificial intelligence, neural networks, learning

BibTeX entry

@INPROCEEDINGS { miranda:02b, AUTHOR="Westermann, G. and Miranda, E. R.", BOOKTITLE="Proceedings of the 7th Neural Computationa and Psychology Workshop", ORGANIZATION="UK", PUBLISHER="World Scientific", TITLE="Integrating Perception and Production in a Neural Network Model", YEAR="2002", }