Note: This paper was originally written for L700 - "Language Acquisition" - a class taught by Laurent Dekydtspotter and Stephen Franks at Indiana University, Winter Semester, 2000. It is partly an elaboration of another paper Schemata: Bootstrapping Language Acquisition that is also available. The entire text is available here in PDF format. Below is the introduction and the bibliography. The paper itself is not completely proof-read but has been supplied regardless for time considerations.
This paper was also presented as "Ling Lunch" on Dec. 4, 2000 - the talk handout and overheads are also available.
A similar presentation by the same name was presented at BOOT-LA (A conference on Language Acquisition) on April 23rd, 2003. The power point from the presentation is available here. A recording of the talk (38 min) is available here.
If you prefer another format or have any questions or comments, feel free to E-mail me.

Schema Theorem in Language Acquisition: A Rags to Riches Story

by Sean McLennan

December 13, 2000




1. Introduction

Learning a language is a Herculean task; one that children perform with relative easy. Exposed only to a language environment – one ripe with errors, incomplete utterances, and no "goodness" information – a child can quickly and expertly acquire a communication system that is symbolic, combinatorial, productive, and expressive. With appropriate awe, linguists have posited that such a feat could not be performed without a boot-strapping mechanism of some sort; since Chomsky (1965) we have assumed that the language stimuli to which a child is exposed is impoverished and that to compensate for poor or indeterminate quality and inadequate quantity of input, humans come with a stock set of discrete, symbolic features and parameters commonly known Universal Grammar.

Considering the state of academic thought in Linguistics, Psychology, Computer Science – all the areas that have contributed to the modern study of Cognitive Science – this claim was both warranted and understandable. However, while other disciplines have increasingly shunned logical, symbolic, and a temporal models of intelligence and behavior due to overwhelming evidence to the contrary, modern theoretical linguistics has remained committed to the same framework.

This, I believe, is due to three reasons: 1) Linguists remain convinced that language can be 100% dissociated from other cognitive abilities; 2) Linguists remain convinced that language can be "lifted out" of the physical bodies within which it is instantiated; and 3) in general other disciplines are linguistically naive and have little respect for what linguists do. Given these facts, it is unsurprising that Linguistics as a field would be swayed by research performed in other areas. I believe that the "Poverty of Stimulus" argument in particular has held up over time because no one has provided linguists with a differing view of what constitutes the "input" (i.e. the language data), nor what constitutes the resulting phenomena (i.e. language, itself). If neither of these well-defined entities are challenged, there is no reason to challenge the underlying intuitions that gave rise to "Poverty of Stimulus".

The purpose then of this paper is to present a differing view of one of those well-defined entities – the input. I maintain that what constitutes linguistic input differs dramatically from what we have previously thought and provide a new conception that is more parsimonious with current research in other cognitive disciplines. I argue that we can better understand this new notion of input and how it can give rise to a system as complicated as language through an abstracted form of Schema Theorem which has been used as a domain specific explanation of how Genetic Algorithms perform efficiently. Finally, I present a first step in trying to experimentally support to this new conception of input via a computational model of the acquisition of grammar.


References:

Batali, J. (1998). Computational simulations of the emergence of grammar. in J. Hurford, M Studdert-Kennedy, and C. Knight (eds.) Approaches to the Evolution of Language: Social and Cognitive Bases. 405-426. Cambridge University Press: Cambridge, GB.

Brooks, R. (1991). Intelligence without representation. Artificial Intelligence. 47, 139–159.

Chalmers, David. (1990). Syntactic Transformations on Distributed Representations. Connection Science, Vol. 2, Nos 1 & 2, 53-62.

Chomsky, N. (1959). A review of B.F. Skinner's Verbal Behaviour. Language. 35 (1), 26-58.

Chomsky, N. (1965). Aspects of the theory of syntax. Cambridge, MA: MIT Press.

Clark, A. (1998). Being There: Putting Brain, Body, and World Together Again. MIT Press: Cambridge, MA.

Colunga-Leal, E. and M. Gasser. (ms). A model of the acquisition of spatial-relation concepts and words.

Cook, V.J. and M. Newson (1996). Chomsky's Universal Grammar. Blackwell: Cambridge, MA.

Damasio, A. and H. Damasio. (1994). Cortical systems for retrieval of concrete knowledge: The convergence zone framework. In: Koch, C. and L. Davis (Eds.). Large-Scale Neuronal Theories of the Brain. Cambridge, MA: MIT Press.

Elman, Jeffery. (1995). Language as a dynamical system. In: Port et al.

Elman, J, E. Bates, M. Johnson, A. Karmiloff-Smith, D. Parisi, and K. Plunkett. (1998). Rethinking Innateness. MIT Press: Cambridge, MA.

Hebb, Donald. (1949). The Organization of Behavior. New York, NY: Wiley.

Hock, H. and B. Joseph. (1996). Language History, Language Change, and Language Relationship. Mouton de Gruyter: New York, NY.

Hofstadter, D. (forthcoming). Analogy as the core of cognition. In K.J. Holyoak, D. Gentner, and B. Kokinov (eds.) The Analogical Mind: Perspectives from Cognitive Science. MIT Press: Cambridge, MA.

Holland, John. (1975). Adaption in Natural and Artificial Systems. Ann Arbor, MI: University of Michigan Press.

Holland, J. (1998). Emergence. Addison-Wesley: Reading, MA.

Johnson, J. and E. L. Newport. (1989). Critical period effects in second language learning: The influence of mturational state on the acquisition of English as a second language. Cognitive Psychology, 21, 60-99.

Kelso, J.A.S. (1998). Dynamic Patterns. MIT Press: Cambridge, MA.

Kirby, S., and J. Hurford. (1997). Learning, culture, and evolution in the origin of linguistic constraints. in P. Husbands and H. Harvey (eds.) Fourth European Conference in Artificial Life. 493-502. MIT Press: Cambridge, MA.

Mitchell, Melanie. (1996). An Introduction to Genetic Algorithms. Cambridge, MA: MIT Press.

Newport, E. L. (1990). Maturational constraints on language learning. Cognitive Science, 14, 11-29.

O'Grady, W. (1997). Syntactic Development. University of Chicago Press: Chicago, IL.

Port, R. and J. Dalby. (1982). Consonant/vowel ratio as a cue for voicing in English. Perception and Psychophysics. 32 (2), 141-152.

Port, R. and T. van Gelder. (1995). Mind as Motion: Explorations in the Dynamics of Cognition. Cambridge, MA: MIT Press.

Redington, M. and N. Chater. (1998). Connectionist and Statistical Approaches to Language Acquisition: A Distributional Perspective. Language and Cognitive Processes. 13 (2/3), 129-191.

Redington, M., N. Chater, and S. Finch. (1998). Distributional information: a powerful cue for acquiring syntactic categories. Cognitive Science. 22(4), 425-469.

Rovee-Collier, C. (1991). The "memory system" of prelinguistic infants. Annals of the New York Academy of Sciences, 608, 517-536.

Rumelhart, David. (1997). The architecture of mind: A connectionist approach. In: Haugeland, John (Ed.) Mind Design II. Cambridge, MA: MIT Press.

Rumelhart, David and D. Zipser. (1985). Feature discovery by competitive learning. In: Rumelhart, D. and J. McClelland (Eds.). Parallel Distributed Processes: Explorations in the Microstructure of Cognition, Vol 1. Cambridge, MA: MIT Press.

Sharma, J., A. Angelucci, and M. Sur. (2000). Induction of visual orientation modules in auditory cortex. Nature. 404 - 6780, 841 - 847.

Skinner, B. F. (1957). Verbal Behavior. Appleton-Century-Crofts: New York, NY.

Thelen, Ester. (1995). Time-scale dynamics and the development of an embodied cognition. In: Port et al.

Thelen, E., and L. Smith (1994). A Dynamic Systems Approach to the Development of Cognition and Action. MIT Press: Cambridge, MA.

Vogt, P. (2000). Lexicon Grounding on Mobile Robots. Unpublished PhD Thesis, Vrije Universiteit Brussel.