Required readings are preceded by a solid bullet (●); readings on-line are shown by clickable links.

Recommended or supplemental readings (and other resources) are indicated with a hollow circle (○).

If you have problems viewing the paper in your browser, try saving the target (right-click w/mouse) to your hard disk, and then open the saved file.

The chapters for the tlearn exercises can be found on this page (http://crl.ucsd.edu/cogs202/tlearn.html); this page also has a copy of the User's Manual and Tlearn Under Unix.

Check the course discussion board periodically for updates or corrections.

Week 1 3/29/2004	Topic: Background & foundations
	Turing, A.M. (1950). Computing Machinery and Intelligence. In A. Collins and E. E. Smith (Eds), Readings in Cognitive Science: A Perspective from Psychology and Artificial Intelligence, (1988). . Kaufmann, San Mateo, CA, pp. 6-19. [This is the famous paper from which the so-called 'Turing Test' was based] Email me for the PDF of this paper. Von Neumann, J. (1948/1963). The general and logical theory of automata. In A.H. Taub, Ed., John von Neumann, Collected Works, Vol. 5. Oxford: Pergamon Press. Miller, G.A. (1956). The Magical Number Seven, Plus or Minus Two: Some Limits on our Capacity for Processing Information. Psychological Review, 63, 81-97. McCulloch, W.S., Pitts, W. (1943). A logical calculus for ideas immanent in nervous activity. Bull. Math. Biophys., 5, 115-133. Miller, G.A., Galanter, E., & Pribram, K.H. (1960) Plans and the structure of behavior. Holt, Rinehart, and Winston. Ch. 1, 2, 3. Chomsky, N. (1959). A review of B. F. Skinner's Verbal Behavior. Language, 35, 26-58. Walter Pitts biography McCulloch & Pitts applet Alan Turing Home Page The Church-Turing Thesis and effective computation The Turing Test Page biography of John von Neumann Short history of AI RealPlayer recording of Skinner discussing Chomsky's review of Verbal Behavior Quicktime movie of Skinner discussing his theory Newell, A., & Simon, H.A. (1972). Human Problem Solving. Englewood Cliffs, NJ: Prentice Hall. Ch 14. Schank, R.C., & Abelson, R.P. (1977). Scripts, plans, goals and understanding. Hillsdale, NJ: Erlbaum. Ch. 1-3 (pp. 1-68). ELIZA links: http://www.manifestation.com/neurotoys/eliza.php3 http://www.lpa.co.uk/pws_exec/pws/proweb.exe?eg=Eliza http://www-ai.ijs.si/eliza/eliza.html A few transcripts of ELIZA sessions: http://www.word.com/newstaff/tclark/three/ An excellent site devoted to ELIZA and other "chatterbots" is: http://www.toptown.com/hp/sjlaven/index.htm
Week 2 4/5/2004	Topic: The appeal of PDP
	McClelland, J.L. & Rumelhart, D.E. (1991). An interactive activation model of context effects in letter perception: Part 1. Psychological Review, 5, 375-407. McClelland, J.L., Rumelhart, D.E., & Hinton, G. (1986) The appeal of parallel distributed processing. In D.E. Rumelhart and J.L. McClelland (Eds.) Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1. Cambridge, MA: MIT Press. McClelland, J.L., & Elman, J.L. (1986). Interactive processes in speech perception: The TRACE model. In D.E. Rumelhart and J.L. McClelland (Eds.) Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 2. Cambridge, MA: MIT Press.
	Students should email me to let me know which of the 3 course requirement options they have chosen. Simulations: Plunkett & Elman: Exercises in Rethinking Innateness, Preface, Ch. 1, 2. See also User's Manual, and Tlearn under Unix
Week 3 4/12/2004	Topic: (1) An old idea revisited: the Schema; (2) Learning
	Rumelhart, D.E., Smolensky, P., McClelland, J.L., & Hinton, G.E. (1986). Schemata and sequential thought processes in PDP models. In J.L. McClelland and D.E. Rumelhart (Eds.) Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 2. Cambridge, MA: MIT Press. Ch. 14. Rumelhart, D.E., Hinton, G.E., & Williams, R. (1986). Learning internal representations by error propagation. In D.E. Rumelhart and J.L. McClelland (Eds.) Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1. Cambridge, MA: MIT Press. Ch. 9
	Simulations: Plunkett & Elman: Exercises in Rethinking Innateness, Ch. 3
Week 4 4/19/2004	Topic: The form and content of knowledge: Connections or symbols?
	Annotated reading list of past tense, infant learning, and generalization debates (PDF) Rumelhart, D.E., & McClelland, J.L. (1986). On learning the past tenses of English verbs. In J.L. McClelland and D.E. Rumelhart (Eds.) Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 2. Cambridge, MA: MIT Press. Ch. 18. Pinker, S., & Prince, A. (1988). On language and connectionism: Analysis of a parallel distributed processing model of language acquisition. In S. Pinker and J. Mehler (Eds.) Connections and Symbols. Cambridge, MA: MIT Press. Pp. 73-193. Fodor, J., & Pylyshyn, Z.W. (1988). Connectionism and cognitive architecture: A critical analysis. In S. Pinker and J. Mehler (Eds.) Connections and Symbols. Cambridge, MA: MIT Press. Pp. 3-71.
	Simulations: Plunkett & Elman: Exercises in Rethinking Innateness, Ch. 4
Week 5 4/26/2004	No class
Week 6 5/3/2004	Topic: Representing time
	Elman, J.L. (1990). Finding structure in time. Cognitive Science, 14, 179-211. Elman, J. L. (1991). Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning, 7, 195-224. Servan-Schriber, Cleeremans, A., & McClelland, J.L. (1988). Encoding sequential structure in simple recurrent networks
	Simulations: Plunkett & Elman: Exercises in Rethinking Innateness, Ch. 5, 6
Week 7 5/10/2004	Topic: Self-organization; Modularity; Pathology; Plasticity
	Jacobs, R.A., Jordan, M.I., & Barto, A.G. (1991). Task decomposition through competition in a modular connectionist architecture: The what and where vision tasks. Cognitive Science, 15, 219-250 Jacobs, R.A., Jordan, M.I., Nowlan, S.J., & Hinton, G.E. (1999). Adaptive mixtures of local experts. Neural Computation, 3, 79-97. Jacobs, R.A. (1999). Computational studies of the development of functionally specialized neural modules. Trends in Cognitive Science, 3. Plaut, D.C., McClelland, J.L., Seidenberg, M.S., & Patterson, K.E. (1996). Understanding normal and impaired word reading: Computational principles in quasi-regular domains. Psychological Review, 103, 56-115. Marchman, V.A. (1993). Constraints on plasticity in a connectionist model of the English past tense. Journal of Cognitive Neuroscience, 5, 215-234.
	Simulations: Plunkett & Elman: Exercises in Rethinking Innateness, Ch. 8
Week 8 5/17/2004	Topic: Development
	Miller, K.D., Keller, J.B., & Stryker, M.P. (1989). Ocular dominance column development: Analysis and simulation. Science, 245, 605-615. Elman, J.L. (1993). Learning and development in neural networks: The importance of starting small. Cognition, 48, 71-99. Elman, J.L., Bates, E.A., Johnson, M.H., Karmiloff-Smith, A., Parisi, D., & Plunkett, K. (1996). Rethinking Innateness: A Connectionist Perspective on Development. Ch. 1. Cambridge, MA: MIT Press.
Week 9 5/24/2004	Topic: Dynamical computation; Artificial Life
	Rodriguez, P., Wiles, J., & Elman, J.L. (1999). A recurrent neural network that learns to count. Connection Science, 11, 5-40. Elman, J.L. (1995). Language as a dynamical system. In R. Port and T. van Gelder (Eds.), Mind as Motion: Explorations in the Dynamics of Cognition. Cambridge, MA: MIT Press. Pp. 195-223. Nolfi, S., Elman, J.L., & Parisi, D. (1994). Learning and evolution in neural networks. Adaptive Behavior, 3, 5-28. Java applet: cellular automata & the 'game of life' Searle. J.R. (1980). Minds, Brains, and Programs. The Behavioral and Brain Sciences, 3. [the Chinese Room paper] Langton, C.G. (1989). Artificial life. In C.G. Langton (Ed.), Artificial Life. Redwood City, CA: Addison Wesley. Ch. 1. Belew, R.K., & Mitchell, M. (1996). Introduction. In R.K. Belew and M. Mitchell (Eds.) Adaptive Individuals in Evolving Populations: Models and Algorithms. Reading, MA: Addison-Wesley. Ch. 1 Brooks, R. (1991). Intelligence without representation. Artificial Intelligence, 47, 139-159. [pdf display is poor, but prints ok] Batali, J., (1994) Innate Biases and Critical Periods: Combining Evolution and Learning in the Acquisition of Syntax. In R. Brooks and P. Maes (Eds.), Proceedings of the Fourth Artificial Life Workshop The MIT Press. 1994. Pp. 160-171. R. K. Belew. (1990). Evolution, learning and culture: computational metaphors for adaptive search. Complex Systems, 4, 11-49. Hutchins, E., Hazlehurst, B. (1991) Learning in the cultural process. In C. Langton, C. Taylor, J.D. Farmer, & S. Rasmussen (Eds.) Artificial Life II, Addison-Wesley.. Hutchins, E., Hazlehurst, B. (1995) How to invent a lexicon: The development of shared symbols in interaction. In N. Gilbert & R. Conte (Eds.) Artificial Societies: The computer simulation of social life, UCL Press. Artificial life bibliography of on-line publications
	Simulations: Plunkett & Elman: Exercises in Rethinking Innateness, Ch. 9
Week 10 5/31/2004	Topic: Learning and generalization revisited
	Marcus, G.F., Vijayan, S., Bandi Rao, S., & Viston, P.M. (1999). Rule learning by seven-month-old infants. Science, 77-80. Seidenberg, M., & Elman, J.L. (1999). Do infants learn grammar with algebra or statistics? Letter to Science commenting on Marcus et al., 1999. Science, 284, 433. Lewis, J.D., & Elman, J.L. (2001). A connectionist investigation of linguistic arguments from the poverty of the stimulus: Learning the unlearnable. In J.D. Moore and K. Stenning (Eds.) Proceedings of the Twenty-Third Annual Conference of the Cognitive Science Society, Mahwah, NJ: Lawrence Erlbaum Associates. Pp. 552-557. Seidenberg, M., & Elman, J.L. (1999). Networks are not 'hidden rules'. Trends in Cognitive Science, 3, 288-289. Morris W.C., Cottrell, G.W., & Elman, J.L. (2000). A connectionist simulation of the empirical acquisition of grammatical relations. In Stefan Wermter and Run Sun (Eds.) Hybrid Neural Symbolic Integration. Springer Verlag.