Whatmough Lecture XVIII - Paul Smolensky (Johns Hopkins)

Title: Do the syntactic abilities of generative AI systems falsify fundamental principles of generative linguistics?

Paul Smolensky, Johns Hopkins Cognitive Science Department, Microsoft Research Deep Learning Group

Do the impressive abilities of neural networks in form of Large Language Models to generate rich, wellformed syntax falsify fundamental principles of generative linguistic theory? In short, the answer I will argue for is: no. But it will be a rather nuanced “no”, trying to identify the proper treatment of generative AI for generative linguistics.

Specifically, I will consider these principles:

1. Computability: Generating natural language with rich, human-level syntax requires use of symbolic grammatical rule systems.

2. Explanation: Theoretical explanation in generative linguistics requires built-in discrete symbolic structure.

3. Acquisition: Children’s ability to acquire language requires innate knowledge of grammatical rule systems.

4. Universals: Linguistic universals can only be explained from innate limitations on what languages are learnable.

The quantity of discussion of these questions will decrease sharply from points 1–4, the bulk of the presentation focused on point 1.  The discussion of point 1 takes off from joint work with Roland Fernandez, Herbert Zhou, Mattia Opper, and Jianfeng Gao (arXiv:2410.17498).

______

Paul Smolensky is the Krieger-Eisenhower Professor of Cognitive Science at Johns Hopkins University and a Senior Principal Researcher in the Deep Learning Group at Microsoft Research Redmond. His work focuses on the integration of symbolic and neural network computation for modeling reasoning and, especially, grammar in the human mind/brain. This work created: Harmony Networks (a.k.a. Restricted Boltzmann Machines); Tensor Product Representations; Optimality Theory and Harmonic Grammar (grammar frameworks grounded in neural computation, developed jointly with A. Prince and G. Legendre); and Gradient Symbolic Computation. The work up through the early 2000’s is presented in the 2-volume MIT Press book with G Legendre, The Harmonic Mind. He received the 2005 David E. Rumelhart Prize for Outstanding Contributions to the Formal Analysis of Human Cognition.

ASL interpretation will be provided upon request.

Reception to follow immediately afterwards at the Harvard Faculty Club.