[PDF] von lingbuzz.net
Modern language models refute Chomsky’s approach to language
Autoren Steven Piantadosi
Publikationsdatum 2023
Zeitschrift Lingbuzz Preprint, lingbuzz
Band 7180
Beschreibung
The rise and success of large language models undermines virtually every
strong claim for the innateness of language that has been proposed
by generative linguistics. Modern machine learning has subverted and
bypassed the entire theoretical framework of Chomsky’s approach,
including its core claims to particular insights, principles, structures, and processes.
I describe the sense in which modern language models implement genuine theories of language,
including representations of syntactic and semantic structure.
I highlight the relationship between contemporary models and
prior approaches in linguistics, namely those based on gradient computations and
memorized constructions. I also respond to several critiques of large language models,
including claims that they can’t answer “why” questions,
and skepticism that they are informative about real life acquisition.
Most notably, large language models have attained remarkable success
at discovering grammar without using any of the methods that some
in linguistics insisted were necessary for a science of language to progress.

Zitate insgesamt
Zitiert von: 139

Artikel
Modern language models refute Chomsky’s approach to language
S Piantadosi - Lingbuzz Preprint, lingbuzz, 2023
Zitiert von: 139 Ahnliche Artikel Alle 3 Versionen