Kyle Mahowald conducted experiments using small language models trained on human-scale corpora, systematically manipulating the input corpus and pretraining models from scratch to study the A+Adjective+Numeral+Noun construction (e.g., 'a beautiful five days in Montreal').

Authors

• Person: Not available Organization: Skywritings Press
  Understanding LLM Understanding

Sources

• Understanding LLM Understanding skywritingspress.ca Skywritings Press via serper

Referenced by nodes (1)

• small language models concept