How natural systems fundamental laws help explain AI’s unexpected abilities
Note: This article presents key findings from our recent research paper, “A non-ergodic framework for understanding emergent capabilities in Large Language Models” [link1] [link2]. While the paper offers a comprehensive mathematical framework and detailed experimental evidence, this post aims to make these insights accessible to a broader audience.
However, how many kinds of sentence are there? Say assertion, question and command? There are countless kinds; countless different kinds of use of all the things we call “signs”, “words”, “sentences”. Furthermore, this diversity is not something fixed, given once for all; but new types of language, new language-games, as we may say, come into existence, and others become obsolete and get forgotten. We can get a rough picture of this from the changes in mathematics.
Ludwing Wittgenstein…
