{"id":197,"date":"2025-01-03T07:46:46","date_gmt":"2025-01-03T07:46:46","guid":{"rendered":"https:\/\/blog.adlington.fr\/index.php\/2025\/01\/03\/things-we-learned-about-llms-in-2024\/"},"modified":"2025-01-03T07:46:46","modified_gmt":"2025-01-03T07:46:46","slug":"things-we-learned-about-llms-in-2024","status":"publish","type":"post","link":"https:\/\/blog.adlington.fr\/index.php\/2025\/01\/03\/things-we-learned-about-llms-in-2024\/","title":{"rendered":"Things we learned about LLMs in 2024"},"content":{"rendered":"<blockquote><p>Amazing summary including:<\/p>\n<p>The GPT-4 barrier was comprehensively broken<br \/>\nSome of those GPT-4 models run on my laptop<br \/>\nLLM prices crashed, thanks to competition and increased efficiency<br \/>\nMultimodal vision is common, audio and video are starting to emerge<br \/>\nVoice and live camera mode are science fiction come to life<br \/>\nPrompt driven app generation is a commodity already<br \/>\nUniversal access to the best models lasted for just a few short months<br \/>\n\u201cAgents\u201d still haven\u2019t really happened yet<br \/>\nEvals really matter<br \/>\nApple Intelligence is bad, Apple\u2019s MLX library is excellent<br \/>\nThe rise of inference-scaling \u201creasoning\u201d models<br \/>\nWas the best currently available LLM trained in China for less than $6m?<br \/>\nThe environmental impact got better<br \/>\nThe environmental impact got much, much worse<br \/>\nThe year of slop<br \/>\nSynthetic training data works great<br \/>\nLLMs somehow got even harder to use<br \/>\nKnowledge is incredibly unevenly distributed<br \/>\nLLMs need better criticism<br \/>\n\u2014 Read on <a href=\"https:\/\/simonwillison.net\/2024\/Dec\/31\/llms-in-2024\/\">simonwillison.net\/2024\/Dec\/31\/llms-in-2024\/<\/a><\/p>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>Amazing summary including: The GPT-4 barrier was comprehensively broken Some of those GPT-4 models run on my laptop LLM prices crashed, thanks to competition and increased efficiency Multimodal vision is common, audio and video are starting to emerge Voice and live camera mode are science fiction come to life Prompt driven app generation is a [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-197","post","type-post","status-publish","format-standard","hentry","category-blog"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/posts\/197","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/comments?post=197"}],"version-history":[{"count":0,"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/posts\/197\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/media?parent=197"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/categories?post=197"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/tags?post=197"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}