{"id":74,"date":"2024-05-29T05:33:50","date_gmt":"2024-05-29T05:33:50","guid":{"rendered":"https:\/\/blog.adlington.fr\/index.php\/2024\/05\/29\/mapping-the-mind-of-a-large-language-model-anthropic\/"},"modified":"2024-05-29T05:33:50","modified_gmt":"2024-05-29T05:33:50","slug":"mapping-the-mind-of-a-large-language-model-anthropic","status":"publish","type":"post","link":"https:\/\/blog.adlington.fr\/index.php\/2024\/05\/29\/mapping-the-mind-of-a-large-language-model-anthropic\/","title":{"rendered":"Mapping the Mind of a Large Language Model \\ Anthropic"},"content":{"rendered":"<blockquote><p>We were able to measure a kind of &#8220;distance&#8221; between features based on which neurons appeared in their activation patterns. This allowed us to look for features that are &#8220;close&#8221; to each other. Looking near a &#8220;Golden Gate Bridge&#8221; feature, we found features for Alcatraz Island, Ghirardelli Square, the Golden State Warriors, California Governor Gavin Newsom, the 1906 earthquake, and the San Francisco-set Alfred Hitchcock film Vertigo.<br \/>\nThis holds at a higher level of conceptual abstraction: looking near a feature related to the concept of &#8220;inner conflict&#8221;, we find features related to relationship breakups, conflicting allegiances, logical inconsistencies, as well as the phrase &#8220;catch-22&#8221;. This shows that the internal organization of concepts in the AI model corresponds, at least somewhat, to our human notions of similarity.<br \/>\n\u2014 Read on <a href=\"https:\/\/www.anthropic.com\/research\/mapping-mind-language-model\">www.anthropic.com\/research\/mapping-mind-language-model<\/a><\/p>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>We were able to measure a kind of &#8220;distance&#8221; between features based on which neurons appeared in their activation patterns. This allowed us to look for features that are &#8220;close&#8221; to each other. Looking near a &#8220;Golden Gate Bridge&#8221; feature, we found features for Alcatraz Island, Ghirardelli Square, the Golden State Warriors, California Governor Gavin [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-74","post","type-post","status-publish","format-standard","hentry","category-blog"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/posts\/74","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/comments?post=74"}],"version-history":[{"count":0,"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/posts\/74\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/media?parent=74"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/categories?post=74"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.adlington.fr\/index.php\/wp-json\/wp\/v2\/tags?post=74"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}