We have identified how millions of concepts are represented inside Claude Sonnet, one of our deployed large language models. This is the first ever detailed look inside a modern, production-grade large language model.

I often see a lot of people with outdated understanding of modern LLMs.

This is probably the best interpretability research to date, by the leading interpretability research team.

It’s worth a read if you want a peek behind the curtain on modern models.

  • Womble@lemmy.worldEnglish
    271·
    6 months ago

    This is a really good science communication article, it describes their work in clear terms (finding structures that relate to abstract concepts, seeing when they are activated and how strengthening and weaking them modifies outputs) and goes into the implications for it. I’m probably going to save this link as a rebuttal for the people who claim LLMs just predict the next word and have no concepts embedded in them.

    • A_A@lemmy.worldEnglish
      34·
      6 months ago

      Yes, good topic, good research…
      ( you have a few typos : intobthe … into the, predicr … predict, im … i am. )