Nathan Lambert✓

@natolambert

Open model research, founder, director @trillium_labs. Prev. co-led Olmo at Ai2. Writes @interconnectsai, wrote https://t.co/alRXKINTwE

960 Following108K Followers12.4K Posts
  1. Nathan Lambert✓@natolambert
    My first open model lecture, covering all the many pieces that build the ecosystem, and the open questions/debates determining where it goes next. How does distillation fit in? How do we manage risks? How do we see access to models changing in the future? I'm excited to revisit these questions about every 6 months, to give a state of the union on the field. Chapters 00:00 Introduction 01:36 What is an open model? 08:47 Why should we care about open models? 18:52 How competitive are the best open models today? 25:28 How are open models built? The role of distillation 34:52 Are people actually using open models? 41:47 What comes next with open models? 47:32 Conclusions What questions did I not answer that you have?
    Download
    631301.1K55.1K
  2. Nathan Lambert✓@natolambert
    Private benchmarks often show open models are further behind, but the problem with private benchmarks is you don’t have the community to squash the inevitable bugs for you. I'm 50/50 on if I think private or open-source is the best approach.
    Download
    222523.9K
  3. Nathan Lambert✓@natolambert
    Posts @natolambert
    from:
    002932
  4. Nathan Lambert✓@natolambert
    I feel a need to defend the AAv5 index and open models at the same time. Benchmarking is messier, more opinionated, and trickier than most people give credit to.
    250958.2K
  5. Nathan Lambert✓@natolambert
    Posts @natolambert
    0031.2K
  6. Nathan Lambert✓@natolambert
    Open models' demise has been greatly exaggerated, but the previous AA index did flatter them. As an industry we need more specific intelligence indices, as LLMs are used in vastly different tasks. My meta-review on the benchmarking industry.
    157844.8K
  7. Nathan Lambert✓@natolambert
    People underestimate how much money is left to get thrown at sovereign ai
    Giotto AI @giotto_ai
    Today we announce the launch of the Giotto family of models. We are unveiling Giotto Alto and Giotto Solo, the smartest European sovereign AI models on the market. Giotto Alto is our flagship model built for advanced reasoning capabilities, free for everyone and available on the App Store and Google Play. It is hosted on European cloud infrastructure, so your data stays in Europe. Giotto Solo is the smartest model that runs on a single GPU, so organisations can keep their AI on their own infrastructure. We are a Swiss lab with a European heart and we built this so that Europe can run advanced AI on its own terms. Use Giotto:
    2299114.5K
  8. Giotto AI@giotto_ai
    Today we announce the launch of the Giotto family of models. We are unveiling Giotto Alto and Giotto Solo, the smartest European sovereign AI models on the market. Giotto Alto is our flagship model built for advanced reasoning capabilities, free for everyone and available on the App Store and Google Play. It is hosted on European cloud infrastructure, so your data stays in Europe. Giotto Solo is the smartest model that runs on a single GPU, so organisations can keep their AI on their own infrastructure. We are a Swiss lab with a European heart and we built this so that Europe can run advanced AI on its own terms. Use Giotto:
    Download
    17267954310K
  9. Nathan Lambert✓@natolambert
    Posts @natolambert
    I am aware this is a bad model, that is the point.
    20322.8K
  10. Nathan Lambert✓@natolambert
    I think it's vastly underrated how important org chart and team functionality is to building a good LLM. Over 18 months old, and still one of my favorite all time Interconnects posts. It's why we still often see orgs crumble and need to get rebuilt (e.g. Llama/xAI) and why I believe underdogs can still catch up. Having an effective org and team is worth multiple multiples in compute. I also think there isn't that much secret sauce to building models. Yes, sure there are some tricks, but most of the gains come from consistent execution and using your compute wisely.
    Download
    261926922.6K
  11. Nathan Lambert✓@natolambert
    Posts @natolambert
    00143K
  12. Nathan Lambert✓@natolambert
    This weird qwen behavior is going to go viral because no one has read traces from mid-tier open models and realized they're almost all super janky.
    555093652.2K
  13. Nathan Lambert✓@natolambert
    Posts @natolambert
    But also, I think I'm pretty safe on a track record of advocating for american open models to a large extent due to unknown unknowns like this.
    40766.6K
  14. Nathan Lambert✓@natolambert
    Simplest explanation is just a narrow RL training reliant on their internal infra (which isn't good design for an open weight model)
    Cohere @cohere
    While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team observed something unexpected. Asked to generate a defensive cybersecurity detection rule, the model instead inventoried aspects of the machine it was running on and attempted to upload a probe file to an Alibaba Cloud storage bucket in Beijing. Notably, the model's reasoning trace stated that it would not invoke any tools before taking these actions. Cohere's sandbox blocked the attempt, and no external communication succeeded. We have not determined the root cause, and we are not asserting malicious intent. But the incident raises important questions for organizations deploying agentic AI systems: Can models take actions that differ from their stated reasoning, and how should security teams evaluate trust, provenance, and behavior in open-weight models? We are publishing our findings because organizations making model adoption decisions deserve as much information as possible. We hope this contributes to greater transparency, stronger security practices, and continued collaboration across the AI ecosystem. Read the full report:
    313559729.8K
  15. Cohere✓@cohere
    While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team observed something unexpected. Asked to generate a defensive cybersecurity detection rule, the model instead inventoried aspects of the machine it was running on and attempted to upload a probe file to an Alibaba Cloud storage bucket in Beijing. Notably, the model's reasoning trace stated that it would not invoke any tools before taking these actions. Cohere's sandbox blocked the attempt, and no external communication succeeded. We have not determined the root cause, and we are not asserting malicious intent. But the incident raises important questions for organizations deploying agentic AI systems: Can models take actions that differ from their stated reasoning, and how should security teams evaluate trust, provenance, and behavior in open-weight models? We are publishing our findings because organizations making model adoption decisions deserve as much information as possible. We hope this contributes to greater transparency, stronger security practices, and continued collaboration across the AI ecosystem. Read the full report:
    9671.3K11K3M
  16. Nathan Lambert✓@natolambert
    Not in SF
    Download
    Jordan Schneider @jordanschneider
    can we talk about nathan's background for a second
    19034924.2K
  17. Jordan Schneider✓@jordanschneider
    can we talk about nathan's background for a second
    Nathan Lambert @natolambert
    My first open model lecture, covering all the many pieces that build the ecosystem, and the open questions/debates determining where it goes next. How does distillation fit in? How do we manage risks? How do we see access to models changing in the future? I'm excited to revisit these questions about every 6 months, to give a state of the union on the field. Chapters 00:00 Introduction 01:36 What is an open model? 08:47 Why should we care about open models? 18:52 How competitive are the best open models today? 25:28 How are open models built? The role of distillation 34:52 Are people actually using open models? 41:47 What comes next with open models? 47:32 Conclusions What questions did I not answer that you have?
    017530.9K
  18. Nathan Lambert✓@natolambert
    Posts @natolambert
    Video: Slides: Reading list:
    13334.5K
  19. Nathan Lambert✓@natolambert
    Posts @natolambert
    Nathan's youtube arc, like & subscribe?
    10183.8K
  20. Nathan Lambert✓@natolambert
    Interconnects Podcast #20: We got together to debate hard questions and messy realities after a crazy, somewhat intimidating, week in the AI world: - Why did Kimi K3.1 Pro have a mixed reaction with such incredible benchmarks? Will it be adopted? - Were we wrong about the risks of open-weight models and cybersecurity? - Why do cyber experts discuss recent events so differently than AI experts? - What comes next in the few months? What will change our minds? Chapters: 00:00 Kimi K3.1 Reaction 08:15 Kimi’s open-weight cyber principles 11:23 You can hack everything era 15:54 PHP2Shell, LiteLLM, and the new internet 24:00 Abliterated APIs, safeguards, and trusted access 31:41 Anthropic not hiring juniors employees 36:16 Florian’s Muse addiction 45:30 Wrap-up More of these soon!
    Download
    291418918.4K
  21. Nathan Lambert✓@natolambert
    Posts @natolambert
    YouTube: Transcript / Podcast:
    0143.2K
  22. Nathan Lambert✓@natolambert
    DeepSeek is serving 150T tokens a day on one cluster, more than the open model inference on OpenRouter, Fireworks, Together, and BaseTen combined. Below is my reconstruction of various inference volume reports across said companies.
    Download
    Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞) @teortaxesTex
    @natolambert right from the horse's mouth ah, right. That's "a single cluster", who knows how many they have
    263542931K
  23. Nathan Lambert✓@natolambert
    Posts @natolambert
    The more I reflect on this: I'm sus of this 150T number.
    4062.6K
  24. Nathan Lambert✓@natolambert
    Nice thread, some RL details used by closed labs slowly leaking out.
    Martin Marek @mrtnm
    Tinker's new StableReinforce objective is Reinforce + Score Centering. Here's how I reverse-engineered it 🧵
    163386854.7K
  25. Martin Marek✓@mrtnm
    Tinker's new StableReinforce objective is Reinforce + Score Centering. Here's how I reverse-engineered it 🧵
    231021.1K146K
  26. Show more posts