@logangraham
Head of the Frontier Red Team @anthropicai. 🌎 Make things radically good.
Elizabeth Dwoskin @lizzadwoskinEXCLUSIVE: In less than 12 hours, a group of ex-DOGE cyber researchers were able to penetrate Anthropic’s systems using AI agents — including Slack channels where the most sensitive models are discussed. This is just weeks after Anthropic whistleblower Joseph Coxon charged the company w/launching “a hubristic gamble” from a “private company’s Slack.” Read our story here (gift link):
Anthropic @AnthropicAINew on our Frontier Red Team blog: using Claude to formally verify software at large scale. Formal verification can prove that code is free of certain bugs, but historically it has only been feasible for small codebases (or required a lot of expert time). With AI models, however, this is beginning to change. In collaboration with @theoremlabs, we used Claude to prove security properties in over one hundred real-world open-source libraries over the span of a few weeks. Read our research in full here:
chrisrohlf @chrisrohlfReducing the attack surface of deployed services and apps is a fundamental component of software that is secure by design. Earlier this year we tasked Claude with autonomously mapping and reducing the attack surface of 25 large and widely used OSS codebases. This blog post covers some of our methodology and a preview of the data we collected. This research resulted in a significant reduction in OpenSSH pre-authentication attack surface (now fixed in 10.6). And over 500 findings where reachability could be reduced and configurations hardened to ensure security controls weren’t silently disabled.
Punit Shah @thepunit11 days ago, our team @AnthropicAI launched OSS Scanner to give open source projects free, periodic vulnerability scans from our strongest models, inspired by OSS-Fuzz. Some numbers so far: • ~650 projects applied • 114 accepted • 77 critical and 803 high model-rated findings reported (we haven’t scanned all projects yet) How our reports ended up flagged as malware, and other learnings/updates below 🧵
knower @knowerofmarketsMTS is LIVE - here's what we're talking about this morning: - Gemini 4 Argon beats Minecraft - China instilling new export controls on AI and other tech - Taiwan planning $4 billion chip facility in Texas Followed by some great interviews: - @scottaar Professor at UT Austin talking about his recent writing and the rapid rate of AI capabilities growth in mathematics - @logangraham Frontier Red Team lead at Anthropic talking about self-replicating AI and autonomous worms - @RyanFedasiuk and @Satvik_Pen of AEI talking about their recent writing on AI chip restrictions and the race for chips - @SamoBurja Founder of Bismarck Analysis talking about live v. dead players in AI - @founderengineer co-founder of abliteration ai talking about building unrestricted ai - Ahmad Osman founder @OsmanticAI talking about open models & the hardware needed to run it - Suddu Head of Data and AI @Plaid talking about the company's latest breakthroughs in AI - @BernAceituno co-founder of StackAI (acq. by Asana) discussing what it's like building capable enterprise agents - @efarrellgregory Fellow at the Foundation for American Innovation talking about Sinomodernity - Aden Barton head of evals @mercor talking about the company's latest report on the US economy - Masumi Reynders co-founder and COO of Majestic Labs talking about the "memory wall" and what Majestic is working on
Daniel Freeman @bucketofketsSome reflections/responses to some commentary I’ve seen on the autonomous worms work: - how “scary” is this / to what extent is the point of this work to “be scary”: I think this is the wrong frame, in the same way that “you’re just fearmongering about mold!” isn’t really a coherent response to the observation that dampness will cause overgrowth of mold. We perform this research to better understand what is coming, and to help motivate cyber defensive efforts. It’s true that IoT devices have been vulnerable for a very long time, but we expect this extant vulnerability to get a lot weirder exactly _because_ of the prevalence of digital intelligences. - why would small models “want” to do this: they might not! But humans absolutely will make models do this, and many are already trying! A better guiding principle here is something more like: if a model has a capability, you should expect to see that capability exhibited in the wild. Different threat models can help you reason about the source and motive of that capability (be it humans or models), but there are enough bad actors (and probably soon enough autonomous agents) that you can safely bet on bad behavior happening. - implications for open weight: while it’s certainly true this particular threat vector wouldn’t be as severe in a world that didn’t have highly capable, small open weight models, it’s simultaneously true that open weight models have been an enormous boon for cyber defenders. The world is complicated! Positive and negative externalities can exist simultaneously! We try pretty hard to reflect this nuance in our work!
Daniel Freeman @bucketofketsThe world is filled with computers, and many of those computers are pretty poorly secured. Models are also becoming _really_ capable cyber agents. Combined this with the observation that frontier model performance tends to be recapitulated in significantly smaller models—models that can fit on consumer GPU hardware—within about 18 months, and you arrive at a pretty clear prediction: small, capable models will exist, they’ll be able to gobble up vulnerable compute if they want to, and they’ll be able to do this within a few months if trends continue.
William Zhou @willzhou97Excited to share a research blog post that Daniel Freeman (@bucketofkets) and I have been working on for the past few months:
Andrew Curran @AndrewCurran_Anthropic's Frontier Red Team believes small AI models may now be months away from being capable of self replicating without access to a datacenter. Quoting from the blog: 'The capabilities that make AI models generally powerful coding agents also generalize to cyber tasks, including autonomous replication. Like coding agents in 2024, we’re seeing signs of life for AI worms. We don’t yet have a full rogue replicator, but agents are becoming increasingly capable of completing the individual steps in the replication chain (and passing on their adaptations to future copies of themselves). At the same time, increasing amounts of inference compute are now available both inside and outside of datacenters (see Appendix D). It’s uncertain exactly what form autonomous AI replication will take. It could be a slow, distributed “digital slime mold,” living on relatively insecure compute. It could also be a powerful cyber model that breaches datacenters at a high pace, or a model that scams people for compute credits. As a prediction that goes beyond our experiments, we expect a future awash with agents running on all types of hardware, including some that aren’t under human control. While it’s true that IoT devices have been vulnerable for a long time, lightweight agents may be much more willing than human attackers to put in the effort to compromise large fractions of the world’s IoT compute. The rise of slow replicators would also be a bellwether for more aggressive, faster ones that can breach more hardened machines or be effective API key thieves. We should aim to harden our systems to make it difficult for such replicators to spread, but also prepare to deal with a world where they are here to stay.'
William Zhou @willzhou97Excited to share a research blog post that Daniel Freeman (@bucketofkets) and I have been working on for the past few months:
Anthropic @AnthropicAIWe’re launching the Anthropic Cyber Mission, a new effort to secure critical infrastructure and open-source software.
Rapid Response 47 @RapidResponse47Chief Design Officer @jgebbia officially unveils the new online home for the United States of America
Ben Hawkes @benhawkesToday I'm joining Anthropic to lead the cybersecurity mission of the Frontier Red Team. In my career I've never seen a clearer opportunity to build a more secure world for everyone. For 40 years we've lived with fundamentally insecure technology. What will it take to make the past 40 years of hacking a historical oddity? That's what I'm here to find out. Super excited to work with @logangraham and the rest of the FRT crew.
Hannu Rajaniemi @hannuWith @WSJ and @georgia_wells we are now sharing a bit more about our work at @redqueenbio : using AI and a lot of hard wet lab work to create medicines that let us prepare for both natural and synthetic viruses in advance.
Jake Adler @jakeadler1/ Biological threats can bring a country to a halt without a single shot being fired. Yet much of our biodefense infrastructure has barely changed in decades, even as America’s institutions produce extraordinary scientific breakthroughs.
Erika Alden DeBenedictis @erika_alden_dToday, Pioneer Labs is announcing our first step towards terraforming Mars. 🚀🌼 With equipment that fits in just a single rocket launch, we can convert Martian dirt, water, and air into enough building materials to construct a small city on Mars. To do it, we made the first microbe for Mars. We found the best microbe on Earth and used evolution to teach it how to source all of its nutrients directly from Martian materials. The first astronauts will be greeted with safe shelter already filled with water, oxygen, and rocket fuel for the return journey. This is the first step toward using biology to make Mars a friendly place for life. It lets us live off the land and helps us build the next great frontier. It's the first of five organisms we need to green Mars ⬇️
Claude @claudeaiIntroducing Claude Opus 5.5, the first model in our new Claude 5.5 family. It performs at the level of Claude Fable 5.1 for most tasks, and costs 40% less to run than Opus 5.
