@devindevelopers
Official developer account for Devin. Guides, new features, and community events. Built by @cognition.
Cognition @cognitionIntroducing SWE-2, our closest model yet to the frontier. On leading evals, it scores on par with recent frontier models – at up to 70% lower cost. We scaled RL to multiple trillions of parameters, with a refined recipe that pushes the Pareto curve on both capabilities & cost.
Cognition @cognitionFounded by three 22-year-olds in 2023, @mercor crossed $2B ARR in June, only 4 months after hitting $1B. Today, millions of experts on the platform bring their knowledge of medicine, law, engineering, and beyond to frontier AI - helping models take on increasingly complex and consequential work in the real world. Mercor's engineers move at extraordinary speed. They give Devin long-running tasks before bed, during meetings, or on their way to the gym. They come back to tested features and PRs ready to merge.
Decagon @DecagonAI
Artificial Analysis @ArtificialAnlysAnnouncing Artificial Analysis Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 is our biggest upgrade since v4 launched in January. With v5, 60% of the Index is now based on evaluations with private test sets or held-out answers. Alongside Intelligence Index v5, we’re launching the Artificial Analysis Progress Index v1, which tracks model capability over time on one continuous scale. New to the Intelligence Index: ➤ FrontierCode 2.0: Cognition's newly-launched private benchmark of real-world coding tasks, graded on whether a repository maintainer would merge the agent's change ➤ Terminal-Bench-Science: 70 agentic scientific research tasks, run in a terminal environment Upgraded: ➤ HLE-Diamond (replacing Humanity's Last Exam): a refined 1,000-question version of Humanity's Last Exam, split evenly between reasoning and knowledge questions ➤ AA-Omniscience v1.1: An updated dataset with saturated and public set questions removed, new questions added, and ambiguous or erroneous questions revised ➤ CritPt v2: a private, 40-question hard subset of CritPt v2, revised by the CritPt authors and run with a code-execution tool Staying in the Index: AA-Briefcase, AutomationBench-AA, GDP.pdf and Terminal-Bench 4.0 Removed from the Index: GDPval-AA v2.1, SciCode, and AA-LCR v1.1 Key results: ➤ Claude Opus 5.5 (max) leads at 58, ahead of GPT-6 Astra (max, 57) and GPT-6.1 Sol (max, 55): Anthropic and OpenAI hold the top five models. Gemini 4 Argon (high) is next at 50 ➤ The open weights gap widens from 3 points to 12: Kimi K3.1 Pro (weights not yet released) is the top open weights model at 46. Among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead at 32 - 26 points behind the leader and below Claude Haiku 5.5 (max, 36) ➤ Cost per task varies by more than 13x among the leading models: of the 10 highest-scoring models shown, GPT-6.1 Terra (max) is the cheapest at $0.96 per Intelligence Index task and Claude Fable 5.1 (max) the most expensive at $13.04
Cognition @cognitionIntroducing FrontierCode 2.0: our new coding benchmark that measures a model’s ability to go beyond the spec. Most coding evals measure a model’s ability to write code that meets a spec. With FrontierCode 1.0, we asked a new question: would you actually merge the PR? FrontierCode 2.0 is comprised of more diverse tasks, featuring larger scopes and higher mergeability standards. We are now asking: not only would you merge this PR, but should you? One key feature of FrontierCode 2.0 is underspecified prompts. Rather than including every engineering decision, prompts are deliberately ambiguous, giving the models room to demonstrate their judgment. The result is a benchmark that is far from saturated, with the top model scoring just 45%.
Cognition @cognitionWe are entering a new dark age of cybersecurity. Devin is here to help. Introducing the new Devin Security: powered by Claude Mythos and frontier cyber models, plus hundreds of millions of dollars of credits to help teams find, prioritize, and fix urgent vulnerabilities.
Marc Lou @marclouDubai, let's meet! 📍 TheBlock 📅 Sun, Oct 25 🕣 3:00–6:00 PM I'm organizing the 13rd Indie Hackers meetup with the help of @cognition. See you there! RSVP →
Cognition @cognitionToday we're introducing a refreshed Devin Desktop app, with an agent command center designed to be smoother and more polished than ever before.
Cognition @cognitionToday we're introducing a refreshed Devin Desktop app, with an agent command center designed to be smoother and more polished than ever before.
Marques Brownlee @MKBHDThe current state of apps on iPhone Duo:
Cognition @cognitionDevin Fusion has claimed a top score of 68 on the @ArtificialAnlys Coding Agent Index with an Opus 5.5 lead and GPT-6 Luna sidekick. Devin Fusion outperforms Claude Code with Opus 5.5 on both performance and price – earning a score of 68 at a 31% lower cost per task.
