ᴅᴀɴɪᴇʟ ᴍɪᴇssʟᴇʀ 🛡️✓
@DanielMiessler
Building Vector: The Enterprise AI Operating System @ https://t.co/D38E5CXwiA and LifeOS: The Human Magnification OS @ https://t.co/muV0Un09sA | Ex: Apple, Robinhood, HP, Army
1.7K Following161K Followers29.7K Posts
- Posts @DanielMiesslerThe full post, with notes and related reading, is on my blog:000367
- The new analysis is vastly more in-line with my actual experience using these models, which was the whole point.Alexey Fateev @superaleshaFuck you, @ArtificialAnlys Your new index says Claude Haiku 5.5 is smarter than DeepSeek V4.1 Flash 1017 and GLM-5.3. Haiku is Anthropic's small cheap model. DeepSeek 1017 is the model Cursor put on its cost frontier this month, and Cursor says no model scores higher at those prices. I run it every day on my 4x 3090. I dont believe for a second that Haiku beats it. Look at how they got there. 60% of the index now runs on private tests nobody outside can see. GDPval-AA, SciCode and the long context test are gone. In comes a private coding benchmark from Cognition. And the open weights gap goes from 3 points to 12 in 1 release, 4x. Released open models are now 26 points behind the top. 1 day before v5, on the old version, they gave Ling 3.1 Flash 1019 a 44. Now the best released open model gets 32. The weights didnt change. The tests did, and you cant see the tests. This is a bought benchmark. A leaderboard where you cant check a single question, that widens the gap 4x overnight and puts Haiku above DeepSeek, is marketing for closed labs. Its not measurement. I hope at least you were paid enough money to publish such garbage. Liars. Publish the questions or stop calling it an index.21154.5K
Fuck you, @ArtificialAnlys Your new index says Claude Haiku 5.5 is smarter than DeepSeek V4.1 Flash 1017 and GLM-5.3. Haiku is Anthropic's small cheap model. DeepSeek 1017 is the model Cursor put on its cost frontier this month, and Cursor says no model scores higher at those prices. I run it every day on my 4x 3090. I dont believe for a second that Haiku beats it. Look at how they got there. 60% of the index now runs on private tests nobody outside can see. GDPval-AA, SciCode and the long context test are gone. In comes a private coding benchmark from Cognition. And the open weights gap goes from 3 points to 12 in 1 release, 4x. Released open models are now 26 points behind the top. 1 day before v5, on the old version, they gave Ling 3.1 Flash 1019 a 44. Now the best released open model gets 32. The weights didnt change. The tests did, and you cant see the tests. This is a bought benchmark. A leaderboard where you cant check a single question, that widens the gap 4x overnight and puts Haiku above DeepSeek, is marketing for closed labs. Its not measurement. I hope at least you were paid enough money to publish such garbage. Liars. Publish the questions or stop calling it an index.2031102.3K163K- ᴅᴀɴɪᴇʟ ᴍɪᴇssʟᴇʀ 🛡️RT @benhylak: every product i use should just be a headless mcp, that feeds into an agent, where i never have to think about anything underneath. except for our product, of course. in our product, customers love the ui and love us very much. we're special that way.04010666
- I think the tangible tipping point for local models will come when you can have Opus 5.5 level intelligence at the house with nothing more than a Mac mini. Rented GPUs are a nice middle step, but even that is super fringe. I could be wrong here, but I feel like there is some magical “good enough” line for the majority of human work, and that Opus 5.5 is pretty close.162545K
- Artificial Analysis updated their ratings based on their new, closed benchmarks, and look how far the open models are falling vs the top ones. This is what we’ve felt the whole time, and now we see it reflected in reality after they switch to benchmarks that aren’t able to be gamed as easily.Beamsters @Beamsters1Artificial Analysis v4.3.2 to v5, AI models re-ranking step by step.51184.4K
- The US government is going after foreign gadgets, especially in the drone / robot space.1042.4K
- On paper this jumps ahead of Opus 5.5. Even AA has it higher. Currently running my own Explanation Bench on it to see how it does.Google DeepMind @GoogleDeepMindGemini 4 Carbon is our next frontier model. It’s state-of-the-art across cybersecurity and long-horizon capabilities.60163.6K
Google DeepMind@GoogleDeepMindGemini 4 Carbon is our next frontier model. It’s state-of-the-art across cybersecurity and long-horizon capabilities.
6551.3K13.8K1.4M- There's been a 1,500% jump in forward deployed AI engineers in China. These are people who don't just know AI but are good at going inside companies and getting it implemented for them.41132.2K
- Microsoft has offered to buy out an entire quarter of their workforce. Feels like that's the voluntary phase before it becomes less optional.1184.4K
- ᴅᴀɴɪᴇʟ ᴍɪᴇssʟᴇʀ 🛡️RT @DanielMiessler: I disagree with @mattpocockuk that the code should be the source of truth when building with AI. - The intent in our minds is the true source - How we capture that in English is 2nd - Code is an implementation, and it's actually 3rd Writing is closer to thought than code.0180102K
- This feels quasi-criminal to me. I'm no lawyer, but I am not ok with criminal shit being done, without anyone's knowledge, and then it being somehow made un-criminal because it was in the 4,000 page terms and conditions and technically there's a way to opt out. Super gross.Tristan @Tristan0xIf you've ever wondered why smart TVs are so cheap, this is why. @log4j rooted his Samsung and found an always-on hot mic, automatic content recognition, geolocation, network mapping, ad targeting and user profiling, shared with Samsung's "400 partners". A lot of it can be blocked in <15 min, wrote a basic guide below. What your TV is doing The main culprit is ACR (automatic content recognition). Your TV screenshots what's on screen, fingerprints it, and sends it home to build your ad profile. Samsung does it every 500ms, LG every 10ms [1]. What is insane: it happens on connected devices too. Plug in your laptop, your console, your work machine, and your TV can fingerprint that via HDMI [1]. He also found that if your Samsung doesn't have a mic, it'll look for one from a connected soundbar or bluetooth device. It's on by default, and you likely agreed to it on the setup screen you clicked through in 10 seconds. Step 1: Turn off ACR Samsung: Terms & Privacy → Viewing Information Services LG: Live Plus Vizio: Viewing Data Roku: "Use info from TV inputs" Sony/Google TV: Samba Interactive TV Menus vary by model, but those are the names to look for. While you're in there, opt out of interest-based ads, reset your advertising ID, decline every optional privacy agreement, turn off voice recognition, and delete apps you never open. Step 2: Give smart devices their own network Put the TV, cameras, speakers and vacuum on your router's guest/IoT network. The logic is simple: these devices rarely get patched. If one gets compromised (getting drastically more frequent with AI), it shouldn't be able to see your other devices or home network. Step 3: Block trackers for the whole house with DNS-level filtering NextDNS (cloud-based) is easy and has a solid free plan. Pi-hole is a little bit more work if you prefer self hosting. For simplicity we'll focus on the former. 1. Sign up at (free tier is plenty) 2. Privacy tab: add a blocklist (OISD is a good bet) and turn on Native Tracking Protection for Samsung, LG, Roku, Amazon (see attached image) 3. Setup tab: copy your endpoint 4. Paste it into your router's DNS settings as DNS-over-HTTPS/TLS (or use the IPs + "Link IP" if your router only does plain DNS) 5. Bonus: block outbound port 53 except to your router. Some devices hardcode their own DNS to get around you Then open the NextDNS logs and watch how often your TV phones home. It's eye-opening. If an app or update breaks, find the domain in the logs and allowlist it. Why they do this TV prices are down 97% since 2000 [2]. Most of that is better manufacturing and brutal competition. But once margins on the hardware hit zero, the cost moved to you. In Q3 2024, Vizio lost $6.7M selling TVs and made $115.8M in gross profit from ads and viewing data [3]. They've said on earnings calls that they keep TV prices low to grow the audience they sell to advertisers. Walmart bought them in 2024. This isn't a conspiracy theory either. Vizio paid $2.2M to the FTC in 2017 for tracking 11 million TVs without consent. Last December, Texas sued Samsung, LG, Sony, Hisense and TCL over ACR. Samsung and LG have since agreed to stop collecting that data without explicit consent [4]. TL;DR 1. ACR off 2. Ads + voice off 3. Smart devices on their own network 4. NextDNS filtering on the router Sources: [1] ACR study: [2] Cost of US consumer goods: [3] Vizio Q3 2024: [4] Texas v. Samsung:162121417.6K
If you've ever wondered why smart TVs are so cheap, this is why. @log4j rooted his Samsung and found an always-on hot mic, automatic content recognition, geolocation, network mapping, ad targeting and user profiling, shared with Samsung's "400 partners". A lot of it can be blocked in <15 min, wrote a basic guide below. What your TV is doing The main culprit is ACR (automatic content recognition). Your TV screenshots what's on screen, fingerprints it, and sends it home to build your ad profile. Samsung does it every 500ms, LG every 10ms [1]. What is insane: it happens on connected devices too. Plug in your laptop, your console, your work machine, and your TV can fingerprint that via HDMI [1]. He also found that if your Samsung doesn't have a mic, it'll look for one from a connected soundbar or bluetooth device. It's on by default, and you likely agreed to it on the setup screen you clicked through in 10 seconds. Step 1: Turn off ACR Samsung: Terms & Privacy → Viewing Information Services LG: Live Plus Vizio: Viewing Data Roku: "Use info from TV inputs" Sony/Google TV: Samba Interactive TV Menus vary by model, but those are the names to look for. While you're in there, opt out of interest-based ads, reset your advertising ID, decline every optional privacy agreement, turn off voice recognition, and delete apps you never open. Step 2: Give smart devices their own network Put the TV, cameras, speakers and vacuum on your router's guest/IoT network. The logic is simple: these devices rarely get patched. If one gets compromised (getting drastically more frequent with AI), it shouldn't be able to see your other devices or home network. Step 3: Block trackers for the whole house with DNS-level filtering NextDNS (cloud-based) is easy and has a solid free plan. Pi-hole is a little bit more work if you prefer self hosting. For simplicity we'll focus on the former. 1. Sign up at (free tier is plenty) 2. Privacy tab: add a blocklist (OISD is a good bet) and turn on Native Tracking Protection for Samsung, LG, Roku, Amazon (see attached image) 3. Setup tab: copy your endpoint 4. Paste it into your router's DNS settings as DNS-over-HTTPS/TLS (or use the IPs + "Link IP" if your router only does plain DNS) 5. Bonus: block outbound port 53 except to your router. Some devices hardcode their own DNS to get around you Then open the NextDNS logs and watch how often your TV phones home. It's eye-opening. If an app or update breaks, find the domain in the logs and allowlist it. Why they do this TV prices are down 97% since 2000 [2]. Most of that is better manufacturing and brutal competition. But once margins on the hardware hit zero, the cost moved to you. In Q3 2024, Vizio lost $6.7M selling TVs and made $115.8M in gross profit from ads and viewing data [3]. They've said on earnings calls that they keep TV prices low to grow the audience they sell to advertisers. Walmart bought them in 2024. This isn't a conspiracy theory either. Vizio paid $2.2M to the FTC in 2017 for tracking 11 million TVs without consent. Last December, Texas sued Samsung, LG, Sony, Hisense and TCL over ACR. Samsung and LG have since agreed to stop collecting that data without explicit consent [4]. TL;DR 1. ACR off 2. Ads + voice off 3. Smart devices on their own network 4. NextDNS filtering on the router Sources: [1] ACR study: [2] Cost of US consumer goods: [3] Vizio Q3 2024: [4] Texas v. Samsung:
3533.3K22.6K1.5M- I think this is a really good explainer. But I have a slightly different explanation that’s pretty elegant to remember. 1. Both models and harnesses are made to help you get what you want from AI 2. Models are getting much better, but they can only do so much because they don't know everything about you and how you like things to be done. 3. Harnesses are like model assistants. They help the model get the information that it needs to help you in a way that matches your preferences. 4. In general, the better the models get, the less you will need the harness because they are ultimately pursuing the same goal of getting you exactly what you want. 5. The best harnesses today are focused not on micromanaging the steps to use to accomplish something (we should leave that to the model), but instead on describing exactly how you like things to be done. The more the harness knows about you and your preferences, the better it can provide the model what it needs to give you the best result. 6. In other words, the model is the “how” and the harness’s job is to provide the highest quality “what”.Theo - t3.gg @theo116888K
- I recommend reading this breach data in the voice of the Count from Sesame Street.Diogo Almeida @CompleteSkepticdespite the unfortunate timing, we take disclosures seriously at @typesafeai at approximately 6:49PM this Friday evening, we became aware of a massive unauthorized leak of ALL customer noul outputs in effort to maximize transparency, here is the link:22318.2K
despite the unfortunate timing, we take disclosures seriously at @typesafeai at approximately 6:49PM this Friday evening, we became aware of a massive unauthorized leak of ALL customer noul outputs in effort to maximize transparency, here is the link:4483156.2K1.2M- To me you were the one who started the trend of labs becoming visible and responsive to the community. So you have helped the AI industry not just internally through all the stuff you worked on, but in a meta way as well by making the labs more accessible. Thank you for both!Thariq @trq212I’ve left Anthropic after more than a year of working on Claude Code and seeing it scale larger than I ever imagined. I have really loved working at Ant and believe deeply in the mission, and most of all, the idea of a race to the top. The idea that if we work hard and responsibly, we can raise the bar and inspire others to great outcomes. And if we all push each other to be better, things can be radically good. I will carry the spirit of this with me forever. My colleagues at Anthropic are the most talented, thoughtful, competent, and earnest people I have ever met. I am glad they are at the wheel and trust them deeply. To the community on X, thank you for everything. You’ve made this the most fun (and sometimes stressful) job I’ve ever had. For me, it is time for a bit of a break before diving into something new. If you want more excellent Claude Code content, you should follow @addyosmani , @lydiahallie, @_catwu, @ClaudeDevs and of course @bcherny who started it all.11445.4K
I’ve left Anthropic after more than a year of working on Claude Code and seeing it scale larger than I ever imagined. I have really loved working at Ant and believe deeply in the mission, and most of all, the idea of a race to the top. The idea that if we work hard and responsibly, we can raise the bar and inspire others to great outcomes. And if we all push each other to be better, things can be radically good. I will carry the spirit of this with me forever. My colleagues at Anthropic are the most talented, thoughtful, competent, and earnest people I have ever met. I am glad they are at the wheel and trust them deeply. To the community on X, thank you for everything. You’ve made this the most fun (and sometimes stressful) job I’ve ever had. For me, it is time for a bit of a break before diving into something new. If you want more excellent Claude Code content, you should follow @addyosmani , @lydiahallie, @_catwu, @ClaudeDevs and of course @bcherny who started it all.2.2K1.1K31.7K6.4M- Show more posts
