I transformed the Plush interpreter from a stack-based design to a register-based architecture, and the performance boost was more than I expected!
51613513.7K
Maxime Chevalier✓
@Love2Code
💖 ➞ λ: CS PhD, into compiler design, programming languages, music, simulation, ML/AI, robotics. Follow me code code reviews, stock picks and dating advice.
319 Gefolgt20.6K Follower8.5K Beiträge
- This is pretty cool, and indeed, why do we even need "tokens" when the data is fundamentally just bits/bytes?Albert Gu @_albertguI've always believed that intelligence should come from simple, general building blocks that learn their own abstractions directly from raw data; in other words, the bitter lesson. I think we're finally seeing a real step towards AI that can learn from all data. Language modeling on raw bytes is a microcosm of this ideal, and to me it's a central problem in AI: if we can't build LLMs that learn end-to-end from bytes, how will we handle the rest of the world's data that we understand even less? Last year we introduced hierarchical networks (H-Nets) as a first step. Our new version finds up to 3-5x efficiency gains in controlled scaling law experiments, and at larger scale matches an open-source model trained on 11T tokens with ~10x less data and compute. The posts below walk through what we found and why we think it works.03453.1K
I've always believed that intelligence should come from simple, general building blocks that learn their own abstractions directly from raw data; in other words, the bitter lesson. I think we're finally seeing a real step towards AI that can learn from all data. Language modeling on raw bytes is a microcosm of this ideal, and to me it's a central problem in AI: if we can't build LLMs that learn end-to-end from bytes, how will we handle the rest of the world's data that we understand even less? Last year we introduced hierarchical networks (H-Nets) as a first step. Our new version finds up to 3-5x efficiency gains in controlled scaling law experiments, and at larger scale matches an open-source model trained on 11T tokens with ~10x less data and compute. The posts below walk through what we found and why we think it works.2407707.1K904K- More adventures in server land: I used certbot to create an HTTPs certificate, nobody else knew about the domain, and within minutes, ~8 scanner bots had loaded the page, coming from Google Cloud and AWS... Scanners were running headless chrome and one faked being an iPhone.341690860.7K
- My Pixel 10 pro seems to have suddenly died just two months out of warranty (thanks Google), with the screen only displaying garbage. Tempted to just get an iPhone seeing how disappointing this is, but the prices are kinda insane. Next question would be which model to pick 🤔152344.3K
- I don't trust claude code or opus to do 3D modelling at all, but I've successfully had CC transplant skeletal animation between character models, fix pose issues in existing animations, and even fix rigging/weighing issues!21302.4K
- A few weeks ago I vibe-coded a GLB 3D model viewer in Plush, made a number of tweaks and improvements... And it's now become my goto model viewer program. I like it much better than F3D!21141.8K
- Multiplayer + animated mesh demo with my girlfriend on her iPhone :)01251.8K
- Having Claude Code perform surgery on GLB model files to fix wonky skeletal animations, and transplant them between different 3D models.20151.3K
- Claude Code ported my GLB mesh loader and skeletal animation code from Plush to Rust in all of 5 minutes... That was... faster than I expected.
31173.4K - I've been reviewing a lot of code written by Opus 5.5, and it still seems to make a lot of bad software engineering decisions. The kind that will accumulate/calcify into unmaintainable software over time. IMO even the agents will struggle to maintain vibecoded software.4291173.3K328K
- Had to show you this one because I think this is genuinely cool. My WIP networked 3D engine that runs in a browser. Also demoing live-editing the world, and prefab objects! :)25402.8K
- Maxime ChevalierRT @astuyve: Oh god: The p384 private keys are randomly selected integers between 1 and 256, the private keys are effectively all-zeroes apart from the last byte0125055
- I had to try this Google search to see if it would give me the ticker I expected 😂
21242.8K - Looking at some Rust wgpu/winit/Axum/tokio code and I feel like I've found the ugly/Java side of Rust, where everything is verbose and overcomplicated for no reason, except to please the type gods. It's just missing an AsyncLazyFactoryFactoryProxy to top it all off 🍒 🥮 🤦♀️21826515.3K
- Weekend project: mini 3D engine to render a cyberpunk-themed city using WebGL in the browser. It does 60fps on my Pixel 10, with ~1M polygons visible. Does per-pixel lighting and dynamic lights too :)
50753.4K - I repurposed some of my fighter plane simulator code to build a space fighter game where you're racing to destroy the enemy mothership's antimatter core before it can charge a weapon that will destroy the earth. Still a work in progress. Let me know if you would like to play it!113413K
- I put together a GLB 3D model renderer that supports skeletal animation. It's written in Plush, the interpreted language I'm building. To implement this, I first added JSON and JPEG libraries to Plush 👩💻 🧸 📷 The source code of the model viewer is here:53424.4K
