English
🤷 Nico Martin
Report

🤷 Nico Martin✓

@nicodotdev

Building Transformers.js at 🤗 @huggingface // @GoogleDevExpert for #WebTechnologies and #AI

1.4K Following3.6K Followers3.5K Posts
  1. 🤷 Nico Martin✓@nicodotdev
    Speaking at @codetalkshh in Hamburg next week! Nov 4, 15:00, main stage: “Boring but Effective: WebAI That Ships” ML that isn’t a chatbot: embeddings, speech recognition, background removal. All in the browser with Transformers.js + WebGPU, fully offline
    108270
  2. 🤷 Nico Martin✓@nicodotdev
    Posts @nicodotdev
    👉 As a little gift you get 50% off your ticket with CT50-FINALCALL, valid until the event with no usage limit.
    10080
  3. 🤷 Nico Martin✓@nicodotdev
    Posts @nicodotdev
    Also, the evening before (Nov 3) there will be the Agentic Coding Meetup at Google Hamburg. I’ll show you how to go from raw recording to finished video in 15 min by just prompting @Remotion.
    00167
  5. 🤷 Nico Martin✓@nicodotdev
    Posts @nicodotdev
    @Remotion I did a Trailer for it in *ONE* prompt😅: "Create a new video with remotion. It shoud be a hollywood-like trailer/making off of the reel-video/. You will find some assets and the generated video in assets/making-off/. Make it epic!"
    Download
    00255
  7. 🤷 Nico Martin✓@nicodotdev
    Exciting week ahead: flying to the Bay Area on Wednesday for WebAI Summit! It's a short trip, just three days, so if you want to grab a coffee, drop me a DM 😊
    1010698
  8. 🤷 Nico Martin✓@nicodotdev
    I'm sooooo soo happy to see the first snow in the mountains😍
    Download
    3035724
  9. 🤷 Nico Martin✓@nicodotdev
    I turned structured output into a game 🎮 The LLM scores the next tokens. You pick one. The constraints decide if it’s allowed. Most likely ≠ valid. Even a capital letter can lose you points. Watch the demo. Play it yourself below 👇
    Download
    3014459
  10. 🤷 Nico Martin✓@nicodotdev
    Posts @nicodotdev
    Your turn: can you get 100/100? Try heads or tails, then build a tiny JSON creature one token at a time. @googlegemma 4 E2B runs locally in your browser via Transformers.js + WebGPU. Play Token Arcade:
    00180
  11. 🤷 Nico Martin✓@nicodotdev
    New York, here I come! 🗽 On Nov 16 I'm speaking at JSNation US about multimodal AI agents that see, hear and remember, all running entirely in your browser.
    JSNation | The Main WebDev Conference @thejsnation
    Voice, vision and memory, all running in the browser. No backend, no API keys 🙌 @nicodotdev, Machine Learning Engineer at @huggingface, shows how WebGPU and WebAssembly make real-time AI agents possible on the open web. Join us at JSNation US 👇
    2012309
  13. 🤷 Nico Martin✓@nicodotdev
    For all the german speaking people, I'll be on the token therapie podcast with @janschultecom and Michael Köpf live in about 5 minutes:
    009632
  14. 🤷 Nico Martin✓@nicodotdev
    More Ternary Bonsai 2 models from @PrismML just dropped: 2B, 4B, 9B, 27B 🌱 Hundreds of tok/s on consumer hardware, fully in the browser with custom WebGPU kernels. At ~1.8 bits/weight the 2B is just 430MB. Local agentic AI is getting wild 🤯
    Xenova @xenovacom
    Today has been one of the biggest days for open-source AI this year... and it keeps getting better. @PrismML just released more Ternary Bonsai 2 models on Hugging Face: now in 2B, 4B, 9B, and 27B. The 2B reaches up to 500 tok/s on my M4 Max ENTIRELY in the browser with custom WebGPU kernels... that's insane! 🤯 At ~1.8 bits per weight, the language-model weights are just 430MB for 2B and 950MB for 4B (plus ~365MB for the 8-bit vision weights). The future of local agentic AI is going to be wild. Try out the demo yourself 👇
    0111623
  15. Xenova✓@xenovacom
    Today has been one of the biggest days for open-source AI this year... and it keeps getting better. @PrismML just released more Ternary Bonsai 2 models on Hugging Face: now in 2B, 4B, 9B, and 27B. The 2B reaches up to 500 tok/s on my M4 Max ENTIRELY in the browser with custom WebGPU kernels... that's insane! 🤯 At ~1.8 bits per weight, the language-model weights are just 430MB for 2B and 950MB for 4B (plus ~365MB for the 8-bit vision weights). The future of local agentic AI is going to be wild. Try out the demo yourself 👇
    Download
    152819211.3K
  16. 🤷 Nico Martin✓@nicodotdev
    Next week I'll be at F{AI}R, an AI unconference in Liebefeld, Bern 🇨🇭 The best part of unconferences: the schedule is built together on the spot, and the best moments usually happen over coffee, not on stage.
    4011530
  17. 🤷 Nico Martin✓@nicodotdev
    Posts @nicodotdev
    I'll bring some input on running AI directly in the browser, but mostly I’m looking forward to the conversations. Got a topic? Submit a session. Entry is free.
    00287
  18. 🤷 Nico Martin✓@nicodotdev
    Posts @nicodotdev
    Your turn: can you get 100/100? Try heads or tails, then build a tiny JSON creature one token at a time. @googlegemma 4 runs locally in your browser via Transformers.js + WebGPU. First visit downloads the model. Play Token Arcade:
    200106
  19. 🤷 Nico Martin✓@nicodotdev
    Posts @nicodotdev
    The prompt says what we want. The constraints define what’s allowed. Token Arcade lets you step through that distinction yourself: probabilities, token choices, rejected continuations, and explanations. Code:
    00044
  20. 🤷 Nico Martin✓@nicodotdev
    Multimodal similarity search in the browser❤️!
    Xenova @xenovacom
    NEW: EmbeddingGemma 2 just released on Hugging Face. Project text, images, video, and audio into a single, unified embedding space. At just 740M parameters, it can even run 100% locally in your browser on WebGPU with 🤗 Transformers.js! Try it yourself 👇
    21141.3K
  21. Xenova✓@xenovacom
    NEW: EmbeddingGemma 2 just released on Hugging Face. Project text, images, video, and audio into a single, unified embedding space. At just 740M parameters, it can even run 100% locally in your browser on WebGPU with 🤗 Transformers.js! Try it yourself 👇
    Download
    41713210.2K
  22. 🤷 Nico Martin✓@nicodotdev
    🤷 Nico Martin
    RT @dotConferences: AI that runs in your browser, on your hardware, without calling the cloud? That’s not boring. That’s pretty handy. In “Boring but Effective: WebAI That Ships,” Nico Martin shows how small open models can handle useful tasks right in the browser - from semantic search to speech recognition and background removal. No API key, no cloud subscription, no giant download. Just WebAI that’s ready to get to work. @nicodotdev is a Machine Learning Engineer focused on WebML at Hugging Face, and a Google Developer Expert in AI and Web Technologies. He makes it easier for web developers to bring machine learning into the browser - and shares what he learns through workshops, articles and talks. 🟡 Catch the replay:
    01017
  23. 🤷 Nico Martin✓@nicodotdev
    Today marks one year at @huggingface 🤗 Transformers.js went from 150k to 3.7M weekly downloads, we shipped v4, Tokenizers.js, structured output and 207 WebGPU kernels. I wrote down the whole story 👇
    11581.2K