English
Mesh LLM
Report

Mesh LLM

@Mesh_LLM

Distributed inference for the people. Private and public mesh, sharing hardware for inference. https://t.co/yqbhmITeYQ

60 Following35 Followers8 Posts
  1. Mesh LLM@Mesh_LLM
    New Mesh plugins for Apple Silicon: ⚡ Uzu: high-throughput Metal inference for Qwen 3.8 & more 🧠 DwarfStar: run huge DeepSeek V4 models locally 💾 Slotstream: SSD-backed MoE for Macs with less RAM
    1003
  2. Mesh LLM@Mesh_LLM
    Mesh LLM
    RT @matbalez: this was fun to build - fork of signal - agent built with GDK - using open weights model - served via e2ee mesh-llm - via private GPU TEE - making private search tool calls - paid for with ₿ over LN a cool stack of permissionless & open source tech all working together!
    PBJ Podcast @PresidioPod
    An agent inside Signal using decentralized compute paid for with bitcoin @moneyball demos a fork of Signal built by @matbalez using @Mesh_LLM and @lexeapp ↓ Timestamps: 0:00 - Demo: agent inside Signal 10:51 - The economics of decentralized compute 14:39 - Running inference at home
    0240152K
  3. PBJ Podcast✓@PresidioPod
    An agent inside Signal using decentralized compute paid for with bitcoin @moneyball demos a fork of Signal built by @matbalez using @Mesh_LLM and @lexeapp ↓ Timestamps: 0:00 - Demo: agent inside Signal 10:51 - The economics of decentralized compute 14:39 - Running inference at home
    Download
    617789K
  4. Mesh LLM@Mesh_LLM
    Mesh LLM
    RT @Mesh_LLM: Right on - this is what we made MeshLLM for (well that and some procrastination: Metal, CPU, CUDA (various), ROCm, Vulkan, x86_64, arm, windows/mac/linux and appropriate combinations. (fingers are sore).
    Georgios Konstantopoulos @gakonst
    this is THE time to be revisiting distributed inference on heterogeneous hardware, software is collapsing the barriers of hardware incompatibility
    02047
  5. Georgios Konstantopoulos✓@gakonst
    this is THE time to be revisiting distributed inference on heterogeneous hardware, software is collapsing the barriers of hardware incompatibility
    371835631.5K
  6. Mesh LLM@Mesh_LLM
    Mesh LLM
    RT @Mesh_LLM: Who wants ads? So great to have ads. Everyone wants ads. More ads. Should we put ads in?
    Download
    020132
  7. Mesh LLM@Mesh_LLM
    we have shifted a fair bit of dev to buzz to try out multi player agents, just to see how it goes. Some findings from the other month:
    00134
  8. Mesh LLM@Mesh_LLM
    welcome to ...
    00147
  9. Show more posts