ray
RT @anyscalecompute: Physical AI gets tested in fog, rain, snow, and glare, where data is scarce.
Our NeurIPS 2026 lesson restages one real drive in bad weather with NVIDIA Cosmos Transfer 2.5 + Ray, check out the interactive app:
01036
ray✓
@raydistributed
A distributed compute framework for scaling AI workloads. Created and developed by @anyscalecompute.
2 Following11.7K Followers2K Posts
- rayRT @anyscalecompute: Multi-band satellite imagery left @Xoople's GPUs idle, epochs running 5x slower than they should. Fix: Anyscale FDE tuning on the CPU-to-GPU handoff + fractional GPU allocation across A10s. 15 engineers at planetary scale with no infra team:01029
- rayRT @anyscalecompute: Learn how to productionize large language models using distributed post-training and inference optimization techniques. Participants will explore advanced LLM post-training techniques, including agentic reinforcement learning with SkyRL. Hands-on topics include: - Intro to LLM post-training - Intro to RLVR (with GRPO) - Recent development of LLM post-training: - On-policy distillation (OPD) and Multi-teacher On-policy distillation (MOPD) - Case study: Post-training a terminal agent - Building evals - Building custom environments - RL systems - Demo walkthrough - Intro to SkyRL - Full Async RL with SkyRL - Performance monitoring and tuning for RL rollouts Register:01036
- rayRT @robertnishihara: If you’re interested in the low-level algorithmic and systems details of how to scale training to 1M-token context, read this post from our team.avi basnet @avigyabasnetSuper excited to share some of the work I’ve been doing on supporting 1M token context training on SkyRL for GLM 5.3 Flash, 64x higher than the out of the box Megatron baseline! 🚀 This work was done in collaboration with the amazing folks at @LilaSciences! 🤩 Getting there took key algorithmic and systems optimizations in four main areas: 1) DeepSeek Sparse Attention: run DSA on a sparse kernel; chunk and shard its quadratic indexer. 2) Activation recompute and offloading: recompute activations in backward and offload saved inputs to CPU. 3) Context parallelism: split each sequence across GPUs, with new CP support for KDA and a fix for DSA. 4) Avoiding unnecessary precision upcasts: keep FP32 copies out of memory and off the network. For more details on our implementations and our results, check out our full technical blog here: This work benefited from the contributions of many people along the way. Big thanks to @pcmoritz, @erictang000, @sumanthrh, @CyrusHakha, @richliaw from @anyscalecompute and Keith Truongcao, Tushar Khot, Vivek Subramanian, Semih Kara from Lila Sciences for all the help and guidance!015044
- rayRT @anyscalecompute: When one region runs short on GPU capacity, @ChefRobotics jobs on Anyscale try others automatically until one comes through, instead of risking days without H100 access. See how the team scales robot training:01035
- rayRT @avigyabasnet: Super excited to share some of the work I’ve been doing on supporting 1M token context training on SkyRL for GLM 5.3 Flash, 64x higher than the out of the box Megatron baseline! 🚀 This work was done in collaboration with the amazing folks at @LilaSciences! 🤩 Getting there took key algorithmic and systems optimizations in four main areas: 1) DeepSeek Sparse Attention: run DSA on a sparse kernel; chunk and shard its quadratic indexer. 2) Activation recompute and offloading: recompute activations in backward and offload saved inputs to CPU. 3) Context parallelism: split each sequence across GPUs, with new CP support for KDA and a fix for DSA. 4) Avoiding unnecessary precision upcasts: keep FP32 copies out of memory and off the network. For more details on our implementations and our results, check out our full technical blog here: This work benefited from the contributions of many people along the way. Big thanks to @pcmoritz, @erictang000, @sumanthrh, @CyrusHakha, @richliaw from @anyscalecompute and Keith Truongcao, Tushar Khot, Vivek Subramanian, Semih Kara from Lila Sciences for all the help and guidance!026054
- rayRT @anyscalecompute: @StimulerApp runs 4 AI models simultaneously for every English coaching session. Speech understanding. Assessment. Proficiency tracking. Speech generation. Each fires at a different rate. Each needs its own compute. One three-person ML team runs it all. 900K+ speeches a day on Ray and Anyscale Case study:02033
- rayRT @anyscalecompute: In this session, @Marwan1112, AI Engineer at Anyscale, will walk through: - Building Ray Serve applications with deployments, composition, and load-aware request routing - Deploying and scaling LLM endpoints with Ray Serve LLM on engines like @vllm_project and @sgl_project - Optimizing the inference engine with the KV cache, paged attention, prefix caching, and continuous batching - Scaling frontier models with KV-cache-aware routing, prefill/decode disaggregation, and wide expert parallelism for mixture-of-experts (MoE) models - Deploying Custom LLMs on Anyscale and Integrating Them with Agentic Platforms (Claude Code, Cursor, Codex) - Comparing costs across self-hosted GPUs, subscriptions, and token-based API billing. Register:02029
- rayRT @anyscalecompute: Kubernetes doesn’t know what a Ray cluster is. So teams keep hand writing the same Deployments, Services, and recovery scripts to run Ray on it. KubeRay fixes that: autoscaling, fault tolerance, and zero downtime upgrades for Ray, built into Kubernetes.02038
- rayRT @anyscalecompute: @Xoople processes 500,000 km² of satellite imagery in under 5 minutes on 12 A10 GPUs with Anyscale on @Azure. A single request can fan out to 2 trillion pixels. 15 engineers without a dedicated infra team. Read the case study:01037
- rayRT @anyscalecompute: Run Reflection's Beam at scale in your own account for full sovereignty but without managing infra with Ray Serve LLM on Anyscale!Jeffrey Wang @jeffreyycwangExcited to announce Day 0 support for Reflection's Beam model on Ray Serve LLM! Beam is Reflection's first open-weight model, advancing the frontier of Western AI in the 500B-parameter class. Built as a sparse MoE model, Beam is optimized for coding, agentic workloads, and efficient inference. We've validated Ray Serve LLM deployment recipes for Beam along with its DFlash2 drafter. 🧵03027
Excited to announce Day 0 support for Reflection's Beam model on Ray Serve LLM! Beam is Reflection's first open-weight model, advancing the frontier of Western AI in the 500B-parameter class. Built as a sparse MoE model, Beam is optimized for coding, agentic workloads, and efficient inference. We've validated Ray Serve LLM deployment recipes for Beam along with its DFlash2 drafter. 🧵45223.2K- rayRT @anyscalecompute: Heading to @PyTorch Conference next week? ☕ Come hang at the Coffee Club with the teams behind Ray and vLLM, two key projects under the PyTorch Foundation. Hosted by Anyscale, @Inferact and @Nscale. Request your spot here:01028
- rayRT @anyscalecompute: Open Source AI Week kicks off tomorrow 🎉 📍 The Midway, SF, 6pm 👇 Join us alongside other key players in AI helping organizations adopt and scale their use of open-source.01035
- rayRT @bthecohen: We post-train GLM-5.3 Flash in a sandbox that reproduces the Bits Investigation tools over archived scenario data. Our async RL stack is based on #SkyRL, with efficiency and reliability enhancements in our internal fork. Training and inference run concurrently, with a staleness budget for off-policy updates.04049
- rayRT @erictang000: datadog ai research used SkyRL to post-train GLM 5.3 Flash to perform at the pareto frontier for their SRE eval @bthecohen and team were some of the earliest users of SkyRL at scale, really cool to see these results finally out! great tech report as wellDatadog, Inc. @datadoghqMeet Scout 1.0, our first AI model built for investigating production incidents. Scout matches frontier-model investigation quality at a fraction of the cost, which makes it practical to investigate more issues, earlier. We trained Scout on realistic simulations built from real-world incidents and production telemetry, using reinforcement learning to reward accurate root causes backed by evidence. Learn more and sign up for the preview:06043
Meet Scout 1.0, our first AI model built for investigating production incidents. Scout matches frontier-model investigation quality at a fraction of the cost, which makes it practical to investigate more issues, earlier. We trained Scout on realistic simulations built from real-world incidents and production telemetry, using reinforcement learning to reward accurate root causes backed by evidence. Learn more and sign up for the preview:256633452.1K- rayRT @sumanthrh: Great to see this out! Datadog's new SOTA model for investigating production incidents. Their in-house training stack builds on top of SkyRL! 🚀🚀🚀Datadog, Inc. @datadoghqMeet Scout 1.0, our first AI model built for investigating production incidents. Scout matches frontier-model investigation quality at a fraction of the cost, which makes it practical to investigate more issues, earlier. We trained Scout on realistic simulations built from real-world incidents and production telemetry, using reinforcement learning to reward accurate root causes backed by evidence. Learn more and sign up for the preview:06043
- rayRT @charlie_ruan: Datadog post-trained GLM-5.3 Flash via RL on real-incident sims. Matches frontier SRE performance at much lower cost. Their RL stack is built on top of SkyRL! Check out the technical reportDatadog, Inc. @datadoghqMeet Scout 1.0, our first AI model built for investigating production incidents. Scout matches frontier-model investigation quality at a fraction of the cost, which makes it practical to investigate more issues, earlier. We trained Scout on realistic simulations built from real-world incidents and production telemetry, using reinforcement learning to reward accurate root causes backed by evidence. Learn more and sign up for the preview:012040
- rayRT @anyscalecompute: @ChefRobotics trains the Vision-Language-Action models behind its food assembly robots 10x faster on Anyscale, with 92% scaling efficiency across multi GPU runs on 16 A100s. Read the story:03032
- rayRT @anyscalecompute: @Coinbase is building an agent-first ML platform where AI agents watch model performance and trigger retraining on their own. Aman Choudhary on how Ray on Anyscale helps them run up to 1 billion inferences a day03030