Distributed Machine Learning Patterns

👋 Hello, World! This is a dedicated account for Distributed Machine Learning Patterns by @TerryTangYuan from @ManningBooks. 🔔 Stay tuned for updates, discounts, and giveaways! #MachineLearning #DevOps #MLOps #DistributedSystems #Kubernetes

RT @ManningBooks: Generative AI is reshaping Kubernetes. At 2:05 pm EST, @TerryTangYuan breaks down KServe Next — how v0.17 handles LLMs, KV caching, distributed execution, & the Envoy AI Gateway. Details: KubeCon bundle:

RT @ManningBooks: Security in the technosphere is evolving — you see it in job listings, T&Cs, cookies, & more. K8s is in the thick of it. Catch @TerryTangYuan at #KubeCon, 10:08am EST on how KServe makes AI trust work: Bundle his book:

RT @TerryTangYuan: 📚✨ 𝗕𝗼𝗼𝗸 𝗦𝗶𝗴𝗻𝗶𝗻𝗴 𝗮𝗻𝗱 𝗘-𝗕𝗼𝗼𝗸 𝗚𝗶𝘃𝗲𝗮𝘄𝗮𝘆 𝗮𝘁 𝗞𝘂𝗯𝗲𝗖𝗼𝗻 𝗡𝗼𝗿𝘁𝗵 𝗔𝗺𝗲𝗿𝗶𝗰𝗮! ✨📚 If you’re attending #KubeCon in Atlanta and have a copy of my book 𝘋𝘪𝘴𝘵𝘳𝘪𝘣𝘶𝘵𝘦𝘥 𝘔𝘢𝘤𝘩𝘪𝘯𝘦 𝘓𝘦𝘢𝘳𝘯𝘪𝘯𝘨 𝘗𝘢𝘵𝘵𝘦𝘳𝘯𝘴, bring it along and I’d love to sign it! 🖊️ You can find me at these sessions: 1️⃣ 𝗔𝗻𝗰𝗵𝗼𝗿𝗶𝗻𝗴 𝗧𝗿𝘂𝘀𝘁 𝗶𝗻 𝘁𝗵𝗲 𝗔𝗴𝗲 𝗼𝗳 𝗔𝗜: 𝗜𝗱𝗲𝗻𝘁𝗶𝘁𝗶𝗲𝘀 𝗔𝗰𝗿𝗼𝘀𝘀 𝗛𝘂𝗺𝗮𝗻𝘀, 𝗠𝗮𝗰𝗵𝗶𝗻𝗲𝘀, 𝗮𝗻𝗱 𝗠𝗼𝗱𝗲𝗹𝘀: 2️⃣ 𝗞𝗦𝗲𝗿𝘃𝗲 𝗡𝗲𝘅𝘁: 𝗔𝗱𝘃𝗮𝗻𝗰𝗶𝗻𝗴 𝗚𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝘃𝗲 𝗔𝗜 𝗠𝗼𝗱𝗲𝗹 𝗦𝗲𝗿𝘃𝗶𝗻𝗴: 3️⃣ 𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗧𝗔𝗚 𝗪𝗼𝗿𝗸𝗹𝗼𝗮𝗱𝘀 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻: 𝗔𝗱𝘃𝗮𝗻𝗰𝗶𝗻𝗴 𝘁𝗵𝗲 𝗖𝗼𝗿𝗲 𝗼𝗳 𝗖𝗹𝗼𝘂𝗱 𝗡𝗮𝘁𝗶𝘃𝗲 𝗘𝘅𝗲𝗰𝘂𝘁𝗶𝗼𝗻: 4️⃣ 𝗡𝗮𝘃𝗶𝗴𝗮𝘁𝗶𝗻𝗴 𝘁𝗵𝗲 𝗥𝗮𝗽𝗶𝗱 𝗘𝘃𝗼𝗹𝘂𝘁𝗶𝗼𝗻 𝗼𝗳 𝗟𝗮𝗿𝗴𝗲 𝗠𝗼𝗱𝗲𝗹 𝗜𝗻𝗳𝗲𝗿𝗲𝗻𝗰𝗲: 𝗪𝗵𝗲𝗿𝗲 𝗗𝗼𝗲𝘀 𝗞𝘂𝗯𝗲𝗿𝗻𝗲𝘁𝗲𝘀 𝗙𝗶𝘁?: Don’t have a physical copy yet? I’m giving away 𝟴 𝗳𝗿𝗲𝗲 𝗲-𝗯𝗼𝗼𝗸𝘀 🎁 thanks to @ManningBooks! 👉 Like, comment, or repost this post and I’ll randomly select participants after the conference. And if you’d like your own copy, use code 𝗞𝘂𝗯𝗲𝗖𝗼𝗻𝟮𝟱𝗮𝘂 starting 𝗡𝗼𝘃 𝟵𝘁𝗵 for 45% off. Can’t wait to connect, chat, and celebrate open source + AI with everyone in Atlanta!

RT @ManningBooks: What’s harder than training an AI model? Serving it at scale. @TerryTangYuan shows how KServe makes them faster, cheaper, & more scalable — today at @IBM TechXchange, 1:45 pm ET. Details: Book’s 45% off with code TANGtechX45 thru Oct 24th:

RT @TerryTangYuan: Wrapping up an amazing week at #KubeCon London! It’s been a full week of connecting with an incredible community of users, contributors, collaborators, colleagues, and friends. I had the pleasure of participating in a panel, an opening session, and two other KubeCon sessions!

RT @ManningBooks: How about a recommendation for your next KubeCon EU talk? Check out @TerryTangYuan! He's speaking at 11:15 AM BST on Level 3. Details: Get his book, Distributed Machine Learning Patterns, for 45% off with code KubeConEU25 here:

RT @TerryTangYuan: I've got a 45% off discount code for my Distributed Machine Learning Patterns book! Use the code "KubeConEU25" before May 31 at

RT @TerryTangYuan: Super excited to announce that my book Distributed Machine Learning Patterns from Manning Publications is now available in both Chinese and Korean by leading publishers Tsinghua University Press and Hanbit Media!

RT @vllm_project: We are excited to announce that vLLM inference provider is now available in Llama Stack! This article from @TerryTangYuan and @ashwinb provides an introduction and tutorial to help you get started using it locally or deploying it in a Kubernetes cluster.

RT @TerryTangYuan: Distributed Machine Learning Patterns is being translated into different languages, including Korean and Simplified Chinese! The version in Simplified Chinese will be published soon by Tsinghua University Press. Stay tuned!

RT @TerryTangYuan: Had a great time at KubeCon Europe this year at Paris! I did my first opening remarks session at Cloud Native AI Day as a co-chair, gave a talk on Production-Ready AI Platform on Kubernetes, chatted with many collaborators and colleagues, and had my first book-signing at a conference! Book: Presentation: @CloudNativeFdn #KubeCon #KubeConEU #MachineLearning #AI #CloudNative

RT @ManningBooks: 🚀 Join us at #KubeConEU, Mar 19-22! Don’t miss Manning authors @vitalethomas, Mauricio Salatino @salaboy, & Yuan Tang @TerryTangYuan. 📆Schedule and details: 📚 Explore their books at #Kubernetes #CloudNative #ManningBooks

RT @TerryTangYuan: Distributed Machine Learning Patterns is now available in ePub and liveBook formats in case you'd like to add it to your digital collection!

RT @Al_Grigor: We have a new book of the week – "Distributed Machine Learning Patterns" by @TerryTangYuan. You can talk directly to Yuan, the author of the book, and win a free copy You can join until Jan 18 👇🏼

RT @ManningBooks: 📣Deal of the Day📣 Jan 9 45% off TODAY ONLY! Distributed Machine Learning Patterns & selected titles: @TerryTangYuan #distributedML #Kubeflow #ArgoWorkflows Now in print! Practical patterns for scaling #ML from your laptop to a distributed cluster.

RT @TerryTangYuan: 📚 Distributed Machine Learning Patterns is now available to order in your favorite websites! Get your copies today! - Amazon: - Barnes & Noble: - Powell’s: - Bookshop: - Manning: 🎯 Table of Contents: PART 1: BASIC CONCEPTS AND BACKGROUND 1 Introduction to distributed machine learning systems PART 2: PATTERNS OF DISTRIBUTED MACHINE LEARNING SYSTEMS 2 Data ingestion patterns 3 Distributed training patterns 4 Model serving patterns 5 Workflow patterns 6 Operation patterns PART 3: BUILDING A DISTRIBUTED MACHINE LEARNING WORKFLOW 7 Project overview and system architecture 8 Overview of relevant technologies 9 A complete implementation

RT @TerryTangYuan: Hi all, I am participating Kubeflow’s first ever Steering Committee Election and the testimonial phase is now open! Check out this summary of my involvement in Kubeflow and feel free to comment on this issue if you would like to offer an endorsement!

RT @TerryTangYuan: My new book Distributed Machine Learning Patterns from @ManningBooks is now officially published! Printed books are now available to order on Manning website!

RT @TerryTangYuan: We are excited to announce that the GA release for Argo Workflows v3.5.0 is now available, with 66 new features from 63 contributors! Check out the release blog for more details! @argoproj @CloudNativeFdn #Kubernetes #MLOps #DevOps #CloudNative

RT @ManningBooks: 💬A must-read for anyone in the field. Brian Ray, Managing Director and Global Data Science Lead at Eviden on Distributed Machine Learning Patterns by @TerryTangYuan: #machinelearning #distributedcomputing #distributedmachinelearning #deeplearning