Distributed Machine Learning Patterns @DistML

Generative AI is reshaping Kubernetes. At 2:05 pm EST, @TerryTangYuan breaks down KServe Next — how v0.17 handles LLMs, KV caching, distributed execution, & the Envoy AI Gateway. Details: hubs.la/Q03Sf3zS0 KubeCon bundle: hubs.la/Q03Sf4tK0

Security in the technosphere is evolving — you see it in job listings, T&Cs, cookies, & more. K8s is in the thick of it. Catch @TerryTangYuan at #KubeCon, 10:08am EST on how KServe makes AI trust work: hubs.la/Q03StWmv0 Bundle his book: hubs.la/Q03StZ1T0

📚✨ 𝗕𝗼𝗼𝗸 𝗦𝗶𝗴𝗻𝗶𝗻𝗴 𝗮𝗻𝗱 𝗘-𝗕𝗼𝗼𝗸 𝗚𝗶𝘃𝗲𝗮𝘄𝗮𝘆 𝗮𝘁 𝗞𝘂𝗯𝗲𝗖𝗼𝗻 𝗡𝗼𝗿𝘁𝗵 𝗔𝗺𝗲𝗿𝗶𝗰𝗮! ✨📚 If you’re attending #KubeCon in Atlanta and have a copy of my book 𝘋𝘪𝘴𝘵𝘳𝘪𝘣𝘶𝘵𝘦𝘥 𝘔𝘢𝘤𝘩𝘪𝘯𝘦 𝘓𝘦𝘢𝘳𝘯𝘪𝘯𝘨 𝘗𝘢𝘵𝘵𝘦𝘳𝘯𝘴, bring it along and I’d love to sign it! 🖊️ You can find me at these sessions: 1️⃣ 𝗔𝗻𝗰𝗵𝗼𝗿𝗶𝗻𝗴 𝗧𝗿𝘂𝘀𝘁 𝗶𝗻 𝘁𝗵𝗲 𝗔𝗴𝗲 𝗼𝗳 𝗔𝗜: 𝗜𝗱𝗲𝗻𝘁𝗶𝘁𝗶𝗲𝘀 𝗔𝗰𝗿𝗼𝘀𝘀 𝗛𝘂𝗺𝗮𝗻𝘀, 𝗠𝗮𝗰𝗵𝗶𝗻𝗲𝘀, 𝗮𝗻𝗱 𝗠𝗼𝗱𝗲𝗹𝘀: sched.co/27dCb 2️⃣ 𝗞𝗦𝗲𝗿𝘃𝗲 𝗡𝗲𝘅𝘁: 𝗔𝗱𝘃𝗮𝗻𝗰𝗶𝗻𝗴 𝗚𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝘃𝗲 𝗔𝗜 𝗠𝗼𝗱𝗲𝗹 𝗦𝗲𝗿𝘃𝗶𝗻𝗴: sched.co/28D4J 3️⃣ 𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗧𝗔𝗚 𝗪𝗼𝗿𝗸𝗹𝗼𝗮𝗱𝘀 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻: 𝗔𝗱𝘃𝗮𝗻𝗰𝗶𝗻𝗴 𝘁𝗵𝗲 𝗖𝗼𝗿𝗲 𝗼𝗳 𝗖𝗹𝗼𝘂𝗱 𝗡𝗮𝘁𝗶𝘃𝗲 𝗘𝘅𝗲𝗰𝘂𝘁𝗶𝗼𝗻: sched.co/27NnE 4️⃣ 𝗡𝗮𝘃𝗶𝗴𝗮𝘁𝗶𝗻𝗴 𝘁𝗵𝗲 𝗥𝗮𝗽𝗶𝗱 𝗘𝘃𝗼𝗹𝘂𝘁𝗶𝗼𝗻 𝗼𝗳 𝗟𝗮𝗿𝗴𝗲 𝗠𝗼𝗱𝗲𝗹 𝗜𝗻𝗳𝗲𝗿𝗲𝗻𝗰𝗲: 𝗪𝗵𝗲𝗿𝗲 𝗗𝗼𝗲𝘀 𝗞𝘂𝗯𝗲𝗿𝗻𝗲𝘁𝗲𝘀 𝗙𝗶𝘁?: sched.co/27Nlv Don’t have a physical copy yet? I’m giving away 𝟴 𝗳𝗿𝗲𝗲 𝗲-𝗯𝗼𝗼𝗸𝘀 🎁 thanks to @ManningBooks! 👉 Like, comment, or repost this post and I’ll randomly select participants after the conference. And if you’d like your own copy, use code 𝗞𝘂𝗯𝗲𝗖𝗼𝗻𝟮𝟱𝗮𝘂 starting 𝗡𝗼𝘃 𝟵𝘁𝗵 for 45% off. Can’t wait to connect, chat, and celebrate open source + AI with everyone in Atlanta!

What’s harder than training an AI model? Serving it at scale. @TerryTangYuan shows how KServe makes them faster, cheaper, & more scalable — today at @IBM TechXchange, 1:45 pm ET. Details: hubs.la/Q03M8mfc0 Book’s 45% off with code TANGtechX45 thru Oct 24th: hubs.la/Q03M8jc_0

Wrapping up an amazing week at #KubeCon London! It’s been a full week of connecting with an incredible community of users, contributors, collaborators, colleagues, and friends. I had the pleasure of participating in a panel, an opening session, and two other KubeCon sessions!

keyboard_arrow_left Previous keyboard_arrow_right Next

How about a recommendation for your next KubeCon EU talk? Check out @TerryTangYuan! He's speaking at 11:15 AM BST on Level 3. Details: mng.bz/wZ2W Get his book, Distributed Machine Learning Patterns, for 45% off with code KubeConEU25 here: mng.bz/7QYg

I've got a 45% off discount code for my Distributed Machine Learning Patterns book! Use the code "KubeConEU25" before May 31 at mng.bz/rKXj

Super excited to announce that my book Distributed Machine Learning Patterns from Manning Publications is now available in both Chinese and Korean by leading publishers Tsinghua University Press and Hanbit Media!

keyboard_arrow_left Previous keyboard_arrow_right Next

We are excited to announce that vLLM inference provider is now available in Llama Stack! This article from @TerryTangYuan and @ashwinb provides an introduction and tutorial to help you get started using it locally or deploying it in a Kubernetes cluster. blog.vllm.ai/2025/01/27/int…

Distributed Machine Learning Patterns is being translated into different languages, including Korean and Simplified Chinese! bit.ly/2RKv8Zo The version in Simplified Chinese will be published soon by Tsinghua University Press. Stay tuned!

Had a great time at KubeCon Europe this year at Paris! I did my first opening remarks session at Cloud Native AI Day as a co-chair, gave a talk on Production-Ready AI Platform on Kubernetes, chatted with many collaborators and colleagues, and had my first book-signing at a conference! Book: mng.bz/QZgv Presentation: youtu.be/_RthQ01bwU8?si… @CloudNativeFdn #KubeCon #KubeConEU #MachineLearning #AI #CloudNative

keyboard_arrow_left Previous keyboard_arrow_right Next

🚀 Join us at #KubeConEU, Mar 19-22! Don’t miss Manning authors @vitalethomas, Mauricio Salatino @salaboy, & Yuan Tang @TerryTangYuan. 📆Schedule and details: mng.bz/y8Jo 📚 Explore their books at Manning.com! #Kubernetes #CloudNative #ManningBooks

Distributed Machine Learning Patterns is now available in ePub and liveBook formats in case you'd like to add it to your digital collection! bit.ly/2RKv8Zo

Yuan (Terry) Tang @TerryTangYuan

3 years ago

My new book Distributed Machine Learning Patterns from @ManningBooks is now officially published! Printed books are now available to order on Manning website! bit.ly/2RKv8Zo

keyboard_arrow_left Previous keyboard_arrow_right Next

6 38 245 56K 102

We have a new book of the week – "Distributed Machine Learning Patterns" by @TerryTangYuan. You can talk directly to Yuan, the author of the book, and win a free copy You can join until Jan 18 👇🏼

📣Deal of the Day📣 Jan 9 45% off TODAY ONLY! Distributed Machine Learning Patterns & selected titles: mng.bz/WrEx @TerryTangYuan #distributedML #Kubeflow #ArgoWorkflows Now in print! Practical patterns for scaling #ML from your laptop to a distributed cluster.

📚 Distributed Machine Learning Patterns is now available to order in your favorite websites! Get your copies today! - Amazon: amazon.com/dp/1617299022/ - Barnes & Noble: barnesandnoble.com/w/distributed-… - Powell’s: powells.com/book/distribut… - Bookshop: bookshop.org/p/books/distri… - Manning: bit.ly/2RKv8Zo 🎯 Table of Contents: PART 1: BASIC CONCEPTS AND BACKGROUND 1 Introduction to distributed machine learning systems PART 2: PATTERNS OF DISTRIBUTED MACHINE LEARNING SYSTEMS 2 Data ingestion patterns 3 Distributed training patterns 4 Model serving patterns 5 Workflow patterns 6 Operation patterns PART 3: BUILDING A DISTRIBUTED MACHINE LEARNING WORKFLOW 7 Project overview and system architecture 8 Overview of relevant technologies 9 A complete implementation

Yuan (Terry) Tang @TerryTangYuan

3 years ago

My new book Distributed Machine Learning Patterns from @ManningBooks is now officially published! Printed books are now available to order on Manning website! bit.ly/2RKv8Zo

keyboard_arrow_left Previous keyboard_arrow_right Next

6 38 245 56K 102

Hi all, I am participating Kubeflow’s first ever Steering Committee Election and the testimonial phase is now open! Check out this summary of my involvement in Kubeflow and feel free to comment on this issue if you would like to offer an endorsement! github.com/kubeflow/commu…

My new book Distributed Machine Learning Patterns from @ManningBooks is now officially published! Printed books are now available to order on Manning website! bit.ly/2RKv8Zo

keyboard_arrow_left Previous keyboard_arrow_right Next

We are excited to announce that the GA release for Argo Workflows v3.5.0 is now available, with 66 new features from 63 contributors! Check out the release blog for more details! blog.argoproj.io/whats-new-in-a… @argoproj @CloudNativeFdn #Kubernetes #MLOps #DevOps #CloudNative

💬A must-read for anyone in the field. Brian Ray, Managing Director and Global Data Science Lead at Eviden on Distributed Machine Learning Patterns by @TerryTangYuan: mng.bz/K4v0 #machinelearning #distributedcomputing #distributedmachinelearning #deeplearning