Distributed Machine Learning Patterns @DistML
Distributed Machine Learning Patterns by @TerryTangYuan from @ManningBooks Leveraging #TensorFlow #Argo #Kubeflow #Kubernetes bit.ly/2RKv8Zo United States Joined October 2021-
Tweets62
-
Followers69
-
Following8
-
Likes100
Generative AI is reshaping Kubernetes. At 2:05 pm EST, @TerryTangYuan breaks down KServe Next โ how v0.17 handles LLMs, KV caching, distributed execution, & the Envoy AI Gateway. Details: hubs.la/Q03Sf3zS0 KubeCon bundle: hubs.la/Q03Sf4tK0
Security in the technosphere is evolving โ you see it in job listings, T&Cs, cookies, & more. K8s is in the thick of it. Catch @TerryTangYuan at #KubeCon, 10:08am EST on how KServe makes AI trust work: hubs.la/Q03StWmv0 Bundle his book: hubs.la/Q03StZ1T0
๐โจ ๐๐ผ๐ผ๐ธ ๐ฆ๐ถ๐ด๐ป๐ถ๐ป๐ด ๐ฎ๐ป๐ฑ ๐-๐๐ผ๐ผ๐ธ ๐๐ถ๐๐ฒ๐ฎ๐๐ฎ๐ ๐ฎ๐ ๐๐๐ฏ๐ฒ๐๐ผ๐ป ๐ก๐ผ๐ฟ๐๐ต ๐๐บ๐ฒ๐ฟ๐ถ๐ฐ๐ฎ! โจ๐ If youโre attending #KubeCon in Atlanta and have a copy of my book ๐๐ช๐ด๐ต๐ณ๐ช๐ฃ๐ถ๐ต๐ฆ๐ฅ ๐๐ข๐ค๐ฉ๐ช๐ฏ๐ฆ ๐๐ฆ๐ข๐ณ๐ฏ๐ช๐ฏ๐จ ๐๐ข๐ต๐ต๐ฆ๐ณ๐ฏ๐ด, bring it along and Iโd love to sign it! ๐๏ธ You can find me at these sessions: 1๏ธโฃ ๐๐ป๐ฐ๐ต๐ผ๐ฟ๐ถ๐ป๐ด ๐ง๐ฟ๐๐๐ ๐ถ๐ป ๐๐ต๐ฒ ๐๐ด๐ฒ ๐ผ๐ณ ๐๐: ๐๐ฑ๐ฒ๐ป๐๐ถ๐๐ถ๐ฒ๐ ๐๐ฐ๐ฟ๐ผ๐๐ ๐๐๐บ๐ฎ๐ป๐, ๐ ๐ฎ๐ฐ๐ต๐ถ๐ป๐ฒ๐, ๐ฎ๐ป๐ฑ ๐ ๐ผ๐ฑ๐ฒ๐น๐: sched.co/27dCb 2๏ธโฃ ๐๐ฆ๐ฒ๐ฟ๐๐ฒ ๐ก๐ฒ๐ ๐: ๐๐ฑ๐๐ฎ๐ป๐ฐ๐ถ๐ป๐ด ๐๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐๐ถ๐๐ฒ ๐๐ ๐ ๐ผ๐ฑ๐ฒ๐น ๐ฆ๐ฒ๐ฟ๐๐ถ๐ป๐ด: sched.co/28D4J 3๏ธโฃ ๐๐ป๐๐ฟ๐ผ๐ฑ๐๐ฐ๐ถ๐ป๐ด ๐ง๐๐ ๐ช๐ผ๐ฟ๐ธ๐น๐ผ๐ฎ๐ฑ๐ ๐๐ผ๐๐ป๐ฑ๐ฎ๐๐ถ๐ผ๐ป: ๐๐ฑ๐๐ฎ๐ป๐ฐ๐ถ๐ป๐ด ๐๐ต๐ฒ ๐๐ผ๐ฟ๐ฒ ๐ผ๐ณ ๐๐น๐ผ๐๐ฑ ๐ก๐ฎ๐๐ถ๐๐ฒ ๐๐ ๐ฒ๐ฐ๐๐๐ถ๐ผ๐ป: sched.co/27NnE 4๏ธโฃ ๐ก๐ฎ๐๐ถ๐ด๐ฎ๐๐ถ๐ป๐ด ๐๐ต๐ฒ ๐ฅ๐ฎ๐ฝ๐ถ๐ฑ ๐๐๐ผ๐น๐๐๐ถ๐ผ๐ป ๐ผ๐ณ ๐๐ฎ๐ฟ๐ด๐ฒ ๐ ๐ผ๐ฑ๐ฒ๐น ๐๐ป๐ณ๐ฒ๐ฟ๐ฒ๐ป๐ฐ๐ฒ: ๐ช๐ต๐ฒ๐ฟ๐ฒ ๐๐ผ๐ฒ๐ ๐๐๐ฏ๐ฒ๐ฟ๐ป๐ฒ๐๐ฒ๐ ๐๐ถ๐?: sched.co/27Nlv Donโt have a physical copy yet? Iโm giving away ๐ด ๐ณ๐ฟ๐ฒ๐ฒ ๐ฒ-๐ฏ๐ผ๐ผ๐ธ๐ ๐ thanks to @ManningBooks! ๐ Like, comment, or repost this post and Iโll randomly select participants after the conference. And if youโd like your own copy, use code ๐๐๐ฏ๐ฒ๐๐ผ๐ป๐ฎ๐ฑ๐ฎ๐ starting ๐ก๐ผ๐ ๐ต๐๐ต for 45% off. Canโt wait to connect, chat, and celebrate open source + AI with everyone in Atlanta!
Whatโs harder than training an AI model? Serving it at scale. @TerryTangYuan shows how KServe makes them faster, cheaper, & more scalable โ today at @IBM TechXchange, 1:45 pm ET. Details: hubs.la/Q03M8mfc0 Bookโs 45% off with code TANGtechX45 thru Oct 24th: hubs.la/Q03M8jc_0
Wrapping up an amazing week at #KubeCon London! Itโs been a full week of connecting with an incredible community of users, contributors, collaborators, colleagues, and friends. I had the pleasure of participating in a panel, an opening session, and two other KubeCon sessions!
How about a recommendation for your next KubeCon EU talk? Check out @TerryTangYuan! He's speaking at 11:15 AM BST on Level 3. Details: mng.bz/wZ2W Get his book, Distributed Machine Learning Patterns, for 45% off with code KubeConEU25 here: mng.bz/7QYg
I've got a 45% off discount code for my Distributed Machine Learning Patterns book! Use the code "KubeConEU25"ย before May 31 at mng.bz/rKXj
Super excited to announce that my book Distributed Machine Learning Patterns from Manning Publications is now available in both Chinese and Korean by leading publishers Tsinghua University Press and Hanbit Media!
We are excited to announce that vLLM inference provider is now available in Llama Stack! This article from @TerryTangYuan and @ashwinb provides an introduction and tutorial to help you get started using it locally or deploying it in a Kubernetes cluster. blog.vllm.ai/2025/01/27/intโฆ
Distributed Machine Learning Patterns is being translated into different languages, including Korean and Simplified Chinese! bit.ly/2RKv8Zo The version in Simplified Chinese will be published soon by Tsinghua University Press. Stay tuned!
Had a great time at KubeCon Europe this year at Paris! I did my first opening remarks session at Cloud Native AI Day as a co-chair, gave a talk on Production-Ready AI Platform on Kubernetes, chatted with many collaborators and colleagues, and had my first book-signing at a conference! Book: mng.bz/QZgv Presentation: youtu.be/_RthQ01bwU8?siโฆ @CloudNativeFdn #KubeCon #KubeConEU #MachineLearning #AI #CloudNative
๐ Join us at #KubeConEU, Mar 19-22! Donโt miss Manning authors @vitalethomas, Mauricio Salatino @salaboy, & Yuan Tang @TerryTangYuan. ๐Schedule and details: mng.bz/y8Jo ๐ Explore their books at Manning.com! #Kubernetes #CloudNative #ManningBooks
Distributed Machine Learning Patterns is now available in ePub and liveBook formats in case you'd like to add it to your digital collection! bit.ly/2RKv8Zo
My new book Distributed Machine Learning Patterns from @ManningBooks is now officially published! Printed books are now available to order on Manning website! bit.ly/2RKv8Zo
We have a new book of the week โ "Distributed Machine Learning Patterns" by @TerryTangYuan. You can talk directly to Yuan, the author of the book, and win a free copy You can join until Jan 18 ๐๐ผ
๐ฃDeal of the Day๐ฃ Jan 9 45% off TODAY ONLY! Distributed Machine Learning Patterns & selected titles: mng.bz/WrEx @TerryTangYuan #distributedML #Kubeflow #ArgoWorkflows Now in print! Practical patterns for scaling #ML from your laptop to a distributed cluster.
๐ Distributed Machine Learning Patterns is now available to order in your favorite websites! Get your copies today! - Amazon: amazon.com/dp/1617299022/ - Barnes & Noble: barnesandnoble.com/w/distributed-โฆ - Powellโs: powells.com/book/distributโฆ - Bookshop: bookshop.org/p/books/distriโฆ - Manning: bit.ly/2RKv8Zo ๐ฏ Table of Contents: PART 1: BASIC CONCEPTS AND BACKGROUND 1 Introduction to distributed machine learning systems PART 2: PATTERNS OF DISTRIBUTED MACHINE LEARNING SYSTEMS 2 Data ingestion patterns 3 Distributed training patterns 4 Model serving patterns 5 Workflow patterns 6 Operation patterns PART 3: BUILDING A DISTRIBUTED MACHINE LEARNING WORKFLOW 7 Project overview and system architecture 8 Overview of relevant technologies 9 A complete implementation
My new book Distributed Machine Learning Patterns from @ManningBooks is now officially published! Printed books are now available to order on Manning website! bit.ly/2RKv8Zo
Hi all, I am participating Kubeflowโs first ever Steering Committee Election and the testimonial phase is now open! Check out this summary of my involvement in Kubeflow and feel free to comment on this issue if you would like to offer an endorsement! github.com/kubeflow/commuโฆ
My new book Distributed Machine Learning Patterns from @ManningBooks is now officially published! Printed books are now available to order on Manning website! bit.ly/2RKv8Zo
We are excited to announce that the GA release for Argo Workflows v3.5.0ย is now available, with 66 new features from 63 contributors! Check out the release blog for more details! blog.argoproj.io/whats-new-in-aโฆ @argoproj @CloudNativeFdn #Kubernetes #MLOps #DevOps #CloudNative
๐ฌA must-read for anyone in the field. Brian Ray, Managing Director and Global Data Science Lead at Eviden on Distributed Machine Learning Patterns by @TerryTangYuan: mng.bz/K4v0 #machinelearning #distributedcomputing #distributedmachinelearning #deeplearning
Johnson @Johnson52002332
42 Followers 256 Following Data analysis | Python Programming | Cloud Computing | Web3
Isatou Sarr @IsatouSarr4
23 Followers 2K Following
Jonas vasconceloss @Jonasvasco66460
112 Followers 8K Following
Kanithi Sowmya @kanithisowmyaa
19 Followers 364 Following
Epic Plain @EpicPlain
750 Followers 3K Following #AgenticAI #GenerativeAI #GenAI #AI #ResponsibleAI #CyberSecurity #QuantumComputing #MachineLearning #LLMs #PQC #QuantumInternet #QuantumNetworking
Theeto @TheetoAxx
45 Followers 4K Following
Rahul Chouhan @Rahul_Chouhan
23K Followers 17K Following #DataScience #MachineLearning #ArtificialIntelligence enthusiast. DM for any Web Development, Digital Marketing, Data Analysis and Automation related work.
Sunny Patneedi @sunnypatneedi
537 Followers 2K Following Building for parents growing curious minds, not screen addicts | Ex ๏ฃฟ Apple, Microsoft Engineering, Dad, Writing https://t.co/2gJ0M3jOjK
Krishna Rangavajjala @KRangavajjala
62 Followers 201 Following Software Professional with over 25 years of experience strategizing, leading global teams, managing software development, and delivering value to US businesses.
Chiung-Yi @CTsengBiz
15 Followers 20 Following
Md. Rashed Miah @rashed_mahmud7
57 Followers 1K Following Software Engineer ๐งโ๐ป Problem Solver || ML Research || DL || Computer Vision || NLP
Tobias Rรผedi @Rutobias56
0 Followers 11 Following
Luis Chamba-Eras ๐ช... @lachamba
1K Followers 3K Following Prof. @UNLoficial @CisUnl | Leader @GiticUnl @dia4k12 | #running #trail๐| I love my ๐จโ๐ฉโ๐งโ๐ง
Andy Peng @pymhq
607 Followers 4K Following MLE @AmazonScience: post-train, inference & benchmark; @CNCFAmbassadors; Lecturer @UW; @ai2incubator Resident Expert; Opinions are my own.
Shanqing Cai @sqcai
3K Followers 2K Following Software Engineer @Google. Tweets about AI, speech science, & neuroscience.
Kartik Powar @Rei_Moriaty
18 Followers 248 Following
ADITYA KUMAR @adityaguraru
14 Followers 65 Following Distributed Computing, Federated Learning, Systems Design, Machine Learning Pursuing PhD @uohyd
Nguyen Cong Dat @DatGatto
5 Followers 183 Following
ashkan sobhani @ashkansobhani1
5 Followers 151 Following
Mahdi Afshari @afshari_mahdi
392 Followers 1K Following #gnn #graphs #datascience #ai #PyTorch #python #geometric #Machine_Learning #data_science #deeplearning
jielbert @jielbyr
120 Followers 3K Following โIn a time of universal deceit, telling the truth is a revolutionary act.โ George Orwell | RTs โ Endorsement | BLM
Mariya Akter @MariyaA66672821
214 Followers 900 Following Here i'm for you any kind of #eCommerce product photo #editing & ecommerce #marketing needs.i'm also #socialmedia #marketer and #communitydeveloper.
Damien Benveniste @DamiBenveniste
3K Followers 441 Following The ML Guy - Follow me to learn about Machine Learning applications, Machine Learning System Design, MLOps, and the latest techniques and news about the field.
Shonal Rawat @ArtificialEvent
584 Followers 5K Following Program Manager | Global Conference on Artificial Intelligence and Robotics
Wedge wood @Wedgewo53838633
1 Followers 203 Following
Lucian Maly @LucianMaly
313 Followers 714 Following DevOpsuccess is the ability to go from one failure to another with no loss of enthusiasm๐ธ๐จ๐ฟ/๐ฆ๐บ๐ธZCU alumni๐ธPrcpl. Architect @RedHatโผ๏ธOpinions are my ownโผ๏ธ
ineffable alias @joorosa12185462
132 Followers 7K Following
Olly @ollyjcobb__
1 Followers 1K Following
Patrick Vogel PhD @TWMPI
716 Followers 5K Following #scientist #engineer #teacher #postdoc @uni_WUE #EP5 working on #magneticparticleimaging #TWMPI #tomography #technology #3D #visualization #hardware #SarsCov2
Luso @luso_v2
58 Followers 1K Following
๐กSimplexityWare ๏ฟฝ... @simplexityware
35 Followers 363 Following #Technology to harness #collectiveintelligence in the #digitalecosystem of the #Industry40 | Follow @UniSimplexity | responding to https://t.co/xoe9msr3eD
Bernard Marr @BernardMarr
139K Followers 52K Following ๐ Internationally Best-selling #Author ๐ค #KeynoteSpeaker ๐ค #Futurist ๐ป #Business, #Tech & #Data Advisor #AI #AR #VR #BigData #Robotics #MachineLearning
M. M. @MatthiasM5
257 Followers 2K Following
Georgiana Copil @GeorgianaCopil
225 Followers 831 Following Software engineer. PhD @dsg_tuwien, senior computer scientist @adobe. Opinions are my own.
Codefresh @codefresh
8K Followers 4K Following The GitOps platform to reliably ship changes fast โก๏ธ
Mbako A Goitsemang @mbakoG90210
347 Followers 2K Following Fullstack JS-FrameworksDev || CyberSecurity Specialist ๐ฅ๏ธ IBMCloud-Developer ๐ป AWS-SfwrDevEngineer ๐ฅ๏ธ OracleCloud-Architect ๐ป Azure-Certified-Developer
Gil Klein @gklein
473 Followers 4K Following Lead Admin of Supertools (since 2018) | Co-founder of https://t.co/ER8NL2JRIT | Red-Hatter
Danial J @dnlsyfq90
78 Followers 1K Following
argoproj @argoproj
22K Followers 27 Following Argo is the premier open source GitOps and MLOps CNCF project
Kubeflow @kubeflow
7K Followers 12 Following Helping make ML on Kubernetes easy, portable and scalable, everywhere.
TensorFlow @TensorFlow
378K Followers 115 Following TensorFlow is a fast, flexible, and scalable open-source machine learning library for research and production.
Kubernetes @kubernetesio
323K Followers 86 Following #Kubernetes: open source production-grade container orchestration management. #CNCF #K8s
Couler Project @CoulerProject
46 Followers 0 Following Unified Interface for Constructing and Managing Workflows on different workflow engines, such as @argoproj.















