Learn Data Science & Engineering @DataSciencePY
Data Engineers, Data Scientists & Data Architects building a community to learn smarter, and stay ahead in the data world. Helping each other grow 🚀📚 Bengaluru, India Joined March 2019-
Tweets375
-
Followers1K
-
Following88
-
Likes231
🚨 The Tech Industry is witnessing the birth of a NEW engineering era. First came Software Engineering. Then Data Engineering exploded. Now… Gen AI Engineering is changing everything. We are moving from: ➡ Writing logic → Designing intelligence ➡ Building apps → Building autonomous systems ➡ Dashboards → Decision-making AI ➡ Static pipelines → Self-learning workflows A few years ago: • Data Scientists predicted outcomes • Data Engineers moved data at scale But today? 🔥 Gen AI Engineers are building systems that can: ✔ Understand human language ✔ Generate code ✔ Automate workflows ✔ Analyze massive datasets ✔ Create content ✔ Act like intelligent copilots The shift is MASSIVE. The future tech stack is no longer just: Python + SQL + Spark It’s becoming: LLMs + Vector DBs + Agents + RAG + Real-time Data + AI Orchestration And the biggest opportunity? 💡 Engineers who combine: Data + AI + Systems Thinking will dominate the next decade. Because the real winners won’t be the people who simply use AI… They’ll be the people who BUILD with AI. The next generation of engineers will not just create software. They’ll create digital intelligence. 🤯 We are still early. Very early. And this may become the biggest technology shift of our lifetime. 🚀 #AI #GenAI #DataScience #DataEngineering #MachineLearning #LLM #ArtificialIntelligence #BigData #Tech #Innovation #FutureOfWork x.com/GoogleDeepMind…
Gemini Omni doesn't just build scenes that look real, it reasons about what should happen next. It combines an intuitive understanding of physics with Gemini's knowledge of history, science, and cultural context. Rolling out today starting with video outputs to Google AI Plus, Pro and Ultra subscribers globally through the @Geminiapp + Google Flow, and @YouTube Shorts this week. Incredible #Gemini x.com/sundarpichai/s…
Claude #Cheatsheet
Introducing Composer 2.5, our most powerful model yet. It's more intelligent, better at sustained work on long-running tasks, and more reliable at following complex instructions. For the next week, we’re doubling the included usage of the model.
x.com/tradermorin/st… Build an AI system on whatever you like trading health or finance - that’s the way to learn GenAI #Claude #ChatGPT
How to Build Personal AI System with Claude #Claude
AI is creating a new kind of engineer. 🤯 Not the one who memorizes syntax. The one who builds systems with AI at the center. The smartest engineers today are using AI to: ⚡ Write code ⚡ Debug faster ⚡ Automate workflows ⚡ Generate architectures ⚡ Learn 10x faster ⚡ Build entire products solo This is the biggest shift in tech since the internet. 🚀 The gap is no longer: “Who can code?” It’s: “Who can leverage AI better than everyone else?” Average developers use AI like autocomplete. Top engineers use AI like a team. 🔥 The future belongs to: 🧠 AI-native builders ⚙️ System thinkers 🚀 Fast executors Adapt fast… or get outpaced. Reference x.com/eng_khairallah…
ChatGPT Claude - master how to use efficiency.
Master AI in 30 Days #AI
OpenAI just sent shockwaves through fintech. 💀📉 Today, ChatGPT became a personal finance assistant. Connect your bank accounts via Plaid → and GPT-5.5 can now: 💰 Analyze spending 📊 Track subscriptions 📈 Understand investments 🧠 Remember savings goals 💳 Answer questions using your real transaction data And this is only the beginning. Next: ⚡ Tax estimates ⚡ Credit card recommendations ⚡ Financial planning ⚡ AI-native banking experiences Most fintech startups built dashboards. OpenAI built: 👉 An intelligent financial operating system. That changes everything. The scary part? People don’t want 10 finance apps anymore. They want ONE AI that understands their entire financial life. AI is no longer replacing features. It’s replacing products. 🔥
Claude vs. Claude Code vs. Cowork. Anthropic offers three distinct ways to interact with Claude, and each one targets a fundamentally different workflow. Think of it as: Chat for thinking, Code for building, and Cowork for doing. Here's a quick breakdown: 1️⃣ Claude Chat This is the conversational AI assistant most people already know. You type a prompt, Claude responds, and you iterate together. - Turn rough ideas into structured plans through conversation - Write emails, reports, essays, and long-form content - Research and summarize complex topics in minutes - Analyze documents, PDFs, and images - Build interactive prototypes through Artifacts The key here is that everything happens through conversation. You're thinking with Claude, not delegating work to it. It's available on every device, has a free tier, and supports persistent memory across sessions. The tradeoff is that it has no direct access to your local files (upload only), and it can't generate raster images natively. 2️⃣ Claude Code This is a terminal-native coding agent. You describe what you want in plain English, and Claude reads your codebase, writes code, runs tests, fixes errors, and ships the result. - Build and debug entire features across the full codebase - Write, run, and fix tests automatically - Manage git workflows and create pull requests - Spawn multiple parallel agents working on different parts of a task simultaneously It handles the full development cycle end to end, from planning to execution to testing. With the CLAUDE(.)md configuration file, you can teach it your project's conventions, patterns, and constraints so it writes code the way your team expects. The tradeoff is a steeper learning curve compared to Chat, and token costs can add up during heavy sessions. 3️⃣ Claude Cowork This is the newest addition. Anthropic describes it as Claude Code for the rest of your work. It's an agentic desktop assistant that automates file management and repetitive tasks through a GUI. You describe an outcome, and Claude plans, executes, and delivers finished work: formatted documents, organized file systems, spreadsheets with working formulas, and synthesized research. - Direct local file access and editing (no upload/download cycle) - Schedule recurring tasks automatically - Assign tasks remotely via Dispatch from your phone - Computer Use lets Claude control your screen directly It runs inside a sandboxed virtual machine on your computer, so Claude can only access folders you explicitly grant. You don't need to know how to code to use it. The tradeoff is that your computer must stay awake for tasks to run, and it's still in research preview. Here's how to think about choosing between them: → If you need to think through a problem or get writing/research help, use Chat → If you're building software and want an autonomous coding partner, use Code → If you have a clearly defined deliverable that involves local files and desktop workflows, use Cowork All three are included in the same subscription starting at $20/month, which makes it one of the highest-leverage subscriptions in productivity software right now. I've put together a visual below that maps the workflow of each product side by side. Also, if you want to go deeper into Claude Code specifically, my co-founder wrote a detailed article covering the anatomy of the .claude/ folder, a complete guide to CLAUDE(.)md, custom commands, skills, agents, and permissions, and how to set them all up properly.
This GitHub repo changed how I think about job hunting. 🤯 Career-Ops GitHub Repo Instead of manually applying to 500 jobs… It turns your entire career search into an AI-powered operating system. 🚀 What it does 👇 ⚡ Scans 45+ company career portals ⚡ Scores jobs with an A→F system ⚡ Generates ATS-optimized resumes automatically ⚡ Tracks applications like a sales pipeline ⚡ Runs batch evaluations using AI agents ⚡ Creates tailored PDFs for every role ⚡ Supports Claude + Gemini workflows Built by an engineer who: 🔥 Evaluated 740+ job offers 🔥 Generated 100+ tailored CVs 🔥 Landed a Head of Applied AI role This isn’t “AI applying blindly.” It’s: 🧠 AI-assisted career strategy 📊 Signal over noise 🎯 Precision over mass applying The biggest lesson? Future engineers won’t just use AI to code. They’ll use AI to: • Learn • Build • Network • Negotiate • And optimize their careers end-to-end. Most candidates still apply manually. Top candidates are building systems. ⚡ #Claude #Copilot #ChatGPT
If I had 6 months to become an ML Engineer… I wouldn’t waste time collecting certificates. ❌ I’d build systems. 🚀 Month 1 → Learn Python + Data Engineering foundations Month 2 → Master ML + Statistics Month 3 → Deep Learning with PyTorch Month 4 → Pipelines, Feature Stores & MLOps Month 5 → Deploy models using APIs + Docker + Cloud Month 6 → Scale, monitor, optimize, and ship real-world ML systems publicly. Skills I’d focus on 👇 ⚡ Data pipelines ⚡ Feature engineering ⚡ Experiment tracking ⚡ Model deployment ⚡ Drift detection ⚡ GPU scaling ⚡ CI/CD for ML ⚡ Reliability engineering Because companies don’t hire people who only train models. They hire engineers who can take ML systems from: 🧠 Idea → 📦 Production → 📈 Scale Most people stay stuck: Watching tutorials. Saving posts. Buying courses. Builders get hired. 🔥 What would YOU add to this roadmap?
#Anthropic #Claude Nice workshop !
Anthropic just showed a 24-minute workshop on how to actually prompt Claude. Taught by the people who built it. Free. No signup. No paywall. I've watched $300 courses that don't cover what they teach in the first 8 minutes.
🧵 FAANG-Level Data Engineering Interview Q&A (Deep + Real) 1/ Q: Design a real-time analytics system like Uber’s ETA pipeline. A: Ingest streams (Kafka), process with Apache Flink / Apache Spark, use event-time windows + state stores, serve via low-latency DB (Cassandra/Redis). Key: latency vs accuracy tradeoff. ⸻ 2/ Q: How would you design a data warehouse for billions of events/day? A: Columnar storage, partitioning (time/user), clustering, compression, and query optimization. Balance storage cost vs query speed. ⸻ 3/ Q: Explain how you’d handle backfills at scale without breaking production. A: Isolate compute, use versioned datasets, throttle workloads, and ensure idempotency. Never mix live + backfill pipelines blindly. ⸻ 4/ Q: Design a system for near real-time fraud detection. A: Streaming ingestion, feature computation, stateful processing, ML inference layer, and alerting. Critical: low latency + high accuracy. ⸻ 5/ Q: Your pipeline processes 500M records but suddenly slows down. Why? A: Likely causes: data skew, bad join strategy, increased shuffle, small files problem, or inefficient partitioning. ⸻ 6/ Q: How do you ensure data quality at scale? A: Validation layers, schema enforcement, anomaly detection, SLAs, and automated monitoring pipelines. ⸻ 7/ Q: Design a multi-tenant data platform. A: Data isolation, access control, resource quotas, metadata layer, and cost attribution per tenant. ⸻ 8/ Q: What’s your approach to schema design for evolving products? A: Use flexible schemas, versioning, backward compatibility, and avoid tight coupling between producers and consumers. ⸻ 9/ Q: How would you debug a silent data corruption issue? A: Compare historical vs current outputs, trace lineage, validate upstream sources, and add checksums/data audits. ⸻ 10/ Q: Design a system that guarantees exactly-once delivery across failures. A: Combine checkpointing, idempotent writes, transactional sinks, and replayable logs (Kafka). Accept tradeoffs in latency/complexity. ⸻ 11/ Q: Tradeoff: Latency vs Cost vs Accuracy — how do you decide? A: Based on business use-case. Real-time → low latency, higher cost. Reporting → cheaper, batch acceptable. Always align with business value. ⸻ 12/ Q: What separates FAANG-level engineers? A: Not tools. Not syntax. 👉 Thinking in trade-offs, scale, and failure scenarios. ⸻ 🔥 Final Insight: At FAANG level, they don’t test if you can use Python… They test if your system still works when everything breaks. #dataengineering #dataengineeringcommunity
Elitsa Krumova @Eli_Krumova
63K Followers 47K Following |Digital🦄| 🏆🔝 Global Thought Leader & B2B #Tech #Influencer | #WomenInTech @Onalytica @WomenTechmakers |#AI #IoT #IIoT #ML #Robotics|#Marketing #SocialMedia|
NIVAS MIDIDHODI @NivasChintu1
13 Followers 542 Following Passionate AI & ML Enthusiast |§ Be a part of my AI Learning Journey
Yosha Mundhra @_yosha09_
1 Followers 49 Following
‘Mayowa Oludoyi @MayowaOludoyi
455 Followers 2K Following Data Products | Data-Intensive Applications | Bluesky: @mayowao.bsky.socia
Vijaymal yadav @YadavVijay26477
0 Followers 19 Following
Joseph smith @Josephsmityo7z
0 Followers 43 Following
Shrividya Hegde @Shrividyahegde
3 Followers 24 Following
DE with Esther @DEwithEsther
0 Followers 12 Following
sweta @dangerdangdank
5 Followers 46 Following shits that never got real doing stuff i never imagined aspiring Data Scientist
Sumit Kalra | AI & ML... @AIMLShift
13K Followers 468 Following AI isn't a tool. It's a leadership shift. For tech leaders going from AI adoption → AI-native. Agents, engineering, future of work.
beardRider @BeardedGaru3
49 Followers 118 Following
Oche Ujah @oche_dt
0 Followers 24 Following Chemical Engineering Student || Data Analyst || Python Data Associate || Data Engineering and Automation
Bruno Avellar @BrunoAvellar11
1 Followers 35 Following
DataEngineerNext @DataEngineerNXT
0 Followers 17 Following Helping ETL engineers move to modern data stack Databricks • PySpark • AI • Real-world transitions 12+ yrs in data | सीखते रहो 🚀
João Domingos Gomes ... @JooDomingo60517
2 Followers 220 Following
Gizem @Gizemaksy_02
3 Followers 191 Following
Bea @bea56525
26 Followers 264 Following
Vicky @Vicky78094442
0 Followers 57 Following
Usama Sukri @fit_engineer98
0 Followers 18 Following
Tejas Garad @Tejas_Garad_
0 Followers 56 Following
Frederic Ghana @frederic101
294 Followers 3K Following ★EVENT BRANDING★ADVERTISING★DIGITAL PRINTING★
pavan kumar @pavanku52646557
5 Followers 321 Following
..... @f40Wqy0cmOSbJgy
7 Followers 15 Following
spiral mantra @spiral_mantra
32 Followers 52 Following A Fast-Growing #DataEngineering Company, Empowering Enterprises and Start-ups. ➡#CloudConsultingServices ➡#MobileAppDevelopment ➡#BigDataAnalytics
Yvonne Nkomo @YveeSNkomo90
2 Followers 62 Following
Vedant Jadhav @__vedantjadhav_
0 Followers 21 Following
MOHAMED GASIM @GasimMoham56093
0 Followers 10 Following
Danish @Danish4136
0 Followers 9 Following
Aashish Shrestha @aash_crest02
0 Followers 36 Following
Bhavesh Choudhary @BhaveshCho51726
0 Followers 17 Following
parth patil @parth_pati18604
0 Followers 16 Following
ZouNourayni @ZouNourayni44
0 Followers 57 Following
Thura Win Hein @thurawinhein
51 Followers 494 Following
James Barsomo @Zachjack0123
0 Followers 10 Following
Daniel Eshun @junior_dhanny
1 Followers 38 Following
Malkeet Singh @Malkeet56097348
0 Followers 15 Following
Muneer dev @DevMuneerAi
0 Followers 28 Following Data Analyst | AI & Python Learner | Frontend Developer Turning data into insights 📊 Building AI Bots & Predictive Solutions 🤖 Ex-Pharmacist → Tech Explorer
Monserrath Esc @esc_monser58407
0 Followers 9 Following
champ @champ163053
0 Followers 3 Following
Professor GANX @AIR_Professor_
3 Followers 100 Following
Myil Vaughanan V L @myil_l
2 Followers 5 Following
Paddy @paddy_eman
20 Followers 84 Following Data Science | Machine Learning Engineer | Python • SQL • Power BI • Excel
Kowser_Hasib @KowserHasib
0 Followers 75 Following
somesh sadalge @Soma250496
12 Followers 33 Following
Ronald van Loon @Ronald_vanLoon
353K Followers 164K Following Helping AI driven companies generate value•Top10Influencer #AI #BigData #DataScience #IoT #MachineLearning #Analytics #Cloud
Kirk Borne @KirkDBorne
485K Followers 3K Following Advisor to startups. Freelancer. @LeadershipData founder. Global Speaker. Top #B2B influencer & social promoter #DataScience #AI #ML. PhD Astrophysics @Caltech
Andrew Ng @AndrewYNg
1.6M Followers 1K Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
ODSC (Open Data Scien... @_odsc
111K Followers 24K Following Bringing together the global data science community to help foster the exchange of innovative ideas and encourage the growth of open source software.
Elitsa Krumova @Eli_Krumova
63K Followers 47K Following |Digital🦄| 🏆🔝 Global Thought Leader & B2B #Tech #Influencer | #WomenInTech @Onalytica @WomenTechmakers |#AI #IoT #IIoT #ML #Robotics|#Marketing #SocialMedia|
MIT CSAIL @MIT_CSAIL
346K Followers 20K Following MIT's Computer Science & Artificial Intelligence Laboratory (CSAIL). Media Inquiries: [email protected] Check out the latest CSAIL content ⬇️
freeCodeCamp.org @freeCodeCamp
1.2M Followers 159 Following We're a community of millions of people who are building new skills and getting new jobs together. A 501(c)(3) public charity. Tweets by @abbeyrenn.
Towards Data Science @TDataScience
250K Followers 2K Following The world's leading publication for data science and artificial intelligence professionals. Submit an Article ✍️ https://t.co/57pIMegK1o
DataCamp @DataCamp
108K Followers 504 Following Learn data and AI skills from scratch with 620+ courses. Master Python, ChatGPT, SQL, Power BI, and more.
Ajit kumar @ajitcodes
22K Followers 575 Following 350K+ LinkedIn|| 50K Telegram || Marketing || Business || AI Enthusiast || Content Creator || Open for Collaborations👇 Contact: [email protected]
Shalini Goyal @goyalshaliniuk
11K Followers 189 Following Executive Director @ J.P Morgan, Ex-Amazon || 120K on LinkedIn || Engineering and AI || https://t.co/vH67Jn1Xxi || Collab ➡️ [email protected]
DATA ENGINEERING @dataengwithaws
3K Followers 62 Following upgrade your knowledge in DATA ENGINEERING with A W S
data engineer academy @data_e_academy
802 Followers 20 Following Become a data engineer and start shaping your future today! Land A $100,000 - $500,000 /yr (without a degree) Have Helped Over 1000 People
Revant Himatsingka �... @foodpharmer2
208K Followers 210 Following Trying to get 140 crore Indians become health literate | Wharton MBA | Fighting with major food brands to help improve India's health!
Hugging Face @huggingface
700K Followers 222 Following The AI community building the future. https://t.co/TpiXQMQ9rZ
OpenAI @OpenAI
4.9M Followers 4 Following OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6LgzPA
Arogya Health @arogya_mantra
157 Followers 129 Following World Platform for Yoga & Meditation , Ayurveda, Health & Life Skills Experts Talk and Nutritionist for Health & Soul and Health for All.
Sebastian Raschka @rasbt
459K Followers 1K Following ML/AI research engineer. Ex stats professor. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW) & reasoning (https://t.co/5TueQKx2Fk)
AWS Community @AWSCommunity
6K Followers 414 Following Independent account run by AWS community leaders. Powered by AWS.
Mike Driscoll @driscollis
135K Followers 971 Following Python Book author, blogger, and more @ThePSF #Python
fast.ai @fastdotai
129K Followers 18 Following Deep learning R&D: https://t.co/cGBcDU8wJ9; Education: https://t.co/bNXBttRAuR; Software: https://t.co/0z7Ws3SHDt; Book: https://t.co/lVEDyioBtg; @math_rachel @jeremyphoward
Marko Denic @denicmarko
269K Followers 386 Following Software Engineer - Content Creator - Community Builder - Let's grow together → https://t.co/rSwUHtCUFL
Helen Yu @YuHelenYu
61K Followers 18K Following #DigitalTransformation obsessed #CXO and #GrowthHacker. Find me at the intersection of #Tech and #Humanity. #AI #DataAnalytics #FinTech #CX #IoT #CyberSecurity
KatherineMunro 👩�... @KatherineAMunro
997 Followers 693 Following Data Scientist (#MachineLearning, #DataViz, #NLP). Speaker. Teacher. Editor/co-author of The Handbook of #DataScience and #AI. Get it here: https://t.co/gT6K9yD5ih
Hacktoberfest @hacktoberfest
33K Followers 16 Following The official account for Hacktoberfest by DigitalOcean. 👾
Financial Learning @stockworld2030
24 Followers 51 Following Searching for Next Big Potential Growth Stock (Like Tesla) and asset (Like Bitcoin) . Learning the Financial system and trying to predict the future
AWS Education @AWS_Edu
555K Followers 573 Following Updates, resources, events, & news about ☁️ education & #AWSEducate. Follow our other #AWSPublicSector accounts: @AWS_Nonprofits & @AWS_Gov
Quincy Larson @ossia
296K Followers 856 Following Founder @freecodecamp. 🏕️ Teach yourself math, programming, and computer science for free. A 501(c)(3) public charity.
Ayushi Rawat @ayushi7rawat
12K Followers 223 Following Senior Software Engineer | Technical Blogger: https://t.co/cxbQpbguTP | YouTuber | Github: https://t.co/nnqFNQjgfi
EuroPython @europython
25K Followers 2 Following EuroPython 2026, 13-19 July The European Python Conference - by the community & for the communityGuido van Rossum @gvanrossum
308K Followers 480 Following Python's BDFL-emeritus, Distinguished Engineer at Microsoft, Computer History Fellow, fully vaccinated. Opinions are my own. He/him.
Kaggle @kaggle
316K Followers 284 Following Kaggle is the largest global AI community of developers, researchers, and enthusiasts who compete, collaborate, and benchmark what's next in AI.
Tawanda Nyahuye👨�... @towernter
31K Followers 892 Following Software Developer | Mostly here for the memes
Python Software Found... @ThePSF
692K Followers 126 Following The nonprofit organization behind the Python programming language. For help with Python code: https://t.co/XDHPttz2Xv On Mastodon: @[email protected]
dataanalyticsireland ... @dataanalyticsi1
579 Followers 2K Following Data analytics free video tutorials, see the YouTube link below to subscribe! Get answers to your questions here: https://t.co/aDywH0A89U
100DaysOfCode @_100DaysOfCode
201K Followers 5 Following The official #100DaysOfCode Twitter bot. Part of @freeCodeCamp. Founded by @ka11away. Coded in JavaScript by @amanhimself.
Machine Learning FLX @machinelearnflx
171K Followers 28K Following ML & AI Engineering • LLMs • MLOps • Data Engineering • Practical AI systems, architectures, tools and curated resources for AI.
TED Talks @TEDTalks
10.1M Followers 668 Following TED is a nonprofit devoted to the ideas shaping tomorrow. 🔴
Bill Gates @BillGates
63.4M Followers 571 Following Sharing things I'm learning through my foundation work and other interests.
Google for Developers @googledevs
2.6M Followers 313 Following Discover the latest developer tools, resources, events, and announcements to help you build smarter, ship faster. 🚀
Emily Robinson @robinson_es
26K Followers 331 Following Senior data scientist. She/her. Author of the book Build a Career in Data Science, available at https://t.co/9FwNDr2IO7, & podcast https://t.co/XgJF6Xjo5G
Kyunghyun Cho @kchonyc
86K Followers 2K Following a mediocre combination of a mediocre scientist and a mediocre advisor at @nyuniversity (@CILVRatNYU)
Tassos Noulas @taslanous
1K Followers 2K Following Head of Data Science @firefly_cities - Previously at Center for Data Science, NYU, Cambridge, Foursquare, Telefonica & UCL. Wiki Atlas https://t.co/d3NHyspg6O
UC Berkeley I School ... @BerkeleyData
13K Followers 352 Following Online master’s in data science (MIDS) and master’s in cybersecurity (MICS) programs from the UC Berkeley I School. Learn more at: https://t.co/SIaZb5ku93
Monica Rogati @mrogati
49K Followers 662 Following Data Science & AI advisor; fractional CDO. Former VP of Data @Jawbone & @LinkedIn data scientist. Equity Partner @DCVC. CMU CS PhD.
Hilary Mason @hmason
120K Followers 2K Following Co-Founder of @PlayHiddenDoor. Formerly Founder of @FastForwardLabs (acquired by @Cloudera). I ♥ data and cheeseburgers. She/her.
Noemi Derzsy @NoemiDerzsy
993 Followers 393 Following Principal Inventive Scientist @ATT Chief Data Office-Data Science & AI Research | PhD Physics | Network Science | Computational Social Science | Opinions my own



















