GlassFlow @glassflowdev
Run any data transformation at TB scale for ClickHouse 🌐 https://t.co/IYDzfviTyn glassflow.dev Berlin (Germany) Joined October 2023-
Tweets77
-
Followers53
-
Following9
-
Likes37
Full breakdown + upgrade notes → glassflow.dev/blog/glassflow…
Also in v3.2.0: OTLP receiver concurrency caps, operator reconciles 4 pipelines in parallel, and full backpressure signals from every component to the control plane.
Before v3.1.0, when a downstream stage couldn't keep up, GlassFlow had no coordinated way to slow down. Events would pile up, NATS memory would fill, pipeline would fail. That's fixed now. 🧵
Most teams default to OTel → Kafka → ClickHouse for observability. Kafka is powerful. But is it always necessary? We broke down when it's worth the overhead and when it isn't. 👉 glassflow.dev/blog/opentelem… #ClickHouse #OpenTelemetry #DataEngineering #Kafka #OTel
ReplacingMergeTree deduplicates eventually in #ClickHouse. Your counts might be wrong until the merge runs. Fix it upstream with GlassFlow → glassflow.dev #DataEngineering #GlassFlow #OpenSource #DataPipelines
If you're sending #OTel data to ClickHouse without a processing layer in between, you're probably storing 15–30% duplicate logs and fighting nested JSON schema issues. We built GlassFlow to fix this:dedup, enrichment, & schema mapping for #ClickHouse. → glassflow.dev/use-cases/real…
Still looking for a Founding Engineer 🚀🚀 Not a "senior dev" role. Not a backlog ticket role. A "here's the problem, let's build for it" role. → Low-latency #eventstreaming infra → Billions of events → GlassFlow stack: #Go, #Kafka, #NATS Apply here: join.com/companies/getg…
Your Kafka → #ClickHouse pipeline shouldn't be a 2 AM nightmare. ReplacingMergeTree doesn't deduplicate on insert. It merges "eventually", leading in messy count()s GlassFlow fixes this by handling dedup, PII masking, and more upstream ➡️ Details: glassflow.dev #Kafka
Stop writing glue code to connect #OTel to #ClickHouse. 🛑 GlassFlow now ingests OTLP data natively: deduplicating, masking PII, and delivering traces/logs/metrics query-ready. ✅ No #Kafka ✅ No custom transforms ✅ Just clean data See how: glassflow.dev/blog/clean-enr… #OpenTelemetry
Read more here: glassflow.dev/blog/clickhous…
ClickHouse for #observability is great, until you have to deal with: • Duplicate spans from collector retries • PII leaking into trace attributes New guide: #OTel Collector → GlassFlow → #ClickHouse Dedup, PII masking, tail sampling. 🔗 Link in replies #OpenTelemetry
Working with #ClickHouse and running into the "Too Many Parts" errors? Let the server do the heavy lifting with Asynchronous Inserts. Check our article on Asynchronous Inserts in ClickHouse here: glassflow.dev/blog/asynchron… #DataOps #Analytics #DataEngineering #RealTimeData
We just shipped native #OTel ingestion in GlassFlow. 🚀 The OTel Collector exports. ClickHouse stores. Nobody handles what happens in between. Now GlassFlow does: deduplication, enrichment, schema mapping, before the first row hits your DB. glassflow.dev/blog/clean-enr… #OpenTelemetry
Moving to #ClickHouse? Don't let denormalization slow you down! While it’s a standard hack for row-based DBs, in ClickHouse it causes: 📦 Bloated storage ✍️ Write amplification ⏳ Ingestion friction The solution? glassflow.dev/blog/denormali… #DataEngineering
ClickHouse #MaterializedViews are powerful, but they aren't a silver bullet. Learn how they work and when they might be killing your ingestion performance. Read more: glassflow.dev/blog/clickhous… #ClickHouse #DataEngineering #OpenSource
Backfilling PB-scale #AI data is usually where the "standard" approach breaks. If you're managing real-time embeddings or feature stores in #ClickHouse, you need a strategy that won't kill your production uptime. Here\s how to handle the switch: glassflow.dev/blog/clickhous… #AIInfra
ICYMI: GlassFlow just broke the 500k events/sec barrier. 🚀 We’ve achieved linear horizontal scaling within a single pipeline. No architectural rework, no complexity—just add resources and go. Read the benchmark breakdown: glassflow.dev/blog/glassflow… #DataEngineering #ClickHouse
Devdatta Talele @devdattatalele
66 Followers 452 Following AI engineer building production systems with LLMs, RAG, & MCP. Co-founder @hdgelabs. OSS contributor: Zed, OpenAI, CURL. Built GitHub issue solver MCP server.
Ankit Kumar @xankitk
0 Followers 41 Following Senior Platform Engineer • Site Reliability Engineer • Developer Experience • DevX • Kubernetes • CKA Certified • Golang • Python • GRPC • Open Source
Kaव्य @MaNiAcCoder3
52 Followers 197 Following caffeinated coder by day, highly caffeinated coder by night compsci grad @_PECChandigarh 24 @liverpoolfc
Satyamm Soni @satyampsoni
674 Followers 522 Following Organizer @kcddelhi | CNCF Ambassador | @kubernetesio Release Notes Lead v1.32 | GSoC @OpenSUSE
Ashwin Ashok @ashwinashok1998
9 Followers 4K Following Data & AI Engineer | MS CS @ SUNY - Buffalo Thoughts are my own.
Shashati @sdshariati
65 Followers 119 Following
@Ali_ @HeyAliux
5K Followers 2K Following Design Inspiration, Marketing & Paid Promotion ✉️[email protected]
林架 @BUZZABC3
60 Followers 4K Following
Ranu Hasan @ranu_hasan
297 Followers 4K Following I designed 75+ B2B SaaS Websites, Driving $3M+ Revenue for SaaS Founders | UI/UX Designer | Webflow Designer
Emili Balcells @emilibalcells
61 Followers 2K Following
Samira @SamiraMian
301 Followers 2K Following A #DataScience enthusiast who uses #MachineLearning to train models and generate #PredictiveAnalytics. Fascinated by all things #Data - the #science & #art🛴
El_Ro @ROMANYA27167279
21 Followers 820 Following
Proby Shandilya @ProbyShandilya
1K Followers 4K Following enterprise software nerd @work_bench // collector of interesting ideas
Lil Bindle @YungBindlestiff
101 Followers 5K Following
Ahmed @ahmedrann
14K Followers 961 Following | Founder of https://t.co/apE8T9vniA ❤️ | Founder of https://t.co/T9BTwmzlRa ❤️
Timi Adesina @TimmyAdesina
338 Followers 3K Following Big Beaver 🦫 @unboxdco 👨💻 @peigesapp 🚀 @weddnco 💍. Romans 9:16
Rajiv Singh @therajiv
4K Followers 4K Following sde 3 @maersk | gsoc | gsod | lfx | icpc regionalist | just sharing whats on my mind this is my life the wins the mess the mindset the data opinions mine alone
DataTweaker @DataTweakerbv
140 Followers 2K Following Independent Data Architect, data geek, foodie, art lover based in Antwerp, Belgium
Hiten Jaypal @HitenJaypal
74 Followers 116 Following Devops Engineer | 💻 Learning, Lifting & Building | On a journey to create & grow 🚀
coroot @coroot_com
6K Followers 3K Following Open source observability platform | Automatic RCA insights to improve service uptime | Out-of-the-box visibility with no-code setup
Patrick Dung @mpatdung
330 Followers 967 Following 🔮Quest to Cloud Native computing ☁⚓☸ https://t.co/oJOt4LoRBp and https://t.co/HKm4MKzMrv Retweets, likes and follow do not mean endorsement. Opinions are my own
Davis Treybig @TreybigDavis
1K Followers 5K Following Early stage investor at Innovation Endeavors, focused on computing infrastructure, data/AI, and tools for builders.
Kevin Zhang @kevinyzhang
3K Followers 2K Following GP @UpfrontVC, focused on healthcare, gaming (check out The Gaming Founders Podcast), dev tools & infra. Appreciate co-op game recs.
Peter Zakin @pzakin
6K Followers 5K Following Partner @upfrontvc investing in AI + dev tools. Sold Hyper Travel to @tradeshift. ex @venmo, @usemacro, YC S2010.
M @maadegy
83 Followers 319 Following
David Sanwald @DavidSanwald
198 Followers 2K Following Pronouns: Don't care about mine, sure as hell will respect yours. Berlin-based software developer. Loving: Code, learning, reinforcement learning... Pro Choice.
Departament SIDE @Departamen46733
572 Followers 8K Following
Satyam Tripathi @triposat
241 Followers 731 Following Developer Marketer 🕷️ | Web Data Infrastructure 🕸️
Mustapha Moshood Olaw... @MustaphaMoshoo8
103 Followers 1K Following Software Engineer | Geomatics Engineer | Core Member @GlobalAIHub
Entropy ☄️ @fortsadek
801 Followers 595 Following I'm unsatisfied with the world I live in, so I engineer like I'm running out of time. 42.
Bobur @BoburUmurzokov
394 Followers 41 Following 🥑 Developer Advocate 🧑💻 Software Engineer 🧑🏫 Speaker Follow me to learn more about AI, Data Engineering, and stream processing tools.
Laura @lauraar83984415
382 Followers 3K Following
Meryem Cebeci @MeryemCebe69197
0 Followers 2 Following
Markus @MarkusKazmaier
146 Followers 835 Following Venture Capitalist | Tech Enthusiast | Opinions are my own.
TechBerlin @TechBerlin_
73 Followers 454 Following
Gali Belleli @hi_firstname
29 Followers 119 Following Helping growing tech companies sell better. Talk about #startups, #salesdevelopment.
observability-360 @TheObsGuy
242 Followers 226 Following All things observability-related. Author of the Observability 360 newsletter: https://t.co/PppN88pck5
Denis Gobo @DenisGobo
2K Followers 2K Following Senior Lead Database Engineer, fluent in English, Dutch and Croatian. Ex SQL Server MVP
Kan Ouivirach 🐻�... @zkancs
1K Followers 2K Following ODDS-TEAM. Data Product Developer. Rails Noob. Passionate in software engineering, data engineering, and data science. ♥
Andi Pangeran @A_Pangeran
1K Followers 661 Following Principal Engineer working on loT platforms to accelerate the global transition to electric motorcycles.
Patrick Dung @mpatdung
330 Followers 967 Following 🔮Quest to Cloud Native computing ☁⚓☸ https://t.co/oJOt4LoRBp and https://t.co/HKm4MKzMrv Retweets, likes and follow do not mean endorsement. Opinions are my own
Entropy ☄️ @fortsadek
801 Followers 595 Following I'm unsatisfied with the world I live in, so I engineer like I'm running out of time. 42.
Python Coding @clcoding
652K Followers 113 Following Lets Learn #Python with tips and tricks. Free Python Course: https://t.co/l9NKxZWrh7 biz : [email protected] AI Community Partner. DM for Everything.
Ingrid @ingridlunden
33K Followers 2K Following Journalist. Mom. Wife. Traveler. Speaks English, American, Russian, Franglais, Spanglish, in metaphors. ex-TechCrunch ingrid.101 on Signal.You might like
