Arroyo @ArroyoSystems
The next-gen stream processing engine. Now part of @CloudflareDev. arroyo.dev Berkeley, CA Joined October 2022-
Tweets66
-
Followers233
-
Following2
-
Likes3
I'm very excited to announce that after 8 months of work, Arroyo 0.15.0 is now available! This is a huge release that brings all of the improvements, fixes, and learnings from running Arroyo at scale to power @CloudflareDev Pipelines, our fully-managed ingestion service.
The news is finally out! Cloudflare has a Data Platform! We're starting with serverless streaming pipelines (powered by @ArroyoSystems), a managed Iceberg Catalog, and a new distributed SQL engine built on @ApacheDataFusio.
Say hi to the Cloudflare Data Platform — a serverless data platform built on Cloudflare's global infrastructure. Ingest data with Pipelines, manage it with our Iceberg-compatible Data Catalog, and *query it* using the brand-new R2 SQL query engine.
Arroyo 0.14.1 is now available! This is a patch release with a number of fixes over 0.14.0, and is a drop-in upgrade: github.com/ArroyoSystems/…
The third SF DataFusion meetup is today at 6! We have a bunch of great speakers including project leader @andrewlamb1111, @camuelg, @lakesail , and @Greptime. I'll be giving a talk about how Arroyo does streaming incremental view maintenance to support unbounded SQL queries.
@sdil @CloudflareDev Arroyo is remaining open source and will continue to be developed: arroyo.dev/blog/arroyo-is…
@Cloudflare We couldn't be more excited to be building the future of real-time process with Cloudflare! See all of the details on the blog: arroyo.dev/blog/arroyo-is…
We are very excited to announce that we are joining @Cloudflare to bring stream processing to everybody! Arroyo is coming to the Cloudflare Developer Platform as a serverless stream processing system, and will also remain open-source and self-hostable.
Two big things: 1. Pipelines, our brand new streaming ingestion service, is now in public beta. 2. We've acquired @ArroyoSystems so we can bring SQL-based stateful transforms to Pipelines! Ingest tens-of-thousands of records per second right now: blog.cloudflare.com/cloudflare-acq…
Arroyo 0.14.0 is now available! New features in this release include: 🔎 Lookup joins 🪆 Nested updating aggregates {} Struct types 📖 Streaming SQL syntax 🔀 Sink shuffles See the full release notes at arroyo.dev/blog/arroyo-0-…
Arroyo just crossed 4,000 GitHub stars! It's amazing to see the excitement for a new future of open-source stream processing. Thanks to all of our users and contributors for your help getting here!
@v1gnesh @mwylde Here you go! arroyo.dev/feeds/blog.rss
You'd think that the key to being a fast streaming engine is like clever join algorithms, but it's mostly just being really good at JSON. @ArroyoSystems uses Arrow and the arrow-rs JSON decoder. I think it's pretty cool, so I wrote up how it works: arroyo.dev/blog/fast-arro…
Building a near-real-time analytics stack used to take a team months or years. Thanks to modern tech like S3, @redpandadata, @duckdb, and Arroyo, any company can build a sub-minute data lake in under an hour: arroyo.dev/blog/building-…
Arroyo 0.13.1 is now available: github.com/ArroyoSystems/… This patch release includes several fixes over 0.13.0 and is a drop-in upgrade.
Arroyo 0.13.0 is now available, with 📘 Source metadata support 🐰 RabbitMQ streams connector ⚛ Atomic updating outputs 🔐 IAM auth for Kafka ⛓️Operator chaining See all of the details in the release post: arroyo.dev/blog/arroyo-0-…
Arroyo 0.12.1 is now available: github.com/ArroyoSystems/… This patch release contains several bug fixes and is a drop-in upgrade for clusters running 0.12.0.
If you missed #p99conf last week, talks are now available to stream on YouTube. I spoke about the design decisions that went into Arroyo's incredible performance: youtube.com/watch?v=7H4CIK… Come for the Rust hot takes, stay for my terrible hand-drawn architecture diagrams 😅
Arroyo 0.12.0 is now available, with support for 🐍 Python UDFS 🐍, plus Protobuf, faster JSON functions, custom state TTLs, and more. See all the details in the release notes: arroyo.dev/blog/arroyo-0-…
Arroyo is coming to #Current24! Come chat with the team and learn about the future of stream processing.
Looking forward to talking about how we dynamically-load DataFusion UDFs in @ArroyoSystems! Because Rust lacks a stable ABI, this is harder than it sounds!
Excited to announce the next SF DataFusion meetup will take place September 25th hosted by @trychroma! We'll have talks by @asc89 @mwylde and @lukekim Event link in comments 👇
Nhat Nguyen @NhatNguyen78430
8 Followers 1K Following
Jason @jason0x99
161 Followers 6K Following Father of two boys, Back-end Developer (Go, Java) 3JAJ68D5
stevelauc @SteveLauC
1K Followers 1K Following Ailurophile, bike lover (gravel cycling/mountain biking), coffee drinker (mostly Americano), and open-source enthusiast. Enjoying hacking Postgres
Jacob Hands @jachands
1K Followers 1K Following Making ci better at Blacksmith // https://t.co/kNlKHcybwL
jenkin 🛡️ {zec|e... @jenkin27
2K Followers 6K Following Curiosity-driven web developer 🛡️ Openness, freedom, privacy enthusiast 🛡️ Open data hacktivist 🛡️ Zcash node operator 🛡️ https://t.co/49rEly2xGl
Eran Sandler @erans
973 Followers 4K Following Builder, operator and investor. Infra, AI, and product nerd. Trying to make powerful things simple. Opinions are my own. Building https://t.co/b0sgru9dFz
Josh @JoshPurtell
4K Followers 7K Following Ars longa, vita brevia Your works are wonderful, I know that full well Working on optimization
Garry @garryj
52 Followers 2K Following Building @teemoonai — private AI chat for iOS. Agentic search, E2EE, TEE attestation. Bring your own API key.
himesh_p @himesh_p
269 Followers 6K Following The price of discipline is far less than the pain of regret.
Nafiz @fuadnafiz98
11 Followers 695 Following
Nick Minor @nrminor
1K Followers 1K Following Bioinformatician & data scientist working on host and pathogen genomics. Writing in Python, R, Rust, Nextflow, and more.
pragnesh @pragnesh
154 Followers 2K Following
aaaq1 @aaaq1564904
0 Followers 721 Following
Ahmed gouda @AhmedGouda999
21 Followers 995 Following
JustAnotherBrokeLarpe... @pennilesslarper
0 Followers 1K Following LARP. Enjoyer of good art, meme, and alpha.
Roxor @xqzhou
22 Followers 282 Following
CanRau building kondu... @CanRau
633 Followers 2K Following 🇩🇪🇬🇧🇵🇪 Hallo - Hi - Hola 🤵🏻♂️ Hubby 🤓 CTO & Cofounder @konduktum.com 🤗 He/him
Ministry of 🍿 @Raven_krishna
1K Followers 6K Following
derek @D0Wind
267 Followers 269 Following
Serghei Bondarenko @lylpaws
17 Followers 107 Following
RoboDollars @UrMom2College
184 Followers 6K Following
Sümer Cip @sumercip
413 Followers 2K Following Sr Sw Eng working on observability. Specially interested in observability tools & databases & low-level stuff. Dad. Sports nerd.
Bayardalai @bayardalai_b
3 Followers 257 Following
Rogê Gonçalves @rogegoncalvess
35 Followers 357 Following Cristão, marido da Monique e pai da Sofí. No tempo livre, trabalho e dou asas a curiosidade.
bttb.eth @Chenvii
196 Followers 2K Following
schrepfler @schrepfler
975 Followers 5K Following VP of Engineering at Huddle Tech. Opinions are my own. ULC minister. He/Him
amino @aminoid
29 Followers 1K Following
Jonathan Foote @JFoote2715
5 Followers 891 Following
Ernest Bursa @Swistak
202 Followers 1K Following Father of three. Non-conformist, wastrel, has 7th Dan in Negotiation Skills, yet prefers violence. Opinions are my own.
Wendell Misiedjan @_ItsWendell_
139 Followers 1K Following Founding engineer https://t.co/cFBNkMpoLK. Building agentic GTM software. AI workflows, devtools, developer platforms.
G @cooliosghost
146 Followers 2K Following
Rishabh Maurya @_rishabhm
19 Followers 91 Following Software engineer who loves hiking, biking, geo politics and physics.
Kyutaro@Web x AI x DX @kyutaro15
5K Followers 7K Following セキュリティやStackのことを発信しています。一般ウケは狙っていないので、興味のある方以外はフォロー非推奨です。｜元AI 探検家 ｜主な取り組み：セキュリティ、インフラ、Stack、AIなど｜趣味: PC自作・写真撮影・ドローン飛行｜一児の父
Michael Hellman @mthellman
197 Followers 4K Following working on something new | prev. @NUSComputing |Opinions are my own RP≠E
Jackson Newhouse @JacksonNewhouse
4 Followers 3 Following CTO at @ArroyoSystems. Expert at distributed computing so you don't have to be.
Micah Wylde @mwylde
807 Followers 367 Following Stream processing and query engines @Cloudflare. Prev co-founder @ArroyoSystems, @LyftEng, @GetSift.Trends for United States
You might like
