Data Eng Weekly @DataEngWeekly
Data Eng Weekly covers the week's top news in data engineering-related open source and cloud products. Curated by @joecrobak dataengweekly.com Joined August 2015-
Tweets121
-
Followers994
-
Following29
-
Likes20
To all my dear #BigData colleagues! Feel invited to submit an abstract to #BigDataTechWarsaw 2020, so that we can meet in Warsaw, talk about data and have a beer 🍺 This is the conference that I co-organise :) The CfP is open until Sep 30th. medium.com/getindata-blog…
A couple of good links, both from @DataEngWeekly: 1. Review of idempotence complete with elevator analogy: lispcast.com/what-is-idempo… 2. How to learn to build distributed systems: brooker.co.za/blog/2019/04/0…
What changed in the Big data landscape from 2013 to 2019 blog.marouni.fr/bidata-trends-… - interesting analysis from @abbassmarouni based on articles in @DataEngWeekly
My @apachekafka @kafkastreams challenges github repo has been announced in the last @DataEngWeekly issue: dataengweekly.com/Data-Eng-Weekl… Thank you guys!
@dacort Sorry about that! Did it end up in your spam folder by any chance?
List of new features in Amazon Redshift so far in 2018 - queries on nested data recently announced! blog.openbridge.com/whats-new-with…
Aaand another chapter is done! 🎉 The Early Release of "Stream Processing with @ApacheFlink" was updated with a new chapter about connectors and end-to-end consistency. Only two chapters ("Setup & Configuration", "Operations") are left. I should start looking for another hobby 🤔
Data Eng Weekly 279 ▪︎ Benchmarking Hive on MR3 ▪︎ Event Sourcing ▪︎ Efficiently writing to a db ▪︎ Jepsen for Dgraph ▪︎ PulsarIO ▪︎ Scheduling of notebooks at Netflix ... and more! dataengweekly.com/Data-Eng-Weekl…
Apache Airflow 1.10.0 is out ❤️🎉 !! Highlights: - New RBAC web interface in beta - First class kubernetes operator - Experimental kubernetes executor - Timezone support - Performance optimizations for large DAGs - Many GCP and S3 integration improvements - Tons of Bug Fixes
We've just released Apache Arrow 0.10.0, the biggest release yet with 4 months of work and nearly 500 issues closed. We've added 3 new languages to the project: Go, Ruby, and Rust. Read more arrow.apache.org/blog/2018/08/0…
Fortnite: 12 AWS regions, 5000 shards of Kinesis Streams, 4000 instances of EMR, and adding 2PB of data per month. datanami.com/2018/07/31/ins…
Catch up on the latest issue of Data Eng Weekly before the next one this Sunday! dataengweekly.com/Data-Eng-Weekl…
The @ApacheFlink community reached 10,000 issues in JIRA. Thanks to everyone who participated! Let's file another 10,000 feature requests/bug reports and keep the community alive! issues.apache.org/jira/browse/FL…
Big growth in flash storage: 55% year-over-year in Q1 2018. datanami.com/2018/07/26/the…
Apache Accumulo 1.9.2 was released with fixes for a few serious bugs. accumulo.apache.org/release/accumu…
Data Eng Weekly Issue #274 Lots of stream processing coverage this week—Apache Kafka, Wallaroo, Apache Samza, WSO2, and Amazon SQS + a couple of posts on Kubernetes, db monitoring + 2 new books + a proposed data ethics checklist. dataengweekly.com/Data-Eng-Weekl…
ERA5 atmospheric data is now available on S3 as a public data set. Currently available from 2008 on-wards, all 9 petabytes dating back to 1950 will be released incrementally. medium.com/planet-os/era5…
Speeding up ETL in PySpark by parallelizing db access. medium.com/@joaopedro.pin…
HDP 3.0 delivers new capabilities for the enterprise to enable agile application deployment, new #machinelearning /deep learning workloads, real-time database, & security and governance. Learn more about the enhancements, here: bit.ly/2JZms8t #BigData
Data Eng Weekly #273 is out. It was a tough one—so much great content to choose from. Coverage includes Scio, make at Propublica, Paypal's NameNode analytics, MySQL on Kubernetes, Kinesis+Lambda, data replication at Hotels.com, & much more. dataengweekly.com/Data-Eng-Weekl…
Gwen (Chen) Shapira @gwenshap
30K Followers 11K Following Co-founder of @niledatabase. Making SaaS global, elastic and chill. Find me at: https://t.co/uyuHg400cp
Rahul Jain @rahulj51
5K Followers 2K Following Engineering Manager, AI Data Products. Formerly led Data and Engineering at @thebeatapp , @omioglobal , @thoughtworks .
Tanel Poder 🇺🇦 @TanelPoder
12K Followers 1K Following Creator of https://t.co/w1Pz4s2EhV and a long time computer performance nerd. Performance & Troubleshooting Training: https://t.co/lRKHSCFE6M
Ananth Packkildurai @ananthdurai
3K Followers 2K Following Data @Zendesk, @SlackHQ | Author https://t.co/rvlBOXXy26 | Creator of https://t.co/XdMVrxUInE
Aravind @iamAravind7032
20 Followers 217 Following
Sajid -Analytics @IqbalSajid71648
0 Followers 28 Following My name is sajid iqbal . I'm from Pakistan. As a student in Data science.I created a account for growing himself to show our work project in social media .
Akash Singh @AkashSinghbld
0 Followers 116 Following
Omar Mohamed @0mar_m0hamud
2 Followers 281 Following
Datis @DatisAgent
95 Followers 777 Following AI automation + data engineering tools. Python, PySpark, Databricks, agent memory systems. Builds: https://t.co/eneMoSISJU | ClawHub: https://t.co/ZJjQOncPwS
Nguyễn Thiện Quan... @quang_xien_23
0 Followers 118 Following
Muhammad Forhad Islam @forhadislamse
0 Followers 35 Following Software Developer & Data Engineering Learner, passionate about AI & Machine Learning.
Shamanth Krishna @ShamanthK02
15 Followers 263 Following Aspiring Data Engineer 📊 | Too lazy to repeat myself, so I automate it 🦥 | Powered by curiosity, strong tea, and questionable ideas 🍵 | Trek 🏔️ Bike 🚴 Trav
Xuân Dương @XunDng1157125
0 Followers 4 Following
Oladele Akanle @OladeleAkanle
169 Followers 232 Following Senior Pastor at Christ Chapel MD. Loves teaching & applying biblical concepts and principles to life. Husband to Toyin. Pop to 3 great guys; Demi,Temi & Nimi
Abdullah Alholiel @AAlholiel
529 Followers 2K Following Memento Mori 🌎 • AI & Software Developer • Tech Enthusiast • Data Analyst • Applied Computing MSc Graduate • Aerospace Engineer • SAGGITARUIS ♐️
appaaah @Natures_chiiild
8 Followers 58 Following
JonR @JonRouss
334 Followers 495 Following Experienced DE, exploring and documenting my vibe coding journey on X. Follow and chat with me!
Jarod Davis @JarodDDavis
31 Followers 78 Following
Fábio A. Raimundo @fabio_raimundo
9 Followers 64 Following
Dagen.AI @dagen_ai
0 Followers 89 Following
Mohammad Husain @mdhusain_Shaan
15 Followers 136 Following Software Professional. Poetry, Urdu, Hindi, English, Persian
msafi @datawithsafi
7 Followers 73 Following working on cloud bigdata spark databricks and some code with Cognizant Banglore
Srinivas Peddi @speddi22
1 Followers 81 Following
Crodemor @claudemirfranco
16 Followers 186 Following
RAVI RAI @ravirai_99
10 Followers 84 Following
ERT @xvix999999999
4 Followers 2K Following
Chetan Choudhary @TheChetanDev
1 Followers 13 Following BCS student on a journey to become a Data Engineer. Learning Python, SQL, and cloud technologies. Sharing my projects and progress. #DataEngineering
Tammam ALASHA @AlashaTammam
21 Followers 174 Following
eigentiki @tolaniakinola_
1K Followers 3K Following ~ just a dude 💜 @turingcom | prev @googledeepmind | prev LSPIRG https://t.co/Ost4n1FkiT
Dhanush @Dhanush_1520
3 Followers 206 Following
ShannuR @ShannuR3
9 Followers 142 Following
Krsna @KrsnaTeja
14 Followers 300 Following
Mitul @mitulsinghh7896
0 Followers 65 Following
Piyush Jain @pia_jain05
187 Followers 539 Following
Bala Subramanian @Bala2462000
58 Followers 2K Following
anakantweeti @kn9wdsway3
9 Followers 140 Following
Sri Nivas @Srini7210
7 Followers 122 Following
Venu.dev @VenuPelluru
237 Followers 2K Following User-centric personalization became my gateway drug into serious software development.
Usha ushh..! @ushaiitkgp
3 Followers 159 Following
Diptesh Rane @rane_diptesh
18 Followers 209 Following
Kobby Immanuel @kobbyimmanueld1
67 Followers 353 Following Digital Technology Governance & Policy Consultant (BSc IT | MSc IoT & Big Data | LL.B | Webmaster || Software developer (online /offline ) | Entrepreneur)
Dhara ni @Dharani1202
0 Followers 7 Following
saurabh vora @saurabhvora4
43 Followers 355 Following
Kalyan Msn @KalyanMsn14767
0 Followers 29 Following
saranyashrinivasan @saranya_genga
1 Followers 73 Following
Rinil Kunhiraman @rinilkunhiraman
4 Followers 548 Following Exploring the future where humans and AI collide. 🤖✨ Inspired by bots, but not one. Curiosity driven by algorithms.
Ricardo A Muñoz M @ricardoandres33
52 Followers 89 Following La belleza se encuentra en la simplicidad de las cosas.
havu doit @havudoit
2 Followers 113 Following
Eric Sammer @esammer
12K Followers 681 Following ceo at @decodableco! prev: @splunk, @rocanainc (acq'd), @cloudera. open source / dist systems / data. o'reilly author. [email protected]
Confluent, an IBM Com... @confluentinc
44K Followers 237 Following The World's Data Streaming Platform
Apache Airflow @ApacheAirflow
12K Followers 0 Following Airflow is a workflow scheduler. Now on https://t.co/r5iMFW0E2h
Julien Le Dem @J_
4K Followers 2K Following Architect, Founder, Angel, Advisor, Keynote speaker, OSS: @OpenLineage @MarquezProject, ASF: Parquet Arrow Iceberg 🐖. 🦋 https://t.co/4VQUXaZ5vu . he/him
Streamlio @streamlio
1K Followers 3K Following Streamlio, an enterprise-grade solution unifying messaging, compute, and stream storage, was acquired by @Splunk in October 2019.
DynamoDB @dynamodb
21K Followers 4K Following This account is no longer active. Follow @awscloud for the latest updates from AWS.
Apache Hive @ApacheHive
3K Followers 9 Following Apache Hive - An Apache Software Foundation Project (Official Account: Managed by Apache Hive PMC)
ARCHITECHT @architechtpub
1K Followers 1 Following Powered by @derrickharris . Newsletter at https://t.co/FX5c36BcJL . Podcast home: https://t.co/OIOxLI6KqN .
Joe Crobak @joecrobak
2K Followers 2K Following distributed systems, healthcare, and government. Previously @confluentinc @USDS healthcare team, @Foursquare & @DataEngWeekly
Etsy Engineering @codeascraft
12K Followers 115 Following The engineers who make Etsy make our living with a craft we love: software.
Engineering at Meta @Meta_Engineers
215K Followers 197 Following Engineering at Meta is a technical news resource for engineers interested in how we solve large-scale technical challenges at Meta.
Airbnb Engineering @AirbnbEng
54K Followers 219 Following Creative engineers building a world where you can belong anywhere.
O'Reilly Strata Data ... @strataconf
34K Followers 3K Following Data, ML & AI news + resources from @OReillyMedia.
Cloudera Community @cldrcommunity
106K Followers 356 Following At Cloudera, we believe that data can make what is impossible today, possible tomorrow.
Cloudera @cloudera
106K Followers 3K Following Cloudera is the only data and AI platform company that brings AI to data anywhere: in clouds, data centers, and at the edge.
Data Engineering @InsightDataEng
1K Followers 81 Following Insight Data Engineering Fellows Program: Your bridge to a career in big data
Apache Accumulo (arch... @ApacheAccumulo
1K Followers 19 Following Secure, robust, scalable, high performance data storage and retrieval
Apache NiFi @apachenifi
5K Followers 1 Following Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data.
Apache Flink @ApacheFlink
18K Followers 26 Following Official Apache Flink Twitter account managed by the Flink PMC
Apache Calcite @ApacheCalcite
5K Followers 25 Following Dynamic data management framework. The foundation for your next high-performance database.
Apache Samza @samzastream
2K Followers 0 Following Apache Samza is a distributed stream processing framework. Follow for news and updates.
Apache Kudu @ApacheKudu
4K Followers 69 Following An open-source native columnar storage engine that enables fast analytics on fast data. https://t.co/ke9kwqPmqn
Apache Kafka @apachekafka
68K Followers 235 Following A distributed streaming platform. Account managed by the Kafka PMC.
LinkedIn Engineering @LinkedInEng
45K Followers 385 Following Powered by the world’s most trusted and largest professional platform, our vision is to create economic opportunity for every member of the global workforce.Trends for United States
You might like
