Cascading @cascading
Need support or guidance? Reach out to @cwensel https://t.co/5YnPV67z39 cascading.wensel.net Joined November 2010-
Tweets778
-
Followers2K
-
Following10
-
Likes7
Cascading 4.5.2 is out! github.com/cwensel/cascad… central.sonatype.com/artifact/net.w…
Do you miss meetups of the Big Data era, when you could learn about RAFT protocol or map-side join over pizza and beer? Us too! My friend @cwensel has launched SF Distributed Systems Meetup. First meetup is next week, with talks by me and @conor_power23 lu.ma/t6r4mi4v
If your company is still running Cascading+HadoopMR applications and are itching to drop MR for Spark, dm me. Some companies have 100s of @Cascading apps in production and moving them off MR in a couple lines of code would be a huge cost savings. Also true for @scalding.
I always suspected that Parquet and Orc weren't very good, but TIL from @ViktorLeis that one can do much much better with BtrBlocks. cs.cit.tum.de/fileadmin/w00c…
Cascading 4.5.1 was just released to Maven Central. buff.ly/3YgQHyh This release includes minor bug fixes and dependency updates. buff.ly/45qUnAf
@fuyufjh @andy_pavlo @ApacheCalcite @luciddb @iskyzh @ApacheHive Before I worked at Hortonworks putting Calcite in Hive, I worked on Lingual, a SQL interface to @cascading. That was the first commercial use of Calcite (then called Optiq) and some much needed consulting $$
I'm hanging my shingle out again. I have some new insights I want time to work out into a developer tool for cloud data engineers, but I want to bootstrap it with contract/consulting revenue. This is how I started @Cascading in 2007. chris.wensel.net Please boost!
Scala folks: if there are open source GitHub Twitter libraries you like, you might want to make a clone/fork now. Seems like we are in a situation where anything can happen.
really interested in adding mergeable summary as a datatype to @cascading. think having daily/hourly aggregate tables, then daily/hourly performing a last N day/hour aggregation against the partials. cost efficient way to have rolling percentiles/aggregates
Cascading 4.5 is out! With native @ApacheParquet, @ApacheKafka, @neo4j, and @splunk support. - cascading.wensel.net - github.com/cwensel/cascad… - groups.google.com/g/cascading-us…
cross your fingers, we might have a @cascading 4.1 release tonight, and a quick 4.5 release a day later w/ Hadoop 3 support. Both will include native @ApacheParquet support to replace the support dropped by Parquet. Plus some well worn enhanced Parquet support in 4.6
For fun I really want to fork the @cascading local mode planner to support RocksDB as the backend for joins instead of the memory only hashmaps. Local mode was never intended to scale in joins.
Cascading 4.1 is out! With native @ApacheParquet, @ApacheKafka, @neo4j, and @splunk support. - github.com/cwensel/cascad… - groups.google.com/g/cascading-us…
finally @cascading has Apache Hadoop 3 (and Tez 0.10) support thanks to the team at @Foursquare Labs! github.com/cwensel/cascad…
Gradle makes me feel stupid
@cwensel @PinterestEng Google gs connector does do aligned block reads...both that and this one work well for backwards seeks (footers, stripe footers -> stripes) /2
Improving efficiency and reducing runtime using S3 read optimization by @PinterestEng link.medium.com/KGRST76OBjb << do you have a link to the git repo?
Next up will be adding Parquet into the mix.
The cascading-local repo has been merged into Cascading 4.1 providing direct support for Kafka, Splunk, S3, and Neo4j github.com/cwensel/cascad…
P. Oscar Boykin @posco
9K Followers 2K Following engineer for recommendations at @Netflix. Former employee of @stripe, @twitter. Former academic. Programmer. Maui resident. Just some guy. @[email protected]
Daniel Bryant @danielbryantuk
15K Followers 3K Following Building platforms @Syntasso | News/Podcast @InfoQ | Web 2.0 coder, platform engineer, Java Champion, CS PhD | cloud/K8s, APIs, IPAs, running | learner/teacher
Julian Hyde @julianhyde
5K Followers 417 Following On a mission to tame data. Author of Apache Calcite, Mondrian OLAP engine, and the Morel language. Formerly Looker/Google, now working on the next thing.
🕹️ Alexander Gal... @emaxerrno
4K Followers 3K Following Founder & CEO of @RedpandaData. Building the Agentic Data Plane - https://t.co/xyvsqqV5OM. 🇨🇴
𝕬𝖗𝖌𝖞𝖗�... @argyris
3K Followers 2K Following (Neo)liberal greek dad, software geek, and metalhead. Formerly at @scale_ai, @kittyhawkcorp, @twitter, @adgrok #warriors #paobc
hayashi 「実践Redi... @hayashier
1K Followers 3K Following Senior Site Reliability Engineer, ex-AWS EMR product team @awscloud. 著書「実践Redis入門」https://t.co/2Sb9PFnMkc (한국어판) https://t.co/nIFZTsS5Zu
Armando Ramos Garcima... @AR_eu
2K Followers 7K Following GOFAI guy 🦣 https://t.co/yyQx6vIAwV #cleanair #350 #opendata #privacy #cooperation #consciousness #freethought
Nir Zilberman @nirzilberman
42 Followers 7K Following
⚡🛡️ Evan Pappa... @Hevalon
1K Followers 4K Following 🛡️ Ex Technologia Libertas - Έλευθερία διὰ τῆς τέχνης - (Dec/Acc)
Crypto Trader Don Vic... @victorchuks34
17 Followers 295 Following Crypto trader, investor and chart analyst
RTSit @tristout
6 Followers 272 Following
Shekh Ahammed Adnan B... @adnan_ab_bashir
91 Followers 3K Following Knowledge Representation, Logic, and Semantics to reason Complex Systems and dense text of Biology and History. Writes Culture, History, and Political Thoughts.
stefič @superplume_
18 Followers 223 Following
Fahad @Fahad22065
161 Followers 2K Following
Erik Yan @__syan__
116 Followers 3K Following “若逢新雪初霁，满月当空，下面平铺着皓影，上面流转着亮银，而你带笑地向我走来，月色与雪色之间，你是第三种绝色。” ——节选自余光中; 若批评不自由,则赞美无意义。 https://t.co/WyO62CQaGQ https://t.co/WY0PGUG1JY
Mark Adamenko @AdamenkoMark
40 Followers 2K Following
Ashwin Jayaprakash @ashwinjay
221 Followers 4K Following Falling into the future at light speed. (Any opinions expressed are my own)
Chiyoung Hwang @ChiyoungH
0 Followers 6 Following
Adrien Suresh Lopez @AdienLopez
4 Followers 239 Following
Rohan Kapoor @Rohangh1
10 Followers 3K Following
King Of Kings @rajan_vengat
18 Followers 358 Following
Bill Burcham @billburcham
428 Followers 970 Following diligent discipline dissection ... furiously focused fabrication
pegademo888 @pegademo888
4 Followers 125 Following
MBA Fernando Montes �... @MontesMba
131 Followers 4K Following Why accept mediocrity when excellence is an option? #Networking #BNI. Proud BNI member.
Giulio Mazzanti @Giuzzilla
370 Followers 2K Following Head of Engineering @quickalgorithm. Formerly: @GeorgiaTech @GTOMSCS, @sfliberty, BSc Economics & CompSci @unibocconi.
Rakesh Arumalla @rcarumalla
37 Followers 2K Following
Slawomir Chodnicki @slawo_ch
577 Followers 2K Following Solution Architect at Twineworks GmbH. I help create awesome analytics.
Carlos Jose Pertuz A @CJPertuz
241 Followers 3K Following
Vincent Kieftenbeld @VKieftenbeld
2 Followers 162 Following
thinkiny @coredump_again
3 Followers 163 Following
LA FORD JADE @LAFORDJADE1
344 Followers 4K Following #FEEDINHOUSETHECHILDREN DEFINE N SIDE 2B4OUR7S8 Mi TEAM S HAS E YES SEA SONS SEE CL EAR IN G S C Y EAR S UR E
Chetan Vashistth @chetanhere
1K Followers 3K Following Tennis & Books. Software professional who is building solution as an AI operator 😁 An entrepreneur who works at corporate 🚦
Todd A Johnston @TEXAS_TAJ
250 Followers 2K Following ~Applied Technology Professional ~Musician, Ethical hacker and tweets are TEXASTAJ@my own
Sudheer 🚩 @sudheer2011
2K Followers 7K Following Investment in turn around cos is my passion... Proud Hindu 🚩|| Nationalist 🇮🇳
Ak @Utd21_Believe
979 Followers 4K Following
Nezih Yigitbasi @istanbul_techie
835 Followers 3K Following engineering leader passionate about AI, distributed systems, and open source; currently @MSL/Meta Superintelligence Labs, previously @Netflix, @Intel, et al.
Sandrabarabanoff @Sandrabarabano2
11 Followers 219 Following bare your Hart Sweet Link eyelashes race cars twin turbos quarter mile chassis certified 750 down the quarter mile Yates heads toterhomes stacker trailers ATVs
rohit sohlot @rohitsohlot
281 Followers 3K Following Working as Data Engineer II @infinxinc.Worked as Data Scientist @kratinmobile . Completed Big Data Analytics Course @cdacindia ACTS,pune. HakerRank @rohitsohlot
Igors Vaitkus @unlitdev
13 Followers 2K Following
Daniel Kavita @DanielKavita4
1K Followers 4K Following Am a professional Artist and Sign writer and a member of Repentance and Holiness Ministry.
P. Oscar Boykin @posco
9K Followers 2K Following engineer for recommendations at @Netflix. Former employee of @stripe, @twitter. Former academic. Programmer. Maui resident. Just some guy. @[email protected]
Julian Hyde @julianhyde
5K Followers 417 Following On a mission to tame data. Author of Apache Calcite, Mondrian OLAP engine, and the Morel language. Formerly Looker/Google, now working on the next thing.
Michael Covert @mcovert
74 Followers 118 Following CEO of Analytics Inside specializing in big data, machine learning, and graph theory. Co-author of Learning Cascading from Packt Publishing.
Apache Flink @ApacheFlink
19K Followers 26 Following Official Apache Flink Twitter account managed by the Flink PMC
Thor Olavsrud @ThorOlavsrud
5K Followers 150 Following Senior Writer for http://t.co/QF0Tfbi0gv, IDG Enterprise covering IT Security, Big Data, Open Source and Microsoft Tools and Servers
fs111 @fs111@mastodon... @fs111
599 Followers 166 Following Defender of the secrets of Castle Grayskull.
Scalding @scalding
4K Followers 77 Following Scalding is a scala DSL for Cascading, running on Hadoop. It's concise and functional, and it's just good, clean fun.
Nathan Marz @nathanmarz
17K Followers 136 Following Founder of @redplanetlabs. On a mission to dramatically improve programmer productivity and software quality by reducing the complexity of software development.
Chris K Wensel @cwens... @cwensel
2K Followers 531 Following Developing Clusterless, a declarative cloud platform for data engineering and data science. https://t.co/zgFbxQmlvhTrends for United States
You might like
