-
Tweets154
-
Followers171
-
Following121
-
Likes12
Read how @Microsoft makes data lineage extraction possible for #AzureDatabricks and #MicrosoftPurview users openlineage.io/blog/openlinea… #Azure #DataLineage #DataAnalytics #DataGovernance
If you have @SnowflakeDB Enterprise and you like lineage, I have good news for you. You can now easily send it to your favorite @MarquezProject or any other @OpenLineage compatible consumer. (Hint: check my bio)
The OpenLineage Adapter offers Snowflake's enterprise users a powerful tool for analyzing their pipelines. Read our latest blog post to learn more: openlineage.io/blog/openlinea…
Today starts the next stage of our evolution! I'm looking forward combining the best of data orchestration and data observability at @astronomerio, and helping grow the @ApacheAirflow and @OpenLineage communities.
Astronomer has acquired Datakin, the data lineage tool from founders of the @OpenLineage and @MarquezProject. The move accelerates our shared goal of helping organizations build and manage reliable ecosystems that deliver trusted data. #blog hubs.ly/Q016zFzH0
We interrupt our programming for an important message of Ross from @DatakinHQ vimeo.com/601590009
Data lineage captured in real time as it evolves is the key to true data observability.
There are a lot of different ways to collect #datalineage metadata. We choose to observe it in real-time - here's why. datak.in/2WUix7X
so true
How a startup vs. How a startup looks on the looks on the outside inside
This is a big milestone in the journey to bring true observability to the world of data. Thanks to all community members who have made this possible! #dataobservability #dataquality
Congrats to @OpenLineage, which has just become an @LFAIDataFdn sandbox project! Consistent collection of lineage metadata is hard, and requires a broad collaborative effort.
If you don’t know what you need to know when your pipeline is on fire, you are likely to get burned. See the difference #datalineage can make the next time you're on-call. datak.in/3rgH9TN
We're excited to announce that the Marquez integrations for Airflow, Spark and DBT will be the official integrations for @OpenLineage! 🎉 To learn more about the high-level timeline of when the integration will be moved over, see: github.com/OpenLineage/Op…
Once we have data lineage, we can start to work with platforms that provide an operational degree of introspection into data logs, metrics and traces i.e. all the elements of data mechanics that give us a window into that thing we seek most in cloud - observability. Me, 2021
@data_mesh_learn @montecarlodata No. A rigorous record is required, not notes. Provenance requirements. And we do document it. In code. And there is an execution plan with all of this information. All the information is in Spark. We just need to save it. Sounds like @OpenLineage and Marquez do exactly this.
There are a lot of similarities between the goals of @OpenTelemetry and @OpenLineage - this post (on the shiny new OpenLineage site!) explores them in detail
I blogged on the parallels and differences between observability for Data Pipelines and Observability for Services. "How @OpenLineage takes inspiration from @OpenTelemetry" openlineage.io/blog/openlinea…
Great post from @HightouchData about @OpenLineage paving the way to the future of data observability. hightouch.io/blog/exploring…
Data without context is just technical debt. That’s why lineage matters - if you haven’t spent much time thinking about how to track #datalineage, this podcast about @openlineage is a great place to start.
Episode 187 of the @DataEngPodcast is live, featuring our CTO @J_ providing a great overview of #datalineage with @OpenLineage dataengineeringpodcast.com/openlineage-da…
@mattturck All symptoms of the Great Dispersion profgalloway.com/the-great-disp…
We are excited to launch @OpenLineage and work cross functionally with contributors of open source projects in the data ecosystem to enable the development of tools and solutions in terms of data operations, governance, and compliance.#DataOps #DataLineage
Today is the official launch of @OpenLineage, a new open source project to define a flexible industry standard for data lineage. Thank you for the collaboration @drewbanin @mistercrunch @AbeGong @MandyChessell @wesmckinn @zhamakd datakin.com/2020/12/18/int…
Are you looking for a "hello world" approach for #datagovernance? Take a look at my latest article on available metadata solutions. p.s. @MarquezProject is a great place to start! dataplatformschool.com/blog/w0y8g0-th…
Can't agree more on the need to be more warm-hearted these days
You are human beings, I'm a human being; you want a happy life, and I want a happy life. But I think that aim will not be fulfilled only on the basis of material values; what we all want is affection and what we all need is to be more warm-hearted.
Data helping save the planet vox.com/energy-and-env… @ClimateTRACE
Jamie Lamont @LamontJami39365
0 Followers 105 Following
Thoathood @ThoathoodxJm7i
44 Followers 4K Following
Thairez @ThairezTlpgaL
52 Followers 4K Following
Darko @Darko1521056
33 Followers 4K Following
Kaxil Naik @kaxil
2K Followers 2K Following Orchestrating the next era of AI agents ⚙️ | @ApacheAirflow Committer & PMC member | Sr Eng Director @ @astronomerio | Open-source advocate
David Gasquez @davidgasquez
2K Followers 3K Following Learning about anything and everything all of the time. Open source, open data, open protocols. Data stuff @protocollabs. Prev more data things @buffer.
Rebecka Storm @rebecka_sara
40 Followers 314 Following Co-founder of @twirldata, acquired by @modal. Previously built data & ML teams at @tink and @izettle.
Annie🇺🇸🇺🇸 @emusayergrg
130 Followers 4K Following I enjoy swimming, golf, yoga, running and skiing. I have invested in a Cheongdam beauty company in Singapore which focuses on face, body and eye treatments。🇺🇸
Ryan Fox-Tyler @ryanfoxtyler
2K Followers 592 Following Building agents @awscloud. Driven by Curiosity. Helping people build tech products via @HypermodeInc @Astronomerio @HarvardHBS @Northeastern. Almost there...
Kate G @kategiday
225 Followers 806 Following Data enthusiast, world traveller and @thabalacloud - fully managed analytical services
Apurba Biswas @ApurbaB45099156
133 Followers 3K Following I am a professional digital marketer. I am provide digital marketing service.
Mitrankur Majumdar @mitrankurm
175 Followers 453 Following
Benedetta @benecittadin
297 Followers 2K Following Growth & Marketing @Siffletdata | Italian in Paris 🍝
Brent Fox @brentfox
194 Followers 443 Following
Harel Shein @HarelShein
92 Followers 188 Following partner & father, engineering leader, data, design & biology nerd. music, festivals & nature
Ethan Batraski @ethanjb
2K Followers 1K Following Venture Capitalist, Partner @Venrock, writing about open-source infrastructure and hard engineering at https://t.co/r45vVAiEAw
Minkyu Park @minkyu.b... @MinkyuPark_
753 Followers 309 Following https://t.co/xnLRKMHXmM 젊어서 고생은 늙어서 후유증이다. 즐길 수 없으면 피하라. 되면 한다. 일찍 일어나는 새가 더 피곤하다. 일찍 일어나는 벌레가 먼저 잡아먹힌다. 높이 나는 새가 힘들다.
Eric Hansander @erichansander
263 Followers 977 Following Building things @modal. ex-founder @twirldata
Jeff Huber @jeffreyhuber
12K Followers 1K Following founder @trychroma the best for the most for the least
Michael Robinson @devrel_michael
17 Followers 28 Following Developer Relations Engineer at Astronomer
Blake @dblakev
26 Followers 2K Following
Selcuk @_SelcukArslan_
5 Followers 320 Following
"Leigh Marie" Braswel... @LM_Braswell
21K Followers 5K Following partner @kleinerperkins; previously investing @foundersfund, first pm & early eng @scale_ai; if you like infra, ML, or poker let's chat
Maxime Beauchemin @mistercrunch
5K Followers 203 Following Founder & CEO @preset_data. Original creator of Apache Superset and Apache Airflow.
Blake Burch @BlakeBurch_
328 Followers 582 Following Data Strategy + AI by day. Music + Board Games by night. Live in ATX? Let's meet! Past: Cofounder @ Shipyard, Head of Data @PMGWorldwide. DMs Open.
Xavier @xavier2bois
488 Followers 2K Following COO, Castor (https://t.co/4ArYf0IM4b) - Bring trust and visibility to your data
Modern Data Stack @moderndatastack
6K Followers 439 Following Everything that you need to know about building and operating a Modern Data Stack. Operated by team at @quantive_inc
Tim Gasper @TimGasper
3K Followers 2K Following data nerd, product guy, catalog / governance / knowledge graph @servicenow, podcast co-host #CatalogAndCocktails @HonestNoBSData
Gösta Forsum @GostaForsum
86 Followers 311 Following Father, Outdoors enthusiast, Software engineer.
Sarah Krasnik Bedell @sarahkb125
3K Followers 1K Following Growth, Analytics & GTM. @Railway, prev @PrefectIO @Perpay_inc & blogging at https://t.co/7D3jwtQ9az. Ski ⛷️ and sail ⛵ in Vermont 🌲
Ross Turk @rossturk
1K Followers 77 Following Storyteller, marketer, open source advocate, community strategist, gadget lover, guitar player, maker of things, he/him. Find me anywhere but here.
Joyce Coach Mann @Joycebinary1
864 Followers 7K Following World’s 1st female FX Educator💃🏻 🌎 Company Investor | IPOs |🇬🇧UK| Binary/Forex/Crypto Trader 👤Certified Account Manager💼 Entrepreneu
Nick Washburn @NickWashburn80
631 Followers 1K Following VC @IntelCapital. Invest in cloud infra/devtools/AI/ML/data platforms. Proud father to twins. Avid ice hockey player & outdoor enthusiast. Opinions are my own.
Michael Collado @PeladoCollado
229 Followers 420 Following Staff Eng @Astronomer via @DatakinHQ; big data nerd; formerly @ Cruise and @ Amazon; Christian; Husband; Father; Seattle lover; cyclist; geek; 🇩🇴🇵🇷🇺🇸
Harshal Sheth @harshalsheth_
262 Followers 837 Following Building @AcrylData. Prev @8VC, @citsecurities, @Google, @InstabaseInc. @Yale '22.
Felix Van de Maele @fvdmaele
1K Followers 878 Following Cofounder and CEO of Collibra, the Data Intelligence company
Willy Lulciuc @wslulciuc
323 Followers 156 Following Co-Founder / CEO @OleanderHQ, Ex-Founding Engineer @DatakinHQ, Co-Creator @MarquezProject, @OpenLineage
Datakin @DatakinHQ
368 Followers 17 Following Real-time, operational data lineage tracing that helps data engineers and data scientists find, fix, and prevent operational issues.
alex peysakhovich @alex_peys
6K Followers 810 Following partner @shv, ex-facebook ai research. currently really into ai for biology
Science Is Strategic @scienceisstrat1
51K Followers 5K Following Science and technology are our best weapons against Covid-19, climate change, cancer, neurodegenerative diseases, diabetes and more.
Yann LeCun @ylecun
1.2M Followers 787 Following Professor at NYU & Executive Chairman at AMI Labs. Ex-Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Defense of Ukraine @DefenceU
2.2M Followers 93 Following Official page of the Ministry of Defense of Ukraine 🇺🇦 Minister: @FedorovMykhailo
Modal @modal
31K Followers 152 Following AI infrastructure that developers love 💚 Run inference, sandboxes, batch processing, training, and many other things on Modal
Ethan Batraski @ethanjb
2K Followers 1K Following Venture Capitalist, Partner @Venrock, writing about open-source infrastructure and hard engineering at https://t.co/r45vVAiEAw
Coalesce @coalesceconf
2K Followers 2 Following @getdbt community event dedicated to advancing the practice of analytics engineering. #dbtCoalesce Register for Coalesce 2023—see you there October 16-20!
Soda @sodadata
897 Followers 587 Following Soda is the data quality platform that enables data teams to test data at multiple points in your CI/CD and data pipelines and deliver data everyone can trust.
Bigeye @Bigeyedata
651 Followers 114 Following The Enterprise AI Trust Platform | Monitor, control, and govern how AI agents access and use enterprise data.
Tristan Handy @jthandy
8K Followers 329 Following Building a modern analytics workflow. Founder & CEO @ dbt Labs, creators and maintainers of dbt.
Datafold @datafoldcom
1K Followers 89 Following Automating data migrations and critical data engineering workflows to help data teams ship high-quality pipelines faster and more confidently.
Anomalo @anomalo_hq
555 Followers 12 Following Anomalo is the AI-native data quality platform that automatically detects and explains issues in your enterprise data, with no manual rules required.
amundsenio @amundsenio
512 Followers 4 Following Open-source data discovery & metadata engine, created at Lyft, now used by 35+ companies including ING, Square, Asana, Workday and many more! https://t.co/Mz2kg0VFHs
OpenLineage @OpenLineage
2K Followers 18 Following An open framework for data lineage collection and analysis
Great Expectations @expectgreatdata
4K Followers 1K Following We help data teams have confidence in their data, no matter what. GX Cloud, our end-to-end SaaS data quality platform, is powered by the open source GX Core.
Dagster @dagster
6K Followers 149 Following Ship data pipelines with extraordinary velocity. Dagster+: https://t.co/8tT8GYu1eH GitHub: https://t.co/CLeCsEH08Q Slack: https://t.co/9zEzXaqghk
Monte Carlo @montecarlodata
2K Followers 419 Following Data reliability delivered. #datadowntime https://t.co/4Xol3qOYbr
Astronomer @astronomerio
20K Followers 3K Following Astro by Astronomer is the leading unified orchestration platform. Powered by Apache Airflow, Astro accelerates building reliable data products for AI.
DataEngPodcast @DataEngPodcast
3K Followers 1 Following A podcast about data engineering and modern data infrastructure. Hosted by @TobiasMacey
Data Lineage @data_lineage
2K Followers 1K Following Data lineage provides visibility while greatly simplifying the ability to trace errors back to the root cause in a data analytics process.
Modern Data Stack @moderndatastack
6K Followers 439 Following Everything that you need to know about building and operating a Modern Data Stack. Operated by team at @quantive_inc
Zhamak Dehghani @zhamakd
11K Followers 556 Following an empathetic technologist | founder ceo of nextdata | data mesh creator | author | speaker | learner | mother | she/her | ex-thoughtworks
Data Mesh Learning Co... @data_mesh_learn
1K Followers 331 Following The global home for data mesh. Join 7000+ data leaders implementing data mesh to learn, share, and connect.
Olivier Pomel @oliveur
3K Followers 258 Following Co-founder at Datadog. Former Education data wrangler.
Mark Grover @mark_grover
1K Followers 659 Following prev. founder at https://t.co/xbbK0ywh3e, co-creator of Amundsen, Author.
Sarah Krasnik Bedell @sarahkb125
3K Followers 1K Following Growth, Analytics & GTM. @Railway, prev @PrefectIO @Perpay_inc & blogging at https://t.co/7D3jwtQ9az. Ski ⛷️ and sail ⛵ in Vermont 🌲
Ross Turk @rossturk
1K Followers 77 Following Storyteller, marketer, open source advocate, community strategist, gadget lover, guitar player, maker of things, he/him. Find me anywhere but here.
Apache Airflow @ApacheAirflow
12K Followers 0 Following Airflow is a workflow scheduler. Now on https://t.co/r5iMFW0E2h
Felix Van de Maele @fvdmaele
1K Followers 878 Following Cofounder and CEO of Collibra, the Data Intelligence company
Willy Lulciuc @wslulciuc
323 Followers 156 Following Co-Founder / CEO @OleanderHQ, Ex-Founding Engineer @DatakinHQ, Co-Creator @MarquezProject, @OpenLineage
Barr Moses @BarrMoses_MC
3K Followers 957 Following Co-Founder and CEO of Monte Carlo. https://t.co/FUUJPkkyDt
Michael Collado @PeladoCollado
229 Followers 420 Following Staff Eng @Astronomer via @DatakinHQ; big data nerd; formerly @ Cruise and @ Amazon; Christian; Husband; Father; Seattle lover; cyclist; geek; 🇩🇴🇵🇷🇺🇸
Astasia Myers @AstasiaMyers
7K Followers 1K Following Senior Venture Partner at @Felicis. Former GP @ Felicis & investor @Redpoint @QuietCapital & @Cisco. Backed 10 unicorns. Blog: https://t.co/fZRzRA4Yi2
Charly CLAIRMONT @egwada
855 Followers 290 Following https://t.co/lsJ6xs8Ow5 | https://t.co/REFHnZa28e | @HugFrance co-fondateur | Open Source, Data Intelligence, Innovation Guadeloupe, Caraïbe
Marouane @___marouane___
170 Followers 525 Following
dbt @getdbt
15K Followers 69 Following 🏗 Your entire analytics engineering workflow 🧪 Built by @dbt_labs
Sarah Catanzaro @sarahcat21
16K Followers 2K Following “All methods are sacred if they are internally necessary” (GP @amplifypartners, prev @canvasvc; Head of Data @Mattermark; @palantirtech; @c4ads)
Data Engineering Week... @data_weekly
7K Followers 85 Following Weekly Data Engineering Newsletter. Subscribe to https://t.co/trebyY8UGX | Wanna talk about Data engineering? Book Me here https://t.co/OXj3VJheDH
Datakin @DatakinHQ
368 Followers 17 Following Real-time, operational data lineage tracing that helps data engineers and data scientists find, fix, and prevent operational issues.
MarquezProject @MarquezProject
910 Followers 33 Following Collect, aggregate, and visualize a data ecosystem's metadata. Powered by @OpenLineage.
Matt Turck @mattturck
141K Followers 2K Following VC at @FirstMarkCap. Host: MAD Podcast; Organizer: Data Driven NYC, Author: MAD Landscape.You might like
