Metaplane reposted this
Data teams should be the first to know about data issues. That’s why I’m particularly excited to announce the first 𝑆𝑢𝑚𝑚𝑒𝑟 𝑜𝑓 𝐷𝑎𝑡𝑎 𝑂𝑏𝑠𝑒𝑟𝑣𝑎𝑏𝑖𝑙𝑖𝑡𝑦 drop: Metaplane now integrates with Airbyte. Airbyte is the leading open-source data movement platform, helping 6K companies move data from 300 data sources. Now, both Airbyte Cloud and self-managed users can proactively detect issues like: 𝟏. 𝐋𝐨𝐧𝐠-𝐫𝐮𝐧𝐧𝐢𝐧𝐠 𝐬𝐲𝐧𝐜𝐬 (duration) 𝟐. 𝐋𝐚𝐭𝐞-𝐚𝐫𝐫𝐢𝐯𝐢𝐧𝐠 𝐝𝐚𝐭𝐚 (last succeeded timestamp) 𝟑. 𝐒𝐲𝐧𝐜𝐬 𝐭𝐡𝐚𝐭 𝐝𝐢𝐝𝐧’𝐭 𝐦𝐨𝐯𝐞 𝐭𝐡𝐞 𝐫𝐢𝐠𝐡𝐭 𝐚𝐦𝐨𝐮𝐧𝐭 𝐨𝐟 𝐝𝐚𝐭𝐚 (rows and bytes synced) Our Airbyte integration monitors all of these metrics out-of-the-box with machine learning, so no configuration is needed. We also extract lineage so you can see the Airbyte streams that feed into warehouse tables and trace dependencies end-to-end from ingestion to consumption. Read more about the integration in the blog post in the comments :). And if you use Metaplane already, you can connect in <5 minutes. #dataengineering #dataquality #dataintegration
Kevin Hu, PhD... I like the use of the manatee. Is it representative of all Hu-manatee...that benefits from Metaplane???
It was great working with your team on this. There was a lot of nerding out on our side to see full lineage from ETL to BI and having the Metaplane modeling applied to this data. Just a fair warning though that looking through all the data has sparked a few more ideas...
This is awesome!
It's been a blast working with Alex Gronemeyer, Anil Maharjan, and Teo Gonzalez 🙌🙌🙌
Chief SQL Wrangler & CEO at Metaplane | MIT research | Data-informed posts about data
3moLearn more about our Airbyte integration here: https://www.metaplane.dev/blog/new-integration-airbyte