Web applications and data pipelines probably have more in common than you think! Both require efficient handling of background tasks, yet scheduling those tasks are often harder than it should be. Andrew Brookins, Lead Staff Software Engineer here at Prefect, goes in deeper to describe the similarities in the issues that non-data software engineers and data engineers both face, and how Prefect 3.0 can help. Read more 👉 https://prefec.tv/46aFseM
Prefect
Software Development
Washington, District of Columbia 24,382 followers
Stop wondering about your workflows.
About us
Modern workflow orchestration for data and ML engineers
- Website
-
http://www.prefect.io
External link for Prefect
- Industry
- Software Development
- Company size
- 51-200 employees
- Headquarters
- Washington, District of Columbia
- Type
- Privately Held
Products
Prefect
Data Science & Machine Learning Platforms
Prefect is open-source workflow orchestration for building, observing, and reacting to your data pipelines. With Prefect, control and observe: 1. What code runs, and the data it handles 2. When it runs, scheduled or triggered by an event 3. Where it runs, and the systems it talks to
Locations
-
Primary
1200 18th St NW
Washington, District of Columbia 20036, US
Employees at Prefect
Updates
-
Curious how fintech organization optimize their machine learning processes? Learn from Wendy Tang, a Machine Learning Engineer at Cash App, who uses Prefect to improve their machine learning workflows! By adopting Prefect, Wendy and her team have been able to: ✅ Move beyond traditional ETL processes to achieve greater compute flexibility ✅ Better manage their custom Python packages ✅ Streamline data exchange between tasks They’ve also been able to ensure efficient, secure deployment of flows across various environments, which is crucial for their fraud detection models. Read the blog to learn how Wendy and her team stay ahead in the fast-evolving fintech industry 👉 https://prefec.tv/3Sd0OCC
-
-
The struggle is real: complex webs of tasks, constant failure risks, and limited tool flexibility. Enter Prefect 3.0. 🌟 This next-generation workflow engine empowers you to: ⚡ Build workflows that are resilient by design: Prefect 3.0 uses transactional semantics for rollbacks, re-runnable tasks, and more to enable truly idempotent workflows. ⚡ Run any workflow, anywhere: Prefect's open-source foundation lets you automate any function, anywhere, and with right-sized resources. ⚡ Take control of your AI agents with ControlFlow: This open-source framework built on Prefect 3.0 helps AI engineers orchestrate and control AI agents with consistent history and context. Learn more about Prefect 3.0 directly from our CEO and Co-Founder, Jeremiah Lowin by reading the blog here: https://prefec.tv/4cyH97U
-
-
⏰ The wait for Prefect Summit 2024 is almost over! ⏰ We’re less than a day away from the event and we’re so excited to see everyone! Stay tuned on our social channels this week as we share announcements, highlights, and other content from the summit. It’s not too late to register if you haven’t already 👉 https://prefec.tv/3WGZdYH Don’t forget Chicago and New York attendees - we are hosting happy hours in your area! Get the details and save your spot using the links below: 📍 New York: https://prefec.tv/3VFBwz1 📍 Chicago: https://prefec.tv/3x6iDfv
-
-
🚀Only few days left until Prefect Summit 2024! 🚀 Attend the event to hear exclusive insights from industry leader John Kang from Cox Automotive! In his session, you'll learn how Cox Automotive migrated models to Python using Prefect 2.0 Cloud and deliver real-time labor and equipment predictions. 📅 Date: 6/25/24 🔗 Register now: https://prefec.tv/3WGZdYH --- Attention attendees in New York and Chicago! We are hosting happy hours in your area and would love to see you there! Save your spot using the links below: New York: https://prefec.tv/3VFBwz1 Chicago: https://prefec.tv/3x6iDfv
-
-
Knowing your failures happen is fine. Having tools to debug them is good. Reacting to failures automatically so everything still works while you debug? Now that's great. This is exactly the feature that ClickHouse powers for Prefect - our backend eventing system. Prefect automations are more robust because of ClickHouse. Event-driven systems are the future, and we're happy users!
When Prefect migrated from a BigQuery and Postgres-based analytical stack to ClickHouse, they reduced costs by 33%. 🤯 Using ClickHouse, Prefect streamlined their architecture, making it more reliable and easier to maintain. As Sarah Krasnik Bedell explains, “ClickHouse has created resiliency in a completely new way with fewer systems to maintain, I think that's another reason why this work is so important.” 🔗 Read the full story about how Prefect powers next-gen workflow orchestration observability with ClickHouse below! https://lnkd.in/eytfSQip
-
We’re less than two weeks away from Prefect Summit 2024: Ready, Set, Flow! 🗓️ Have you registered yet? If not, here are five reasons you ✨should ✨ —> https://prefec.tv/3Vq0bpV If you can’t attend, register now and you’ll get access after the event to watch whenever works best for you 🫵 https://prefec.tv/3WGZdYH
-
-
We’re less than a month away from Prefect Summit 2024! 🎉 We’re excited to introduce one of our guest speakers, Wendy Tang, a machine Learning Engineer at Cash App! In her session ‘Building Blocks for Orchestration Platforms’, Wendy will be sharing how her team uses Prefect to build an orchestration platform that's not only flexible but also scalable. Reserve your spot at the summit by registering here —> https://prefec.tv/3WGZdYH
-
-
Heading to Big Data & Analytics Canada 2024? Swing by our booth on June 5-6th! Fun fact: you might be able to snag a rubber duck if you catch us early! 🦆 Also, don't miss your chance to gain valuable insights from our very own Sarah Krasnik Bedell! She'll be sharing her expert views on 'Overcoming Industry Barriers with Big Data', as part of the panel at 12pm on June 6th. See you there! 👋
-
-
Cleaning up infrastructure failure is a challenge on its own. But what do you do when the cleanup jobs themselves fail? Take a read at our latest blog post, where it sheds light on the importance of cleanup jobs and how to overcome the challenges of hosting them reliably. Read the blog here: https://prefec.tv/3QV2PTr
-