Hello Product Hunt!

We're excited to share Orchest 2.0 with you today: our modern take on building data pipelines. Over the past year we've learned a ton from our early user community and oh boy did we listen to your feedback!

Building data pipelines shouldn't require a PhD or 10+ years of DevOps experience. Our goal is to bring Data Scientists and Data Analysts into the fold by making the complex parts of building and deploying data pipelines in production... disappear 🪄

Orchest brings together best-in-class Open Source projects like JupyterLab, nbconvert, Argo, BuildKit, Kubernetes to provide a seamless data pipeline development *and* deployment experience. The best part is - Orchest itself is open source too! Whether you're ETL/ELT-ing, training models, feeding dashboards, monitoring systems, querying databases or fetching from web APIs - you can get it done in Orchest fast & easily.

Development 🛠️

✅ Graphical pipeline editor ✅ Integrated Scripting & Notebook IDE ✅ Fully integrated with your Git version control system ✅ Text editor, REPL and interactive Bash Shell ✅ Multiple users ✅ Code in Python, R, Julia, JavaScript and Bash. ✅ All this in your browser 🤯

Deployment 🚀

✅ Schedule cron jobs with a single click ✅ Automatic multi-node/cluster scaling ✅ Fully integrated logging ✅ Failure notifications (Webhook) ✅ Container image building & versioning

Try out our free hosted version on cloud.orchest.io (up and running without creditcard under 1 minute) or install the Open Source project directly from GitHub. You can build anything.

Thank you from the entire Orchest team - a fully distributed team with nationalities from across the globe 🌍🇳🇱🇩🇪🇮🇹🇺🇸🇸🇪🇬🇧🇹🇼🇮🇷🇪🇸.