🚀 Building your first data pipeline? Start small, but plan for growth.
🛠️ Data evolves—build for change.
🚮 Standardize early to reduce tech debt.
🔭 Prioritize observability and quality checks.
In this article, @DagWorks co-founder @stefkrawczyk breaks it down for you.
https://t.co/WJEWPDw8Do
Data pipelines have been around but they’re becoming increasingly crucial as organizations look to deploy AI agents. We spoke with @DagWorks co-founder @stefkrawczyk to understand what teams should consider when standing up their first data pipeline. https://t.co/qCLQ3ofaqB
Check out the latest article in my newsletter: February Updates https://t.co/CH4viGqTl2 via @LinkedIn@hamilton_os:
- crosses 2K⭐️
- installs in @pyodide envs
- mutlithreaded parallel DAG execution
@burr_framework:
- crosses 1.5K ⭐️
- async persister implementations
- tag aliases for actions
📣 New blog post! Chat with your webpage with
@scrapegraphai, @burr_framework and @lancedb
https://t.co/QtjBSEYixP
TL;DR: a great post showing the use of lightweight tools that are "orchestrated" and "observed" with Burr.
💬Chat with your webpage cookbook is out! 💬
It uses @scrapegraphai to extract the webpage content, @lancedb to vector store it and retrieve the most relevant chunks and @DagWorks@burr_framework to orchestrate everything ���
Try it out: https://t.co/rOIpGIx7KB
Excited to show the pluggability of #Burr here:
- execution can be farmed out to @raydistributed
- persistence is pluggable and means you can have fine grained fault tolerance!
Super excited for this HOW-TO on running the Hamilton
UI on @SnowflakeDB :
"Observability of Python Code and Application Logic with @hamilton_os UI on @SnowflakeDB Containers" Services by Greg Przemyslaw Kantyka https://t.co/kYyE0CIIf2
Tired of the deployment headaches with #LLM agents? #BentoML takes care of the heavy lifting - from REST endpoints to scaling. Great post by Thierry Jean from @DagWorks showing how to combine #Burr and BentoML for streamlined agent deployment! Read the blog post to learn more: https://t.co/LfcxcNsPpy
🎓 Learn to Test and Improve Your LLM Applications 🤖
LLM-powered apps are everywhere, but building reliable ones? That’s still a challenge. If you’ve ever wondered how to systematically test, evaluate, and improve your generative AI applications, this free 30-minute Lightning Lesson is for you.
I’ll be teaching this session alongside @stefkrawczyk, co-founder of DAGWorks and an expert in building robust ML systems. Together, we’ll cover practical strategies to help you confidently test and refine your LLM apps.
📅 When: Monday, December 16, 2024
⏰ Time: 7:00 PM EST
📍 Where: Virtual (Zoom)
💡 What You’ll Learn:
•How to write pytest cases to test LLM outputs.
•Building a framework for iterative improvement.
•Techniques to evaluate outputs and improve stability.
✅ Register here: https://t.co/M95Msw0jDv
Let’s move beyond demoware and start building applications that work in production 🚀
Check out the latest article in my newsletter - highlights:
@hamilton_os:
- async @datadoghq tracer for async Hamilton
- @pandas_dev@DataPolars with_columns support
@burr_framework:
- Persistence configurability for parallelism.
See more here:
https://t.co/n7qCSls5FI via @LinkedIn
Super excited to be doing a @MavenHQ ⚡️ class with @hugobowne next week: "Building with #GenAI from First Principles".
If you're struggling to get out of POC purgatory, or want to better understand how to develop #GenAI software, then what we're going to be talking about is for you!
It's a free class - sign up here - https://t.co/Sx7s2bGPju
(It's a sneak peek of our course that starts in January.)
Don’t miss episode 22 of Generationship! Elijah Ben Izzy (@elijahbenizzy), CTO of @DagWorks, shares his journey in AI and the exciting projects he’s leading to revolutionize data pipelines. Tune in now!
https://t.co/X4JyTTa93t
Excited to be running a course on @MavenHQ with @hugobowne around building GenAI products using "first principles".
But the course material isn't set yet. We'd love your feedback please! If you can spare a few minutes, we'd love your input here - https://t.co/leDAbyS7HH
#genai #llmops #genaiops #SoftwareEngineering
Diving into OSS is a blast and super important!
Lately, I've been all about @burr_framework for whipping up state machines and AI agents.
Just dropped my first commit in the new release 🎉
Give BURR a look guys, it plays nice with any framework. AI devs, you'll love it!
#OpenSource #AI
In Episode 22 of Generationship, @RachelChalmers chats with Elijah Ben Izzy (@elijahbenizzy) of @DagWorks about Burr (@burr_framework), a tool that’s revolutionizing AI workflows. Tune in!
https://t.co/DSZIXtWY7R
New blog post on #Burr:
TL;DR: a quick overview of Burr's features to help curate your data for review and use by your internal team:
1. Review & annotate
2. React
3. Retune
https://t.co/rUnXU5lqCl