RE: "how often do you see teams actually fine tuning LLMs?"
It's an interesting question, about how prompting (optimization over prefix tokens) and finetuning (optimization over weights) will be used over time. If people have data points please pitch in.
I expect that finetuning is still quite new / a lot more involved (accessible data collection, optimization, expertise around making it work) but a lot of this is improving.
In 2023, Data Engineering is the fastest-growing field in machine learning. A lot of challenges that we have previously explored in database design are now being adapted to Machine Learning.
Here are some of my fav papers on the topic: 👇🧵
This course overview with @GoAbiAryan is pretty dope! It feels like all my data engineering / MLOps questions are addressed in one place.
👇Topics covered 👇
What to do about LLM FOMO?
Learn to be a tester.
When done with testing, get back to the fundamentals-
1. Customer acquisition
2. Database management
3. Putting models in production
4. Personalization
5. Making revenue
Don't get attached to tools, use tools to ur own end!
My *slightly* contrarian take is that our decision processes emulate probabilistic causal reasoning far more than deterministic causal reasoning. And if so, the LLMs are likely a step in the right direction when it comes to general intelligence and developing performant systems.
There is a lot that has to be covered from a #DataEngineering perspective before a company can consider implementing some of the #MLOps practices.
Invest unproportionally large amounts into your #DataEngineering efforts.
If you liked the conversation, you're certainly going to love @AiSimonThompson's new book on the topic that we talk about extensively on the podcast outro https://t.co/aNN0bZVcch
Two weeks ago, I got to ask Simon @AiSimonThompson some pressing questions about managing machine learning projects.
Here are some of my fav takeaways from that conversation. A thread 🧵⤵️
This has been such an excellent year for software system design in ML. So, I compiled a list of some of my favorite papers 📜in MLOps.
Here are some of my favorite ones till date⤵️
In Data Engineering EcoSystems, we will discuss the data engineering processes for full-stack applications briefly touching on data science processing pipelines, ML models, pipeline management tools, databases, front-end and more.
- A Noob's Intro to Python helps you develop an intuitive understanding of programming concepts and Python syntax.
- Designing Data-Intensive Scalable Apps will be focused on system design for building scalable and reliable applications with online services and modern databases.