Today we're sharing details on AudioCraft, a new family of generative AI models built for generating high-quality, realistic audio & music from text. AudioCraft is a single code base that works for music, sound, compression & generation — all in the same place.
More details ⬇️
Quickly highlighting some awesome end-to-end examples (complete with UI) leveraging @langchain and @streamlit:
basic_streaming
mrkl_demo
minimal_agent
search_and_chat
chat_with_documents
What examples should we add next?
Repo: https://t.co/VSCgGpZmWl
🔎Code Interpreter Insights
@Shroominic released an incredible open source implementation of code interpreter this weekend: https://t.co/yovVn8MTbu
Since its built on top of LangChain, you can easily visualized everything that's going on under the hood!
https://t.co/wgwaxZ0V5A
Last week i got over 300k views on an experimental syntax for building prompts with structured outputs
This week i spent some time writing docs and preparing a preview
I'm going out outline some one of my thoughts and links below 🧵
glad to see apps like @quivr_brain taking advantage of the fact that with langchain you can switch between multiple models (including local models!) pretty seamlessly
⭐️Multi-Action Agent w/ @OpenAI Functions⭐️
OpenAI functions allows the LLM to select a single tool to use... but often times it can be more efficient to have the LLM select MULTIPLE tools to use (if tasks can be done in parallel)
Enter... the `openai-multi-functions` agent👇
A lot of agent toolkits were mostly designed to work with normal LLMs, not chat models
But chat models are newer, faster, and generally better
We're working on making all our agent toolkits usable with these chat models, s/o @fpingham for doing the first four!
We updated key agent toolkits in 🦜🔗 to work with @OpenAI Functions
Previously SQL, CSV, Pandas agents all used the `zero-shot-react-description` agent
The new `openai-functions` agent is often faster and better - so we added an option to use that!
h/t @fpingham
you can tell from the lack of proper grammar that its been a long day 😅
Big s/o to @veryboldbagel and @nfcampos
but its only day zero! Looking forward to seeing what new functionality this unlocks