Omar Solano

AI Engineering

[Adit @aditabrm]

Many companies are #1 in a benchmark they crafted.

We worked with @micro1 to create an independently audited benchmark to measure document extraction performance with long documents.

The results of LongExtractBench show the nuances companies are likely to find in the real world. micro1 tested frontier models with max reasoning and document processing platforms with their strongest configurations, and found notable precision/recall and completion tradeoffs across most.

Reducto’s Deep Extract leads the industry by a wide margin. 🧵

[Omar Solano @omar_solano1]

@scaling01 yes but DeepSeek open souced the tech which means big tech can now be more efficient too, with the ability to scale more quickly

[Omar Solano @omar_solano1]

@sama Bingo Card from @hlr_newsletter

[Omar Solano @omar_solano1]

@eugeneyalt that’s funny tbh

[Louis-François Bouchard 🎥🤖 @Whats_AI]

I am super excited to finally announce that we ( @towards_AI ) released our first independent industry-focussed course: From Beginner to Advanced LLM Developer.

Put a dozen experts (frustrated ex-PhDs, graduates and industry) and a year of dedicated work, and you get the most practical and in-depth LLM Developer course out there (~90 lessons). It is a one-stop conversion for software developers, machine learning engineers, data scientists, aspiring founders or AI/Computer Science students. We think many millions of LLM Developers will be needed to build reliable customised products on top of foundation LLMs and achieve mass GenAI adoption at companies. We want to help you lead this new field!

One of the reasons I quit my PhD in AI (one year + 8 days ago) was to build practical solutions that will help others in the real world and improve what exists. Along with our book “Building LLMs for Production,” this course is our attempt to achieve this goal. While I love the world of academia, when I first stepped into the startup world in 2019, it felt like I pretty much knew nothing all over again. I needed to understand the problems in the real-world application of AI and build solutions for it. Not just research but real models, real products, and real people using them. But here’s the thing: grasping these challenges is merely the first step. For the ‘how’ part of it, you need to get into the code, the architecture, the models, the APIs, the deployments, the trials and errors, and the complex and wide varieties of frameworks - you don’t have time to reinvent the wheel in a startup! This discrepancy between academia and the industry is even worse in the LLM era.

So we’ve gathered everything we worked on building products and AI systems and put them into one super practical industry-focused course. Right now, this means working with Python, OpenAI, Llama 3, Gemini, Perplexity, LlamaIndex, Gradio, and many other amazing tools (we are unaffiliated and will introduce all the best LLM tool options). It also means learning many new non technical skills and habits unique to the world of LLMs.

Even though the course is super practical (oriented towards building a real-world project), we believe the course teaches concepts that will stay relevant for a long time even as LLMs get better, such as reducing hallucinations, customising to specific companies and tasks, teaching how to work with them, some cool theory, practical tips and more.

The only skill required for the course is some Python (or programming) knowledge.

We cover the full stack of learning to build on top of foundation LLMs - from choosing a suitable LLM application to collecting data, iterating on many advanced techniques (RAG, fine-tuning, agents, audio, caching), integrating industry expertise and deploying. Our students will create a working product, which we certify, and we also provide instructor support in our dedicated Discord channel. This could become the seed of a startup, a new tool at your company or portfolio project for your LLM job applications. You can find all the lesson titles and more information on the course page (or DM me).

I also want to thank some of our amazing team at Towards AI that helped achieve this, including @omar_solano1 , Fabio , Rucha , @_LouiePeters , Arjun, Jaiganesan and everyone in the team that contributed to this course.

A big thanks to some of our reviewers and my friends for the support, @daansan_ml , @SerranoAcademy , @rohanpaul_ai , @tunguz , @antgrasso , @ceobillionaire , @Scobleizer , @swyx , @hasantoxr and many others...

“From Beginner to Advanced LLM Developer” is now available on the Towards AI Academy: https://t.co/elrd1sri9b

#llms #llm #llmops #llmdeveloper

[Omar Solano @omar_solano1]

@Wenxuan_Zhou Your question made me think about diffusion models and how they perform better when generating over multiple steps and not just in one go

[Frank Marcoux @FrankHMarcoux]

LLMs have more weights than @elonmusk has money.

[High Learning Rate Newsletter @hlr_newsletter]

What is an autoregressive model in AI?

In large language models (LLMs), an autoregressive model generates the next word in a sentence by looking at the words that came before it, one at a time, to predict what should come next.

#llm #llms #gpt #gpt4 #gpt4o #llama #ai

[Omar Solano @omar_solano1]

@jxnlco what skills do they bring compared to software engineers?

[Ahmed Moubtahij @ahmed_moubtahij]

Call to ML-Montrealers: The montreal channel in the Latent Space discord is holding a paperclub Friday Apr 26th 12:00pm at "Le Petit Dep" (Griffintown).

We'll be covering the "Towards Efficient Generative LLM" paper. Links below :)

[Omar Solano @omar_solano1]

@Karmedge data extraction on the document, drop cosine similarity

[Omar Solano @omar_solano1]

@jxnlco Give me an example of "fine-tuning"

[Omar Solano @omar_solano1]

@abacaj Have you tried fine-tuning for function calls?

[Omar Solano @omar_solano1]

@jxnlco @pydantic @anyscalecompute Thanks, this will be useful. Do you know where they talk about constrained sampling?

[Omar Solano @omar_solano1]

@charlieholtz @elevenlabs very cool!

[Omar Solano @omar_solano1]

Do you remember when you joined Twitter? I do! #MyTwitterAnniversary

[ein @usr_ein]

Looking for a Discord where to meet other #CVPR2022 attendees?
Join #cvpr-2022 on the Learn AI Together discord server to share your thoughts on the conference!

#CVPR22 #CVPR #AI

https://t.co/KnMtMdX22M

[Omar Solano @omar_solano1]

@gaby_goldberg @balajis

[Omar Solano @omar_solano1]

je twitte