For AI applications - if you can nail Automated Evaluation of what good looks like, combined with some Durable Execution (which supports streaming/steps/retries/complex flows) - then you’re a lot further on than most!
We’re here at #TheAISummit at stand 3-2-1 in the South Expo Hall. We solve difficult problems through great software engineering and design. @parallax
Come say hello 👋
We got GMail (full interface) working in @ladybirdbrowser, let's fricken gooooooo! 🚀
This one is nice because I've been told by many people "you'll never be able to handle modern web apps like GMail"
Don't listen to armchair defeatists. We can build whatever we want! 🤓
- Quantized it so it doesn't crash my M3 Mac. - Started a llama.cpp server, and use the raw (non-OpenAI-compatible) API to delve into the underlying logprob data. - Built a basic UI on top of this to start exploring.
Some interesting advantages to having greater insight into underlying probabilities is knowing when it might be wrong, debugging models issues, and for learning purposes.
Another weekend project, I've built another visualisation.
Commercial LLMs often don't expose their logits/logprobs. This is the chance that the next token/word appears.
What I've done:
- Pulled Llama3.3 locally from HuggingFace, converted it to GGUF for llama.cpp.
Collection of insane and fun facts about SQLite. Let's go!
SQLite is the most deployed and most used database. There are over one trillion (1000000000000 or a million million) SQLite databases in active use.
It is maintained by three people. They don't allow outside contributions.
I've made a tool that lets you explore Text Embedding Vectors (an important step for AI tools which use Retrieval Augmented Generation) in a 3D space.
You can choose between different dimension reductions, which helps you compare features.
@PhilAbdoulaye@pas256@martijnvdo@Osterjour Commemorating the remarkable accomplishments of these AWS Heroes in driving innovation and sharing knowledge:
▶ Keith Yau
▶ Kazuki Miura
▶ Kaushik Mohanraj
▶ James Hall
I wrote a post about our conference dream team following this year's conference, featuring @philhawksworth, @MrRio and @_mrBevan 💪
https://t.co/m1MwaNZCJb
This strange tweet got >25k retweets. The author sounds confident, and he uses lots of hex and jargon. There are red flags though... like what's up with the DEI stuff, and who says "stack trace dump"? Let's take a closer look... 🧵1/n