🚀 Announcing Mighty Inference Server!
☺️ Say goodbye to your NLP latency and cost pain.
⚡️ GPU speed on CPU, using our Rust webserver that works with many transformer models.
Your models. Your stack. Your rules. Try it now!
https://t.co/utkjK9eJAM
@OpenAI IT'S TERRIBLE. Look, I think ChatGPT is great and I'm a plus subscriber, but it's just an OK RAG on top of a web search engine (Bing API I think?). This isn't what a web search should be. The relevance is only bound to top 5, the UX is poor, and it's slow compared to web search.
@jobergum@turbopuffer I made a calculator a while ago that I use with clients and training. Here's a rough equivalent for hot (all vectors in RAM) using traditional compute, across various clouds/configs. The cost is on RAM and CPU, but I don't have numbers for QPS
@RiffTrax I thoroughly enjoyed this riff. Hadn't seen this movie since 1991 as a teen - and got a bit nostalgic. The visuals and soundtrack are mesmerizing. Roger Ebert gave it 3.5/4 stars! But the riffs were so good. I'll be ordering cold pizza for breakfast via BuseyEats tomorrow.
@rossfledderjohn Nice overview. I made a similar framework and spoke about it in early 2023. https://t.co/rDyXTybk3s ...while my first two levels are a bit different, I'd argue levels 4 and 5 are mostly unachievable, as they require complex social interactions.
I don't post on twitter anymore (well except for this) but I lurk every week or so. Apparently it wants my birthdate or I'll lose access. If I get kicked out then so be it. Catch me on linkedin, email, or slack. ✌️
@RebeccaLeclair6@evandawson Thanks for everything @evandawson it was a truly wonderful event. Looking forward to your show with Masum today. @RebeccaLeclair6 based on the praise and support we received, I think we'll have to do it again next year!
Thrilled to announce that @evandawson will be the emcee for next week's https://t.co/EVxfTcpNa9 conference. There's some amazing talent coming and sharing their work and passion. Going to be something amazing that Rochester's never seen before.
🎉 Flower City AI - the local Rochester NY community AI conference - is out of stealth! This is a not-for-profit community event on December 6th showcasing AI tech in Rochester. Tickets cover the cost of the event, and students attend free. https://t.co/EVxfTcpNa9
Big thanks to all the listeners and supporters! Many of you reached out to say thank you for the podcast and some of your became guests. Stay tuned for the new episodes :)
FYI, we've just renamed the default branch from 𝘮𝘢𝘴𝘵𝘦𝘳 to 𝘮𝘢𝘪𝘯 for https://t.co/iWlUTFiuMZ. You can run the following to quickly update a previously pulled repo:
git branch -m master main
git fetch origin
git branch -u origin/main main
git remote set-head origin -a