Exciting start to our company all-hands in Austin, Texas! Great opportunity to get together with an amazing group of people, keep everyone on the same page, and build cool solutions that make a difference in the AI space!
Working on some awesome stuff with @thewebAI. We've been working hard to bring large LLM models to local distributed environments through our own framework, webFrame. Last night we got Llama 3.1 405B Instruct running on a cluster of 4 Mac Studios. Parsing direct to MLX from HF.