@jasminewsun For those in the trades - what were they working on before, did they transition careers due to demand? Also would be worth examining the labor components of maintaining data centers after buildout.
@mattparlmer Yeah, MMMU is a good proxy for spatial reasoning across models that support multimodal inputs. Gemini Pro/Flash remains at the frontier by a wide margin for performance as well as latency in my experience
@skooookum the benefit is that via in-context learning, once such a practice is established initially, agents pop off
it's a bit like having a jr. engineer onboard a greenfield vs mature codebase -- in the latter, there are way more best practices to mimic
@imranchaudhri congrats on shipping
new schools of thought should always be welcomed with an open mind and in this case it will be interesting to see if widespread usage results in a killer workflow
1. Data companies - Scale AI, Twitter/Reddit (API changes are a big bet on this), Databricks
2. Compute: GPU companies, cloud compute companies, and companies that train foundational models (we know the players) here
3. Interface - ChatGPT, Poe, Tesla Car/Bot, Copilot, TikTok
@chipro On control: Relying on APIs bets that the particular model or company will always be SOTA - using open source allows folks to plug and play as things progress and iteration might be better with OSS even though initial setup is trickier than an API call.
Sometimes it’s easy to forget that most target markets are outside the sphere of hyperactive influencers - might be the reason why some products show a growth initially and then stall within 2mo of launch. Echo chambers produce seasonal products