@hiddensmallcaps 1. Neo DCs are better 2. TPUs are a reach to not be locked into Nvidia's allocations (if they have better economics, why offer Nvidia at all?) 3. They're struggling to get memory allocations for TPUs - they're new, they have purchasing power but not the trust of memory producers
@charlieholtz Yeah 5.5s definitely better. For sure felt the difference, and felt like the Codex harness may have been doing the improvements. ✊Glad you caught it, back to running my life in parallel
@LottoLabs There were a lot of 3090 pre-builds last year. Toronto area. Got some sub-$1400 4090s right now as well. Gotta make sure your breakers can support the draw though, mine couldn't at load 😭
@thorstenball@lewis_b_metcalf The main value I got from this was a better understanding of Thread usage in Amp 👍 My workflow's similar, but with some manual shenanigans in CC. Gonna have to have another look at Amp
@TriDeapthBear Would love some evals on this. In LLM prompting passing nested JSON as completion content can create noise for the models. There have been some studies that they're better at kv, markdown, and XML vs. JSON. key:value make sense, but I find these structured blobs questionable