harnesses are everything. and they help smooth out the jagged edges of intelligence. here's a primer on them.
a few months ago, I wrote a series documenting learnings and useful patterns around building and working with harnesses with my friend @zakkeener42 at @baseten.
last week, we compiled them and turned it into a small book. it covers how to optimize existing harnesses, how to choose the best one for you, how they are co-evolving with models. as a bonus, we added some thoughts on what the future might look like. link in description:
@quxiaoyin Crazy the switch up on the market for who is seen as being in the right or in the wrong. Felt like OAI was losing public perception for a while now
Prediction: within 12 months, top three models will be open source.
Economic winners will be the American clouds that serve them:
Nebius
Iren
Baseten
Together
Fireworks
We believe openness to be an advantage for AI safety. Openness provides more visibility into the behavior of models and, most importantly, greater means of turning safety research into actionable and transparent controls than closed-source.
This is why Baseten and Base Labs are building a stronger safety and security standard for open models, with the launch of our safety infrastructure. Base Labs will develop and publish methods for training and monitoring open models, and Baseten will integrate that work into its deployment infrastructure, live at runtime, and offer this work as a managed service. This will be a standard that is transparent and built into how our models are trained and deployed.
We invite the open-source community to contribute, and are proud to partner with @huggingface and @GoodfireAI to bring this vision to fruition.
Together, we are building an ecosystem of open models that are safe and accessible to all.