I’m hiring experienced ML engineers for my team to work on pre-training data and mid-training. We have ambitious plans, and you’ll play a key role in shaping the data mixture for large-scale pre-training runs. Please consider applying if you care deeply about data and its impact on model performance. Links are in thread!
Introducing Cohere's first open-source coding model: North Mini Code
Small & efficient, designed for agentic performance and built for community input.
Extremely excited to present Command A+, our first sparse model!
I am very proud of the work we did to enable this model. We built our sparse training stack from the ground up over the past year with a lot of custom kernels, performance engineering to enable us to train large sparse models with a very small compute footprint.
We presented our work on a fully dropless FP8 kernel stack for sparse models at Nvidia GTC earlier this year. We are extremely ambitious and are marching towards a state-of-the-art model training stack, come join us if you are interested in pushing the frontier!!
Apply here - https://t.co/BhV5ffuarA
Our work here - https://t.co/o86oK5iD2E
Introducing: Cohere Command A+
We’ve created our most powerful LLM yet, optimized it to run on as little hardware as possible, and released it open-source for all.
Excited to share our work on production-ready W4A8 inference, now integrated in vLLM! By combining 4-bit weights (low memory) with 8-bit activations (high compute), we hit the sweet spot for both decoding and prefill — up to 58% faster TTFT and 45% faster TPOT vs W4A16 on Hopper.
We’re excited to announce our partnership with @RWSGroup, bringing Cohere’s frontier AI models to Language Weaver Pro - unlocking new enterprise‑grade translation capabilities.
Purpose-built for high-stakes environments, this integration empowers enterprises and governments to communicate seamlessly across languages and accelerate new opportunities for global collaboration and growth!
Learn more: https://t.co/Bt7S9EcOwc
We’re excited to announce that we’ve signed a Memorandum of Understanding for advanced AI collaboration with Saab, a global leader in defense and security.
Together, we’ll explore groundbreaking AI partnerships for their aerospace platforms and deliver tailored solutions critical to Saab’s operations.
Read more: https://t.co/yvHeXKqYfn
Hey all, I will be at GTC next week talking about all the work my team and I did on large-scale MoE training in JAX on GPUs! We decided early on to have a fully dropless training stack to avoid token dropping. (1/7)
We are excited to share our new paper on Verifiable Aggregate Receipts (VAR) — a cryptographic primitive for auditable engagement counts that prevents inflation while preserving user privacy.
This is joint work with @wanggary142857, Jasleen Malvai, and @0xFanZhang at @YaleACL.
I will be at Nvidia GTC in March! @bharatvenki and I are gonna talk about all the systems work we do at Cohere. Come listen from me about all the custom kernel work we do for large scale LLM training on Hopper and Blackwell!! https://t.co/2SEbDtrIQk
I love discovering extremely talented young Greeks like @giannis2two in NYC building super cool stuff. So many hidden (people) gems out there. Who are some of the highest signal yet most underfollowed GR techies you know? Drop them below, help me bring the spotlight they deserve.
Apply to do research with me on emergence of agency/planning in LLMs, out-of-context reasoning, understanding generalization from data, or propose your own direction!
Very excited to be mentoring this spring 💫
@SahilBloom You should distinguish uncertainty of purpose from uncertainty of rewards
E.g. it should be certain that you'll show up and take a step every day; even if it's uncertain you'll be rewarded
Uncertainty of purpose should be extinguished, uncertainty of rewards should be expected