Jason Wang

[Percy Liang @percyliang]

What would truly open-source AI look like? Not just open weights, open code/data, but *open development*, where the entire research and development process is public *and* anyone can contribute. We built Marin, an open lab, to fulfill this vision:

[David Hall @dlwh]

@_jasonw_sy recently added Grouped Query Attention to Levanter’s Llama implementation. GQA is used in the higher parameter count Llama 2 configurations, meaning Levanter now supports the full suite of Llama models! https://t.co/sxSResA8Qe