@Wenpeng_Yin For a second I thought it was one of my ongoing works cuz of the little robots you are using in your diagram 😃. Anyways, the paper was a nice read!
Stay-tuned with @ai2_allennlp since soon they will be releasing:
- OLMo 65B
- Adapted OLMo with instruction-tuning and RLHF
- Training logs, ablation and Weights and Biases runs
Technical report: https://t.co/RXMBdsftlH
A truly open-source LLM is out! OLMo by @ai2_allennlp is another step towards democratizing LLMs. With its 1B and 7B already hitting huggingface and 65B under training, there is a lot to look forward to! Here are some cool things about OLMo:
Are biases unique to specific language representations based on the history & culture of the region they're spoken in? Check out our #NAACL2022 paper on “Socially Aware Bias Measurements for Hindi Language Representations“ (https://t.co/q6Jwnip7FD) with @kaiwei_chang @sunipa17