Silo AI, together with TurkuNLP and HPLT, is releasing Viking 33B. Viking 33B is evidence of efficiently scaling an open source distributed training framework for the LUMI supercomputer powered by AMD Instinct GPU accelerators.
https://t.co/rf03wfqNG1
We are (finally) releasing the 🍷 FineWeb technical report!
In it, we detail and explain every processing decision we took, and we also introduce our newest dataset: 📚 FineWeb-Edu, a (web only) subset of FW filtered for high educational content.
Link: https://t.co/MRsc8Q5K9q