@zainhas@antoine_chaffin@bclavie@jeremyphoward@tomaarsen@apsarathchandar Thanks a lot for the interest! We evaluated all models with a standardized compute efficient finetuning and could not run a large grid search. LRs could probably be tuned for each of them. It'd definitely be interesting to see all models evaluated with more complex finetuning!
@zephyr277@apsarathchandar@qfournier2 Thank you! NeoBERT is not integrated into the transformers library yet, so our code is hosted in the HF repo with the model (https://t.co/VIUpKVWRxt… needs to be run locally). But we would definitely be happy to work with a HF team to integrate it if people are interested!
2025 BERT is NeoBERT! We have fully pre-trained a next-generation encoder for 2.1T tokens with the latest advances in data, training, and architecture. This is a heroic effort from my PhD student @lo_LB_La in collaboration with @qfournier2 and Mariam El Mezouar (1/n)
@IKEA_France ou l’incompétence à son maximum. Leur service client c’est un message copié-coller proposant de « chatter » (ce qui n’est en fait jamais disponible).
@IKEA_France Nous portons plainte de manière groupée contre Ikea. Il ne s’agit plus d’un problème de service client, mais d’un problème judiciaire. Associez-vous à nos témoignages.