Top Tweets for #Gaperon

10 months ago

You guys so should read this thread :) @riantouchent made his super cool « benchmark in a haystack » visualizer from our #GAPeron paper available at @huggingface and it’s telling to see how most high quality pretraining data classifiers works in practice #ContaminationIsAllYouNeed We’ll be super happy to add your own classifier in the pool, contact Rian :)

rian @riantouchent

10 months ago

Using neural classifiers as quality filters for pretraining data is now a standard step of LLM training. But is it really finding relevant documents or is it a powerful benchmark leaks finder ? As part of Gaperon work, we made a tool to find out!👇

riantouchent's tweet photo. Using neural classifiers as quality filters for pretraining data is now a standard step of LLM training.

But is it really finding relevant documents or is it a powerful benchmark leaks finder ?

As part of Gaperon work, we made a tool to find out!👇 https://t.co/DycdJNeuII

496

Top Tweets for #Gaperon

Last Seen Hashtags on Sotwe

Trends for you

Most Popular Users