Top Tweets for #FineTuneBench

over 1 year ago

How well do #LLM fine-tuning APIs work? Not well. We created #FineTuneBench to study if we can update #ChatGPT, #Gemini's knowledge or teach it new facts via finetuning APIs. Answer is mostly No. Finetune 4o-mini was the most effective; Gemini less https://t.co/PKladFsctv Users want finetuning-as-a-service but current commercial APIs are limited wrt knowledge infusion. While OpenAI APIs can memorize, generalization is poor. We hope #FineTuneBench can be a useful metric and leaderboard to improve these services https://t.co/p54ejqzMcG Great work by @kevinywu @ericwu93 👏

james_y_zou's tweet photo. How well do #LLM fine-tuning APIs work? Not well.

We created #FineTuneBench to study if we can update #ChatGPT, #Gemini's knowledge or teach it new facts via finetuning APIs. Answer is mostly No.

Finetune 4o-mini was the most effective; Gemini less https://t.co/PKladFsctv Users want finetuning-as-a-service but current commercial APIs are limited wrt knowledge infusion. While OpenAI APIs can memorize, generalization is poor. We hope #FineTuneBench can be a useful metric and leaderboard to improve these services https://t.co/p54ejqzMcG

Great work by @kevinywu @ericwu93 👏

128

16K

Top Tweets for #FineTuneBench

Last Seen Hashtags on Sotwe

Trends for you

Most Popular Users