SeeRole

@SeeRoleTask

Joined March 2024

21 Following

1 Followers

2 Posts

SeeRole @SeeRoleTask

8 months ago

■ Review 하기 #ThinkingMachines

Thinking Machines

@thinkymachines

8 months ago

Our latest post explores on-policy distillation, a training approach that unites the error-correcting relevance of RL with the reward density of SFT. When training it for math reasoning and as an internal chat assistant, we find that on-policy distillation can outperform other approaches for a fraction of the cost. https://t.co/JhpyWQOpBe

$thinkymachines's tweet photo. Our latest post explores on-policy distillation, a training approach that unites the error-correcting relevance of RL with the reward density of SFT. When training it for math reasoning and as an internal chat assistant, we find that on-policy distillation can outperform other approaches for a fraction of the cost. https://t.co/JhpyWQOpBe$

404

SeeRoleTask retweeted

Elon Musk

@elonmusk

over 1 year ago

Very important concept!

194K

18K

11K

54M

SeeRole

@SeeRoleTask

Last Seen Users on Sotwe

Trends for you

Most Popular Users