@hoyeon_chang What's more interesting here is probably forgetting: when a model forgets a factual info, does it hallucinate or does it admit to have forgotten? How do we steer this behavior better?
@andyzou_jiaming Really cool work but wouldnt short circuiting still suffer from the same issue with degraded performance?
This is especially tricky since a lot of user prompts are not intentionally harmful but the short circuit logic is never perfect.
@giffmana I met these guys irl. They were selling their torch fsdp implementation on 10 4090s as something that can rival OpenAI's H200s.
They even got second place on a hackathon.
Should tell you enough who they are lol.
@hingeloss I met these guys irl. They were selling their torch fsdp implementation on 10 4090s as something that can rival OpenAI's H200s. Should tell you enough who they are lol.