Have a new dataset and not sure which pre-trained model to fine-tune?
We present GBC, a scalable approach for selecting the ideal source models for fine-tuning (without actually fine-tuning!). To appear in #CVPR2022.
Paper: https://t.co/Fbm1ESPM0T
1/4 π§΅
@RoupenMD Original is often whoever wins distribution first. Two teams can start at the same time, but the one with massive marketing becomes the baseline. Everyone else looks like a follow-on when they finally reach users.
@gritfollow@ycombinator@medi_search Hi! We did run the benchmark using Gemini 3. We could only get it to 13.3 with maxed out reasoning. However, we did not want to share this in the original chart because this is not an official result from their published evals. The OpenAI results are here: https://t.co/wzB8D4ijnQ
Weβve just released our most advanced medical AI yet: MediSearch Max.
We tested it on HealthBench Hard, a new benchmark from OpenAI designed to test models on difficult medical cases. Max scores 53.3%, beating both GPT-5 and GPT-4o.
Give it a try. Link in the comments. π
@DrKesbeh I am not super familiar with their quality level. We have some comparisons based on the performance they published: https://t.co/zfLMDlvBPV. Happy to hear your thoughts once you try MediSearch though π
@agihippo It is a bit unfair to judge science this way. Someone can riff on it and _maybe_ make something that will work better than MLPs. That's how progress happens.
@GillVerd@ylecun I found training an EBM extremely challenging for high dimensional data using non-smooth architectures. Always had to make the nets residual, Lipschitz etc. + other tricks. How do you plan to overcome this @GillVerd?