Giuseppe Steduto

[Giuseppe Steduto @giusteduto]

Crazy W for Gemini

Still a lot of to do to improve computer-use agents, really fun times to work on this

[Seldon @seldon_tech]

Gemini 3.7 Flash delivers performance comparable to Fable 5 at a fraction of the cost

We see that many models finish the tasks prematurely, resulting in lower scores and costs

[Seldon @seldon_tech]

@GoogleDeepMind and @Alibaba_Qwen released new models this week. These are the results:

Gemini 3.7 Flash is the new State-of-the-art model on VGI-Bench.

Qwen 3.8 Max comes in as fourth place in after Gemini 3.6 Flash.

[Seldon @seldon_tech]

Introducing VGI-Bench: a multimodal, holistic benchmark probing 12 distinct visual and audio-visual skills.

550 human-curated questions, designed to mitigate the common mistakes in today's video benchmarks and expose pragmatic failures of state-of-the-art models.

Best model: 64.73%. Humans: 84.5%.

[Carl Camel @TwoHumpChump]

@AnthropicAI