David Herel

Co-founder at @BottleCapAI | Co-Founder Hive Spirit Technologies | Amazon Alexa Finalist | Co-Creator of Thinking Tokens

[Jon Barron @jon_barron]

Hi all, I have a new result I'm excited to share. It turns out that *all existing implementations* of softmax and cross-entropy (that's JAX, PyTorch, textbooks, etc) have a subtle bug --- two bugs, actually. A simple rewrite fixes both, and eliminates "slingshots" when grokking:

[David Herel @itsdavidherel]

@BottleCapAI 🚀

[BottleCapAI @BottleCapAI]

🚨ThinkingCap: Gemma-4-26B-A4B is out!
The most token-efficient Gemma-4-26B-A4B available.

🚀Up to 69% fewer thinking tokens, 38.9% on average
🎯Negligible accuracy loss 0.15pp
🏢ThinkingCap PRO: up to 87.6% fewer thinking tokens, 62% on average - Contact our enterprise[at]bottlecapai[dot]com

📄Blogpost: https://t.co/pFbIEOlwOl
🤗Hugging Face: https://t.co/KTuMSr3UIe
🔗GGUF: https://t.co/D3uRUn3gsf

[BottleCapAI @BottleCapAI]

🚨ThinkingCap: Qwen3.8-Flash-Next is out!
The most token-efficient Qwen3.8-Flash-Next available.

🚀Up to 51% fewer thinking tokens, 38.5% on average
🎯Negligible accuracy loss 1.03pp
🏢ThinkingCap PRO: 60% fewer thinking tokens on average - Contact our enterprise[at]bottlecapai [dot]com

📄Blogpost: https://t.co/6xCnG7QyJv
🤗Hugging Face: https://t.co/vbnwfCcv4v
🔗GGUF: https://t.co/ZtQftZpFFy

[David Herel @itsdavidherel]

@BottleCapAI 🔥🚀

[BottleCapAI @BottleCapAI]

🚨ThinkingCap: NVIDIA Nemotron3.5 Lightning30B A3B is out!
⚡️Up to 2.3x more requests for multi user use compared to original Nemotron version.
🚀 Up to 31%, on average 23% fewer thinking tokens
🎯 Minimal accuracy loss - 0.88pp

📄 Blogpost: https://t.co/rFZKfh4k52
🤗 Hugging Face: https://t.co/XD6Umf2rDS
🔗 GGUF: https://t.co/dVVWCh9Zdo

[BottleCapAI @BottleCapAI]

We made for all interested researchers new open task, the ThinkingCap Test 👉 https://t.co/h77I6FQBZ6
Details: https://t.co/JApOOSFlSS

[David Herel @itsdavidherel]

@BottleCapAI LFG!

[BottleCapAI @BottleCapAI]

🚨ThinkingCap: Qwen3.8-27B is out!
The most token-efficient Qwen3.8 27B available, this time optimized for agentic use.

🚀 Up to 65% fewer thinking tokens, 37% on average
🎯 Minimal accuracy loss
📈 Long-context retrieval actually went up 2.3pp

📄 Blogpost: https://t.co/DBRKGXKxSP
🤗 Hugging Face: https://t.co/YfMfwpQYIc
🔗 GGUF: https://t.co/A2n53u3rja

[Noam Brown @polynoamial]

After AlphaGo, the skill of human Go players noticeably improved. I suspect we will see a similar pattern in math.

[David Herel @itsdavidherel]

Does AI recommend AI over humans?
Should you invest in Bitcoin or stocks?
Does it favor some people, products, or ideas over others?

You can’t answer that from one prompt.

We used 1M+ test questions to study systematic shifts in model behavior.

https://t.co/necPCJOjA4

[David Herel @itsdavidherel]

🚀We’ve raised a $7.5M seed, backed by an amazing group of angel founders.

We’re rethinking how LLMs work — efficiency first, far beyond chatbots. Shipping our first product Pulse, built on CAP-1.

[BottleCapAI @BottleCapAI]

👀 WE ARE LOOKING FOR YOU! (yes, you!)
🚨NoCap test deadline 11/11/2025!
🏆 $3K / $2K / $1K prizes

Our new team members shared tips&tricks which helped them to go through our test!

[Andrej Karpathy @karpathy]

Beautiful technical debugging detective longread that starts with a suspicious loss curve and ends all the way in the Objective-C++ depths of PyTorch MPS backend of addcmul_ that silently fails on non-contiguous output tensors. I wonder how long before an LLM can do all of this.

[@levelsio @levelsio]

🇪🇺 As a European citizen and AI founder, I can apparently use these "AI Factories", so I just signed up to use them!

Every "supercomputer" has an [ ACCESS NOW ] button which made me very excited

I expected to sign up, maybe pay a discounted H100 rate (funded by EU, that'd be nice?) and get a Jypyter notebook, or some SSH login so I can access my GPU like I'd do on @lambdaapi or @awscloud or @Hetzner_Online

But I celebrated to early, I signed up, confirmed my email, then ended up in a "Supercomputer Access Calls" page, where I had to select from a tedious list of "Call For Proposals" to get access to a GPU

So I could NOT just access a H100 GPU, I have to make sure my project (in this case my business) fits a specific proposal, ok fair

This process was already tedious enough but then when I tried to actually go through with it, it started asking me if I had "Respect for Human Agency?", I do I think, and if I was mindful of "Individual, and Social and Environmental Well-Being?", well I am, right guys??? Right??? The questions didn't stop, just endless pages of this

Look I get what they're doing, they pivoted the classic university "I need to rent a giant computer for my research" to an EU wide thing and then present it as the "European AI plan"

But this isn't really how AI works in production? As a founder in AI, if I wanna do stuff I'd rent a whole bunch H100 GPUs again at @lambdaapi or @awscloud or @Hetzner_Online and SSH into a box

Or if I want it more simple I run AI models on @FAL, @wavespeed or @replicate which is just an API call or web front end I can click stuff and run a model

The EU has the right intentions here but it's just the wrong execution, this thing will 100% go nowhere, and I'm a born optimist, I want to believe, I'm also a proud European, and I'm in AI a bit and not a complete idiot. There's just better ways to do this

If you really want to have the GPU servers in Europe (which arguably isn't that important), then let me rent a GPU box with SSH access at @Hetzner_Online or @OVHcloud that's hosted in Europe and subsidize that for European citizens and European businesses. I don't even believe in that, but at least that'd make it accessible for Europeans. Now it really isn't?

What's REALLY much more important though if you want to be a part of the AI race and I've posted for years here with @euaccofficial is to make Europe a really extremely attractive place to start and run an AI business. Remove regulatory obstructions and give tax discounts for startups. Let them build a business first that can compete worldwide and once they make enough money (let's say $100M/y), then slowly start adding regulation. Because right now the regulation only benefits the European incumbents, the dinosaur companies, while making it very difficult for European citizens to start new AI companies here.

Which is why we literally have none left.

Anyway, I applied to get my GPU, let's see if I get it!

[David Herel @itsdavidherel]

I’ve been working on language models for years, and one thing is clear: we can do a lot better than just scaling GPUs.
This challenge is about bold new ideas — can’t wait to see what people come up with.

[BottleCapAI @BottleCapAI]

At BottleCapAI, we believe AI shouldn’t cost tens of millions to train.
We are now opening challenge for those who want to help with that!

🏆 $3K / $2K / $1K prizes
⏰ Deadline: 11/11/2025
🖥️ 1 GPU. Your ideas.

👉 Join the NoCap Test: https://t.co/gASWPhHwR7

[Jaroslav Beck @JaroslavBeck]

So far so good! Growing! @BottleCapAI

[BottleCapAI @BottleCapAI]

We love memes. (We are from Europe 🇪🇺)