This Thursday at 1pm EST
Episode 4 of Under the Hood
I believe weβre changing topic direction to discuss solutions around issues like last weeks @MagicEden EVM processor exploit
Set reminders π
Shout out @SoonMrWick for this crazy video of me and @TheMadQueenEth playing π€
β‘Meet Qwen3.8-Flash, a multimodal MoE and an early preview of the Qwen4 architecture, now open-weight!
The production version Qwen3.8-Flash will be available soon via QwenCloud API at just $ 0.16/1M input tokens and $ 0.47/1M output tokens.
125B parameters + 51B N-gram embeddings, with just 6B activated per token. Unmatched cost-efficiency.
What's new: π₯³
- Next architecture: GDN + QSA hybrid attention, Gated Residual, N-gram Embedding & Muon optimizer, serving as a precursor to the architecture used in Qwen4.
- Dramatically lower training and inference costs: trained at just 1/9 the cost of Qwen3.7-Plus, while outperforming it across the board with especially strong gains in coding and office tasks.
- Strong performance: scoring 58.7 on DeepSWE 1.1, 62.5 on SWE-bench Pro, 73.9 on CoWorkBench, 84.5 on AndroidWorld, and 95.7 on MathVision (with CI).
- 262K native context, extensible to 1M with YaRN.
Weβre also releasing the weights for Qwen3.8-Flash-Next, giving the community an early look at the new architecture weβre exploring for Qwen4.π
We can't wait to see what you build with Qwen3.8-Flash!ππ
- Blog: https://t.co/M5hYypFLgJ
- Technical Report: https://t.co/IF0gObIkQO
- Hugging Face: https://t.co/6ow8QVAABt
- ModelScope: https://t.co/tDOn2jNuFG
So sad to hear of Sam Neill passing. Unbelievable to think of it being the case. Such a sad thing for his family.
Forever a celluloid hero. Thanks for the memories Sam
An Amazon Future Engineer is officially joining @Pocket_Dragons_ as our Technical & Product Co-Founder.π
We're excited to officially welcome @TradingJoker (TJ) to the team.
This isn't just another developer joining the project.
TJ has been building in crypto since 2016, led a trading and investing community of 1,000+ members, studied Computer Science at one of Germany's top technical universities, and was selected for the Amazon Future Engineer program - recognition awarded to high-potential students pursuing careers in technology.
He understands code.
He understands product.
He understands markets.
He understands Web3 communities.
Most importantly...
He knows how to ship.
For Pocket Dragons, this is a major step forward.
β - Stronger security.
β - Faster development.
β - Better product execution.
β - Higher-quality engineering.
β - A powerful AI-driven development pipeline.
At our core, we're still just a team of four.
Small team.
Low overhead.
High conviction.
Exceptional talent.
That's exactly how we want it.
We're not here to build another short-term mint.
We're here to build an IP, a world, and a community that lasts.
Full team introductions are coming soon.
For now...
Welcome to the team, TJ. π€
Selling one of my handdrawn nfts isn't about making lots of money ,Its more about a datestamp on a piece of art which reflects my personality.
If you find them interesting enough to purchase thanks π
https://t.co/Rgmzn5Ds1H
@karpathy Dang, must be seeing what the company can bring, congratulations to Anthropic for hiring you. Excited to see where the r&d goes for the platform