Always a pleasure meeting with Congressman @RepChuck at TVC! Great conversation about the future of AI and quantum technology right here in Chattanooga and across Tennessee. Excited to see what's ahead for our region's innovation ecosystem.
🚀 #AI#chattanooga#Tennessee
Train your own LLM from scratch.
This repo builds a GPT-style transformer from the ground up, without using any high-level libraries.
You see exactly how attention, multi-head attention, the feed-forward block, embeddings, residuals, and layer norm fit together.
And it doesn't stop at the model. It walks the whole path from raw data to generated text.
↳ Data download, preprocessing, training, and generation
↳ Training data from The Pile (825GB across 22 sources)
↳ Tokenized with tiktoken (r50k_base) and stored in HDF5
↳ Training loop with eval, LR decay, and crash-safe checkpoints
↳ An SFT and RLHF guide for what comes after pretraining
The same code scales by changing a few config values. Around 13M parameters is where the output starts producing correct grammar and spelling, and you can train that in about a day on a free Colab or Kaggle T4.
If you've ever wanted to actually see how a transformer works instead of importing one, this is a clean place to start.
Link to the repo in the comments.
Interested in ML/AI Engineering? Check my FREE AI engineering Guidebook with 380+ pages (downloaded over 80k times, link below)
جیزِظ کرایست
صحبت های فاندر آنتروپیک داریو آمودی درمورد اینکه چطور ۹۰٪ کد fable رو خود مدل نوشته 😳 وات دا...
۱۲ دقیقه عشق درمورد هوش مصنوعی Claude و کسی از هیچ شرکت ~۲۰۰ میلیارد دلاری ساخت توی کمتر از ۶ سال.
The US government, citing national security authorities, has issued an export control directive to suspend all access to Fable 5 and Mythos 5 by any foreign national, whether inside or outside the United States, including foreign national Anthropic employees.
The net effect of this order is that we must abruptly disable Fable 5 and Mythos 5 for all our customers to ensure compliance.
Access to all other Claude models is not affected.
We apologize for this disruption to our customers. We believe this is a misunderstanding and are working to restore access as soon as possible.
Read our full statement: https://t.co/bwn0sximKZ
Introducing Claude Fable 5: a Mythos-class model that we’ve made safe for general use.
Its capabilities exceed those of any model we’ve ever made generally available.
This Executive Order is an important step in strengthening America’s leadership in AI.
We look forward to collaborating with the White House to support its implementation.
https://t.co/ZwDimPrp3t
As Chair of the Tennessee Valley Corridor Caucus, it was my pleasure to kick off the 2026 TVC Summit in Chattanooga. The Summit brings together world-leading institutions such as the ORNL, TVA, Arnold AFB, and Redstone Arsenal, alongside our dynamic ecosystem of private industry and outstanding universities. I particularly want to thank the fantastic hosts @EPB_Chattanooga and @UTChattanooga for showing off the best of Chattanooga!
INSTEAD OF WATCHING A 2-HOUR MOVIE.
Watch this Anthropic Claude for Finance lecture.
It’s probably the best free hour in quant AI right now.
Bookmark it and watch it today, no matter what.
And think about how this would actually work in practice, and I’ll use Iranians as an example.
Right now, more than 12,000 Iranian nationals who are here legally on student or work visas are already living in fear because of the Trump Administration’s USCIS processing pause. I recently introduced The Iranian Temporary Immigration Relief Act (H.R. 8740) with @RepTomSuozzi to grant Temporary Protected Status (TPS) and work authorization to eligible Iranian nationals.
But this new policy is even more extreme. It’s horrifying, actually.
It would impact people applying for green cards, many of whom have been living in the United States LEGALLY for years, building careers, raising American children, and creating full lives here.
That includes thousands of Iranians who studied in the U.S. and are now working as scientists, engineers, researchers, and doctors at top companies and hospitals across this country. I personally know people in these exact circumstances.
An Iranian married to an American citizen, with U.S. citizen children, could be forced to leave the country and process their case from abroad. But there is no U.S. embassy in Iran. And they could be sent back into the hands of a brutal regime in the middle of war and political repression.
Stephen Miller-the architect behind Trump’s mass deportation agenda-has always pushed cruel and extreme policies. But this is beyond the pale. The human cost will be catastrophic for families across this country.
Live from Code with Claude London: we're launching self-hosted sandboxes (public beta) and MCP tunnels (research preview) in Claude Managed Agents.
Run agents inside your own perimeter, with your security controls applied by default.