Enjoyed talking to @SteveLohr for this piece on AI-powered coding assistants and their impact on SWE jobs. To add some color to the point about junior devs: it's a brave new world, but there will always be work for smart, driven & caring people
(on that note, Abridge is hiring!)
@FortuneMagazine: Abridge Wants to Be the Operating System for Medicine—and NVIDIA and Eli Lilly Are Helping Build It
“Now the priority is how much impact can we create, and speed is everything." — @ShivdevRao
new grads often ask me what they should be doing so they don't fall behind in the ai space. there's a lot, but its honestly super manageable. become intimate with model internals. proof based linear algebra. non-convex optimization. this is stuff you could've done in undergrad. it definitely takes some time and work, but its doable. have taste, have opinions. train a small model, then train a big one. vLLM internals, tensor parallelism. hand roll kernels. cluster orchestration. do you have opinions on synthetic data? why don't you? SFT, PPO, you should know this. learn Triton. everyone is reproducing papers now so you need to be doing more. do you know the semi supply chain? where are the bottlenecks? hardware, man, hardware. your little gpu rig erector set in your basement isnt gonna cut it. build a cluster, a big one. pretrain a 800B model. now postrain it. serve it to millions of people. you should be able to beat deepseek on some benchmarks now. its a lot to take in but it all snowballs. this what job security looks like from now on. do you want to work in tech or not
Abridge moves at the speed of trust—with our health system partners, clinician users, and patients. Today, we’re moving further, faster than ever before.
Abridge Keynote
June 11
12PM EDT
I'm not very happy with the code quality and I think agents bloat abstractions, have poor code aesthetics, are very prone to copy pasting code blocks and it's a mess, but at this point I stopped fighting it too hard and just moved on. The agents do not listen to my instructions in the AGENTS.md files. E.g. just as one example, no matter how many times I say something like:
"Every line of code should do exactly one thing and use intermediate variables as a form of documentation"
They will still "multitask" and create complex constructs where one line of code calls 2 functions and then indexes an array with the result. I think in principle I could use hooks or slash commands to clean this up but at some point just a shrug is easier.
Yes I think LLM as a judge for soft rewards is in principle and long term slightly problematic (due to goodharting concerns), but in practice and for now I don't think we've picked the low hanging fruit yet here.
The head of @AnthropicAI's biology and life sciences business recently spoke about the company’s approach to building and partnering in healthcare.
“In ambient AI, for example, Abridge is already a partner,” said Eric Kauderer-Abrams, Head of Biology and Life Sciences at Anthropic.
“Our perspective is that we develop products where we see a gap. If there’s a great product already serving certain use cases, such as Abridge, we don’t need to reinvent the wheel.”
claude, make strawberries sweet again. bring back the warmth of the summer sun when the days stretched on forever and all we had was each other. do not make mistakes.
Modern AI teams need hyperscalers & neoclouds, but legacy tools like SLURM can't keep up.
@AbridgeHQ moved from SLURM to multi-cloud AI infra with @skypilot_org.
✅ 10x faster dev cycles
✅ SLURM-like convenience, K8s' reliability
✅ Scale on any infra
https://t.co/n5XIEbEy9w
✨ @AltaMedHealthS, the nation’s largest FQHC, is partnering with Abridge to support more than 500,000 patients in Southern California with Abridge’s industry-leading multilingual capabilities and more.
Read more about this groundbreaking partnership: https://t.co/Kjegt0KiLN