Software eng: Distributed systems / DBMS. CTO @Adfin, b: @Apple, @Admeld, @barracuda My thoughts & views are my own.... unless you believe Causal Determinism.
Frontier pretraining is said to be a big-lab-only game. We don’t have 100k chips yet, so there’s only one way: algorithmic efficiency. Our new recipe matches DeepSeek V4 Pro’s pretrain using 50x less compute – that’s roughly half the FLOPs used for GPT3, or ~$0.5M on GB200.
https://t.co/uBs5o5Arsu
@qianl_cs But this is not though of as one cohesive system; the integration is not there.
There's no reason user operation in pandas should not be seamless compiled, pushed down into the database, and executed efficiently as possible.
@qianl_cs A pandas Dataframe as used in this environment is de-facto part of the query tree. It just happens that some relational algebra/calculus operations happen in Python (pandas) and some in the DBMS engine.
@clattner_llvm What a great convo.
I come from a DB eng background. I first toyed with NNs in 2017 and my early though was why is there not something analogous to the modern database optimizer (query optimizer, plan code generator).
Glad to see you guys working on this.
To be clear I love hard work, I do well with chaos, but I like doing it with people I like, for a mission I care about and ideally with significant upside potential (financial or otherwise) to balance downside risk.
Our cops on the subway platform doing anything? Doesn't appear to be the case.
Two different smokers on same platform one 12 feet away, another with eyesight.
In general smoking on the MTA seams to be way up.
NEW: Russian military is trying to degrade morale of Ukraine's civilians and military by launching missile strikes on residential areas & civilian infrastructure, the Ukrainian military said.
Russian troops fired on a passenger bus, killing 5 & shelled kindergarten in Chernihiv
A friend in Kyiv just showed me this meme making the rounds today, and we both shared a laugh (we are sitting in an underground shelter right now).
It sums up the mood in Kyiv today as #Ukraine faces Russia’s invasion alone.
@Carnage4Life I'm not getting the warm and fuzzies right now.
Omnicron is ripping through the country, and they are planning a press conference for Tuesday. That tells you everything about the sense of urgency.
@lemire This has been a long term trend in the US. It's one of the factors contributing to cost of higher ed.
Without some party (gov) mandating that x% is spent on teaching/R&D, I'm afraid it'll always naturally end up there. Management is incentivized to grow their rents.