Really good blog by Alisa on her job search. Here are the resources she used to study ML/LLM stuffs:
1. Stanford's "Language Modelling from Scratch" course: https://t.co/5yLdS1B4DM
(To understand the breadth of the field and keep a coherent picture in the mind)
2. After getting the breadth, she deep dived into concepts ONE at a time using blogs, papers, implementing things from scratch.
3. Implementing / debugging a transformer comes up so often in interviews. Turn it into muscle memory: https://t.co/mykcyp1TFsโฆ
4. Do Leetcode https://t.co/1S1wzopSBLโฆ
5. Other Learning resources she shared:
a. Self-Attention & Transformers: https://t.co/IoRJ8uEBR8โฆ
b. The Illustrated GPT-2: https://t.co/WWYATavGwoโฆ
c. Backpropagation
https://t.co/aJgPpySZr8
d. Introduction to Policy Gradient for LMs
https://t.co/zpTNYiSvQ6โฆ
e. Lightweight Guide to understanding GRPO and RL principles
https://t.co/dByY3V0zOKโฆ
f. How to Scale Your Model
https://t.co/PxAMOwLEVj
@alisawuffles Thanks for sharing, very inspiring. IMO https://t.co/fLvI78Fy1M is one of best resources out there to prepare for ai ml interviews, plus Stanford ai ml videos on YouTube and top 50 leet code.
2/ CPU Cooler/Fan: Corsair AIO CF360 360mm
Power Supply: Corsair RM1200X-Shift 80+ Gold Modular
Cabinet: Corsair 4000D Frame Black
Additional parts in PC: Arctic MX-4 High Performance Thermal Paste (FOC) / Arctic P12 Max Non RGB - 3 Units
@kellabyte For large-scale clusters (up to 65,000 nodes), GKE replaced etcd with Google Cloud Spanner as the backend state store, while still exposing the etcd API for compatibility.
Spanner gives horizontal scalability, global distribution, and low-latency consistency without etcdโs limits
If youโre a builder who reads a lot of papers, you need to check out https://t.co/P7WKOpcyqi. It breaks down real-world applications. Making research sharing so much easier. ExplainThisPaper has quietly become part of my research workflow. โจ #AI#ArXiv#Research#Paper#GenAI
This means you can flexibly obtain TPU capacity for defined-duration workloads like ML training, fine-tuning, batch inference, and benchmarking workloads all while receiving the discounted pricing benefits of DWS.
Get started today atย https://t.co/3IxjubCRWV
It's now easier than ever to cost-efficiently train ML models using Google Cloud Tensor Processing Units (TPUs), because TPUs are now available via Dynamic Workload Scheduler (DWS) Flex start.
4/ and autoscaling configurations so that you can get started with an optimal deployment -- saving you weeks of qualification. All of this information is available with a simple API call: https://t.co/M6qg8AKTvG
One of the most important steps when productionizing ML model serving is to optimize performance -- tweaking your model server configuration to maximize throughput and minimize cost while achieving your desired latency.
#Kubernetes#mlmodel#googlecloud#GKE#modeltraining
3/ his means it's now super easy to get standardized benchmarking results showing the performance of your inference endpoints. On GKE, we use this benchmarkingย framework to generate benchmarking results across many combinations of accelerators, model servers, open weight models
2/ For anyone using Google Kubernetes Engine, this is now easier than ever. Together with others in the Kubernetes community, we just released an open source GenAI inference performance benchmarking tool:ย https://t.co/MmYttbQEp0
๐ง๐ต๐ฒ๐๐ฒ 6 ๐๐ต๐ถ๐๐ฒ ๐ฝ๐ฎ๐ฝ๐ฒ๐ฟ๐ ๐ณ๐ฟ๐ผ๐บ Google ๐ฎ๐ฟ๐ฒ ๐ฎ ๐ด๐ผ๐น๐ฑ ๐บ๐ถ๐ป๐ฒ
I often refer to them every now and then
If you're trying to Adopt AI in your business, I'd highly recommend you to go through these at least once