MelvTheSystemDesigner

Machine Learning Engineer | Time-Series & Sequence Models for Fraud Detection & Payments | System Design

[MelvTheSystemDesigner @MelvTheGoatt]

Explained Variance Ratio

[MelvTheSystemDesigner @MelvTheGoatt]

Yeah, it’s over

[The Kobeissi Letter @KobeissiLetter]

BREAKING: Nvidia, $NVDA, CEO Jensen Huang has resigned as CEO, President, and member of the Board of Directors, effective immediately.

[MelvTheSystemDesigner @MelvTheGoatt]

It is that serious

[Jo🍒 @jojohalle_]

Sometimes, I just wake up in the middle of the night and start applying for jobs.

[MelvTheSystemDesigner @MelvTheGoatt]

📌

[MelvTheSystemDesigner @MelvTheGoatt]

What do you think about my GitHub?
https://t.co/ap0jC7UOF4

[MelvTheSystemDesigner @MelvTheGoatt]

AI/ML interview questions
- What is dropout, and why does it work?
- Explain gradient descent and its variants.
- What is prompt injection? What's your defence? (Anthropic)
- What is the KV cache, and why is it needed? (OpenAI)
- Speculative decoding: why is output quality preserved? (NVIDIA)

[MelvTheSystemDesigner @MelvTheGoatt]

Cosine Similarity

[MelvTheSystemDesigner @MelvTheGoatt]

Something to work on

[MelvTheSystemDesigner @MelvTheGoatt]

Today’s problem: Normalize a vector

One of the easier questions. Maybe I should try something harder tomorrow. np.linalg.norm() put everything in place. Also “Normalize a vector” isn’t the same as “normalization (min max - ranging from 0 to 1)”

[MelvTheSystemDesigner @MelvTheGoatt]

This is why your cold emails don't get responses.

We send out email after email and assume people don't want to reply for a number of reasons. But a lot of the time, they never even see it. It lands in their SPAM.

Most of us are sending from a free address (Gmail, for example) to a work address. Free addresses get extra scrutiny and work addresses are stricter toward them, so your email often ends up in spam.

We can't fully fix this, but we can increase the odds. Here's how to position yourself better:

- Use your own domain ([email protected]), not Gmail
- Verify your domain. SPF, DKIM, and DMARC let inboxes confirm your emails are genuine, not spoofed
- Warm up slowly. A few emails a day at first, not hundreds
- Keep first emails simple: plain text, a clear subject, no attachments, few or no links
- Aim for replies. They're the strongest trust signal there is

This still doesn't guarantee your emails will stay out of spam, but it puts you in a better position for recipients to see them and respond.

[MelvTheSystemDesigner @MelvTheGoatt]

You can check it out here: https://t.co/whQXsNVZRQ

[MelvTheSystemDesigner @MelvTheGoatt]

Earlier this season I decided to use Machine Learning to play Fantasy Premier League (FPL), 2 models (The Manager and Best XI), following the same rules and competing against the average score of global players every gameweek.

The Best XI - This selects a new set of players every game week based on the highest expected score of the upcoming gameweek. Good way to help actual players selects players, you can go there to see the players expected to perform in the upcoming gameweek. The average score has been beaten 6 times out of 10 gameweeks.

The Manager - This started just as everyone else, selected a set of players and programmed to follow the rules like transfers cost etc. It has beat the average score of global players 5/10 times so far.

Link 👇

[MelvTheSystemDesigner @MelvTheGoatt]

@ConsciousRide This is some serious work

[MelvTheSystemDesigner @MelvTheGoatt]

@thesimaximalist Exactly. Fewer trips to GPU memory, it’s the same math but faster result

[MelvTheSystemDesigner @MelvTheGoatt]

Here are some interview questions i worked on today:

1. Explain cross-validation. Why use it?
2. L1 vs L2 regularization: what’s the difference? (Amazon)
3. Prompting, RAG or fine-tuning: how do you choose? (OpenAI)
4. FlashAttention doesn’t cut FLOPs, so why is it faster? (Together AI)
5. What is the lost-in-the-middle problem in LLMs? (Moonshot AI)

How many could you answer? Solutions below

[MelvTheSystemDesigner @MelvTheGoatt]

@tfmlab This is straightforward and the 3d animation makes it easier for one to follow. Brilliant

[MelvTheSystemDesigner @MelvTheGoatt]

Today's problem was on L2 Norm (Ridge). Similar to yesterday's problem because of the "without overflow" condition. The fix here was scaling the vector before calculating the sum of squares. Also, code's looking more structured today.

[MelvTheSystemDesigner @MelvTheGoatt]

If you are looking for tips on how to cold email you should check this out

[Sumit Kesarwani @Sumitboy_007]

nerds thank me later https://t.co/JumXHPylFt

[MelvTheSystemDesigner @MelvTheGoatt]

@harshith_irl Looks good

[MelvTheSystemDesigner @MelvTheGoatt]

1. https://t.co/riTRs3fXsk
2. https://t.co/Sp97hPxsK9
3. https://t.co/Kj8NIVu43b
4. https://t.co/2qP0jpxcUd
5. https://t.co/MFRGD6n7kq

[Amit Shekhar @amitiitbhu]

Understanding Cross-Validation in Machine Learning.

Cross-validation is a technique used to evaluate machine learning models by testing how well they generalize to unseen data.

It involves splitting the original dataset into multiple parts (or "folds"), training the model on some parts, and testing it on the remaining parts. This process is repeated multiple times so that every data point gets a chance to be in the training and test sets.

How does it work?

The most common form is k-fold cross-validation, where the dataset is divided into k equal-sized subsets (folds). The model is trained k times, each time using k-1 folds for training and the remaining fold for validation. The final performance metric is typically the average across all k iterations.

For example, in 5-fold cross-validation:

• Split the data into 5 equal parts
• Train on folds 1,2,3,4, and test on fold 5
• Train on folds 1,2,3,5, and test on fold 4
• Continue this process for all combinations
• Average the 5 performance scores

Why is it used?

• To estimate model performance on unseen data.
• To reduce overfitting risk by checking how the model generalizes.
• To tune hyperparameters
• To make better use of limited data, as all samples are used for both training and validation across the folds.

That's it for now.

#MachineLearning #AI