Dear @poonawallafinco , I am receiving multiple promotional calls every day on my mobile number despite not requesting them. This has become extremely frustrating. Please remove my number from your calling database immediately.
#DND#SpamCalls@RBI
Full Fine-tuning vs. Freezing Layers. Interact 👉 https://t.co/nqHPUBGYOM and https://t.co/tZfhONgWg4
== Full Fine-tuning ==
A real network has many — three layers in this example, billions of parameters in a production model. What does fine-tuning look like when you update all of them?
That’s full fine-tuning: continue training every weight in the pretrained network on your new task. Every layer’s W gets its own ΔW. Nothing is frozen — every parameter is in play.
Think of an MLP as a chain of prerequisites leading to an advanced course. Layer 1 might be Linear Algebra, layer 2 Probability, layer 3 Advanced Machine Learning — each one building on what came before.
Fine-tuning is what happens during graduate study: the foundations are already there from undergrad, so you’re not re-learning. Full fine-tuning is reviewing every prerequisite to see what new topics have appeared and what discoveries the field has made since the last time you sat through them. Effective — but exhausting.
This diagram shows the same three-layer MLP twice, side by side.
On the left, the pretrained network runs on input X: three weight matrices W₁, W₂, W₃, each followed by a ReLU activation.
Full fine-tuning gives the model the most freedom to specialize. Every parameter can move — and every parameter that can move must be stored.
But not every prerequisite needs revisiting. The further you go back in the chain, the less the material has changed since pretraining — the linear-algebra basics under your computer-vision course are largely the same as they ever were. The next page does exactly that: freeze the prerequisites that haven’t moved, and only refresh the advanced one closest to your specialization.
== Freezing Layers ==
Full fine-tuning reviewed every prerequisite — Linear Algebra, Probability, Advanced ML — to refresh each subject with the latest topics. Effective, but exhausting.
Then you realize something. The prerequisites haven’t actually changed that much. Linear Algebra is still Linear Algebra; the matrix decompositions you learned still hold. Probability is still Probability; the distributions and Bayes’ rule haven’t moved. Almost all the new material — the new ideas, the recent discoveries — lives in the advanced layer at the top.
That’s freezing layers: keep the prerequisite layers fixed at their pretrained state, and only update the advanced one. In the diagram below, W1 and W2 — the foundational prerequisites — stay frozen. Only W3 — the layer closest to your task-specific output — gets a ΔW.
Parliament winter session is over. #AirPollution not discussed.
It was obviously not an urgent matter for them.
We are being taken for granted.
And left on our own.
STORY | No conclusive data linking higher AQI to lung diseases: Govt
There is no conclusive data establishing a direct correlation between higher air quality index (AQI) levels and lung diseases, the government has told Parliament.
READ: https://t.co/4WN8qQTe8n
Diwali season is coming and people wants to go home. Is there any new trains or special trains started by Indian railways?
Want to know how many..
@IRCTCofficial
My FREE @DeepLearningAI course on Attention is LIVE!!! Learn the concepts and pytorch code behind the most fundamental part of the AI revolution!
https://t.co/v7sHhLNqen
My client Sam worked hard, delivered quality work, and got along with everyone. But, in big meetings he rarely spoke. When put on the spot, he rambled. Sam got good ratings but was never promoted past senior manager. Why?
Sam lacked Executive Presence.
He could not command a room, hold attention, and present himself as a smart and decisive leader.
Aspiring executives are often told that they lack executive presence, but they aren't given a specific definition of what this means.
Executive presence is tough to define because it isn’t one skill- it’s actually composed of many skills. People often think of it as public speaking, but in reality there is much more to it.
Author Sylvia Ann Hewlett breaks down executive presence into three categories, defining it as a mix of:
→ 60% gravitas
→ 30% communication
→ 10% appearance
”Gravitas” is composed of the things that make you a serious leader, worthy of attention and respect. The two dominant traits in this regard are confidence and decisiveness. People follow leaders who seem composed and sure of themselves, including under the pressure of a crisis or a tough question from another leader.
Communication skills are often the first thing people think of, but they are surprisingly less important than gravitas. Communication skills include speaking, but also your ability to hold attention, manage a room, read an audience, and present your authentic self.
Appearance is the least important, but it does matter in two critical ways. First, appearance is not about being attractive. It is about showing that you pay attention to your dress and grooming. This helps you show that you are a person who takes their work seriously and expects to be taken seriously in return.
Second, appearance matters most as a first impression. It shows professionalism and opens the door for you to showcase your gravitas and communication skills.
To improve your executive presence, you must first identify which of these areas need work and then make a plan to improve them.
Here are some strategies to consider:
1) For public speaking, find small, safe audiences to practice in front of. Consider joining a Toastmasters club.
2)To learn to read a room, partner with a friend after a meeting and discuss what each of you saw.
3)To display calm and practice emotional control, try meditation and build your emotional intelligence skills to help you handle crises.
4)To increase your influence, read “How to Win Friends and Influence People,” and then prepare your arguments in advance (rather than on the fly).
5)Finally, for appearance, consider a professional stylist like a Nordstrom personal shopper.
Readers- What else comes to mind when you hear “executive presence?” Do you have tips on how to improve it?
How to prepare and solve problem when deploying LLMs in the real world.
You've gotta watch this.
It's a 50-minute MIT lecture from the @Cometml team.
Can't miss if you are building production systems.