Top Tweets for #KnowledgeDistillation
📄 Paper: https://t.co/hCFqAznNDY
💻 Code: https://t.co/gRzxdiq7UP
If you work on efficient VLMs, multimodal compression, or KD — curious what you think. RT appreciated 🙏
\#CVPR2025 #VisionLanguageModel #KnowledgeDistillation #EfficientAI #MobileAI
Published on HF: gemma-3-270m pruned to 14 layers and distilled with OptiPFair.
PPL: 120.67 (pruned) → 10.85 (after KD). 89.9% capabilities retention.
Baseline for Chapter 6 of Rearchitecting LLMs. Beat it!
🤗 https://t.co/n5uEzhSN8H
#LLM #KnowledgeDistillation #OpenSource
[2026/05/18 ~ 24] 이번 주에 살펴볼 만한 AI/ML 논문 모음
(by 9bow님)
https://t.co/kCLjNW0Tbq
#paper #aimlpapersoftheweek #knowledgedistillation #autoresearch #coda #aira #evolvemem #codeasagentharness #multistreamllms #graphfoundationmodel #slimqwen #reelicit #lostintokenization
Facial Attribute Prediction Using Knowledge Distillation
https://t.co/tNJf8B1ops
By Maisha Zaman et al.
From the 7th Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability 2025
#MachineLearning #KnowledgeDistillation #EdgeAI
Book-to-SKILL: 기술 서적 PDF나 EPUB을 Claude Code 스킬로 변환해 작업 중에 바로 활용하는 도구
(by 9bow님)
https://t.co/dD7ZgV1L5t
#claudecode #knowledgedistillation #claudeskill #epub #docling #pdfextraction #aitool
How do you fit a 600M-parameter Segment Anything Model (SAM) onto a satellite? 🛰️🧠
Full breakdown + PyTorch implementation: 🔗 https://t.co/DnjZHJRmF6
#SAM #KnowledgeDistillation #RemoteSensing #AITrendBlend #ComputerVision
Knowledge Distillation on asymmetric LLM architectures with OptiPFair.
A Llama-3.2-3B with attention layers removed — broken output recovered in minutes.
New 'KD Express' notebook in the repo 👇
⭐ https://t.co/rmSS4L3HEu
#LLM #KnowledgeDistillation #OpenSource
最后：这个研究问题不是我一个人想出来的。实验是我和 @Anthropic 的 Claude Sonnet 4.6 + @Z_AI 的 GLM-5.1 一起讨论执行的。
核心洞察来自一个没有代码基础的人类（我），AI 是工具不是作者。
这就是人机协作研究的样子 🤝
#LLM #KnowledgeDistillation #Perplexity #AIResearch
#KnowledgeDistillation
#知识蒸馏/Model #Distillation
Beim maschinellen Lernen ist die #Wissensdestillation oder #Modelldestillation der Prozess der Übertragung von Wissen von einem großen Modell auf ein kleineres Modell.
https://t.co/4LLhPKNrEZ
KD-MARL: Resource-Aware Knowledge Distillation in Multi-Agent Reinforcement Learning
Preprint: This study introduces a two-stage framework for resour…
https://t.co/PuPjtuyl0q #AI #ReinforcementLearning #KnowledgeDistillation #MachineLearning #Preprint #Arxiv #ScienceNews
📣 Deal of the Day 📣 Apr 9
Save 45% TODAY ONLY!
Rearchitecting LLMs & selected titles: https://t.co/OHmun39kyn
Structural techniques for efficient models.
@PereMartra #LLMs #LLMOptimization #SLMs #TinyLLMs #Gemma #Qwen #Llama3 #ModelPruning #KnowledgeDistillation #EfficientLLMs #ModelCompression #StructuredPruning #ModelOptimization
This book turns research from the latest AI papers into production-ready practices for domain-specific model optimization. As you work through this practical book, you’ll perform hands-on surgery on popular open-source models like Llama-3, Gemma, and Qwen to create cost-effective local small language models (SLMs). Along the way, you’ll learn how to combine behavioral analysis with structural modifications, identifying and removing parts that don’t contribute to your model’s goals, and even use “fair pruning” to reduce model bias at the neuron level.
Stop asking 1.2B-parameter VLMs to teach ResNet-18 directly. It doesn't work. ❌🦉
DAIT (Distilling CLIP via Adaptive Intermediate Teacher) is the new SOTA for fine-grained vision. 🧵👇
Full Paper + PyTorch Implementation:🔗https://t.co/TrgAN1RGqx
#KnowledgeDistillation #VLM
PCKD (Physically Motivated Knowledge Distillation) is a new framework that straightens sonar imagery blind—no navigation data needed. 🧵👇
Paper breakdown + Full PyTorch Code: 🔗https://t.co/aQy7lIx53t
#SideScanSonar #KnowledgeDistillation #ComputerVision #PCKD #AITrendBlend
Tabular models don't have "pixels," so why are we distilling them like images? 📊🤔
The Results: SOTA student-teacher agreement on Adult, Credit, and Breast Cancer datasets.
🔗https://t.co/mApsKttXxx
#ML #DataScience #XGBoost #KnowledgeDistillation #TabularAI #aitrendblend
🚀 DistilBERT + RAG: Why, What, How & When (With Real Colab Examples)
https://t.co/owEWqXyyQh
#DistilBERT #RAG #NLP #MachineLearning #MLOps #DataEngineering #HuggingFace #KnowledgeDistillation #Python #GoogleColab #AI #LLM #EfficientAI #TechBlog
#highlycited paper
📚MicroBERT: Distilling MoE-Based Knowledge from BERT into a Lighter Model
🔗https://t.co/rACba3HFgE
👨🔬by Dashun Zheng et al.
@mpu1991
#naturallanguageprocessing #knowledgedistillation
📈 The $80M Silent Launch: How Gemini Video Create and 'Proprietary AI' are Replacing Human Consulting in 2026
In 2026, learners are hitting $80M l…
https://t.co/jrKILvCIIr
#GeminiVideoCreate #AIMarketing2026 #KnowledgeDistillation #DigitalTwinBusiness #VERSAROC
Steve-Evolving: Open-World Embodied Self-Evolution via Fine-Grained Diagnosis and Dual-Track Knowledge Distillation
Preprint: Steve-Evolving is a self-evolving framework fo…
https://t.co/KG0lrNp5QI #AI #KnowledgeDistillation #MachineLearning #Preprint #Arxiv #ScienceNews
#KnowledgeDistillation does have scalable impact both +ve and -ve... I recall one of the very first papers (in our group) in the context of @AnthropicAI 's post!
Distillation does have significant impact!
🔬Welcome to Read this Paper
📈Sensor-Drift Compensation in Electronic-Nose-Based Gas Recognition Using Knowledge Distillation
📰by Lin and Zhan
#ElectronicNose #SensorDrift #KnowledgeDistillation #GasRecognition
📎https://t.co/FEurc8QoSq
Trends for you
Most Popular Users
Elon Musk 
@elonmusk
240.1M followers
Barack Obama
@barackobama
119.3M followers
Donald J. Trump
@realdonaldtrump
111.6M followers
Cristiano Ronaldo
@cristiano
108.8M followers
Narendra Modi
@narendramodi
106.9M followers
Rihanna
@rihanna
97.2M followers
NASA
@nasa
92.1M followers
Justin Bieber
@justinbieber
90.5M followers
KATY PERRY
@katyperry
86.7M followers
Taylor Swift
@taylorswift13
80.5M followers
Lady Gaga
@ladygaga
72.1M followers
Kim Kardashian
@kimkardashian
69.3M followers
YouTube
@youtube
68.6M followers
Virat Kohli
@imvkohli
68.4M followers
Bill Gates
@billgates
63.4M followers
The Ellen Show
@theellenshow
62.5M followers
CNN
@cnn
61.9M followers
Neymar Jr
@neymarjr
60.9M followers
X
@x
60.9M followers
CNN Breaking News
@cnnbrk
59.9M followers