Are you planning to submit to *ACL venues through ARR (@ReviewAcl )? Please read the ACL Policy on Publication Ethics very carefully: https://t.co/AMTYerw2Hl
It covers text reuse, dual submissions, use of gen-AI, reviewing conduct, and other related topics. #NLPRoc
The best way to learn PyTorch is by building something with it.
Consider checking out my blog where I help you, build transformers using PyTorch from scratch
We wrapped up CS 8803 "Large Language Model" class at @GeorgiaTech for Fall 2024.
Here is the reading list:
• learning from human preferences (PPO, DPO, SimPO, CPO, RRHF, ORPO, CTO)
• real-world LLM (Llama-3, Aya, Arena's)
• efficient LLM (MoMa, LoRA, QLoRA, LESS)
What factors influence the performance of LLaVA-o1, one of the most promising VLMs?
One of them is the LLaVA-o1-100k dataset, specifically created to train LLaVA-o1 to reason logically.
• LLaVA-o1-100k dataset includes 100k examples of step-by-step reasoning (question-answer pairs), generated by GPT-4.
• Trained only on this 100k examples, LLaVA0-o1 scored 6.9% higher than the base model, showing best results in:
- Instance reasoning
- Logical reasoning
- Math and science
What else makes LLaVA-o1's performance significantly better?
Find out in our article -> https://t.co/K6e5Hr80o4
@rt__uk استعن بالله ولاتعجز، حاول تصلي جميع الصلوات في المسجد وابحث عن السعوديين كلكم في غربة تتشاركون نفس الهموم. إذا ماجيت حاول تتحدث مع المصلين حتى لو بس سلام عليكم . تخفف الضغط وهم الغربة بإذن الله.
Transformer by hand✍️ Excel ~ I designed this exercise to show the core math of a Transformer model is to combine columns (attention), combine rows (feed forward), and repeat.👇Join the 'AI Math' community. 👇Download xlsx.
Cross entropy isn’t just a classification loss. It is a (upper bound on) proper scoring rule for the maxprob (highest class probability) to reflect the true probability of the model being correct.
By optimising for classification, incidentally, we’re also training maxprob for predictive uncertainty.
If you want to see a proof, Trustworthy ML lecture materials are there for you. https://t.co/SDIUvFJL1G (lecture 9 I believe)