Sleepy Eric

[Sleepy Eric @TheTallEric]

🫡🫡🫡

[WANG Ruida @RickyRDWang]

🚀 Introducing MA-LoT Theorem Framework: An open-source multi-agent framework utilizing the Long Chain-of-Thought to boost automated theorem-proving🎉

✅ Achieving 61.07% accuracy rate under pass@32 on MiniF2F-Test outperforming Goedel-Prover, Lean_STP and DeepSeek-Prover-V1.5

🔥 Proposing LoT-TL training-inference framework to train LLMs with field-specific Long CoT ability.

🤖 Composing the multi-agent system that combines the advantage of both whole-proof generation and tree-search.

[1/n]

Paper: https://t.co/J9m5i4lNf6

Website: https://t.co/OjQ9P0fYAN

Huggingface: https://t.co/tXsLlxnfvb

Github repo: https://t.co/PZZqk9wAo2

Wonderful collaborators: @rui4research @TheTallEric @shizhediao @RenjiePi @mircale2003 @JunjieHu12

[Sleepy Eric @TheTallEric]

@RickyRDWang 🫡🫡🫡

[Rui Pan @rui4research]

Presenting our LISA paper at NeurIPS 2024😆
- Dec. 13 at 4:30 pm (Friday afternoon)
- West Ballroom A-D #5708

Fine-tuning 7B in a single GPU❔ Randomly freezing ~90% self-attention layers every 5-20 iterations allows that!🚀It is
- 3x Fast
- Memory-efficient
- Good at memorization, even better than full-parameter training

paper: https://t.co/06FVecNMYL

[Rui Pan @rui4research]

NVIDIA Hymba-1.5B Instruction Fine-tuning, powered by LMFlow🚀

[The Nobel Prize @NobelPrize]

BREAKING NEWS
The Royal Swedish Academy of Sciences has decided to award the 2024 #NobelPrize in Physics to John J. Hopfield and Geoffrey E. Hinton “for foundational discoveries and inventions that enable machine learning with artificial neural networks.”

[WANG Ruida @RickyRDWang]

🚀 Excited to introduce TheoremLlama!
🎉 Our new framework transforms general-purpose LLMs into Lean4 experts. Achieving 36.48% and 33.61% on MiniF2F-Valid and Test, surpassing the GPT-4 baseline of 22.95% and 25.41%.
🌟 Check out our open-sourced Open Boostrapped Theorems (OBT) 📜🔍dataset and model checkpoints. Dive into the future of formal theorem proving!
#AI #MachineLearning #Lean4 #TheoremProving #Llama
📑Paper: https://t.co/nkoqGRkZdg
👉 Learn more:
GitRepo: https://t.co/53YH8dQFJT
Model Ckpt: https://t.co/jRTATXQ9F8
OBT Dataset: https://t.co/57vR5tn4ya

[zed @zmkzmkz]

it's 1:28AM and I just finished this abomination. fully illustrated toy calculation of 1 transformer layer.

why would I make this? idk ask my thesis advisor, "not everyone knows how a transformer works, you have to give an example"

[Sleepy Eric @TheTallEric]

#Qwen 110B 🐢

[Sleepy Eric @TheTallEric]

Account blocked N+1th time, I HATE CAPTCHA🫠