CubanHodLer🇨🇺

If you rewind yourself walking backwards you Go Forward. ⏪⏯⏩

[CubanHodLer🇨🇺 @CubanBTC]

This guy blocked me and I don’t really know why, must be my frozen model’s weights 🥶

[Vaibhav (VB) Srivastav @reach_vb]

Probably the craziest week in Open Source AI (yet):

1. Mistral (in collaboration with Nvidia) dropped Apache 2.0 licensed NeMo 12B LLM, better than L3 8B and Gemma 2 9B. Models are multilingual with 128K context and a highly efficient tokenizer - tekken.

2. Apple released DCLM 7B - truly open source LLM, based on OpenELM, trained on 2.5T tokens with 63.72 MMLU (better than Mistral 7B)

3. HF shared SmolLM - 135M, 360M, & 1.7B Smol LMs capable of running directly in the browser; they beat Qwen 1.5B, Phi 1.5B and more. Trained on just 650B tokens.

4. Groq put out Llama 3 8B & 70B tool use & function calling model checkpoints - achieves 90.76% accuracy on Berkely Function Calling Leaderboard (BFCL). Excels at API usage & structured data manipulation!

5. Salesforce released xLAM 1.35B & 7B Large Action Models along with 60K instruction fine-tuning dataset. The 7B model scores 88.24% on BFCL & 2B 78.94%

6. Deepseek changed the game with v2 chat 0628 - The best open LLM on LYMSYS arena right now - 236B parameter model with 21B active parameters. It also excels at coding (rank #3) and arena hard problems (rank #3)

There's a lot more; Arcee (mergekit) released a series of LLMs, each better than the other, and Numina and HF Numina 72B (based on Qwen 2) and Math datasets, Mixbread with embedding models (english + german) and a lot more!

It's fun to see so many releases next week with L3 405B (?) and companions; we might see a shift in the Open LLM landscape! See you next week!

What else did I miss? 🤗

[𝚐𝔪𝟾𝚡𝚡𝟾 @gm8xx8]

COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability

https://t.co/9dseoUBTSv

[SkalskiP @skalskip92]

that's all the code you need

[SkalskiP @skalskip92]

supervision-0.22.0 is coming out today

one of the things we release is Mediapipe integration along with default visualizers for face and body pose keypoints

link: https://t.co/xXMRaS3Guk

[Emil Eifrem @emileifrem]

My friend and Neo4j CTO @prathle has written an outstanding blog post that summarizes the recent buzz around GraphRAG, what we've learned from a year of helping users build systems with Knowledge Graphs + LLMs and where we believe the space is going.

Thread below. 👇🧵

[Gradio @Gradio]

Gradio Multimodal Demo for LLaVA-NeXT-Interleave😍 : https://t.co/F47ltXME0o

Models and Datasets are on 🤗 Hub: https://t.co/2A1XjchxiU

[Gradio @Gradio]

LLaVA-NeXT-Interleave🔥
- Interleave data format unifies different tasks.
- New datasets on 🤗Hub:
1️⃣M4-Instruct, high-quality dataset, 1.1M samples from domains: multi-image, video, 3D & single-image
2️⃣LLaVA-Interleave Bench - Set of tasks to evaluate multi-image capabilities

[Gradio @Gradio]

🚀Introducing LLaVA-NeXT Interleave: Now AI can understand and reason with multiple images at once

- This opens up multi-image scenarios like multi-frame videos, multi-view 3D, and multiple inter-leaved images.
- An all round LMM that can understand videos, images, and 3D
More⬇️

[SkalskiP @skalskip92]

Florence-2 fine-tuning YouTube tutorial is finally out! (sorry it took me so long)

- running the pre-trained model with different vision tasks
- configuring LoRA
- training and benchmarking
- Florence-2 vs. top vision model

link: https://t.co/5AadqRZdNm

↓ key takeaways

[Gradio @Gradio]

🤯DiffIR2VR-Zero: Zero-shot video restoration to high-resolution using pre-trained image restoration diffusion models.

- Framework can handle video denoising and up to 8x super-resolution
- outperforms trained models in generalizing across diverse datasets and extreme degradations
- Compatible with every 2D restoration model

[MrNeRF @janusch_patas]

Code dropped: https://t.co/3i5w4fvJoX
I've been waiting for far too long to try this!

[Ryohei Sasaki@engineer @rsasaki0109]

OverlapMamba: Novel Shift State Space Model for LiDAR-based Place Recognition
https://t.co/WjcgGW9rV3

[Ryohei Sasaki@engineer @rsasaki0109]

MeshVPR: Citywide Visual Place Recognition Using 3D Meshes
https://t.co/taGxJciglR

[Ethan Mollick @emollick]

Weirdly, the ways things are going, only the LLMs will remember what we wrote, imperfectly.

[Ethan Mollick @emollick]

The Internet is rotting. The destruction of MTV news is the latest.

Over 25% of the links embedded in New York Tunes articles just seven years ago & 60% of older links, are now broken. It isn’t good that the only people preserving decades of digital data is the Internet Archive.

[elvis @omarsar0]

Nice survey on LLM-based synthetic data generation, curation, and evaluation.

If you are working with LLMs, a lot of effort is going into these areas so it's important to get familiar with concepts. This survey is a good starting point.

[Gradio @Gradio]

💪Demo by @AnnioDance: https://t.co/uAJmGYiPST

Model on 🤗
ExVideo: https://t.co/71cdrsrznW
Diffutoon: https://t.co/uj8YQGO77v

🎥Create engaging experiences with Gradio's Video Component. Stream, analyze, and interact with video data seamlessly🌟 Visit: https://t.co/ISNtjNvSkV

[Gradio @Gradio]

🚨Epic News: Demos for ExVideo and Diffutoon are out!

🤯 Play with the advanced parameters for greater control -- this might be the best open model and demo for text2video/image2video out there!

[CubanHodLer🇨🇺 @CubanBTC]

@tradernewsai @emollick The “financial press” manipulates on their own 😂

[Xenova @xenovacom]

Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! 🤗🤯

It supports tasks like image captioning, optical character recognition, object detection, and many more! 😍 WOW!

Demo (+ source code) 👇