MiniCPM

A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

[MiniCPM @MiniCPM]

📢📢📢 MiniCPM-o 2.6 technical report is released! See here: https://t.co/t33pWZVqRr

[MiniCPM @MiniCPM]

Multilingual ability - ask MiniCPM-o 2.6 to be your language assistant!

[MiniCPM @MiniCPM]

💡💡💡 MiniCPM-o 2.6 is now supported by Align-Anything (https://t.co/mOv3Ff8WrV), a framework by PKU-Alignment Team for aligning any-to-any modality large models with human intentions. It supports DPO and SFT fine-tuning on both vision and audio. Try it now!

[MiniCPM @MiniCPM]

MiniCPM-o 2.6 Advanced Voice Chat with different accents and real-time interruption.

[MiniCPM @MiniCPM]

Example 2

More details: https://t.co/O6k0KhIVu8

[MiniCPM @MiniCPM]

📢 ATTENTION! We are currently working on merging MiniCPM-o 2.6 into the official repositories of llama.cpp, ollama, and vllm. Until the merge is complete, please USE OUR LOCAL FORKS of llama.cpp, ollama, and vllm.

[MiniCPM @MiniCPM]

🚨 o3-mini crushed DeepSeek R1

"Write a Python program that shows a ball bouncing inside a spinning hexagon. The ball should be affected by gravity and friction, and it must bounce off the rotating walls realistically"

[MiniCPM @MiniCPM]

We have updated the usage of MiniCPM-o 2.6 int4 quantization version and resolved the model initialization error. Click here and try it now: https://t.co/iJxlWIX0Yv

[MiniCPM @MiniCPM]

Asking MiniCPM-o 2.6 to recall the word that was just erased...

[MiniCPM @MiniCPM]

Play puzzle or trick game with MiniCPM-o 2.6

[MiniCPM @MiniCPM]

Example 1

More: https://t.co/O6k0KhIVu8

[MiniCPM @MiniCPM]

You can easily build your own local WebUI demo using the following commands.

Please ensure that transformers==4.44.2 is installed, as other versions may have compatibility issues.

[MiniCPM @MiniCPM]

🔥🔥🔥 We open-source MiniCPM-o 2.6, which matches GPT-4o-202405 on vision, speech and multimodal live streaming. It advances popular capabilities of MiniCPM-V 2.6, and supports various new fun features. Try it now!