@ivanfioravanti@Prince_Canuma Oh, never mind… thought somehow you were using the 27B 😅
With lower bits, there’s the question, if the changes from SSD interfere with the quantization, so you’d theoretically be turning several knobs at the same time… just some random thoughts 💭
🐰 Down the AI rabbit hole again and again!
The deeper I go, the more I feel like Alice, completely lost in this weird wonderland where nothing behaves like it should 🤯🤣
Layers, engines, code, math, total chaos for my poor human brain, but I can’t stop. I’m hooked on this constant discovery of new things, trying new ideas, finding a new way in this unknown world that doesn’t follow any rules.
And this is why we love it so much, because our brains we love discovery adventures into the unknown!
@ivanfioravanti "Seems the user is in a good mood. I will mirror his cheerful greeting.
Drafting response.
Correction: I shouldn’t overdo it. Let’s keep this professional."
@ivanfioravanti Been 👀 at mlx-lm for a while, not much happening there, except a growing number of PRs… you think there’s some light at the end of the tunnel? 🔦