@NousResearch mac app seems to be broken. thinks its in some sort of sandbox cant call tools to operate on my machine. telegram works fine, but the desktop app isnt working. have updated to the latest. will wait for a fix!
erm why does the deaktop app (mac) insist on downloading all models from hf? it started with just a tiny qwen and carries on downloading larger and larger models in the background. had to delete the app as there was no stopping it. Also does not work with openai compatible endpoints (no LM Studio or custom servers) - love the idea but the app is not usable for local models on a mac at this point. hopefully youll fix these basic issues soon would love to try again
@zeddotdev very cool. however, the terminal sessions disappear on restart - so not sure how useful it is. had a grok build terminal session going and it was gone once I restarted the app. pretty painful
Welcome to DS4, a specialized inference engine for DeepSeek v4 Flash. https://t.co/UrUJz5I2R1
This project would have been impossible without the existence of llama.cpp and GGML and the work of @ggerganov and all the other contributors. Thanks!
youโve done something really special with ds4 mate. I use benchlocal to test quality and what you built qith your q2 on a m5 max 128 blows everything else out of the water. zero OOM ultra long context with no speed degradation and 90% + across all quality test suites. Cant wait to see what you build next
Thats really good - but for local modelsโ quality testing iโve found benchlocal to be a good holistic capabilities test. DS4-q2 kills it (>90% on all tests). MTPLX Qwen (quality tuned) doesnt do too well. Will take another look to see if the fails are due to timeouts or actual quality related issues.
@KobeissiLetter ah yes - purposefully displaying a lower timeframe snippet with no overall context - pure engagement farming - here's two thumbs up for you ๐๐