I'm finally happy with my @UnslothAI unsloth/Qwen3.6-35B-A3B-MTP-GGUF, @no_stp_on_snek llama.cpp-turboquant, @_HermesAgent setup, @MajorFAFO params suggestions, and my own Rust/SQL/Hermes app.
- @ASUS, 32GB RAM, 8GB VRAM 5070 laptop
- MoE fully offloaded to CPU
- I've fiddled around with --no-mmap and mlock. It pegs my RAM to 95% instead of 45% and after it spins up, I don't see a difference.
--cache-type-k q8_0 \
--cache-type-v turbo3 \
-ot "\\.ffn_.*_exps\\..*=CPU" \
--spec-type draft-mtp \
--spec-draft-n-max 3 \
The video shows it has full hermes skills/toolset access easily, knows my system, can be creative, can print out a quick BASIC function, corrected itself when I told it that it was incorrect, and that it doesn't love me....
@stevibe I'd take slower, freeer (mostly), and all local over the other options. I ask mine to transcribe a YouTube video, write an article, write the html, QA it, and upload to server. I go outside to water my garden and come back, it's done.
@aakashgupta The problem with your argument is they are chasing a house, not paying on a house. They're not broke from not paying on a house they are not buying. People live outside their means...it's ok, you can say it.
It has it's own calendar, documentation checklists, goal indicators, has the ability to (and has) created it's own @_HermesAgent skills (and Orchestrator skills), creates reports. I've had to correct it's coarse a few times, but it's getting to the point where I don't have to.
My AI website is now in it's marketing phase. It scouts competitor ads, plans, designs, deploys, and analyzes results. Excited to see what it comes up with. https://t.co/Po5ghMBs1c
@ThundyLightor@ShitpostRock2 What? The fact they decided what to put in the KJV in 1600s, put apocrypha in it, then took it out, invalidates what you're saying completely. There are valid historical gospels that were left intentionally to create a narrative. Ever read the Gospel of Mary?