Got Craft Anything running fully local on my Bazzite PC (RTX 5070 12GB) with Ollama through Alpaca. No cloud at all, love it.
Took some fiddling though. qwen2.5-coder 14b just printed its tool calls as text and never made any files. qwen3 14b got further but stalled. Turned out Ollama's default 4k context was the problem. Bumped qwen3 to 16k and it built a working little page first go.
Two things I noticed: the checker kept saying "No project to build found in app/" even though the site was right there and worked. And a heads-up when the local model's context is too small would've saved me a lot of head scratching.
Great work, keep it up!
Got Craft Anything running fully local on my Bazzite PC (RTX 5070 12GB) with Ollama through Alpaca. No cloud at all, love it.
Took some fiddling though. qwen2.5-coder 14b just printed its tool calls as text and never made any files. qwen3 14b got further but stalled. Turned out Ollama's default 4k context was the problem. Bumped qwen3 to 16k and it built a working little page first go.
Two things I noticed: the checker kept saying "No project to build found in app/" even though the site was right there and worked. And a heads-up when the local model's context is too small would've saved me a lot of head scratching.
Great work, keep it up!
@SavvytheRumGod@ViraXVespa@BluetigerDream1 No, I agree 100% with you, I think there is a long term plan in play, that was the first step and I won't lie this whole thing has turned me into a pessimist for the future of Grokbot.