Naz

Curious engineer navigating an unknown future

[Naz @nothingto12]

@fabiorg74 DeepSeek Harness

[Naz @nothingto12]

Hmm, I don't think I've seen anyone compare OpenCode Go's deepseek v4.1 1017 with DeepSeek's official API to compare quality.

Stay tuned... I'll get some results out for you guys so we can settle the debate about whether OpenCode is quantizing.

[Naz @nothingto12]

@kaygdotorg @theo will prosecute you for saying harness

[Naz @nothingto12]

@hqmank More than twice as expensive... kind of crazy.

[Naz @nothingto12]

@praneos It’s not possible to check what they’re doing under the hood but:

DeepSeek API uses the native deployment of weights they released on huggingface - they use that.

OpenCode Go: who knows haha.

[Naz @nothingto12]

🧵 DeepSeek-v4.1-Flash-1017 - Same prompt, same harness, same reasoning effort, but two different providers.

DeepSeek Platform (45m 38s):
• Cache hit: 99.7%
• Tokens: 136,590
• Cached input: 44,212,736 tok
• Output: 226,572 tok

OpenCode Go (3h 25m 3s)
• Cache hit: 96%
• Tokens: 1,409,656
• Cached input: 33,611,264 tok
• Output: 224,378 tok

[Naz @nothingto12]

Hmm, I don't think I've seen anyone compare OpenCode Go's deepseek v4.1 1017 with DeepSeek's official API to compare quality.

Stay tuned... I'll get some results out for you guys so we can settle the debate about whether OpenCode is quantizing.

[Naz @nothingto12]

@Nicoltxd13 DeepSeek Harness

[Naz @nothingto12]

@tealsea90 I've noticed a lot of timeouts on OpenCode Go as well. It's a significant amount of overall wall time. Wish I could say it was one off but it's not.

[Naz @nothingto12]

@yuhasbeentaken Hey! All of those are what I've noticed myself running these tests. I've gotten plenty of timeouts that actually accounted for a significant chunk of the overall wall time

[Naz @nothingto12]

@ian_90211 Bro this has to be the worst take I've seen all day, and I've seen a lot of takes.

[Naz @nothingto12]

Prompt: Create a beautiful interactive miniature city in a single self-contained HTML file using CSS and vanilla JavaScript. Let users place buildings, grow parks, and watch tiny cars travel through streets as daylight shifts into a glowing neon night. Use an isometric perspective, a tasteful color palette, smooth animations, and elegant controls for building, weather, and time of day.

[Naz @nothingto12]

🧵 ROUND 2: DeepSeek-v4.1-Flash-1017 - Same prompt, same harness (DSH), same reasoning effort (high), but two different providers.

DeepSeek Platform (46m 19s):
• Cache hit: 99.8%
• Input Tokens: 117,828 tok
• Cached input: 53,376,768 tok
• Output: 265,411 tok
• Speed: 192 tok/s avg

OpenCode Go (1h 40m 26s)
• Cache hit: 97%
• Input Tokens: 396,405
• Cached input: 13,864,960 tok
• Output: 158,146 tok
• Speed: 167 tok/s avg

What do you think did better?

[Naz @nothingto12]

The left video is using DeepSeek Platform API, the right video is using OpenCode Go.

I think the official API had a much cleaner UI (no overflows), and overall better design. The cars were slightly angled wrong however.

[Naz @nothingto12]

@ian_90211 That was a nice read! I feel like a lot has changed since then in OpenCode Go (i think they're doing either a hybrid self-host/provider fallback method?). They mentioned model quality isn't impacted, but i'm trying to put that to the test!

[Naz @nothingto12]

@theo @grok This https://t.co/4yxwPNEgrZ
(Rendering bugs in general)

[Naz @nothingto12]

@theo Any plans to make the mobile apps less buggy? Literally just downloaded and came up with a welcome screen where most of the text is cut off. On my android phone, text positioning and rendering is completely off.

Desktop app is cool and all, but mobile is… important

[Naz @nothingto12]

@Fukitsu_ "Lumen" too 😂

[Naz @nothingto12]

@sbintakall Hi!

[Naz @nothingto12]

Prompt: Create a stunning interactive marble music machine in a single self-contained HTML file using CSS and vanilla JavaScript. Let users drop glowing marbles onto curved tracks and musical chimes, creating ripples of light and harmonious sounds as they bounce. Use a rich dark palette, elegant typography, smooth physics, and working controls for tempo, gravity, and clearing the scene.

[Naz @nothingto12]

What do you guys think? Is OpenCode Go quality lower/feel quantized? Follow for more tests like this!

[Naz @nothingto12]

The left video is using DeepSeek Platform API, the right video is using OpenCode Go.

What surprised me was the time it took for completion using OpenCode Go. There were many times I thought of cancelling the run, but it did eventually go to completion.

[Naz @nothingto12]

@MarcosMillaYT I'd say more people supplement their expenses and income with dividends, but people who are doing 100% dividends are either living abroad or accumulated enough where they're more well off than 99% of their peers.