@PCjank If your offensive security provider is using a major llm api instead of local - they are giving away all of your confidential information, and any vulnerabilities or weaknesses discovered.
We think that's a terrible idea. So- local is the only choice.
@PCjank < Offensive security company.
We act like "hackers" to break into your systems, then show you how we did it - so you can fix the issues you didn't even know existed.
We can't do that via "api / cyber prog" - we get blocked. Also we take client IP / data privacy very seriously.
@Italianclownz depends on the hardware - but we prefer qwen3.8-flash-next because we can run FP8 on 2x GX10. We tried heavily quantized GLM and DeepSeek (nvfp4 / q4 / strata / various recipes etc) - the results were poor at best vs the qwen fp8 (on 2xGX10's).
@techspence fair.
that is - UNTIL they get hacked... then they go all in.
Trick is though... to prepare before that happens. But many do not have the foresight. (unfortunately)