Jordan

AI and Tech Focused. I build apps, solutions, and share my thoughts here.

[Jordan @JordanDevAi]

Ai Note taking app - I install and use AI Locally on your devices for offline use. https://t.co/rAFgBvZn3D is the first of many of my AI initiatives!

[Jordan @JordanDevAi]

@HowToAI_ Game development is only going to get so much more wild with the tech as time goes on. I'm excited to see the future of new indie games

[Jordan @JordanDevAi]

@EnricoMagni1 @chesnyfcb Not even in the same league

[Jordan @JordanDevAi]

Drinking hydrogenized water every morning. Anything to help clean up the oxidative stress on the brain.

[Jordan @JordanDevAi]

@RealProductGirl Welcome back. Here's to a productive and successful week 💪

[Jordan @JordanDevAi]

@RealProductGirl Bummer! Plumbing issues suck! Hopefully it all gets resolved quickly!

[Jordan @JordanDevAi]

@HaareBlond @stevibe @TeksEdge You do realize parallel batch processing splits the bandwidth right?

[Jordan @JordanDevAi]

@liquidai @MercedesBenz Congrats - that's awesome!

[Jordan @JordanDevAi]

@stevibe @TeksEdge I have no problem getting 500-700 tok/s on Dense 30B models on my 5090 and 300 tok/sec on my 3090.

Its not so much the quant as it is compiling Llama.cpp for your specific hardware. This pic is Gemma4 running their dense 31b at 500+ tok/sec.

[Jordan @JordanDevAi]

@googlegemma And by both, I mean dual instances of Gemma4

[Jordan @JordanDevAi]

@googlegemma I've been running both 24/7 for the last 6 days:

[Jordan @JordanDevAi]

It's efficient
It does everything I need to do
And its freedom of choice
No bloat

[prashant varma @realpvarma]

Why do you actually use linux?

- Control
- Performance
- Just for flex
- Open-source love

[Jordan @JordanDevAi]

@RealProductGirl The puppers 🐾

[Jordan @JordanDevAi]

@BuescherScott Yo. That's wild. I recently formed a Real estate tech company with a partner who owns a realtor company in South Florida. We're publicly launching soon.

I'll follow you back and check out your project.

[Jordan @JordanDevAi]

I have about 3 million photos I need to run classification on. Can someone do the AWQ 4 bit quantization for me

[Qwen @Alibaba_Qwen]

⚡ Meet Qwen3.6-35B-A3B：Now Open-Source！🚀🚀

A sparse MoE model, 35B total params, 3B active. Apache 2.0 license.

🔥 Agentic coding on par with models 10x its active size
📷 Strong multimodal perception and reasoning ability
🧠 Multimodal thinking + non-thinking modes

Efficient. Powerful. Versatile. Try it now👇

Blog：https://t.co/EXx5y466su
Qwen Studio：https://t.co/bg4tAU1p74
HuggingFace：https://t.co/w4pDX14DZS
ModelScope：https://t.co/SuRyLzdQiO
API（‘Qwen3.6-Flash’ on Model Studio）：Coming soon～ Stay tuned

[Jordan @JordanDevAi]

@RealProductGirl @BuescherScott Uh oh! As in... you need to move out of there like right now?! 🫣

[Jordan @JordanDevAi]

@0thernes_ai @Kimi_Moonshot On pure CPU with 0 GPU inference?

[Jordan @JordanDevAi]

@RealProductGirl Like when I saw your post at 3am eastern time and I responded the other day lol

[Jordan @JordanDevAi]

@petergyang If going for system ram, get as much as you can afford then use MoE and offload layers to CPU/GPU. Then you can run 80B+ MoE models

[Jordan @JordanDevAi]

@DavidOndrej1 Last week lol