Angel Espiritu

🥾 Bootstrapped Founder
🧪
⚡️
🎤

[Angel Espiritu @aceangel]

Check out Magic Potion on https://t.co/TFU3JClAMT

https://t.co/QRN7zGm8FJ

[Angel Espiritu @aceangel]

@MiaAI_lab You can game on the Spark too, but you're going to have to deal with the aarch64 hurdles (no anticheat/denuvo locked games)

[Angel Espiritu @aceangel]

@libsoftiktok RTX on

[NVIDIA AI @NVIDIAAI]

@AtlasInference @spark_arena 🔥

[Azeez @AtlasInference]

Atlas is open source!
An inference engine written from scratch in Rust + CUDA. No PyTorch, no Python, no 200-dependency install dance. <2 min cold start, BUILT for GB10
Qwen3.6-35B at 130 tok/s on a single DGX Spark.
Demo powered by @Gradio
🧵 https://t.co/vxZLwBJMub

[Angel Espiritu @aceangel]

@loktar00 @pupposandro You can get 30-40tk (or even more) with the new dflash speculative decoding techniques. I’ve been using 27b on one of my Sparks at 40-60 tok/s with DFlash.

[Angel Espiritu @aceangel]

@loktar00 @pupposandro This is an unfair comparison because no one really uses ollama as a backend on the Spark. the standard is vLLM for its concurrency/parallelism support. It’s way faster and more robust.

[Angel Espiritu @aceangel]

@0xLaxo All you need is a pixel or logged % scroll, and an automated job to get your keys stolen

[Angel Espiritu @aceangel]

Hi @cerebras + @cline , this is my entry for the hackathon.

Enter GLM Token Saver
https://t.co/YqN51ce6vs

Uses Speculative Decoding (tested on DGX Spark) to save on precious Cerebras Inference Tokens!

[Angel Espiritu @aceangel]

@redtachyon @RayFernando1337 There is an unsloth version and a fix to llama.cpp. There’s also an update coming up that fixes flash attention, it’s running at 65tk/s initially on my spark

[Angel Espiritu @aceangel]

@Hankyone I’ve noticed my iPad and possibly iPhone both also have this same problem. I wonder if there is a way to fix it on those devices?

[Angel Espiritu @aceangel]

@Andrew__Boley

[Angel Espiritu @aceangel]

@Pirat_Nation

[Angel Espiritu @aceangel]

@Slypador

[Angel Espiritu @aceangel]

@DavidKPiano Does Zed count?

[Angel Espiritu @aceangel]

@supersisi

[Angel Espiritu @aceangel]

@realdanieltitus Amen

[Angel Espiritu @aceangel]

@insidemanifest 111

[Angel Espiritu @aceangel]

@levelsio I thought India would at least be one of them?