Anees Iqbal

engineer

[Anees Iqbal @aneesbhatti]

So many new fun new usecases are going to be unlocked when the MoE version of 3.8-27B drops! I'm already getting more than 100 tokens/s on the int4 quant with speculative decoding. 100 tokens/s running 27/4 on this model is a lot of home-lab intelligence!

[Anees Iqbal @aneesbhatti]

@VideoCardz You can buy pre-upgraded ones for $300-350 on Alibaba

[Anees Iqbal @aneesbhatti]

As an experiment, I tried to get KVM-accelerated macOS arm64 VM working on M2-Asahi Linux, with Graphics Acceleration powered by Reims vGPU.

It works! Source code is on Github: https://t.co/Ne8YLQvNDj

[Anees Iqbal @aneesbhatti]

@natebirdman Very impressive! Love the new styles syntax! Good job

[Anees Iqbal @aneesbhatti]

@TheLunarixus Is your qemu fork open source? Curious to see the patches

[Anees Iqbal @aneesbhatti]

@davepl1968 For the website, you can ask your AI agents to replace the screenshot with an HTML/CSS replication of the OG task manager. Much more fun!

[Anees Iqbal @aneesbhatti]

@dhh I would pay money for a clean room Markdown WYSIWYG implementation that doesn't keep breaking (either in code or in rendering) and has a decent API for highlights

[Anees Iqbal @aneesbhatti]

@feross @SocketSecurity Ticket 3741

[Anees Iqbal @aneesbhatti]

@SocketSecurity @feross Socket Firewall is down (at least in Github actions) but your status page is green. FYI

[Anees Iqbal @aneesbhatti]

@Sasobhabha Yes

[Anees Iqbal @aneesbhatti]

Is this unmodified macOS Ghostty running on linux GPU-accelerated? Yes. Yes, it is!
✨ Mach-O Milan sneak peak ✨
This builds on top of the metal2vulkan work that's used in Reims vGPU

[Anees Iqbal @aneesbhatti]

@vic_hates_x Yes this is a from scratch implementation. Initially considered using Darling as base but it would’ve been unsuitable

[Anees Iqbal @aneesbhatti]

@rusabuilds Nothing has been easy so far :D

The challenges you're describing are real tho, they've been worked around far as I understand? Both reims-vgpu and metal2vulkan are open source! You can read on how we solved them

[Anees Iqbal @aneesbhatti]

@1casie I’m RDP-ing into CachyOS (from macOS)

So the turtles only go so far down

[Anees Iqbal @aneesbhatti]

@ADudeFromPersia realsteelbrain -> aneesbhatti

[Anees Iqbal @aneesbhatti]

new handle, who dis?

[Anees Iqbal @aneesbhatti]

Reims vGPU has a discord now! As we're kicking off compatibility sprint for macOS 14+, you're welcome to join in and try out the experiments and share feedback!

https://t.co/cdWv2V6AVd

[Anees Iqbal @aneesbhatti]

@scatano85 OSX-KVM Virtual Sound Device notes will probably help here: https://t.co/NijJIN9RBX

[Anees Iqbal @aneesbhatti]

Reims vGPU Progress Update:

- Crashes are gone, haven't seen one in days
- Performance is better (but not the focus yet)
- Safari web content is flawless now
- Chrome is still faster (unlike Safari, Chrome is not using GPU acceleration)

Enjoy the video!

[Anees Iqbal @aneesbhatti]

@scatano85 QEMU’s builtin audio device should already be supported. Its just not wired up in the test configurations