Baker Shamlan

I administer truth in controlled doses.

[Baker Shamlan @masterde]

Check out my latest article: The Revision: Lessons from Building an Autonomous AI Newsroom https://t.co/1aLbAd1jVZ via @LinkedIn

[Lior Alexander @LiorOnAI]

You can now run 70B LLMs on a 4GB GPU.

AirLLM just made massive models usable on low-memory hardware.

𝗪𝗵𝗮𝘁 𝗷𝘂𝘀𝘁 𝗵𝗮𝗽𝗽𝗲𝗻𝗲𝗱
AirLLM released memory-optimized inference for large language models.

It runs 70B models on 4GB VRAM.
It can even run 405B Llama 3.1 on 8GB VRAM.

𝗛𝗼𝘄 𝗶𝘁 𝘄𝗼𝗿𝗸𝘀
AirLLM loads models one layer at a time.

Instead of loading everything:
→ Load a layer
→ Run computation
→ Free memory
→ Load the next layer

This keeps GPU memory usage extremely low.

𝗞𝗲𝘆 𝗱𝗲𝘁𝗮𝗶𝗹𝘀
• No quantization required by default
• Optional 4-bit or 8-bit weight compression
• Same API as Hugging Face Transformers
• Supports CPU and GPU inference
• Works on Linux and macOS Apple Silicon

𝗪𝗵𝗮𝘁 𝘆𝗼𝘂 𝗰𝗮𝗻 𝗱𝗼
• Run Llama, Qwen, Mistral, Mixtral locally
• Test large models without cloud GPUs
• Prototype agents on cheap hardware

[Baker Shamlan @masterde]

@JamesIvings @OpenAI I would appreciate an invite. 🙏🏽

[James Ivings @JamesIvings]

It's ready! 🚀🚀🚀🚀🚀

Introducing Ellie - your email assistant! 💌

Ellie is powered by @OpenAI and will learn your writing style and reply to emails as if you wrote them 🔥

If you want to be an early user, please retweet and comment below and I'll send you an invite code! 🙂

[Baker Shamlan @masterde]

Hip Hop has lost another giant

"As I walk through the valley of the shadow of death
I take a look at my life & realize there's nothing left"

Coolio ft. L.V. & Stevie Wonder! "Gangsta's Paradise" Live! [Billboard Awards 1995]

#RIPCoolio

[أنس بن حسين @AnasBenHussain]

10 كتب غيرت خريطة دماغي..
حرفيًا.. غيرت سرعتي واتجاهي بشكل رهيب.
بعضها راح تتفاجؤون من بساطتها والبعض شوي عميق..

نقول بسم الله....

[Baker Shamlan @masterde]

I wish i could downvote articles.

[Baker Shamlan @masterde]

I'm attending Vue.js Forge this summer, the largest hands-on Vue.js event EVER! 🔥 You can also join for free at https://t.co/2kb8HoFEyU

[Baker Shamlan @masterde]

I once did something great. It's time to do it again.

[Baker Shamlan @masterde]

@codingyuri https://t.co/omeFeYW9Wv
Vue > React

[Baker Shamlan @masterde]

@khaled @bampen @TwitterMENA @TwitterComms https://t.co/CjOS8Bvf9M

[Baker Shamlan @masterde]

@XScoder 👅

[Baker Shamlan @masterde]

Can’t wait to buy a bunch of these.

[Ivan Kuleshov @Merocle]

Compute Blade development halfway, it's time to sum up some of the results. Easier to do this in the picture.
Important changes in v0.6:
- TPM 2.0 chip
- Port for @zymbit ZYMKEY4i
- USB-A for YubiKey
- Power supply up to 22W
- NVMe 22110
Thanks for your support!
#raspberrypi

[Baker Shamlan @masterde]

@lama3an @CEOTheaterKSA ما بتنزل الفيديوهات على يوتوب؟ أو أي مكان ثاني؟

[Baker Shamlan @masterde]

This should be an introduction to #Twitter for every #NewTwitterUser

[Dax @thatsdax]

Full video: https://t.co/OgyzROlwnA

[Baker Shamlan @masterde]

Vibe pollution
التلوث الڤايبي

[Baker Shamlan @masterde]

As a night owl, I feel obligated to thank every establishment that operates 24/7.

So, thank you for giving me peace of mind, and not having to worry about shops closing on me.

[Baker Shamlan @masterde]

@TreciaKS I think for developers the question should be about how many hours of not coding.

[Baker Shamlan @masterde]

@khaled I also have other uses in mind but i worry about mentioning them.

[Baker Shamlan @masterde]

@khaled Universal smart home automation hub.