Sam Stoelinga

Deploy and finetune LLMs easily:

[Sam Stoelinga @samosx]

Simple guide for anyone to deploy #Deepseek R1 14B on their laptop with a chat Web UI: https://t.co/LCz1wzLv1T

[paco xu @xu_paco]

https://t.co/Lp6xg0iu3N GitHub - substratusai/kubeai: AI Inference Operator for Kubernetes. The easiest way to serve ML mode

[Jacob Austin @jacobaustin132]

Making LLMs run efficiently can feel scary, but scaling isn’t magic, it’s math! We wanted to demystify the “systems view” of LLMs and wrote a little textbook called “How To Scale Your Model” which we’re releasing today. 1/n

[Tom Dörr @tom_doerr]

"AI Inference Operator for Kubernetes"

[Tom Dörr @tom_doerr]

https://t.co/DWO7canxvj

[Star History @StarHistoryHQ]

535 ⭐️ KubeAI is a Kubernetes-native platform for running AI/ML workloads. It simplifies the deployment 🔧 and management 📝 of AI models in Kubernetes clusters, making it easier to scale AI applications.

https://t.co/3aMHI8iZYH

#starhistory #GitHub #OpenSource

[Sam Stoelinga @samosx]

Tutorial: Deploying Llama 3.1 405B on #GKE Autopilot with 8 x A100 80GB https://t.co/7f9SYEAjST

[Kubetools @kubetools]

GitHub - substratusai/kubeai: Private Open AI on Kubernetes https://t.co/EvUBEYKRxW

[Sam Stoelinga @samosx]

Tutorial: Private RAG with Verba, #Weaviate, Embedding Model and LLMs all running inside your own K8s cluster. Copy paste-able instructions for all.
https://t.co/MMwkT1VLp9

[Sam Stoelinga @samosx]

Need to provide a private OpenAI API compatible endpoint backed by OSS or fine-tuned LLMs? Lingo: an open source lightweight ML proxy and autoscaler for K8s makes this easy: https://t.co/HZgfadCuQq

[Sam Stoelinga @samosx]

Kind + GPU: A Local K8s cluster that can run GPU pods https://t.co/hW1yFfGUkl via #k8s #nvidia #gpu #ml

[Sam Stoelinga @samosx]

Tutorial: Converting HuggingFace Models to GGML/GGUF format https://t.co/kMO6IFp1JA

[Sam Stoelinga @samosx]

https://t.co/gustCCcImC Deploy and fine tune LLMs on K8s. Upvotes greatly appreciated!

[Sam Stoelinga @samosx]

@elonmusk Do they play xvideos at night? 🤣

[Sam Stoelinga @samosx]

@mehran__jalali minor correction, it's https://t.co/1w61AqxBc0

[Sam Stoelinga @samosx]

@mehran__jalali https://t.co/pUUNyWWYRV purpose is to make deploying and finetuning OSS LLMs just as easy as OpenAI. It's free and open source. Would love your feedback @mehran__jalali

[Sam Stoelinga @samosx]

Guide: Deploying #stablediffusion on #GKE autopilot https://t.co/0Edqi0MTV6

[Google Cloud Tech @GoogleCloudTech]

Unlock the power of Apache Kafka on #Kubernetes!

Check out this tutorial to learn how to deploy and manage Kafka clusters with ease on #GKE for scalable and high-availability data streaming ↓
https://t.co/8MfDTRDPaO

[Sam Stoelinga @samosx]

Annoyed about `gcloud container node-pools update --node-labels` overwriting all existing labels? Solve it with a simple bash script 😀
https://t.co/rFmHSwDpCE

[Weaviate AI Database @weaviate_io]

⚡ Announcing the Spark Connector for Weaviate!
🗃️ The Spark Connector allows easy importing of data from @ApacheSpark into Weaviate
👀 Check out this tutorial to get started
👉 https://t.co/NzJ9Y8PjmR
👉 https://t.co/SmejUWcdch

More in the 🧵