Agents & Developer Experience Ecosystems Lead EMEA at Google. O'Reilly author. Local AI, fine-tuning. Building tool-eval-bench & awesome-local-ai. Views my own.
I couldn't keep track of all the local AI tools flying around anymore. New engines, harnesses, tooling, benchmarks... every week.
So I started awesome-local-ai: a list sorted by what you want to do, not by hype.
The twist: it's built for agents too. Point your coding agent at it and ask it to recommend a setup for your hardware.
It's early and DGX Spark-heavy. Help me fill the gaps:
https://t.co/aO5UiUnmjh
Found my kind of place at @NVIDIAAI GTC Berlin. Including the (for now) proof-of-concept switch. I counted 2 pairs of 5 ports - so you’d be able to pair up to 10 DGX Spark systems with breakout cables.
Found my kind of place at @NVIDIAAI GTC Berlin. Including the (for now) proof-of-concept switch. I counted 2 pairs of 5 ports - so you’d be able to pair up to 10 DGX Spark systems with breakout cables.
Found my kind of place at @NVIDIAAI GTC Berlin. Including the (for now) proof-of-concept switch. I counted 2 pairs of 5 ports - so you’d be able to pair up to 10 DGX Spark systems with breakout cables.
@jamesladd@GeoffreyHuntley Appeal always helps because that gives me an appeal id that I can reference and helps the colleagues to find more information quicker!
@jamesladd@GeoffreyHuntley Hi James, I don’t know if I’ll be helpful but I can try. I’m on the go today, so would you mind sending me a DM with details?
@ADLXBT@NVIDIAAI@GoogleCloudTech In this case the Google Cloud Hub is a physical space in the context of GTC with really nice programming and great coffee 😁
Had a blast at @NVIDIAAI GTC today in Berlin. I spent a good chunk of the day at the @GoogleCloudTech Hub just across the street of Station F to meet builders from across the region and will be at the conference for most of tomorrow, too!
@DevOpsAndBeyond I came to the same conclusion with bifrost. Right now I use a version of LiteLLM that is considered safe but I’m also inclined to build my own gateway.
❗️LiteLLM was compromised (Again). The latest version 1.107.0 contains an infostealer and RAT.
All 7 compiled wheels are backdoored. Anyone who ran pip install litellm==1.107.0 on any platform should assume credentials are compromised.
More details soon!