Ilya

Distributed Systems, Linux, local AI infra.

[Ilya @ilyarogers]

In certain scenarios it is.

I parsed more than 180k podcast episodes on my $3k server.

Parsing that with the cheapest STT API would have set me back more than $50k.

[@bluecow 🐮 @BLUECOW009]

Running AI locally is not cheaper

[Ilya @ilyarogers]

@zanehengsperger @dagorenouf Zane you inspired me to do my metal business in the near future. Keep up what you do mate!

[Ilya @ilyarogers]

Still can't get over the fact that my uni has more security guards than the private island of that twink trillionaire.

[DiscussingFilm @DiscussingFilm]

‘ALIEN: EARTH’ Season 2 has begun filming.

(Source: Deadline)

[Ilya @ilyarogers]

@thekitze just use fmhy. they have all the streams you need

[Ilya @ilyarogers]

@marclou Also worth checking your thyroids. T4 was working like utter shit forcing the entire system to go into overdrive causing my LDL to spike. Worth a shot if things don't pan out to normal again

[Ilya @ilyarogers]

@levelsio BTS is in town thats why the tickets for Brussel are so high atm

[Ilya @ilyarogers]

Hopefully one product in their line will be dedicated to the local AI enjoyer

[Etched @Etched]

We're coming out of stealth.

We've built our first racks after a successful A0 tapeout, $1B+ in customer contracts, and $800m raised.

Early customer tests show us achieving SOTA throughput, latency, and power efficiency on inference workloads.

Our first racks ship this summer.

[Ilya @ilyarogers]

Created this build with the following in mind:
- absolute cable salad to confuse copy cats
- cooling fans that work against each other
- thermal mismanagement

[Jack Zampolin @jackzampolin]

Wrote this build up if you are interested in:
- Custom water cooled loops
- Living with your GPUs
- Broken computer parts
- Thermal management
- RTX 6000 Pros

[Ilya @ilyarogers]

@PandereOdium @CoachDanGo Gut is insanely harmonized. Both kefir and fermented food like Sauerkraut, kimchi etc promote healthy bacteria. And science backs up that your gut health correlates to a lot of processes in your body

[Ilya @ilyarogers]

@0xSero goat

[Ilya @ilyarogers]

@thekitze mushrooms man. just take them, and feel the difference. or build something with hardware. maybe your brain does not like you hitting only enter on your mac all the time. tinker with hardware, create a drone, fuck shit up, take shrooms.

[Ilya @ilyarogers]

@aHev I store them in S3 and extract insights from them for my app.

[Ilya @ilyarogers]

In certain scenarios it is.

I parsed more than 180k podcast episodes on my $3k server.

Parsing that with the cheapest STT API would have set me back more than $50k.

[@bluecow 🐮 @BLUECOW009]

Running AI locally is not cheaper

[Ilya @ilyarogers]

@AdamsBunnyranch @BLUECOW009 Generated VTT (time stamped) transcriptions.

[Ilya @ilyarogers]

@colemurray @BLUECOW009 I allow it

[Ilya @ilyarogers]

@sflorimm Proprietary data, building horizontally, using AI in undersaturated fields, hardware focus with ai edge

[Ilya @ilyarogers]

@commanderdgr8 You need some hardware to run something locally. Most likely you wont be able to generate the tps as with an API, but in certain scenarios it can be quite cheap

[Ilya @ilyarogers]

@Darky1k 4:1

[Ilya @ilyarogers]

@thekitze look how he is flexing his zloties. mf aint even touching his previous ai hoe anymore

[Naval @naval]

It's the Age of Builders.

(sorry financiers and talkers)