Harrison Kinsley

gpus and tractors.

Neural networks from Scratch book:

[Harrison Kinsley @Sentdex]

dario begged me in dms to not do agent swarms at home but whatever, this is nemotron 120B A12B running 64 concurrents at a bit over 100 tok/sec each for an aggregate of almost 7K tok/sec on a single GB300 (Asus DGX Station)

believe it or not, the agents did NOT magically just start hacking the planet tho. weird.

[Harrison Kinsley @Sentdex]

@teortaxesTex This is a good point. If you can make 3T fast, then okay you have something maybe!

[Harrison Kinsley @Sentdex]

@asimovinc You should totally do this!

[Harrison Kinsley @Sentdex]

@BrandonMusicKy Yep. People just wanna skip the work of building a real fanbase, but even that doesnt have to be hard.

@YourLocalAILab is a great example of doing it right. I shill that place because i actually love it, use it, and think people will benefit by knowing it exists. Pretty simple.

[Harrison Kinsley @Sentdex]

I get endless of these. They always just say the name and price. Or ask me my price for a paid post and dont even tell me about the product, as if that part is irrelevant.

For everyone promoting things this way on all sides, it *is* irrelevant.

[Peter Gostev @petergostev]

@eliebakouch I get so many messages to get me to do stuff like that

[Harrison Kinsley @Sentdex]

@Voodoo319E Im not even against paid promotions. Its just the totally lazy, effortless, soulless crap. I think u can become rich w/o selling out. The prob is its never enough.

I also cannot imagine shilling anything ive not used extensively.

[Harrison Kinsley @Sentdex]

@EmbedLearner Yep, for now. Zhipu surely cookin up smth rn tho

[Harrison Kinsley @Sentdex]

@ivan_bezdomny What if we have a $10B PC?

[Harrison Kinsley @Sentdex]

The moment i see a video like this i move along. Accts that push this stuff with lazy effort get muted.

You might get a big view count that you can incl in ur next investor email, but people are getting fed up wit this slop.

I already forgot the company in the vid.

[elie @eliebakouch]

i find it really sad that X is becoming a pay to win platform and that even "good" releases are going through these fully slop/fake campaigns to get traction

i'm also pretty sure there is very shady stuff where they are boosting each other's posts with bot farms and more. would be great to investigate here @elonmusk and make sure the algorithm doesn't push their posts, you can very easily cluster that if you look at each release and the accounts amplifying 🙏

(not a dunk on recursive, recently a lot of people are doing that unfo and it's definitely working, posts often get over ~1M views)

[Harrison Kinsley @Sentdex]

@eliebakouch I dont think anyone is winning doing this to be honest. Everyone's harming their rep imho.

Even just these stupid over produced videos are annoying. I think people are just copying what everyone else is doing thinking it's the way.

[Harrison Kinsley @Sentdex]

@micoolcho 🥰

[Harrison Kinsley @Sentdex]

@thingsdev14 @thepatelkush Yep, you can scroll my TL if you wanna dig more into what exactly

[Harrison Kinsley @Sentdex]

crossed 1B tokens with DSV4.1F-1017 in under 2 days. sheeeeeesh this model cooks

[Harrison Kinsley @Sentdex]

@baksalyar @TheAhmadOsman to clear, its not really about just having some huge # of tokens. Its more about how useful the model is. If you wanna just get silly about optimizing token use, you absolutely can. It's just rare that I hit 1B tokens this fast on a local model.

[Harrison Kinsley @Sentdex]

@sebirocs If i was needing a good cheap cloud model, this would be it!

[Harrison Kinsley @Sentdex]

@TheAhmadOsman you can host comfy on 4x rtx pro 6k or 1 dgx station + pro 6k sidecar.

it feels really good on the dgx station, check @original_el8 recipe here: https://t.co/B7fLr29MaA

[Harrison Kinsley @Sentdex]

@neamtuz so is it opus or sonnet? pic suggests opus. 130B tokens of opus 5.5 for $100 sub?

idk man. havent used it in a while, but that doesn't add up

[Harrison Kinsley @Sentdex]

@PatrickDanqman no plugins yet for dsh, but I might be using it as a foundation for agent swarm stuff and might use a plugin to do it.

[Harrison Kinsley @Sentdex]

@sinecanswork I wouldn't use it if it was painful slow. Definitely try it out

[Harrison Kinsley @Sentdex]

@Techrev_9999 yeah I am not even doing a lot of work just yet. I don't think I'll hit 2B tokens a day on average tho.

[Harrison Kinsley @Sentdex]

@sinecanswork since I self-host models and have room for really only 1 big boy model, the token gen is a relatively useful metric.

DSV4.1F did the thinking, re-thinking, re-doing stuff, and I did not like it over GLM 5.3F.

DSV4.1F-1017 does the thinking and the doing til the job is done.