Bhavyanshu Parasher

#DevOps #SRE #ML Cloud Infrastructure | M.S. in Computer Science | Hobbyist Musician | #Gaming | | Opinions my own

[Thrilla the Gorilla @ThrillaRilla369]

A 3 PM hotel check-in and 11 AM check-out has got to be one of the biggest scams🤨

[Massimo @Rainmaker1973]

Automatic snow chains deployment systems like the Onspot mechanism, allow vehicles to increase their traction on snow and ice with a relatively immediate activation triggered from the cab.

[Bhavyanshu Parasher @bvynshu]

@kesarito Qq: why is IQ AI limited to wiki for crypto? Why not disrupt wikipedia (which is biased) and become the one true source for all data?

[terminally onλine εngineer @tekbog]

i cant believe ChatGPT lost its job to AI

[Harrison Kinsley @Sentdex]

# Run server
./bin/llama-server -m /path/to/model.gguf -c 64000 -t 56 --host 0.0.0.0 --port 8080

-c is the context length
-t is cpu threads

[Harrison Kinsley @Sentdex]

Depending on the context window, the "used" RAM varies, but the cache in this case is nearly the full 1TB.

I am finding ~64K context to be the sweet spot, the full 128K is very slow, like 1 t/s or less, but no real gains going less than 64K.

[Avichal - Electric ϟ Capital @avichal]

Ironic that we got free AI from a hedge fund and $200/month AI from a nonprofit.

[Yuchen Jin @Yuchenj_UW]

"Tighten export controls on chips" is a loser's attitude.

- DeepSeek can already run inference on Huawei Ascend chips
- This will only push China to accelerate GPU development and create its own CUDA

When did the US start fearing competition?
And why oppose open-source AI?

[signüll @signulll]

🤣

[Bhavyanshu Parasher @bvynshu]

All those AI jobs no longer feel tractive anymore and overall feels over-inflated/hyped. Pull back was essential and DeepSeek made the decision easier.

[kache @yacineMTB]

Seeing openai employees cope like this is all I need to know about them never ever making it ever. So bearish

[Georgi Gerganov @ggerganov]

pack it up boys, it's over

[Orikron 🇵🇹 骆培思 @orikron]

Average American "Ph.D."

[rohit @seatedro]

this means nothing to me anymore

[Bhavyanshu Parasher @bvynshu]

So weird that net-tools doesn't come pre-installed with ubuntu -- it's basic

[Bhavyanshu Parasher @bvynshu]

@KevinNaughtonJr Because we are in it together, as family 😅

[Bhavyanshu Parasher @bvynshu]

No point learning this the hard way and spending hours troubleshooting why the program won't start

[Bhavyanshu Parasher @bvynshu]

About system safety

Always check file usage
lsof <path> # Is the file open by a process?

Always try to truncate instead of delete if unsure of its usage
truncate -s 0 <path>

[Q @qtnx_]

after releasing a Sparse Autoencoder for llama 1B, i'm happy to announce that we've scaled up to 8 billion parameter models, having a trained a SAE for DeepSeek R1 Distill Llama 8B, and releasing it as open source.

[NO CONTEXT HUMANS @HumansNoContext]

Video game physics be like