bnw

distilling knowledge

[bnw @EchoesOfIntent]

the outsider
his very existence is a challenge to your hierarchies of value and status

[bnw @EchoesOfIntent]

i am adapting to ai pretty well but...
i KNOW that there are absolute DEMONS of mankind who are not posting anything and have no online trace, who have adapted to it and use it like fucking Mozart on piano
i would like to meet them someday and measure myself

[bnw @EchoesOfIntent]

fixed issues with instruction tuning, LoRA was making the model too defiant, but mixing in the persona data with regular instruction tuning data during LoRA training made it go away

[bnw @EchoesOfIntent]

ok some back of the envelope calculations: peft to gguf takes roughly around 1 minute, can train a persona LoRA in 30s, and decode speed is roughly 2x on gguf q8 with little to no quality loss on the LoRA
routing LoRA? not sure if it works with ggufs yet, in peft it only decreased decode speed by 10-20% for swapping the LoRA every 10th token

[bnw @EchoesOfIntent]

burn some fat
run, let it be towards your goal

[bnw @EchoesOfIntent]

shallow morality will submit to institutions in times of extreme uncertainty

[bnw @EchoesOfIntent]

@NickBuilds11 @sourccey what does it do, dalek build?

[bnw @EchoesOfIntent]

@i2cjak ggs

[bnw @EchoesOfIntent]

@buildwithsid saas christ

[bnw @EchoesOfIntent]

@haydendevs buy some

[bnw @EchoesOfIntent]

@mervenoyann no pi dev agent, better, Hermes bloat

[bnw @EchoesOfIntent]

@haydendevs Vernier calliper

[bnw @EchoesOfIntent]

@tenobrus fear or awe those are the options
don't fear

[bnw @EchoesOfIntent]

@hthieblot taste

[bnw @EchoesOfIntent]

@NepYope yes

[bnw @EchoesOfIntent]

@NVIDIAGeForce sell

[bnw @EchoesOfIntent]

@chetan_ canon?

[bnw @EchoesOfIntent]

@viemccoy minimal hackable modular things
make some

[bnw @EchoesOfIntent]

@JieWang_ZJUI no

[bnw @EchoesOfIntent]

cut the bullshit
do the thing you said you would do