ｓｏｎｇ

ｓｉｇｎａｌ n̵̥̮̮̠̮̉̾͊̓́̃o̷̞̪͈̜̼͇̣͓̼̽́͌ḭ̶̣̃͌̈́s̵͖̦̠͙̊̅̐͂̓͠͝e̸̠̺͙̮̣͉͋̉̋̓͛͛͝

[ｓｏｎｇ @ollesong]

what industry

[ｓｏｎｇ @ollesong]

ngl i expected worse from Asha at @Xbox
happy to be proven wrong so far

[ｓｏｎｇ @ollesong]

@bnjmn_marie smallish models tend to blah yeah, esp with reasoning mode

[ｓｏｎｇ @ollesong]

i wish unreal engine roadmap was actual roadmap, not list of things that shipped in 5.7 and earlier

[ｓｏｎｇ @ollesong]

@Ex0byt no M4 max with 96gb exists, not sure what other numbers are made up here

[ｓｏｎｇ @ollesong]

@xeophon @giffmana 'thought provoking'? really?

25* years ago maybe. and even then we had TV shows and movies telling about ai doing bad things

* (make it 40 years to include Terminator 1)

[ｓｏｎｇ @ollesong]

@bnjmn_marie goalpost moving incoming:
take Q6 it will be fine
(and it actually is.... right?)

[ｓｏｎｇ @ollesong]

@wookash_podcast just wait till he finds out that linkedin nonsense isnt 100% true as well

[ｓｏｎｇ @ollesong]

@teortaxesTex i dont think the whale itself is hyping anything. its those engagement farmers, no?

[ｓｏｎｇ @ollesong]

@ivanfioravanti thanks for the numbers, and numbers look good
i think the bigger one survives this quantization without accuracy loss (would personally still run at 6bit all of them just to be safe)
overall impressive models, medium sized seems to be the sweet spot for perf/speed/result

[ｓｏｎｇ @ollesong]

@menhguin @openclaw akhem

are you saying it will be different somehow or am i missing something

[ｓｏｎｇ @ollesong]

being proud of using so much compute in the age of knowledge augmentation for this?
yeah i dunno

[ｓｏｎｇ @ollesong]

@awnihannun not gonna lie, those numbers look great. and the size making it accessible for a single-machine use? you dont have to ask me twice

[ｓｏｎｇ @ollesong]

@hallerite "let me demonstrate my point using convoluted triple-standards almost-logic"

[ｓｏｎｇ @ollesong]

@EmpathYang intriguing

[ｓｏｎｇ @ollesong]

@GBminA @ivanfioravanti hmm interesting, i presumed going with 6.5q is 'fine' because of negligible perplexity
losing capabilities with simple conversion to MLX wasnt on my bingo card

[ｓｏｎｇ @ollesong]

@chiefofautism

[ｓｏｎｇ @ollesong]

@Teknium @Yuchenj_UW is a 2B$ company with 14B$ founder with 23B$ MRR in JUST FOUR DAYS

the more i see this crap the more neuron damage i suffer

[ｓｏｎｇ @ollesong]

@Yuchenj_UW yeah lets compare linux to hyped up bot thing that uses its own bots to put stars on itself

[ｓｏｎｇ @ollesong]

@yacinelearning unless you can do dual-n-back like a pro, this will not end well
better do squats and pushups [its also healthier]

[ｓｏｎｇ @ollesong]

working on implementing memory for LLMs is fun for the whole family