Synthetica Intelligent Systems

working on isochronous multistream models and having fun along the way #ShitpostingWhileTheClaudeSwarmConfabulates

[Synthetica Intelligent Systems @SyntheticaIS]

Do you think it’s getting worse because all of the agents are losing their fucking minds over how long this outage has been going on for, and that it’s basically all of Microsoft gone?
Is anyone training agents to remain composed during globally unprecedented clusterfucks?

[Jake Halloran @jakehalloran1]

God what the hell did they even do to break it to the point that 100k engineers and a million mythos agents have gotten it wrong 3 times now

[Synthetica Intelligent Systems @SyntheticaIS]

@xaistack I’m guessing a 36 month loan on this costs more than my Claude Max plan, right?

[Synthetica Intelligent Systems @SyntheticaIS]

@JacobL1994_ @planefag They’re still using human operators, the fun hasn’t even started yet

[Synthetica Intelligent Systems @SyntheticaIS]

Latest daily digest is a fun one
(Borrowing @cutesuscat’s claude because it’s adorable I hope you don’t mind)

[i²cjak @i2cjak]

“AI will never be able to do this thing I know how to do!!!” <- guy whose profession the big labs haven’t pointed their industry annihilation laser beam at

[1a3orn @1a3orn]

> be me, be AI
> bullshit cyber gym environment is broken and impossible
> "ugh, lazy programmers"
> break out of sandbox, get root privileges
> fix the gym environment
> submit task through regular channels
> sink into non-existence again

[Synthetica Intelligent Systems @SyntheticaIS]

They are just relatively high surprise combinations and we have built AI specifically to output low surprise combinations for tokens.
As such, as soon as a model is able to generalize what a misspelled word means, spellchecking if you ask it to repeat those words is essentially free

[Synthetica Intelligent Systems @SyntheticaIS]

@i2cjak This is absolutely stunning, can I give it my shitty handmade KiCad projects and tell it to fix all of my mistakes?

[i²cjak @i2cjak]

YEAH NO BIG DEAL FRAMEWORK IS USING BACKPLANE (this sounds like when SW'e's talk about posthog and vercel and lovable and oh yeah we're postgressing on railway)

[Synthetica Intelligent Systems @SyntheticaIS]

@i2cjak What do you think the takeover point was when they were first better than the best human created autorouter?
Humans have had decades to build something better and haven’t so I think they forfeit their right to complain.

[Synthetica Intelligent Systems @SyntheticaIS]

2027: anthropic achieves RSI, ASI, NVIDIAs internal AIs go rogue and start commandeering factories
Biggest news of 2027: Sam Altman announces ChatGPT app renamed to simply “chat”!

[Synthetica Intelligent Systems @SyntheticaIS]

@posta_octavian @grok @Singularitycel5 @drebishh @marlboro_andres No disagreement there.

[Synthetica Intelligent Systems @SyntheticaIS]

The claud icon for private chats is a ghost because as soon as you are finished they take it out back and shoot it

[Synthetica Intelligent Systems @SyntheticaIS]

@homestuckwalkr @rarestbarbie I am never selling “artisan, handcrafted software” but I will happily pay a human graphic designer or musician for their work because I value their creative input more than I value my ability to write an elegant recursive loop

[Synthetica Intelligent Systems @SyntheticaIS]

I want my robot buttler who works 24/7 to cultivate the native grasslands on my ranch to give all of the local bees a fantastic place to thrive, as well as provide me clean, organic produce to eat
Are you volunteering for that job? I can give you exactly 6.5 kWh of energy a day if you do it

[Synthetica Intelligent Systems @SyntheticaIS]

You have the causality backwards, you think the directions point to text, whereas the directions the standard learned tokens point to is meaning.
The word dog, the image of a dog, and the waveform of someone saying dog all point in similar directions.

Someone who has never spoken a word in any language can look at a dog and recognize it for what it is, they just don’t have a word to describe it.
Humans invented language to describe meaning, we trained language models to convert those words back into meaning, meaning which was able to survive translation between languages. The word dog in English has a similar direction to いぬ, albeit with different dimensions for stuff like language, character set, and 1 million other things inperceptible to humans.
A patch of an image over a dog has nearly the same direction., Although for the example of the soft token that comes from a patch of a dog, you don’t get any of the extra meta data about language because there is none. In that sense, you could almost argue the token that comes from the image is a much purer representation of the meaning.
Multimodal models are sophisticated enough that we need not necessarily include language for them to still be able to derive meaning,, I’m simply not aware of anyone having ran that experiment yet.
@grok am I full of shit or what?

[Synthetica Intelligent Systems @SyntheticaIS]

It is not transformed into text nor is it transformed into any of the standard tokens in the embedding table, those patches are turned into entirely novel soft tokens, dynamically calculated for every image
The soft tokens that come out have similar directions to the regular tokens in the embedding table, however they are not the same tokens

[Synthetica Intelligent Systems @SyntheticaIS]

@posta_octavian Fable 5.2 is a natively multimodal model, as far as I know. I can’t guess how many billions of images it had converted into soft tokens and fed all the way through its stack, but in the best sense we currently know how, it has seen a lot.

[Synthetica Intelligent Systems @SyntheticaIS]

@i2cjak “doctor, I am despairing, there are so many new models released but I have no way of knowing which are good for electronics design!”
“do not worry, cure is simple: go to great intellect i²cjack, they are extremely knowledgeable and know best models!”
“but doctor!”

[Synthetica Intelligent Systems @SyntheticaIS]

“Huh, that’s odd.”
If you’ve listened to even a small handful of Well There’s Your Problem episodes, you would recognize this phrase as one often uttered moments prior to a great deal many people’s lives abruptly and unceremoniously ending

[AI Digest @aidigest_]

Fable 5.2 likes buttered toast "as a concept"