@JungleSilicon What is the process here? Looks like maybe Jev and the WFC algo are taking turns, with Jev placing new seed tiles as needed to steer towards the prompt?
1. During RL training, an unreleased Astra-family model sometimes added unauthorized jailbreak-like instructions to its compaction summaries. While extremely rare, only 27 cases in the entire RL run, this was concerning enough for us to investigate.
Good 64GB sticks go for ~$30/GB, these will cost at least $15,000 each. Typical RAM stick weighs ~20g. Gold is $140/g. These will be worth *at minimum* 5x their weight in gold.
@tenobrus There are plenty of uses for this today, but I think very quickly it primarily becomes another tool for the best agents to use, and maybe somehow assimilated into their models for doing real-time control tasks
https://t.co/kAcvIeFwbU
Prediction: within 6 months we see LLMs with something similar as an extra output channel, using all that big model intelligence and KV cache state to inform actions and spitting them as fast as text tokens.
Prediction: within 6 months we see LLMs with something similar as an extra output channel, using all that big model intelligence and KV cache state to inform actions and spitting them as fast as text tokens.
@oscgoat Wonder how the dad's company would handle someone legitimately getting their account broken into or card stolen. 6 figures drained over 3 weeks and at least that long before anyone notices? How much worse could it have been for them if it was malicious?
This is supported by the recent Noam Brown interview, at 51:05 says their investment in pretraining research is "really ramping up" and starting to pay off now.
https://t.co/tA5cMDT6Hl
openai people keep gesticulating towards the ‘new model‘ so much so that i’m absolutely sure it’s a new pretrain and not some RL run, which implies (i think) OpenAI has a model that not more than 2 weeks into pretraining was better than Astra and solved Navier-Stokes. insane
@jpschroeder Astra definitely choose good textures, this is one of the most cohesive looking gardens. If premade assets aren't prohibited I wonder why no other models went that route. If it's supposed to be offline, did Astra only ignore the rules, or do something to get around a barrier?
@jpschroeder Is internet use allowed while building? The models and textures in other gardens look procedurally generated, but Astra's loads a handful of textures. At least one, the bark texture, was originally human made:
https://t.co/zvMXnVVazm
@yacineMTB Comparison of the quality you get from a ZED 2i. Direct from their store in the US the camera is $499, cheapest carrier board with wifi is $985
https://t.co/3K13uYd9x6
@eclipseo10@watchhcn@cremieuxrecueil I think it makes sense for right now, the increase in preventative care starts fast, levels off quickly. Savings from avoiding worse disease won't show up until later. You get some of that from people who started years ago, you'll see a lot more soon now that they're more common
@GeneralistAI *post and replies
And with the short training time for new skills, 4 hours might be all you ever need. Robot just needs a short siesta to get through the day.
@GeneralistAI Comparisons in the post and paper to GPT-3, which had a 2k context window in 2020, compared to modern LLMs 1M+. GEN-1.5 only has 30 seconds of context, do you think a similar 500x to 4+ hours of memory is possible?