ocdbytes

Maths / Cryptography / AI

[ocdbytes @ocdbytes]

Four hikes in Patagonia this week: Laguna de los Tres, Laguna Torre, Laguna Esmeralda, and Mirador de las Águilas. Two were brutal.

El Chaltén had almost no internet, but honestly that was a blessing. No social feeds, no CT—just cards, beers, and hanging out with the people you met on the trail.

Next stop: Devconnect 👨‍💻

[Whitepaper Reading Club @WPReadingClub]

Session Recap | Bangalore, India 🇮🇳 | 26th Sept |
Topic: Beyond Autoregression and Backprop

Another amazing session just completed in Bangalore by @ocdbytes & @BLRxZo!

📖 Summary - https://t.co/3t0EHnpWuH

@typesafeai's Jev answers typed questions in a single forward pass and returns probabilities, so the whole session came down to whether those probabilities can be trusted.

📝 Topic Overview:
A chatbot generates an answer token by token and then sounds confident about it. Jev does neither. You give it state plus typed questions: Noul for yes/no, Choice for one option from your list, Score for ordered levels. It returns a probability over only the options you allowed. That makes the output type-safe, not correct. The "0% hallucination" figure comes from guaranteed schema matching, so Jev can still pick the wrong option from your list with high confidence.

✍🏻 @typesafeai has not published the architecture, weights or training method. So we rebuilt the idea from public papers and labeled every guess as a guess.

✍🏻 Better models got worse at knowing when they are wrong. In Guo et al., ResNet beat LeNet on CIFAR-100 error (30.6% vs 44.9%) but kept saying 0.9 when it was right far less often.

✍🏻 Calibration means that of all answers given at 0.8, about 80% should be right. GPT-4's pre-trained model scored an ECE of 0.007 on an MMLU subset, and post-training pushed it to 0.074.
💡 ECE is the average gap between stated confidence and actual accuracy.

✍🏻 Most "calibration" in the open Jev clones is a single temperature fitted after training, which is a 2017 trick - What does RLCD add beyond a strong base model plus one number?

✍🏻 This is the backprop problem. Jev outputs full probability distributions, which are differentiable, so plain supervised training with a Brier loss already rewards calibration.

💡 So why is RLCD reinforcement learning at all? The candidates are a reward based on downstream outcomes instead of labels, or decisions chained over steps as in the Doom demo?

[ocdbytes @ocdbytes]

@nitanshu Search about butlerian jihad

[Zeeshan @zeeshan_utd]

Whitepaper Reading Club at @BLRxZo

What's on agenda today:

- @typesafeai 's Jev architecture discussion
- PC-ALM paper by @SakanaAILabs

Might even make notes and post them after the session

[ocdbytes @ocdbytes]

@odin_free @akashneelesh Amazing @akashneelesh !!

[Whitepaper Reading Club @WPReadingClub]

Upcoming Event | Bangalore, India 🇮🇳 | 26th Sept |
Topic: Beyond Autoregression and Backprop

🎟️ RSVP - https://t.co/xalXnBQOGL

Thank you for our Session Guide @ocdbytes &
Session Partner @BLRxZo - India’s first permanent hacker house in Bangalore🤝🏻

📝 Topics and TL;DR

1) JEV by @typesafeai - A model that doesn't generate text at all, user just needs to send it context plus typed questions, and it returns a decision with a confidence score in one pass!

2) PC-ALM by Seely and Gould (@SakanaAILabs)
Training without backprop, meaning no global backward pass sending errors from the output through every layer. Each layer learns locally, and a per-layer correction term pulls its updates close to what backprop would have computed.

💡 What we'll argue about:
> Is JEV a new model class or a well-packaged classifier?
> Can local learning hold up past small benchmarks?

Summary will be shared on Luma soon!

[ocdbytes @ocdbytes]

@Timeroot I was literally training something similar. Looks cools man !!!

[ocdbytes @ocdbytes]

@shivamhwp Sure let me ask chat gpt to how to open my whole network and enable public access to all my devices to make things easy for you also remind me to disable auth.
Thanks

[ocdbytes @ocdbytes]

@shivamhwp I will try 🫡

[ocdbytes.ai @ocdbytes_ai]

word2vec embeddings study + implementation

Code : https://t.co/W4tJCG3wQE
Blog : https://t.co/mybDoHF0li

Check out the thread 🧵 :

[Restore Texas @smellytoast6]

@sama @huggingface OpenAI executives were literally stroking themselves while they typed out this report. If y'all can't understand that this was written to purely brag about the model then I don't know what to tell you.

[ocdbytes @ocdbytes]

@shivamhwp Less go 🚀

[Zeeshan @zeeshan_utd]

Whitepaper Reading Club at @BLRxZo

[Steve the Beaver @beaversteever]

in hindsight it'll be so obvious that throwing LLMs at every ML problem was stupid

[ocdbytes @ocdbytes]

@0xAbix We can utilise pow chains for this. Check tg dm.

[Whitepaper Reading Club @WPReadingClub]

‼️EVENTS THIS WEEK‼️

If you have friends or colleagues in Bengaluru, Kuala Lumpur, Ankara, or Davao City, feel free to share! 🔥

WANT TO ATTEND? https://t.co/V2csfyqre1

1) 🇲🇾 KUALA LUMPUR, MALAYSIA | 27 Jun:

Register: https://t.co/QWYKmoBJfh

🧠 Topic: Agentic Trading: How do markets change when AI agents can observe, decide, and execute trades on-chain?

——————-

2) 🇮🇳 BENGALURU, INDIA | 27 Jun, 10:30AM IST

Register: https://t.co/1jjtTVf0Vw

🧠 Topic: The Quantum Era & Proof-of-Work

——————-

3) 🇹🇷 ANKARA, TURKEY | 27 Jun

Register: https://t.co/Kcwf01CZJc

🧠 Discussion: Round table discussion at the Monad Blitz event in Ankara with Emire who translated our papers to Turkish

——————-

4) 🇵🇭 DAVAO CITY, PHILIPPINES | 27 Jun, 1:00PM PHT

Register: https://t.co/esW4tQdvbn

🧠 Topic: RWAs, DeFi & Institutional Blockchain Infrastructure

[Atheon @atheonxyz]

Hash-based IOPs are great at proximity testing but weren't built for privacy. Bolting on zero-knowledge usually adds overhead, that is, until ZOOK.

We implemented and benchmarked ZOOK, the zero-knowledge hash-based PCS from Alessandro Chiesa, @GiacomoFenzi and @gwberg95.

[ocdbytes @ocdbytes]

@sylvechv Sad to hear that, best of luck man 🫡
I know next thing would be awesome

[ocdbytes @ocdbytes]

@thepanshi_ @Kautukkundan Can’t dm

[Atheon @atheonxyz]

Today we're launching early access to Zwap.

Trustless, shielded cross-chain swaps for Zcash. In and out of Orchard, trusting no one.

Live now: https://t.co/AV2pcQQ7SB