Anup Bishnoi

Autonomous Driving, Augmented Reality, Web, Game Dev
@ Aurora, Ex-Netflix

[Anup Bishnoi @asyncanup]

One thing you can never gain any other way than just slowly growing older -
how to be comfortable in your own skin

[Anup Bishnoi @asyncanup]

AI has no taste. You have taste. That’s why you will always be needed for AI to do a good job.

[Anup Bishnoi @asyncanup]

Walk-in eye exams, where the test is whether you walk into a glass door

[Anup Bishnoi @asyncanup]

Po*p is FIFO, puke is LIFO

[Anup Bishnoi @asyncanup]

⭕️ My circle is 95.2% perfect, can you beat that? https://t.co/eBmTj3fyFq

[Anup Bishnoi @asyncanup]

Single question to tell how long someone has been doing programming:

Did you ever use a source control system other than Git?

[Navjot @_navjotts_]

The 2nd bucket of highly-paid AI talent is emerging: the ones who are deep (enough) into not only pre-training and post-training of LLMs – but with the complementary skills to make LLMs actually work in messy real-world use cases (I don't mean SWE skills here, that's table-stakes).

Are they special? Not sure – just very rare right now – need ~10k hours of focused IC practice in real-world scenarios, when “GenAI” itself is barely 3 years old.

(Related to the recent “95%” Fortune article, the underlying MIT report, and all the chatter about the GenAI bubble)

[Navjot @_navjotts_]

My top 5 most memorable “LLMs” launches:
1. text-davinci-002 (first one that really "got it"/worked)
2. GPT4 (biggest step function jump seen till now)
3. Clause 3.5 Sonnet (first true dethroning)
4. o1-pro (clear glimpse of robust human-like reasoning)
5. DeepSeek-R1 (proof open can beat closed)

[Navjot @_navjotts_]

I am at #NeurIPS2024 this week! Key ML areas our group under @timshi_ai at @cresta is working on:
- AI Agents than can reason and troubleshoot effectively in complex enterprise domains
- Multimodal Knowledge Grounding
- LLM-as-a-judge framework that actually works

We are hiring!

[Navjot @_navjotts_]

This, w.r.t. emergence of consciousness. And I think the “deliberate” aspect is key here. GEB talked about it also in “Jumping out of the System” – the need to jump out of the task being performed, survey whats been done, and ensure key requirements (consistency AND efficiency).

[Brain Explored @BrainExplored]

In the brain, some neurons adapt easily, while others remain resistant to change. This can be likened to our beliefs, where certain deeply ingrained convictions, like the historical belief that the sun revolves around the earth, required substantial evidence and effort to alter.

Similarly, in machine learning, we could enhance efficiency by incorporating a "resistance to change" factor for each neuron during training. This factor would determine how readily a neuron or set of neurons can adapt or how firmly they maintain their learned patterns (or weights).

By drawing on the concept that some brain regions or neuron patterns encode hard-set beliefs through repeated reinforcement, we can apply this principle to improve the adaptability and stability of artificial neural networks. This could be a pathway for the Alignment Problem.

PS: Dropout is a somewhat overlapping, but a completely different concept, introduced for a different need.

[Navjot @_navjotts_]

I am at #NeurIPS2023 this week! Some ML areas our group under @timshi_ai at @cresta is working on:
- Domain specific instruction finetuning
- Retrieval Augmentation and Knowledge Grounding
- Reward modeling and conversation-level outcomes

Hit me up for a chat. We are hiring!

[Anup Bishnoi @asyncanup]

The age of Audio Uncanny Valley is upon us:
https://t.co/1R2yqHS8qg

[Anup Bishnoi @asyncanup]

This one knows what it's talking about

[Anup Bishnoi @asyncanup]

The world runs on shell scripts. :|

[Anup Bishnoi @asyncanup]

wat! no way i'm even trying to answer that

[Jagriti Arora @awwroraborealis]

Psychology says it is okay only if you have read a book or something else but you can also do it yourself or something else or something wrong

[Anup Bishnoi @asyncanup]

@nileshtrivedi Web-based? Link?

[Anup Bishnoi @asyncanup]

As you rip, so shall you sew.