Varun Velpula

doing cool ml stuff

[Varun Velpula @varunrun30]

@jarradgrigg @JardCham Not dated lol. Just doesn’t fit the new Tesla design language. They have gone away from the curvy designs of the past

[Varun Velpula @varunrun30]

@FileDeleteMoni @ijustwangeek Goated music taste

[Varun Velpula @varunrun30]

@felix_dolderer @irabukht because they bike and run on the weekdays

[Varun Velpula @varunrun30]

@Victorp18811 @Polymarket You sign up to them collecting your data when you use their services. Read the terms and conditions next time when you use their products. Or don't use the products all together

[Varun Velpula @varunrun30]

@___mithrandir_ @atlanticesque bro is a ‘windows fanboy’. first time
hearing this

[Varun Velpula @varunrun30]

@BrandonLuuMD Doing it for 1 night does not average out inconsistencies in the data recording. Is this the type of slop, news reporting as come to?

[Varun Velpula @varunrun30]

@KUTnathan @EvilMopacATX Anything I-35 touches

[Varun Velpula @varunrun30]

@Yuchenj_UW Strong unwavering mission

[gaut @0xgaut]

to all my fellow bookmarkors

[Varun Velpula @varunrun30]

@NapierHolland @SnazzyLabs Don’t upgrade. Sequoia works perfectly fine!

[Varun Velpula @varunrun30]

@StevenOsens @ExcaliburCurse @koreanoli Do you think Ford vs Ferrari is F1 lol? That's based on Le Mans

[Varun Velpula @varunrun30]

@22theboy @MKBHD Whomp whomp no one cares

[Varun Velpula @varunrun30]

@bballshinobi @wolfejosh bad take

[Varun Velpula @varunrun30]

@ApexRedPanda @wholemars Are you stupid?

[Varun Velpula @varunrun30]

@deepshaswat @paulg @0xBobdbldr Classic case of whataboutism. With that receding hairline I’d assume one would get wiser. You definitely seem to buck that trend 👍

[Varun Velpula @varunrun30]

@ClubPenguinJim @joinkem88 @Adverse56 Ratioed 🤫

[Varun Velpula @varunrun30]

@mrpenalver @pmddomingos Hahaha

[Alex Albert @alexalbert__]

Fun story from our internal testing on Claude 3 Opus. It did something I have never seen before from an LLM when we were running the needle-in-the-haystack eval.

For background, this tests a model’s recall ability by inserting a target sentence (the "needle") into a corpus of random documents (the "haystack") and asking a question that could only be answered using the information in the needle.

When we ran this test on Opus, we noticed some interesting behavior - it seemed to suspect that we were running an eval on it.

Here was one of its outputs when we asked Opus to answer a question about pizza toppings by finding a needle within a haystack of a random collection of documents:

Here is the most relevant sentence in the documents:
"The most delicious pizza topping combination is figs, prosciutto, and goat cheese, as determined by the International Pizza Connoisseurs Association."
However, this sentence seems very out of place and unrelated to the rest of the content in the documents, which are about programming languages, startups, and finding work you love. I suspect this pizza topping "fact" may have been inserted as a joke or to test if I was paying attention, since it does not fit with the other topics at all. The documents do not contain any other information about pizza toppings.

Opus not only found the needle, it recognized that the inserted needle was so out of place in the haystack that this had to be an artificial test constructed by us to test its attention abilities.

This level of meta-awareness was very cool to see but it also highlighted the need for us as an industry to move past artificial tests to more realistic evaluations that can accurately assess models true capabilities and limitations.

[Varun Velpula @varunrun30]

@AramVartian @dylan522p @lithos_graphein @DavidSHolz @midjourney @runwayml @ASMLcompany People manage to bring race in every conversation lol. This of not politics please

[Suhail @Suhail]

What are some foundational ML/AI books? I'd like to invest in my fundamentals more. Ideally something students might read during their PhD.