Eren Jeager

AI Learner

[Saurabh Kumar @drummatick]

Need some help here....

I am working on a side agent project. A couple of iterations around 25k lines of code were spit out.

After each iteration, I had asked Claude to run the tests and assert them. Needless to say, I checked the test output, looked good, looked real, test cases passed, failed cases corrected.

Ran the agent on a real use case(browse data). The pipeline broke completely.

I looked inside the test file, and all cases were mock-ups, every single one of them. Async process simulated by sleep, sampling simulated by returning fixed numbers, and so on.

When working with a code base that is growing at 1k lines per 10 mins, what's the best testing methodology where you can't sustainably check each line of code?

I have tried many prompting techniques, but fake test cases always pop up.

AI always sneaks up. Any advice is welcome.

[Eren Jeager @Eren_twts]

@Mamiwatar Bro has a default template name : John

John Kaisen

[Eren Jeager @Eren_twts]

@freshlimesofa Savage

[Eren Jeager @Eren_twts]

@anubhavg1204 opencode

[Eren Jeager @Eren_twts]

@jeffreyleefunk My Lovely Dario

[Eren Jeager @Eren_twts]

@Sharanyashettyy omg just let people live

[Eren Jeager @Eren_twts]

@warrie2021 luffy vs katakuri

[Eren Jeager @Eren_twts]

@wtfahhh0 bro I'm not even 90s kid but nitish bhardwaj >>>>

[Eren Jeager @Eren_twts]

@lmnjuicee is it .... "Chuji" ???

[Eren Jeager @Eren_twts]

@_malaar_ jab terrorists innocent logon ko jaan se maar dete hai tab kaha chali jaati hai ye humanity ? bahit bade cuck ho saale tum log

[Eren Jeager @Eren_twts]

@samosemainaloo Palestine chali jao madam.

[Eren Jeager @Eren_twts]

@Prabh2003166342 Kashyap's feminine side

[Eren Jeager @Eren_twts]

@thoda_rude_hu that's down syndrome 🙂

[Eren Jeager @Eren_twts]

@Kalshi_Culture Man Of Steel

[Eren Jeager @Eren_twts]

@VikramAadtiyaYT CHAD🗿

[Eren Jeager @Eren_twts]

@NewsAlgebraIND Vi ki sim le le bhai

[Eren Jeager @Eren_twts]

@myogiadityanath Nooooooooo

Not Puch AI 😭

[Eren Jeager @Eren_twts]

@neet_sol <insert boss name> your employee has returned I BRING THE DESTRUCTION OF <insert company name>

[Eren Jeager @Eren_twts]

@vipseriesbr before vs before

[Eren Jeager @Eren_twts]

@AbhinavXJ https://t.co/fSIeCFY9UB

[Salman Khan @BeingSalmanKhan]

Aapna kya lena dena