@maxjendrall yes above 256k or so it uses double the quota per token. I don't know if there are more thresholds at ~500k and ~750k . But compacting at 400K or so is a good idea, and lower depending on your needs. Astra is very good at compacting and little info is lost.
@PessimistsArc Right. Dario was already claiming that GPT2 was too dangerous to open source back in 2019.
I made fun of them then.
Everyone should make fun of them now.
@techwith_fahim pure scam. fake data. gives a little lag so the model can win, but does not work with real money. you should be banned for sharing this scam.