@RespanAI Take a look at our paper investigating redaction https://t.co/a1tijtOHmi; there's a lot of work to do before we can hill climb on privacy.
@madhavaggar Another one
@thsottiaux Swap between personal and work accounts. Massive pain having to pair remote control/mobile every time.
This is the only reason I have an anthropic subscription.
@JCovetti@max_spero_@PradyuPrasad@snoopy_dot_jpg hey guys, maybe the point of legislation is to encourage a society we want to live in and less about some emanant moral truth of dynamic pricing
I hate nuance too, but you can actually want discounts for students and oppose dynamic medical pricing at the same time. thanks
Let's say we both roll dice to determine which token to generate from the distribution at each step. We give our roll to the model and it gives us a token based on our number.
Do you agree we are both drawing from the same distribution? If yes, continue.
Now, I've been writing down the numbers I've been rolling. If I give the model my numbers and my sequence, the model can say "oh yes, your numbers would generate the rest of the sequence". If you agree, continue.
Now I give the model your sequence and my numbers. The model will say, "hmm, no, if I used your random sequence of numbers I would not generate this sequence--you would need to roll a 3 here to get that token," etc.. If this makes sense, continue.
We have therefore demonstrated that the model can recognize its own outputs if it knows the dice that were used at the time of generating. Let's call the set of dice rolls the 'watermark'.
But, you object, you prefer your sequence anyway.
That's fine. We'll simply use your dice, and now our watermark gives the "preferred" response!
This is the gist of the "distortion free" watermark. The model's behavior is not changed, Anthropic simply knows the dice now.
@packsmarginalia@cain151714@bayeslord I think “human suffering” is the key to his point. There are people who can’t feel pain so we understand what it takes for “human suffering”.
There could be a sub- or other-conscious system that’s constantly suffering in your brain right now, but I wouldn’t lose sleep over it.
@ramin_m_h@liquidai This is great, I think throughput is a huge consideration so I’m glad you shared. We crudely approximate with params to avoid presenting hardware/configuration decisions
@liquidai It's a reasonable model, but considering that openai/privacy-filter is 50M (active) params it's still probably the public choice.
Evaluated on our RedactionBench, happy to follow up
@psiloycne@max_spero_ Can't comment on the burnt out portion, but I'll push the other way in saying that this behavior is precisely why I trust Pangram a priori, despite having not used them yet.
@VictorTaelin GPT has "grass is always greener" syndrome and assumes the current implementation is bad
this is generally a good approximation, but fails to converge ~~ sucks at gathering evidence for taste
keeps me in the loop, but can't rely on it to be my PI
It’s becoming increasingly common to evaluate policies in sim. Policy improvement is harder. We show why vanilla RL learns to exploit the sim2real gap, and provide a simple and principled solution.
@iltenahmet@Kodurubhargav1@chamath Even your second analogy works. Pharmaceutical companies, if not given access to computers, would eventually lose to tech companies that hire pharmacologists or can specify the same objectives