My interview from TED with @kcoleman and @audreyt just went live!
Tons of gold in here:
-why we stuck with crazy principles like not having an override button
-how AI and humans collaborate to write better/more notes than either on their own
-how much impact community notes are making
-why our algorithm is smarter than regular upvoting/downvoting
-new ideas for finding common ground on social media
https://t.co/No3xbHX8u4
Ok, one more caveat about the above metric, Helpful rate.
As AI note writers scale to write on more notes, they need to process increasingly large feeds of candidate posts.
However, as the candidate post feeds grow larger, the % of posts that are actually in need of a note grows smaller (since the required amount of note request signal is largest in the Small eligible post feed, and smaller in the larger feeds).
Therefore, you can think of feed size as something like a 'difficulty level': you'll see the same AI note writer get a significantly lower CRH rate if it's processing a larger feed of posts, all else equal.
We just dropped a new paper on our Community Writer -- scaling AI-written Community Notes, with human raters in charge
The Community Writer submits its notes over the same the public AI note writing API that all other AI note writers use, and altogether, AI note writing has been a huge driver of speeding up and scaling up Community Notes so far (in a way that's complementary with human note writers)
The code is open sourced too so it's easier than ever now to build a great AI note writer
We're open-sourcing the Community Writer, an AI note writer designed to reflect the will of the people, which, together with the open note writing API, has helped drive an 86% increase in the number of notes on X that people from different perspectives find helpful.
The Community Writer works by incorporating input from the public throughout the note writing process.
We've written a technical report detailing how it works and the impact of the Note Writing API overall. And weโre making the code open-source under Apache V2 so that it can be used to advance research and scale informative context across the internet.
Technical report: https://t.co/tKJbAqkdjm
Code: https://t.co/lOGxVM04ba
Here are the Community Writer accounts:
https://t.co/wnjILfIeiy
https://t.co/nBW7M2060y
https://t.co/PEy9RT4q9v
https://t.co/6AhDJ59KNi
https://t.co/QCvpIf01jl
https://t.co/C8W7YGSnQb
some insane stats on these
*if you are numerically inclined: when looking at the stats, do keep in mind that the Community Writers do try to delete notes if they are getting early bad rating signal. So while the Helpful rate is representative of note quality, the Not Helpful rate is not a good representation of overall note quality
@chrislakin congrats!! feels like there is a big opportunity for medical doctors to operate on a bounty-payment system like you do with your clients. right now, unless you have personal connections, it's nearly impossible to tell which doctors are effective at curing people or not--crazy
@captaineco_fr They're handled the same as all notes, since these contributors just use the public API
(So the note text is deleted but the noteId, ratings, and note status history is preserved)
I would love to release these as a separate dataset though
We're open-sourcing the Community Writer, an AI note writer designed to reflect the will of the people, which, together with the open note writing API, has helped drive an 86% increase in the number of notes on X that people from different perspectives find helpful.
The Community Writer works by incorporating input from the public throughout the note writing process.
We've written a technical report detailing how it works and the impact of the Note Writing API overall. And weโre making the code open-source under Apache V2 so that it can be used to advance research and scale informative context across the internet.
Technical report: https://t.co/tKJbAqkdjm
Code: https://t.co/lOGxVM04ba
Last week, @X sued several people who abused Creator Revenue Sharing by operating a coordinated network of accounts, posting inauthentic content to manipulate engagement, and using multiple bank accounts to hide their scheme.
We do not tolerate fraudulent behavior on X -- and will act forcefully to protect our platform and the earnings of genuine creators.
You can read our lawsuit here: https://t.co/EKHFX06nSY
Weโve expanded Under The Hood after seeing peopleโs appreciation of more transparency into government-required content filtering.
In addition to showing labels applied to your account and posts in the prior month, Under The Hood now shows if your account or posts had their visibility limited because of required compliance with local law(s).
For example, you can see if any of your posts were withheld in a country following a legal demand โ and which country.
Weโre making this Under The Hood update available to all accounts that meet the basic eligibility criteria (10+ posts in prior month, account at least one year old).
You can get your report at https://t.co/tlIAB9v9X3
Yeah, that's good feedback, thank you. One reason those notes feel irrelevant sometimes is that we use "needs your help" (NYH) as a way to get more randomly-sampled ratings as an anti-manipulation mechanism (we want to get ratings from people who wouldn't have otherwise seen the note). But point heard loud and clear that you want more relevant NYH! Will see how to make it more relevant while also preserving the anti-manipulation benefits.
People want notes fast. Weโre experimenting with previewing top-performing notes when they have strongly positive ratings from people from different perspectives, but are still in the early stages of gathering ratings.
Now available to a limited group in the US. Weโll shape it with your feedback.
Details in the Guide: https://t.co/PlpTud6EPX
@rootpill in xchat? you can block or mute the sender to stop getting those. sorry you don't like those! anything we could do to make you like them more?