Why is AI slop so frustrating to read?
AI writing often obscures main ideas and invents awkward phrases, making sentences more complex than necessary.
Many of these slop patterns violate writing principles established in English writing books.
In our benchmark, AI writing breaks these principles far more often than human writing, with Claude Code replies by far the worst offenders.
We show examples of the most common slop patterns in this thread
Why is AI slop so frustrating to read?
AI writing often obscures main ideas and invents awkward phrases, making sentences more complex than necessary.
Many of these slop patterns violate writing principles established in English writing books.
In our benchmark, AI writing breaks these principles far more often than human writing, with Claude Code replies by far the worst offenders.
We show examples of the most common slop patterns in this thread
Why is AI slop so frustrating to read?
AI writing often obscures main ideas and invents awkward phrases, making sentences more complex than necessary.
Many of these slop patterns violate writing principles established in English writing books.
In our benchmark, AI writing breaks these principles far more often than human writing, with Claude Code replies by far the worst offenders.
We show examples of the most common slop patterns in this thread
@karenzzhou yes! i think there is a human mental capacity alignment here where we want AI to write in a way that maximizes information given the same amount of mental capacity (human attention and focus)!
I think the first step is to make writing not suck, ie not break very obvious writing principles in Elements of Style. This is likely solvable with a small army of high school english teachers.
Going beyond making writing not suck is much more subjective and artistic, and maybe it would be closer to hyper personalization
@zehavoc this is perhaps something only LLMs can understand
my hypothesis is what we need for writing to be clear is actually pretty inefficient bc our memory is not as robust as giant transformers, and therefore, we have a hard time reading LLM jargon
@SengirShowsU when a sentence is unnecessarily complex, it makes it harder for the reader to understand. I roughly use clarity to refer principles in writing books such as Elements of Style
@alexyrtsai one end of good writing is art form, which would be hard to imitate. the other end is just not terribly incorrect writing, which can be modeled
@GuangyuRobert slop writing seems to be mainly an artifact of post-training, @thomashikaru has a great paper comparing base models, pre-frontier models, and near-frontier models
also transformers are way more capable than our brain, so it needs less "markers" to help organize information