Quick note: Everything I post here is written by me - a real human in Seattle who gets excited about AI Systems Performance. No AI slop, no ghostwriters. Just my actual thoughts.
@PatrickToulme I love this content. This is a very dense topic.
Not judging here, did you use AI to generate some of this report? This seems too opinionated to be AI, but the volume of content is quite high.
Reason why I ask is I want to produce similar quality work on writing.
@ziv_ravid We need a tool or some writer's version of AI version control that discloses AI tools.
We should have some level of transparency of using AI.
@JustinAngel@tdietterich@arxiv True. This is a larger problem. The site needs to take a first step to have researchers disclose their AI tools to producing these papers.
@tdietterich@arxiv Perhaps @arxiv should have disclosure on the tools or AI tech used on the paper and how much?
For example, suppose the researchers generate 80% of the paper with ChatGPT 5.5 with 20% human editing.
This way we can determine how much the paper has human oversight.
TTFT stands for Time To First Token.
This waiting period, measured in milliseconds, is a major latency metric focused on time between first request and first response for AI.
For example, the TTFT SLO may require < 500 ms. Continuous batching can help here.
TTFT
It's basically how long you have to wait until AI first responds.
For example, when you first talk to an AI, there's a short delay before first message appears. That delay is called TTFT.
Important for user experience. Shorter the better.
More technical: 👇
@GergelyOrosz There should be a disclosure of tools upfront used for the post/blog. In addition, there should be proof of human creation.
There should be some easy version control for writers to show authenticity.