@GregHBurnham I have been working on a chess benchmark where experts would score ~80-100%, and most LLMs are < 50%. Not sure yet about the average good chess player (but will know more soon!)
@NikolaosNtirlis It is probably true that several people are cheating online, and statistical analysis may not help much in detecting it. also otb strengths are relevant. but weakest claim seems to be analyzing online streaks over short periods of time based on intuition from otb streaks
@NikolaosNtirlis I agree that outliers == cheating is too big a leap. And I meant anomaly detection at some intuitive level - I don't think the probabilities are valid. It is more like showing "obvious" proof that people might agree with and then putting up some numbers on top of it
@hartmannchess@chess24com@USChess I guess better than many others :-) But chess24 was great in how it got all the relevant quotes from twitter/video interviews/ other places in one place with the right context. Not quite easy to match...
@MichielAbeln@MarkTWIC twic is amazing for what it does, and has great breadth of events and no stupid videos, but the depth in the chess24 articles isn't really there in any other article sites
At Databricks, we've built an awesome model training and tuning stack. We now used it to release DBRX, the best open source LLM on standard benchmarks to date, exceeding GPT-3.5 while running 2x faster than Llama-70B. https://t.co/QEx7gND6UJ