Stats for Evals is now live, and we got a site, too: https://t.co/5FZNj9EF4I We'll be posting regular investigations across the summer. For now, we're starting with the basics: comparing models and prompts. Also has resources, principles, example code, and guidance for others:
There’s a lot going on in the world…
Here’s a small distraction with some interesting results about using LLMs for compression, and the implications for model weight security.
New paper: "Haiku to Opus in Just 10 Bits."
We investigate compression techniques for LLM outputs.
Please read our statement on the remarks made by Dr. Rosalind Picard at her NeurIPS 2024 invited talk and our commitment to respect, inclusivity, and upholding our values:
https://t.co/AsAtriVq5V
I was at the invited talk. As a Korean researcher, I know that such ethnic stereotyping could target any Asian academic community. One of the questioners confronted the inappropriate generalization, and Prof. Picard's response was inconvenient: "Maybe there is one, maybe they are common... I hope it was an outlier."
The audience applauded when the questioner concluded with: "I hope in the future, if you present this again, you can remove that nationality note because that seems unfair for this special group of people."
I think today it's directed at Chinese students; tomorrow it could be any of us. #NeurIPS2024 @NeurIPSConf
At #NeurIPS2024, the keynote speaker perpetuated explicit racist stereotypes against Chinese students. Generalizations against a community subject to discrimination, even as an “example”, further provokes discrimination. Below, video of an audience member’s perfect response.
1/3 Today, an anecdote shared by an invited speaker at #NeurIPS2024 left many Chinese scholars, myself included, feeling uncomfortable. As a community, I believe we should take a moment to reflect on why such remarks in public discourse can be offensive and harmful.
It is just so sad that the #NeurIPS2024 main conference ended with such a racist remark by a faculty when talking about ethics. How ironic!
I also want to commend the Chinese student who spoke up right on spot. She was respectful, decent, and courageous. Her response was exemplary: she began by acknowledging the speaker’s efforts, then gave the speaker an opportunity to clarify (though, regrettably, the speaker’s reply only reinforced her bias), and ultimately called attention to the inappropriate racial bias and offered constructive suggestions. Thank you for speaking out!
🌻 I'm on the job market 🌻
I'm a designer and HCI & Health researcher exploring how emotion, value, and aesthetics shape interactivity and vice versa. Learn more about me and my work here: https://t.co/ngeMLqLt6f
Please get in touch if you're hiring or know of any good fits!
@PhilippeLaban@MSFTResearch Congrats on the move! I’ve worked on designing interactive systems to help humanitarian negotiators read, summarize, and strategize over large amounts of text. Would love to connect and discuss summer internship opportunities! https://t.co/hbJKn3OgEF
[New Preprint🚨] To help prevent future tragedies, our research aims to answer key questions: What risks are teenagers facing on AI companionship platforms? How are they coping? What do their parents know, and how are they responding? Read more here:https://t.co/AalqDWE62Q
🧘♂️ We’re HCI researchers from Harvard & Stanford, studying meditation apps! Join our study, help shape our research! Fill out the survey: https://t.co/JFG7n2m7ss… 📷 #meditation#research#HCI