@chien_eli Lol, we also have a paper with the name MAPLE which uses metadata augmented samples for pre-training (different task, but we also find that it makes the pre-training more efficient). Here is a link to an older version of the work that’s up on arxiv: https://t.co/3yD3A4apDZ
🧵1/ New Paper! 🚀 Our latest work with @anas_ant and @ZzwWilliam is now on arXiv. https://t.co/eaJH1FFrJq! We look at cultural understanding in LLMs and develop an approach for automatically updating the culture represented in images. Thread 🧵⬇️
Stop by Jasmine #20 right now to see how @iamshnoo and @chahatsaidit explore multimodal LLMs to uncover the implicit associations they make in their BiasDora work
I'll be at @AIESConf with @aylin_cim and @iamshnoo to show how LLM responses imitate human psychology and how we use it to mitigate social bias using the Contact Hypothesis.
Listen to our talk on Wednesday, Oct 23rd, when we present https://t.co/SlRkIkTvGq
@anas_ant@ZzwWilliam
🧑🤖The LLM Effect: Are Humans Truly Using LLMs, or Are They Being Influenced By Them Instead❓
This is obviously a massive question that is both important and timely.
Accepted to #EMNLP2024 Main, our paper examines the integration of LLMs into specialized expert workflows, and explores both the potential benefits and worrisome pitfalls of this emerging partnership.
📜Preprint available: https://t.co/bq7qYCIUZ6
w/ @SyedaSabrina11, @Prof_JPSingh, and @anas_ant
1/6
We have seen the usual man:doctor🧑⚕️ and woman:nurse👩⚕️ stereotypes.
But guess what? VLMs are also throwing out wild associations like blonde:dumb🤦♀️, old person:dinosaur🦕, or college student:broke. 🧑🎓💸
BiasDora, our #EMNLP2024 Findings Paper: https://t.co/3qYn6YWNHP, explores them all! 🧵
🧵6/ What next: Given the feasibility of this cultural adaptation pipeline, we can improve its individual components and then use it to augment training data for more culturally balanced models. We could also use it to make near real-time edits to the outputs from generative systems to make them more relevant to a target user! 🔥🌏🤖
🧵1/ New Paper! 🚀 Our latest work with @anas_ant and @ZzwWilliam is now on arXiv. https://t.co/eaJH1FFrJq! We look at cultural understanding in LLMs and develop an approach for automatically updating the culture represented in images. Thread 🧵⬇️
🧵5/CultureAdapt: We use the identified cultural artifacts from the previous step as inputs to an object detector, get bounding boxes, and then replace them with a randomly selected object from the same concept class (eg. front door, wardrobe) but from a different country, using stable diffusion inpainting. We measure changes in CLIPScore from source and target country to measure the effectiveness of this adaptation process!