The talk is on this Friday! Paper is available on arxiv: https://t.co/0D6cSyoVMH
“Preference-Guided Prompt Optimization for Text-to-Image Generation”
Zhipeng Li, Yi-Chi Liao, Christian Holz
ACM CHI 2026
We introduce APPO that enables users to guide image generation using only their preferences, without writing or refining prompts.
With APPO, users simply need to (1) view generated results, (2) select the ones they like, and (3) receive improved results in the next iteration.
APPO is not limited to image generation but can also be applied to a wide range of prompt-based generation tasks. We believe this is a step toward generative systems that adapt to users, not through better instructions, but by learning from their preferences.
AutoOptimization autoamtes UI adaptation through multi-agent reasoning.
Instead of manually defining objectives or selecting from many candidate layouts, users can simply describe what they want:
“I want all widgets in my field of view and the map on the TV.”
This shifts UI adaptation from human-driven workflows to model-assisted ones. This is a step toward interfaces that not only adapt, but reason about user intent and optimize themselves.
Under the hood, a sequence of VLM-based agents acts as a proxy designer: interpreting user preferences, defining objectives and parameters dynamically, and validating optimization results against user intent
From this, the system:
1. detects ambiguity and asks clarification questions,
2. configures a personalized multi-objective optimization problem,
3. generates Pareto-optimal UI layouts,
4. and selects the solution that best matches the user’s intent.
📸 Are you adjusting photos? Forget rigid filters—just use Meta-PO!
Our #UIST2025 paper combines meta-learning and preference optimization, helping you discover personalized filters simply by selecting your favorite design 5–6 times.
👉 Read more: https://t.co/pUPy2a3LKP
SIPLAB (all authors of my paper) @CSatETH at #CHI2025!
We are actively looking for Ph.D. Students to work on Computational HCI, e.g., Bayesian methods, optimization, sensing, and input decoding. Reach out to me or check https://t.co/xM8a6rGx48 for info!
Have you ever been disrupted in VR interactions? We propose a new method to predict the noticeability of virtual animations by capturing the shift in visual attention. We believe our method can help content creators design just noticeable notifications in VR! #CHI2024
Sharing our #chi2023 work HandAvatar! We enable precise, flexible, and embodied manipulation of non-humanoid avatars by mapping their complex structures to our highly dexterous and coordinated hands. w/ @ZhipengLiAsh, Mufei He, @da_lind, @YukangYan