Ken Pfeuffer

Prof @csaudk, #HCI #XR, eye-gaze UI. sharing things from research etc

[Ken Pfeuffer @KenPfeuffer]

Excited to finally announce that we got a bunch of new upcoming research papers on eye and hand HCI for XR! 👁️🖐️

📝1 paper at #UIST2025
📝3 conference + 3 workshop papers at #ISMAR2025

Stay tuned for details.

Thanks to the amazing students at XI lab + collaborators🙏

[Ken Pfeuffer @KenPfeuffer]

👁️✋Pinch-to-zoom, but where you look is where it zooms.

This 2015 example explores multimodal-bimanual-direct-manipulation with gaze (mouthful!).

The hand stays away in comfort zone, the pen at the center. They don't interfere, just symbiosis.

From https://t.co/I90BxxKn0j

[Ken Pfeuffer @KenPfeuffer]

👁️🖐️What makes and breaks the gaze + pinch UI, what challenges remain? Here are 5 design issues, illustrated from the below article. #uiux #xr #spatialcomputing #hci #gesture #gaze

[Ken Pfeuffer @KenPfeuffer]

New article on 👀✋:

Design Principles & Issues for Gaze and Pinch Interaction

Inspired by HCI research and the upcoming @Apple #VisionPro release.

Medium: https://t.co/tbgRLyp8oZ
LinkedIn: https://t.co/Gke6qXkYgD

#arvr #uiux
Below the 5 principles in short:

[Ken Pfeuffer @KenPfeuffer]

@perburr Yes there is actually acceleration in there. I extended a simplified version of an old code snippet I found on the web for the mouse, adapted to this scenario. You can see a little bit how it is faster than the actual physical hand movement. Definitely makes sense to add it.

[Ken Pfeuffer @KenPfeuffer]

With a mouse or touchpad, this would require a lot of cursor dragging.

In 2014, I explored fluid and simple gaze+touch UI (eye tracker under the table).

Why don’t we have this on laptops yet, eg. using gaze + touchpads...?

[Hiroshi Ishii 石井 裕 @ishii_mit]

Thanks to @rkmt Prof. Jun Rekimoto and the team @PFU_HHKB!

[Ken Pfeuffer @KenPfeuffer]

New research incoming for #CHI2026 - on multimodal interaction in XR:

- how to teleport with👀+✏️
- how we preshape our hands with 👀+🖐️ and 👀+ 🎮
- how to multi-select objects with 👀+🖐️+🎤

Huge thanks 🙏to all students & collabs @csaudk @Concordia @LancasterUni @GoogleARVR

[Ken Pfeuffer @KenPfeuffer]

@qiushi__zhou @rkmt Interesting side insight on the roots of... UI

[Patently Apple @PatentlyApple]

https://t.co/t5AEIL8JfN

[Ritwik Pavan @ritwikpavan]

JUST IN: Google unveiled its smart glasses project with XREAL, called Project Aura.

• 70° FOV for a giant virtual screen anywhere
• run full Android apps in floating windows
• Circle to Search on anything you look at
• lightweight frame powered by a small compute puck
• hand tracking for pinch, zoom and window control

Launching in 2026.

[Shahram Izadi @izadi_shahram]

We're taking the next step to make #AndroidXR even more helpful and seamless in your daily life. So much to share from The Android Show | XR Edition today in partnership with @SamsungMobile and @Qualcomm.

We introduced powerful new features for Galaxy XR, including Travel Mode for using your device on the go, PC Connect for streaming high fidelity desktop and laptop experiences to XR, and representing you as a photoreal avatar, with our Likeness feature.

We also shared updates on our AI glasses which we are building with @SamsungMobile, @WarbyParker and @_GentleMonster_. The Developer Preview 3 of the Android XR SDK brings new tools to all developers and opens up development for AI Glasses!

Finally, we also showed how we are expanding Android XR to the broader ecosystem, with Project Aura from @XREAL_Global.

Read more on the blog: https://t.co/P2y2Bzdrw8

Here’s a recap: https://t.co/7dsG2Mdrxp
And you can watch the full keynote here: https://t.co/9MAvSo0oJq

[𝙏𝙝𝙧𝙞𝙡𝙡 @Thrilluwu]

I know it's not exactly the "hottest" part of Valves announcement, but I am really excited for the Steam Frame's "Eye Tracked Foveated Streaming".

Things like this are one of the many reasons why I've been obsessed with headsets shipping natively with eye tracking.

[Brad Lynch @SadlyItsBradley]

When will Apple let you use gaze + chopsticks as input

[Massimo @Rainmaker1973]

Surfer takes us through what it looks like while riding a perfect wave

[📹 gabrielmbenetton]

[Andrew Akbashev @Andrew_Akbashev]

Pressure to publish jumps. And researchers have no time to do science.
(New survey from Elsevier)

Survey of 3200 researchers:

1. Only 45% of scientists have sufficient time for actual research.

2. For 68%, the pressure to publish today is greater than 2-3 years ago.

3. 29% of researchers are considering relocating to another country (for better funding, work‐life balance, or greater research freedom).

4. 58% of researchers use AI tools in their work.

5. Reported benefits from AI: saving time (58%), helping with literature summaries (61%), literature reviews (51%), data analysis (38%), drafting proposals (41%), and drafting papers (38%).

Globally, life in academia is getting worse.

For students & postdocs - it’s especially hard to decide on an academic career.

❗️ A few days ago, I gave a lecture on this topic.

“PhD: Dreams, Reality and Consequences”

Watch it here: https://t.co/5IFhcVFwIL

(I’ll appreciate if you ‘like’ this video - you will GREATLY help it reach more students.)

[yuwen lu @yuwen_lu_]

From: Bill Buxton
re: James Landay – I give up on CHI/UIST

https://t.co/ejvnpNhY9f

[Ian Arawjo @IanArawjo]

Good luck to everyone on the CHI deadline today. Whatever happens, make sure to take time for yourself to appreciate the hard work you’ve done.

[Daniel Lemire @lemire]

We are being flooded by ‘research papers’. It is not a joke. As an editor of Software: Practice and Experience… I review over a thousand papers a year.

Increasingly, papers have been written by AI. My students hand in work done by AI. I have recently got a PhD thesis that the student admitted was AI generated.

So what do we do about it?

We leave the Soviet model of science: science as a bureaucracy.

Focus on doing great and useful work, and then (only then) write about it.

Do you do work so that you can publish it? Bring back your focus to doing great work. It should always have been thus.

To put it another way, the research paper is not the end point of the research. It has a supportive role.

At this point, some people object: “nobody cares about my work, how will they know that it is good if I don’t have a peer-reviewed paper?”

Oh brother: if you cure cancer, they will care. And if they don’t care about your work, they won’t read your paper. And your paper may have been generated by AI, and if nobody cares about it, it may as well have been AI generated.

Daniel Lemire. 2024. Will AI Flood Us with Irrelevant Papers? Commun. ACM 67, 9 (September 2024), 9. https://t.co/Neh0X3IiRJ

[Oded Rechavi @OdedRechavi]

Having a PhD means you can find the word “unfortunately” in an email faster that the search function

[Misha Teplitskiy | Science of Science @MishaTeplitskiy]

Only a million?!
People need to show a little more respect towards Mr. Rachmad of Indonesia, the greatest researcher of all time (according to the metrics)

[Daniel Buschek @DBuschek]

While reviewing for #CHI2026, I noticed four new writing issues, likely due to increased use of LLMs. I describe them here - and how to fix them: https://t.co/pzwTTYwGX2