Projects

WebNExt
Enabling spatial web browsing for blind and low vision users
Accessibility Input & Interaction

2023 – 2025

StreetNav
Using street cameras for on-demand navigation assistance for blind pedestrians
Accessibility ML & Vision

2023 – 2024

Surveyor
Facilitating discovery within video games for blind and low vision players.
Accessibility Games Input & Interaction

2024

Social Wormholes
Using an ecosystem of connected things to connect people
Social Computing

2023

Front Row
Automatically generating immersive audio representations of tennis broadcasts for blind viewers
Accessibility ML & Vision Games

2023

Exploring Immersive Everyday Communication via AR
Understanding feelings and behavior around AR messaging
Social Computing

2023

"I Want to Figure Things Out"
Supporting exploration in navigation for people with visual impairments
Accessibility

2023

ImageAssist
Enhancing touchscreen-based image exploration systems for blind and low vision users.
Accessibility Input & Interaction

2023

Project IRL
Supporting in-person social interactions with augmented reality
Games Social Computing

2022 – 2023

Spatial Awareness Tools
Investigating spatial awareness tools within video games for visually impaired players.
Accessibility Games

2021 – 2022

Friendscope
Exploring in-the-moment experience sharing on camera glasses.
Social Computing

2022

ARcall
Real-time AR communication using smartphones and smartglasses.
Social Computing

2022

NavStick
Making video games blind-accessible via the ability to look around.
Accessibility Games Input & Interaction

2020 – 2021

The Racing Auditory Display (RAD)
Making racing games equivalently accessible to people who are blind.
Accessibility Games

2018

Mining Controller Inputs to Understand Gameplay
Making it possible to describe gameplay in a quantitative way.
Games Input & Interaction ML & Vision

2016

Optimizing Touchscreen Keyboards for Gesture Typing
Making touchscreen typing faster and more accurate than ever.
Input & Interaction

2015

Gaze Locking: Passive Eye Contact Detection for Human–Object Interaction
A technique for interacting with objects by looking at them.
Input & Interaction ML & Vision

2013