About Me
I am currently at Anthropic, focusing on HCI+AI research and product.
Before this, I was a Staff Researcher & Manager at Apple (2018-2024), passionate about building user‐friendly developer tools for ML engineers to boost their productivity. My team built ML infra and tools for model analysis, optimization, and testing, which is mission-critical for the launch of Apple Intelligence (Research post, Optimization section) and Vision Pro (Paper).
I received CS (HCI focus) PhD from UW, and interned at Google Research (with Kayur Patel on Colab) and MSR (with Meredith Ringel Morris). My first project at Apple was extending my PhD research to an ML-powered iOS accessibility feature that supports 20M+ blind users’ daily life.
Research Interests: Human-Computer Interaction (HCI), ML Developer Tools, ML Model Optimization, and UI Accessibility.
Achievements:
- Auto-OPT: ML infra to optimize all Apple Intelligence LLMs (on-device & server).
- Talaria: Developer tool to enable Vision Pro ML models to run in low latency.
- Screen Recognition: The first on-device ML model to recognize and announce iOS App UI, benefiting 20M+ blind users.
- 2 Best Papers, 3 Best Paper nominees, 5 Patents.
Selected Publications
Please see
full publication list (25+) in
Google Scholar
-
Fred Hohman, Chaoqun Wang, Jinmook Lee, Jochen Görtler, Dominik Moritz, Jeffrey P. Bigham, Zhile Ren, Cecile Foret, Qi Shan, Xiaoyi Zhang
CHI 2024
PDF
Video
🏅 Best Paper Nominee; Critical for Apple Intelligence and Vision Pro models
-
Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols, Xiaoyi Zhang
CHI 2022
-
Xiaoyi Zhang, Lilian de Greef, Amanda Swearngin, Samuel White, Kyle Murray, Lisa Yu, Qi Shan, Jeffrey Nichols, Jason Wu, Chris Fleizach, Aaron Everitt, Jeffrey P Bigham
CHI 2021
-
Jason Wu, Gabriel Reyes, Sam C White, Xiaoyi Zhang, Jeffrey P Bigham
W4A 2021
-
Anne Spencer Ross, Xiaoyi Zhang, James Fogarty, Jacob O Wobbrock
ASSETS 2018
-
Anne Spencer Ross, Xiaoyi Zhang, James Fogarty, Jacob O Wobbrock
ASSETS 2017
-
Xiaoyi Zhang, Anne Spencer Ross, Anat Caspi, James Fogarty, Jacob O Wobbrock
CHI 2017
PDF
Video
Foundation Work for Screen Recognition
-
Xiaoyi Zhang, Harish Kulkarni, Meredith Ringel Morris
CHI 2017