Alex Olwal, Ph.D.
Senior Staff Research Scientist and Manager, Google AR

Interaction Technology R&D · Augmented Reality · Wearables · Ubiquitous Computing · Human—Computer Interaction · Accessibility · Displays and Sensors

Research conducted at Google Research, MIT, Columbia University, University of California, KTH (Royal Institute of Technology), and Microsoft Research, with much appreciated collaborators and contributors at the same or other institutions. Also, thank you Stanford University, Rhode Island School of Design and KTH for the opportunity to teach.

Alex Olwal

Publications
2024
pdf UI Mobility Control in XR: Switching UI Positionings between Static, Dynamic, and Self Entities. Pei, S., Kim, D., Olwal, A., Zhang, Y., and Du, R.
Proceedings of CHI 2024 (SIGCHI Conference on Human Factors in Computing Systems), Honolulu, HI, May 11-16, 2024, pp. 1-12.
pdf Experiencing InstructPipe: Building Multi-modal AI Pipelines via Prompting LLMs and Visual Programming. Zhou, Z., Jin, J., Phadnis, V., Yuan, X., Jiang, J., Qian, X., Zhou, J., Huang, Y., Xu, Z., Zhang, Y., Wright, K., Mayes, J., Sherwood, M., Lee, J., Olwal, A., Kim, D., Iyengar, R., Li, N., and Du, R.
CHI 2024 Extended Abstracts (SIGCHI Conference on Human Factors in Computing Systems), Honolulu, HI, May 11-16, 2024, pp. 1-5.
pdf ChatDirector: Enhancing Video Conferencing with Space-Aware Scene Rendering and Speech-Driven Layout Transition. Qian, X., Tan, F., Zhang, Y., Collins, B., Kim, B., Olwal, A., Ramani, K., and Du, R.
Proceedings of CHI 2024 (SIGCHI Conference on Human Factors in Computing Systems), Honolulu, HI, May 11-16, 2024, pp. 1-16.
pdf Quantifying The Effect of Simulator-Based Data Augmentation for Speech Recognition on Augmented Reality Glasses. Arakawa, R., Parvaix, M., Lai, C., Erdogan, H., and Olwal, A.
Proceedings of ICASSP 2024 (IEEE International Conference on Acoustics, Speech and Signal Processing), Seoul, South Korea, Apr 14-19, 2024, pp. 726-730.
2023
pdf Visual Captions: Augmenting Verbal Communication with On-the-fly Visuals. Liu, X, Kirilyuk, V., Yuan, X, Olwal, A., Chi, P., Chen, X., and Du, R.
Proceedings of CHI 2023 (SIGCHI Conference on Human Factors in Computing Systems), Hamburg, Germany, Apr 23-28, 2023, pp. 1-20.
pdf Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications through Visual Programming. Du, R., Li, N., Jin, J., Carney, M., Miles, S., Kleiner, M., Yuan, X., Zhang, Y., Kulkarni, A., Liu, X., Sabie, A., Orts-Escolano, S., Kar, A., Yu, P., Iyengar, R., Kowdle, A., and Olwal, A.
Proceedings of CHI 2023 (SIGCHI Conference on Human Factors in Computing Systems), Hamburg, Germany, Apr 23-28, 2023, pp. 1-23.
pdf Modeling and Improving Text Stability in Live Captions. Liu, B., Zhang, J., Ferrer, L., Xu, S., Bahirwani, V., Smus, B., Olwal, A., and Du, R.
CHI 2023 Extended Abstracts (SIGCHI Conference on Human Factors in Computing Systems), Hamburg, Germany, Apr 23-28, 2023, pp. 1-9.
2022
pdf SilentSpeller: Towards mobile, hands-free, silent speech text entry using electropalatography. Kimura, N., Gemicioglu, T., Womack, J., Zhao, Y., Li, R., Bedri, A., Su, Z., Olwal, A., Rekimoto, J., and Starner
Proceedings of CHI 2022 (SIGCHI Conference on Human Factors in Computing Systems), New Orleans, LA, Apr 19-May 5, 2022, pp. 1-19, Article 288.
pdf ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard-of-Hearing Users. Jain, D., Nguyen, K. H. A., Goodman, S., Grossman-Kahn, R., Ngo, H., Kusupati, A., Du, R., Olwal, A., Findlater, L., and Froehlich, J.E.
Proceedings of CHI 2022 (SIGCHI Conference on Human Factors in Computing Systems), New Orleans, LA, Apr 29-May 5, 2022, pp. 1-16, Article 305.
pdf Hidden Interfaces for Ambient Computing: Enabling Interaction in Everyday Materials through High-brightness Visuals on Low-cost Matrix Displays. Olwal, A., and Dementyev, A.
Proceedings of CHI 2022 (SIGCHI Conference on Human Factors in Computing Systems), New Orleans, LA, Apr 29-May 5, 2022, pp. 1-20, Article 504.
2021
pdf Mobile, Hands-free, Silent Speech Texting Using SilentSpeller. Kimura, N., Gemicioglu, T., Womack, J., Li, R., Zhao, Y., Bedri, A., Olwal, A., Rekimoto, J., and Starner, T.
CHI 2021 Extended Abstracts (SIGCHI Conference on Human Factors in Computing Systems), Virtual Event, May 8-13, 2021, pp. 1-5, Article 178.
pdf Hidden Interfaces for Ambient Computing: Interacting with High-brightness Visuals through Everyday Materials. Olwal, A., and Dementyev, A.
CHI 2021 Extended Abstracts (SIGCHI Conference on Human Factors in Computing Systems), Virtual Event, May 8-13, 2021, pp. 1-5, Article 172.
2020
pdf Wearable Subtitles: Augmenting Spoken Communication with Lightweight Eyewear for All-day Captioning. Olwal, A., Balke, K., Votintcev, D., Starner, T., Conn, P., Chinh, B., and Corda, B.
Proceedings of UIST 2020 - Best Demo Honorable Mention Award (ACM Symposium on User Interface Software and Technology), Virtual Event, Oct 20-23, 2020, pp. 1108-1120.
pdf Haptics with Input: Back-EMF in Linear Resonant Actuators to Enable Touch, Pressure and Environmental Awareness. Dementyev, A., Olwal, A., and Lyon, R.F.
Proceedings of UIST 2020 (ACM Symposium on User Interface Software and Technology), Virtual Event, Oct 20-23, 2020, pp. 420-429.
pdf E-Textile Microinteractions: Augmenting Twist with Flick, Slide and Grasp Gestures for Soft Electronics. Olwal, A., Starner, T., and Mainini, G.
Proceedings of CHI 2020 (ACM CHI Conference on Human Factors in Computing Systems), Honolulu, HI, Apr 25-30, 2020, pp. 1-13.
2019
pdf SensorSnaps: Integrating Wireless Sensor Nodes into Fabric Snap Fasteners for Textile Interfaces. Dementyev, A., Galvez, T., and Olwal, A.
Proceedings of UIST 2019 (ACM Symposium on User Interface Software and Technology), New Orleans, LA, Oct 20-23, 2019, pp. 17-28.
2018
pdf Opening Keynote: Fusing Interfaces with Matter, Humans and Machines. Olwal, A.
SUI 2018 Opening Keynote (ACM Symposium on Spatial User Interaction), Berlin, Oct 13-14, 2018.
pdf I/O Braid: Scalable Touch-Sensitive Lighted Cords Using Spiraling, Repeating Sensing Textiles and Fiber Optics. Olwal, A., Moeller, J., Priest-Dorman, G., Starner, T., and Carroll, B.
Proceedings of UIST 2018 - Best Demo Award (ACM Symposium on User Interface Software and Technology), Berlin, Germany, Oct 14-17, 2018, pp. 485-497.
pdf Hybrid Watch User Interfaces: Collaboration Between Electro-Mechanical Components and Analog Materials. Olwal, A.
Ubicomp 2018 Adjunct Proceedings (ACM International Joint Conference on Pervasive and Ubiquitous Computing), Singapore, Singapore, Oct 9-11, 2018.
pdf Hybrid Watch User Interfaces: Collaboration Between Electro-Mechanical Components and Analog Materials. Olwal, A.
UIST 2018 Adjunct Proceedings (ACM Symposium on User Interface Software and Technology), Berlin, Germany, Oct 14-17, 2018, pp. 200-202.
pdf 1D Eyewear: Peripheral, Hidden LEDs and Near-Eye Holographic Displays for Unobtrusive Augmentation. Olwal, A. and Kress, B.
Proceedings of ISWC 2018 (International Symposium on Wearable Computers), Singapore, Singapore, Oct 8-12, 2018, pp. 184-187.
2017
pdf On-Skin Interaction Using Body Landmarks. Steimle, J., Bergstrom-Lehtovirta, J., Weigel, M., Nittala, A.S., Boring, S., Olwal, A., Hornbæk, K.
Computer 2017 (IEEE Computer, Cover Feature, Vol. 50, no 10), Oct, 2017, pp. 19-27.
pdf shiftIO: Reconfigurable Tactile Elements for Dynamic Affordances and Mobile Interaction. Strasnick, E., Yang, J., Tanner, K., Olwal, A., and Follmer, S.
Proceedings of CHI 2017 - Best Paper Honorable Mention Award (Top 5%) (SIGCHI Conference on Human Factors in Computing Systems), Denver, CO, May 6-11, 2017, pp. 5075-5086.
pdf Zensei: Embedded, Multi-electrode Bioimpedance Sensing for Implicit, Ubiquitous User Recognition. Sato, M., Puri, R., Olwal, A., Ushigome, Y., Franciszkiewicz, L., Chandra, D., Poupyrev, I., and Raskar, R.
Proceedings of CHI 2017 (SIGCHI Conference on Human Factors in Computing Systems), Denver, CO, May 6-11, 2017, pp. 3972-3985.
pdf WatchThru: Expanding Smartwatch Displays with Mid-air Visuals and Wrist-worn Augmented Reality. Wenig, D., Schöning, J., Olwal, A., Oben, M., and Malaka, R.
Proceedings of CHI 2017 (SIGCHI Conference on Human Factors in Computing Systems), Denver, CO, May 6-11, 2017, pp. 716-721.
pdf StretchEBand: Enabling fabric-based interactions through Rapid Fabrication of Textile Stretch Sensors. Vogl, A., Parzer, P., Babic, T., Leong, J., Olwal, A., and Haller, M.
Proceedings of CHI 2017 (SIGCHI Conference on Human Factors in Computing Systems), Denver, CO, May 6-11, 2017, pp. 2617-2627.
pdf SkinMarks: Enabling Interactions on Body Landmarks Using Conformal Skin Electronics. Weigel, M., Nittala, A., Olwal, A., and Steimle, J.
Proceedings of CHI 2017 (SIGCHI Conference on Human Factors in Computing Systems), Denver, CO, May 6-11, 2017, pp. 3095-3105.
pdf SmartSleeve: Real-time Sensing of Surface and Deformation Gestures on Flexible, Interactive Textiles, using a Hybrid Gesture Detection Pipeline. Parzer, P., Sharma, A., Vogl, A., Steimle, J., Olwal, A., Haller, M.
Proceedings of UIST 2017 (ACM Symposium on User Interface Software and Technology), Quebec City, ON, Oct 22-25, 2017, pp. 565-577.
pdf Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. Choi, I., Culbertson, H., M.R., Olwal, A., and Follmer, S.
Proceedings of UIST 2017 - Best Paper Award (Top 1%) (ACM Symposium on User Interface Software and Technology), Quebec City, ON, Oct 22-25, 2017, pp. 119-130.
2016
pdf proCover: Sensory Augmentation of Prosthetic Limbs Using Smart Textile Covers. Leong, J. Parzer, P., Perteneder, F., Babic, T., Rendl, C., Vogl, A., Egger, H., Olwal, A., and Haller, M.
Proceedings of UIST 2016 - Best Paper Award (Top 1%) (ACM Symposium on User Interface Software and Technology), Tokyo, Japan, Oct 16-19, 2016, pp. 335-346.
pdf FlexTiles: A Flexible, Stretchable, Formable, Pressure Sensitive, Tactile Input Sensor. Parzer, P., Probst, K., Babic, T., Rendl, C., Vogl, A., Olwal, A., and Haller, M.
CHI 2016 Extended Abstracts (SIGCHI Conference on Human Factors in Computing Systems), San Jose, CA, May 7-12, 2016, pp. 3754-3757.
2015
pdf Zensei: Augmenting Objects with Effortless User Recognition Capabilities through Bioimpedance Sensing. Sato, M., Puri, R., Olwal, A., Chandra, D., Poupyrev, I., and Raskar, R.
UIST 2015 Extended Abstracts (ACM Symposium on User Interface Software and Technology), Charlotte, NC, Nov 8-11, 2015, pp. 41-42.
pdf Shape Displays: Spatial Interaction with Dynamic Physical Form. Leithinger, D., Follmer, S., Olwal, A., and Ishii, H.
CG&A 2015 (IEEE Computer Graphics and Applications, Vol. 35, no 5), Sep-Oct, 2015, pp. 417-426.
pdf SpecTrans: Versatile Material Classification for Interaction with Textureless, Specular and Transparent Surfaces. Sato, M., Yoshida, S., Olwal, A., Shi, B., Hiyama, A., Tanikawa, T., Hirose, M., Raskar, R.
Proceedings of CHI 2015 (SIGCHI Conference on Human Factors in Computing Systems), Seoul, South Korea, Apr 18-23, 2015, pp. 2191-2200.
2014
pdf T(ether): Spatially-Aware Handhelds, Gestures and Proprioception for Multi-User 3D Modeling and Animation. Lakatos, D., Blackshaw, M., Olwal, A., Barryte, Z., Perlin, K., and Ishii, H.
Proceedings of SUI 2014 (ACM Symposium on Spatial User Interaction), Honolulu, HI, Oct 4-5, 2014, pp. 90-93.
pdf Physical Telepresence: Shape Capture and Display for Embodied, Computer-mediated Remote Collaboration. Leithinger, D., Follmer, S., Olwal, A., and Ishii, H.
Proceedings of UIST 2014 (ACM Symposium on User Interface Software and Technology), Honolulu, HI, Oct 5-8, 2014, pp. 461-470.
2013
pdf inFORM: Dynamic Physical Affordances and Constraints through Shape and Object Actuation. Follmer, S., Leithinger, D., Olwal, A., Hogge, A., and Ishii, H.
Proceedings of UIST 2013 (ACM Symposium on User Interface Software and Technology), St Andrews, UK, Oct 8-11, 2013, pp. 417-426.
pdf Scanners and Drillers: Characterizing Expert Visual Search through Volumetric Images. Drew, T., Vo, M., Olwal, A., Jacobson, F., Seltzer, S., and Wolfe, J.
JOV 2013 (Journal of Vision, Vol. 13, no 10.), Aug 6, 2013.
pdf Cloud Rhymer: Prototype Demo and Intervention Proposal. Robert, D., Schmitt, P., and Olwal, A.
Proceedings of IDC 2013 (International Conference on Interaction Design and Children), New York, NY, Jun 24-27, 2013, pp. 507-510.
pdf Sublimate: State-Changing Virtual and Physical Rendering to Augment Interaction with Shape Displays. Leithinger, D., Follmer, S., Olwal, A., Luescher, S., Hogge, A., Lee, J., and Ishii, H.
Proceedings of CHI 2013 - Best Paper Honorable Mention Award (Top 5%) (SIGCHI Conference on Human Factors in Computing Systems), Paris, France, Apr 27-May 2, 2013, pp. 1441-1450.
pdf SpaceTop: Integrating 2D and Spatial 3D Interactions in a See-through Desktop. Lee, J., Olwal, A., Ishii, H., and Boulanger, C.
Proceedings of CHI 2013 (SIGCHI Conference on Human Factors in Computing Systems), Paris, France, Apr 27-May 2, 2013, pp. 189-192.
[+] more publications...