Author ORCID Identifier

https://orcid.org/0000-0003-2043-823X

Date of Award

Spring 6-9-2024

Document Type

Thesis (Ph.D.)

Department or Program

Computer Science

First Advisor

Xing-Dong Yang

Abstract

Emerging technologies have given us a whole host of new ways for people to be

creative. From the immersive worlds of AR/VR to the synthesis powers of largelanguage

models and generative AI, these new tools hold the potential to reshape

human expression and creativity. But how can we ensure that these new modalities

are accessible to everyone, even those who aren’t able bodied? This thesis advocates

for a human-centered approach to the development of many-modal systems. I will

probe how our machines support, direct, or inhibit creativity as a mode of problem

solving through 6 novel multimodal prototype interfaces and discuss how these systems

support creativity for people who may otherwise be excluded. We will explore

how multimodal systems allow people to interact according to their preferences and

abilities, and how this flexibility creates space between modalities for accessible, rich,

and creative computing. This includes discussing what we can learn about creativity

by engaging people with disabilities in co-design, and how supporting this model of

problem solving is imperative for designing future system interfaces that are inclusive

and usable by all people.

Original Citation

Josh Urban Davis, Hongwei Wang, Parmit K. Chilana, and Xing-Dong Yang. 2023. "It's Not an Issue of Malice, but of Ignorance": Towards Inclusive Video Conferencing for Presenters Who are d/Deaf or Hard of Hearing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 3, Article 92 (September 2023), 31 pages. https://doi.org/10.1145/3610901

Josh Urban Davis, Hongwei Wang, Parmit K. Chilana, and Xing-Dong Yang. 2023. "It's Not an Issue of Malice, but of Ignorance": Towards Inclusive Video Conferencing for Presenters Who are d/Deaf or Hard of Hearing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 3, Article 92 (September 2023), 31 pages. https://doi.org/10.1145/3610901

Josh Urban Davis, Fraser Anderson, Merten Stroetzel, Tovi Grossman, and George Fitzmaurice. 2021. Designing Co-Creative AI for Virtual Environments. In Proceedings of the 13th Conference on Creativity and Cognition (C&C '21). Association for Computing Machinery, New York, NY, USA, Article 26, 1–11. https://doi.org/10.1145/3450741.3465260

Josh Urban Davis, Te-Yen Wu, Bo Shi, Hanyi Lu, Athina Panotopoulou, Emily Whiting, and Xing-Dong Yang. 2020. TangibleCircuits: An Interactive 3D Printed Circuit Education Tool for People with Visual Impairments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376513

Josh Urban Davis, Jun Gong, Yunxin Sun, Parmit Chilana, and Xing-Dong Yang. 2019. CircuitStyle: A System for Peripherally Reinforcing Best Practices in Hardware Computing. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST '19). Association for Computing Machinery, New York, NY, USA, 109–120. https://doi.org/10.1145/3332165.3347920

Download

Share

COinS