UW Interactive Data Lab
IDL logo

Vocal Shortcuts for Creative Experts

Yea-Seul Kim, Mira Dontcheva, Eytan Adar, Jessica Hullman. ACM Human Factors in Computing Systems (CHI), 2019
Figure for Vocal Shortcuts for Creative Experts
VoiceCuts interface and architecture, illustrating how speech interaction is supported throughout the system.
Vocal shortcuts, short spoken phrases to control interfaces, have the potential to reduce cognitive and physical costs of interactions. They may benefit expert users of creative applications (e.g., designers, illustrators) by helping them maintain creative focus. To aid the design of vocal shortcuts and gather use cases and design guidelines for speech interaction, we interviewed ten creative experts. Based on our findings, we built VoiceCuts, a prototype implementation of vocal shortcuts in the context of an existing creative application. In contrast to other speech interfaces, VoiceCuts targets experts' unique needs by handling short and partial commands and leverages document model and application context to disambiguate user utterances. We report on the viability and limitations of our approach based on feedback from creative experts.
  title = {Vocal Shortcuts for Creative Experts},
  author = {Kim, Yea-Seul AND Dontcheva, Mira AND Adar, Eytan AND Hullman, Jessica},
  booktitle = {ACM Human Factors in Computing Systems (CHI)},
  year = {2019},
  url = {https://idl.uw.edu/papers/voicecuts},
  doi = {10.1145/3290605.3300562}