Repurposing Conversation: Experiments with the Continuous Speech StreamAugust 2, 2021
Repurposing Conversation: Experiments with the Continuous Speech Stream
Donald McMillan, Antoine Loriette, Barry Brown
CHI ’15: ACM Conference on Human Factors in Computing Systems
Session: Speech & Auditory Interfaces
Voice interaction with mobile devices has been focused on hands-free interaction or situations where visual interfaces are not applicable. In this paper we explore a subtler means of interaction — speech recognition from continual, in the background, audio recording of conversations. We call this the ‘continuous speech stream’ and explore how it could be repurposed as user input. We analyse ten days of recorded audio from our participants, alongside corresponding interviews, to explore how systems might make use of extracts from this stream. Rather than containing directly actionable items, our data suggests that the continuous speech stream is a rich resource for identifying users’ next actions, along with the interests and dispositions of those being recorded. Through design workshops we explored new interactions using the speech stream, and describe concepts for individual, shared and distributed use.
Recorded at the 33rd Annual ACM Conference on Human Factors in Computing Systems in Seoul, Korea, April 18-23, 2015