Sound, ecological affordances and embodied mappings in auditory display

Stephen Roddy

Brian Bridges

pp. 231-258

in: Michael Filimowicz, Veronika Tzankova (eds), New directions in third wave human-computer interaction 2, Berlin, Springer, 2018

Abstract

The third wave of HCI has seen the widespread adoption of design principles borrowed from and informed by breakthroughs in the field of embodied cognitive science. These developments have taken place primarily in the contexts of visual media and interaction, but they are also of importance to the design of auditory displays and interactive systems in which sounds plays a dominant role, where they open up new affordances by which information might be communicated to a listener. This chapter examines the relationship between auditory display, sonic interaction design and embodied cognition and explores frameworks from embodied cognition that might inform the design of more informative auditory displays in a variety of contexts. It will do so by addressing these issues from an interdisciplinary perspective, bringing together insights from cognitive science and philosophy, general HCI and computer science, along with music theory and practice.