Visual and spatial audio mismatching in virtual environments

Author

Zachary Lawrence Garris, Mississippi State UniversityFollow

Issuing Body

Mississippi State University

Advisor

Jones, James Adam

Committee Member

Swan, J. Edward, II

Committee Member

Pratte, Michael S.

Date of Degree

8-8-2023

Document Type

Graduate Thesis - Open Access

Major

Computer Science

Degree Name

Master of Science (M.S.)

College

James Worth Bagley College of Engineering

Department

Department of Computer Science and Engineering

Abstract

This paper explores how vision affects spatial audio perception in virtual reality. We created four virtual environments with different reverb and room sizes, and recorded binaural clicks in each one. We conducted two experiments: one where participants judged the audio-visual match, and another where they pointed to the click direction. We found that vision influences spatial audio perception and that congruent audio-visual cues improve accuracy. We suggest some implications for virtual reality design and evaluation.

Recommended Citation

Garris, Zachary Lawrence, "Visual and spatial audio mismatching in virtual environments" (2023). Theses and Dissertations. 5903.
https://scholarsjunction.msstate.edu/td/5903