Opin vísindi

Improving the Audio Game-Playing Performances of People with Visual Impairments Through Multimodal Training

Improving the Audio Game-Playing Performances of People with Visual Impairments Through Multimodal Training


Titill: Improving the Audio Game-Playing Performances of People with Visual Impairments Through Multimodal Training
Höfundur: Balan, Oana
Moldoveanu, Alin   orcid.org/0000-0002-1368-7249
Moldoveanu, Florica
Nagy, Hunor
Wersenyi, Gyorgy
Unnthorsson, Runar   orcid.org/0000-0002-1960-0263
Útgáfa: 2017-03
Tungumál: Enska
Umfang: 148-164
Háskóli/Stofnun: Háskóli Íslands
University of Iceland
Svið: Verkfræði- og náttúruvísindasvið (HÍ)
School of Engineering and Natural Sciences (UI)
Deild: Iðnaðarverkfræði-, vélaverkfræði- og tölvunarfræðideild (HÍ)
Faculty of Industrial Eng., Mechanical Eng. and Computer Science (UI)
Birtist í: Journal of Visual Impairment & Blindness;111(2)
ISSN: 0145-482X
1559-1476 (eISSN)
Efnisorð: Sjónskertir; Blindir; Vélaverkfræði; Leikir; Forrit; Hljóð
URI: https://hdl.handle.net/20.500.11815/704

Skoða fulla færslu

Tilvitnun:

O. Bălan, A. Moldoveanu, F. Moldoveanu, H. Nagy, G. Wersényi and R. Unnthorsson. (2017). Improving the Audio Game-Playing Performances of People with Visual Impairments Through Multimodal Training. Journal of Visual Impairment & Blindness, 111(2), 148-164.

Útdráttur:

As the number of people with visual impairments (that is, those who are blind or have low vision) is continuously increasing, rehabilitation and engineering researchers have identified the need to design sensorysubstitution devices that would offer assistance and guidance to these people for performing navigational tasks. Auditory and haptic cues have been shown to be an effective approach towards creating a rich spatial representation of the environment, so they are considered for inclusion in the development of assistive tools that would enable people with visual impairments to acquire knowledge of the surrounding space in a way close to the visually based perception of sighted individuals. However, achieving efficiency through a sensory substitution device requires extensive training for visually impaired users to learn how to process the artificial auditory cues and convert them into spatial information. Methods: Considering all the potential advantages gamebased learning can provide, we propose a new method for training sound localization and virtual navigational skills of visually impaired people in a 3D audio game with hierarchical levels of difficulty. The training procedure is focused on a multimodal (auditory and haptic) learning approach in which the subjects have been asked to listen to 3D sounds while simultaneously perceiving a series of vibrations on a haptic headband that corresponds to the direction of the sound source in space. Results: The results we obtained in a sound-localization experiment with 10 visually impaired people showed that the proposed training strategy resulted in significant improvements in auditory performance and navigation skills of the subjects, thus ensuring behavioral gains in the spatial perception of the environment.

Skrár

Þetta verk birtist í eftirfarandi safni/söfnum:


Fletta

Um vefinn

Reikningurinn minn