Opin vísindi

Improving the Audio Game-Playing Performances of People with Visual Impairments Through Multimodal Training

Show simple item record

dc.contributor Háskóli Íslands
dc.contributor University of Iceland
dc.contributor.author Bălan, Oana
dc.contributor.author Moldoveanu, Alin
dc.contributor.author Moldoveanu, Florica
dc.contributor.author Nagy, Hunor
dc.contributor.author Wersenyi, Gyorgy
dc.contributor.author Unnthorsson, Runar
dc.date.accessioned 2018-04-27T13:28:00Z
dc.date.available 2018-04-27T13:28:00Z
dc.date.issued 2017-03
dc.identifier.citation O. Bălan, A. Moldoveanu, F. Moldoveanu, H. Nagy, G. Wersényi and R. Unnthorsson. (2017). Improving the Audio Game-Playing Performances of People with Visual Impairments Through Multimodal Training. Journal of Visual Impairment & Blindness, 111(2), 148-164.
dc.identifier.issn 0145-482X
dc.identifier.issn 1559-1476 (eISSN)
dc.identifier.uri https://hdl.handle.net/20.500.11815/704
dc.description.abstract As the number of people with visual impairments (that is, those who are blind or have low vision) is continuously increasing, rehabilitation and engineering researchers have identified the need to design sensorysubstitution devices that would offer assistance and guidance to these people for performing navigational tasks. Auditory and haptic cues have been shown to be an effective approach towards creating a rich spatial representation of the environment, so they are considered for inclusion in the development of assistive tools that would enable people with visual impairments to acquire knowledge of the surrounding space in a way close to the visually based perception of sighted individuals. However, achieving efficiency through a sensory substitution device requires extensive training for visually impaired users to learn how to process the artificial auditory cues and convert them into spatial information. Methods: Considering all the potential advantages gamebased learning can provide, we propose a new method for training sound localization and virtual navigational skills of visually impaired people in a 3D audio game with hierarchical levels of difficulty. The training procedure is focused on a multimodal (auditory and haptic) learning approach in which the subjects have been asked to listen to 3D sounds while simultaneously perceiving a series of vibrations on a haptic headband that corresponds to the direction of the sound source in space. Results: The results we obtained in a sound-localization experiment with 10 visually impaired people showed that the proposed training strategy resulted in significant improvements in auditory performance and navigation skills of the subjects, thus ensuring behavioral gains in the spatial perception of the environment.
dc.description.sponsorship Sound of Vision, Horizon 2020 nr. 643636
dc.format.extent 148-164
dc.language.iso en
dc.publisher American Foundation for the Blind.
dc.relation "info:eu-repo/grantAgreement/EC/H2020/643636"
dc.relation.ispartofseries Journal of Visual Impairment & Blindness;111(2)
dc.rights info:eu-repo/semantics/openAccess
dc.subject Sjónskertir
dc.subject Blindir
dc.subject Vélaverkfræði
dc.subject Leikir
dc.subject Forrit
dc.subject Hljóð
dc.title Improving the Audio Game-Playing Performances of People with Visual Impairments Through Multimodal Training
dc.type info:eu-repo/semantics/article
dc.description.version Peer Reviewed
dc.identifier.journal Journal of Visual Impairment & Blindness
dc.contributor.department Iðnaðarverkfræði-, vélaverkfræði- og tölvunarfræðideild (HÍ)
dc.contributor.department Faculty of Industrial Eng., Mechanical Eng. and Computer Science (UI)
dc.contributor.school Verkfræði- og náttúruvísindasvið (HÍ)
dc.contributor.school School of Engineering and Natural Sciences (UI)

Files in this item

This item appears in the following Collection(s)

Show simple item record