Object recognition and localization enhancement in visual prostheses: a real-time mixed reality simulation

Author's Department

Computer Science & Engineering Department

Find in your Library

https://biomedical-engineering-online.biomedcentral.com/counter/pdf/10.1186/s12938-022-01059-7

All Authors

Reham H. Elnabawy, Slim Abdennadher, Olaf Hellwich, Seif Eldawlatly

Document Type

Research Article

Publication Title

BioMedical Engineering OnLine

Publication Date

Fall 12-24-2022

doi

10.1186/s12938-022-01059-7

Abstract

Blindness is a main threat that affects the daily life activities of any human. Visual prostheses have been introduced to provide artificial vision to the blind with the aim of allowing them to restore confidence and independence. In this article, we propose an approach that involves four image enhancement techniques to facilitate object recognition and localization for visual prostheses users. These techniques are clip art representation of the objects, edge sharpening, corner enhancement and electrode dropout handling. The proposed techniques are tested in a real-time mixed reality simulation environment that mimics vision perceived by visual prostheses users. Twelve experiments were conducted to measure the performance of the participants in object recognition and localization. The experiments involved single objects, multiple objects and navigation. To evaluate the performance of the participants in objects recognition, we measure their recognition time, recognition accuracy and confidence level. For object localization, two metrics were used to measure the performance of the participants which are the grasping attempt time and the grasping accuracy. The results demonstrate that using all enhancement techniques simultaneously gives higher accuracy, higher confidence level and less time for recognizing and grasping objects in comparison to not applying the enhancement techniques or applying pair-wise combinations of them. Visual prostheses could benefit from the proposed approach to provide users with an enhanced perception.

First Page

1

Last Page

25

This document is currently not available here.

Find this item online

Share

COinS