The app helps visually impaired people see through audio

In order to help visually impaired people improve their quality of life, Israeli scientists have developed applications for smartphones that can "translate" camera images into sound.

The vOICe system was invented by Dutch engineer Peter Meijer in 1992, in which the height of the sound corresponds to the height of the object, and the volume corresponds to the brightness. For example, an upward-moving light line is "translated" into a progressive sound, a bright spot (like a light bulb) represented by a beep, a rectangular object (such as a window in the day) will be a sound. and a vertical object (like waffle or fence) corresponding to a rhythmic sequence.

Picture 1 of The app helps visually impaired people see through audio

In 2007, Professor Amir Amedi, a neuroscientist at the Hebrew University in Jerusalem, began training visually impaired people using the vOICe system. With about 70 hours of practice, the participants were able to recognize the presence of human beings, as well as accurately recognize the position of the person in the picture and imitate it. VOICe for Android (for Android phones) has made the technology of this system.

Accordingly, the vOICe system converts telephoto shots into sounds by specifying different pitches and pitches that correspond to different object shapes. For example, oblique objects, such as stairs, are represented by a series of high notes. This application uses the phone's camera to record the surrounding landscape and landscape, then instructs the user how to recognize the meaning of each type of sound.

Not only that, Amedi has also recently developed the EyeMusic app for iOS devices, in conjunction with vOICe for Android. EyeMusic provides information about the level of faintness of an object by the sound of different instruments. For example, clear images with high resolution will be represented by high notes of the piano, trumpet or violin, while blurry images with low resolution will be translated into lower notes.