A fascinating article on augmented reality. The vOICe could be used to facilitate this process by helping the user point the camwra. The vOICe on the pc can handle OCR. It can also read shortcodes.
We have been told not to mix sight with touch since sight is like another language. However, new research states that cross modal integration is possible.
Read more here
Our perception of the outside world results from integration of information
simultaneously derived via multiple senses. This happens at the early stages of processing sensory input. Therefore, even for a sense like touch,
the auditory cortex is required to process it successfully.
This was tested by knocking out the respective brain area using TMS.
switchboard
fronthouse
See the abstract of this study. If I understand things correctly, a late blind subject was subjected to TMS such that the areas related to vision were made temporarily inoperative. This user was unable to use the vOICe thereby indicating that the vOICe’s approach to sensory substitution is closly mapped to vision.
I have created a tutorial on the vOICe. You can see it at the following link. The tutorial is meant for a beginner. It walks the reader through simple images and familiarizes them with the vOICe and seeing with sound. The idea is to give the user a launch pad from where she can further explore the vOICe. Do study the other tutorials such as DR. Meijer’s plain text tutorial and the series of podcasts a number of users including me have recorded about the vOICe