We have been told not to mix sight with touch since sight is like another language. However, new research states that cross modal integration is possible.
Read more here
Visual-Haptic Mapping and the Origin of Cross-Modal Identity
Tactile Temporal Processing in the Auditory Cortex
Our perception of the outside world results from integration of information
simultaneously derived via multiple senses. This happens at the early stages of processing sensory input. Therefore, even for a sense like touch,
the auditory cortex is required to process it successfully.
This was tested by knocking out the respective brain area using TMS.
my incredible out the windscreen experience
Before I begin, I want to highlight that in the latest test version of the vOICe, we have hesterernalization sound rendering. this has not been available on the mobile phone version until now. It adds a tremendous amount of clarity to the soundscape. Though, it does slow down the sonification a little bit.
I had wayfinder access running on my mobile phone. at the same time, I had launched the latest version of the vOICe. I had set the vOICe to double speed sonification as well as 4D rendering. I then connected the hands-free kit to the phone. I now was holding the phone on top of the dashboard such that the camera was looking at the windscreen. I was able to detect a surprising number of things. For example, for the first time, I was able to make out whether there was a clear road ahead of me. On top of that, I was able to tell whether a vehicle was getting too close to the left or to the right of the car. In India, we have right-hand drive. So, I was sitting on the left of the driver. therefore, the right side soundscapes were not very clear however, if I paid attention, I was still able to make out that a vehicle was getting too close. On the left, I was able to make an approximate guess on what the vehicle was. For example, a bus gives a very distinctive piano like sound because of its many windows.
Another thing that I was now able to do was to pay attention to the pitch of the soundscapes. By comparing the pitch I heard of the road and that of the object, I was able to tell whether the object was higher than my car or not. I am not sure if this is accurate. I was able to sense traffic moving. At one point, I was also able to sense when a vehicle moved too close to my car and then moved a little away. I was doublechecking my observations with my driver.
As of now, I do not see any way of seeing the rearview mirror and, I was unable to see roadsigns or any other structures on the road. I do need to do a lot more testing but, from my previous similar experiences, this experience represents a qualitative jump. For the first time, I was actually able to analyse what I was looking at.
The sound of shadows and shapes by Nicola Loder
Another artist’s take on seeing with sound using the vOICe
The direct PDF file is here
Blind People Hear Better: Truth or Myth?
They do but only if they are blind from the beginning. Read more in this article from MSN Health And Fitness.
Again, this is to do with neuron plasticity. The neurons seem to be more plastic at birth and in the aearly years of a person’s life so they reorganize faster and better.
What Can Magicians Teach Us about the Brain?
An article discussing what scientists can learn from studying magicians. I enjoyed the spoon example in the article. However, it seems that this kind of magic is very visual. Ouch! Any audio magicians around?
You can read the article here.
This kind of research is useful for the vOICe since the research sheds light on neuron plasticity and on how to get the braiin to perceive vision.
How You Feel the World Impacts How You See It.
An interesting article on motion aftereffect. I have not experienced this with the vOICe so cannot comment further.
You can read the Newswise article here.