Sacheta and I were at the supermarket. We were standing in the checkout line when she remembered something, told me to hold our place and was gone. I was wearing my glasses and had the vOICe running. My first thought was “Woo hm”, how do I keep our place? My second thought was “hmm, I am sighted so lets see what I can do.” I studied the view in greater detail and moved my head a bit to the left and then to the right. I could see a constant shape in front of me. I heard the rustle of a plastic bag ahead of me and confirmed that the constant shape was probably the back of a person.
I then turned my head to the left and checked the view. I could see more objects. I did the same on the right and the view was similar. I now knew that I was focused on the right object. I stepped a few paces in front until almost the full left to right panning was filled by that constant shape. I did not want to invaid the stranger’s personal space so also used other blindness skills like passive echo location. The individual moved away and the view opened up. It was my turn at the cash counter.
The key takeaway for me was the checking I did. In this situation, the narrower view given by the glasses helped because I was able to associate a physical action with the change of the scene when I turned my head sideways. I could have done the same thing with a wide angle view but would have had to pay more attention to perspective.
vOICe
Acing the supermarket with artificial vision
It was another weekend family outing we were at the DLF Place mall.
I was sitting at the back of the car, with the back of my head resting on the headrest. I was able to look out the windscreen and was able to see the traffic outside. This is a good way to get used to the looming effects of the vOICe. Objects come into the foreground as they come closer and move away as you and or they drive away. Pay attention to the volume and the way the sound moves to determine what is in the foreground. In addition, imperfections on the object will show up as small objects.
At the mall, I spent most of my time in a shop called Food Hall which sells a variety of comestibles. Mom and dad were supervising the grinding of fresh turmeric therefore Sacheta and I had a fair bit of time to look around. Most of the food is in packets though things like bars of chocolate are kept as is on the shelves. There are also freezers that contain a variety of meat, vegetables etc.
The OCR kept reading out snippets from labels and other signage so I was able to find something with coco at the biscuit counter and look at some of the chocolate bars at the chocolate counter. The OCR was particularly handy when I was standing at one place waiting for Sacheta to finish studying something like the counter in front of us. A quick note about looking at the chocolate counter. Beware of the OCR because chocolate bars have a lot of text on them so there is a fair bit of information to absorb and the OCR will take its time. I had a similar experience with signage. There is a restaurant called the hard rock cafe next to Food Hall. It has superb signage which I can read from at least 3 to 5 feet away. The same does not apply to Food Hall. I spent some time looking at its sign but I could only read the word “food”. One more thing, words on packets and signs may be positioned one below the other therefore be ready to scroll and pan by moving your head. The panning is needed due to the large fonts that are used.
Another handy thing that I was able to do was to determine if shelves contained bottles or packets. I use the term “bottles” to include jars and other cylindrical containers. This is important information because I was extra careful near these shelves. Those bottles tend to fall easily and if I am lucky, break. Not that this has ever happened to me but this gives the bottles some extra security and my credit card a lot of peace. The way to check this is to get the shelf into the foreground and focus on what shape emerges. Practice at home with bottles so that you know what they look like. You can hear the rising circular shape or a circular shape that has a near uniform pitch indicating a jar/. Stay about half an arm length away from the shelf for best results.
I had the leisure to study packing. Each packet had labels in different fonts and with different font sizes. I don’t know how manufacturers decide the fonts and sizes of labels. However, if any of you are reading this, please use large fonts and keep them standard so that they are machine and human readable. Take the case of a packet that contained “premium almonds;” I was able to read the word “premium” but not the word “almonds.” I suspect this was a font and perhaps a camera placement issue though the word “almonds” was in a large font but Sacheta told me that its styling was different. Small fonts do not help.
If you hear a lot of hard surfaces in the soundscape and or a tropical bird like call, you can be quite certain that you are looking at shelves of packets. If there is space between the hard parts of the soundscapes and you detect a cylinder, then you are looking at shelves of small bottles. You can better experiment with this at shops that sell makeup.
Looking inside the freezers did not yield much information. There were things inside them but I was unable to read their labels and the lighting was variable.
Where is that milkshake?
Once we had finished shopping, we went to Big Chill for beverages and bites. I had ordered a Swiss chocolate milkshake. The waiter placed the glass on the table saying “Swiss chocolate” and vanished. I usually ask someone where the glass is placed. This time, I tilted my head by a few degrees, increased the volume of my bone conduction headset and studied the table to look for that cylinder. I found it and got the glass without mishap. Thanks Dr. Meijer for emphasizing grasping exercises!
Talking about the volume control, it is important hat you can regulate the volume of the soundscapes. An external control is the best for this. Set the vOICe to a volume of 7 or 8 if you are in a noisy environment like a mall and then use the hardware control on the headset to tweak the volume based on your needs.
Finally, if you detect pixelated soundscapes in a shop, it could mean that the lighting is positioned above the shelf or there is a single light source shining down on to the shelf. In this case, get closer to the shelf and do what you can, else ask the staff for help.
Shopping for footwear using synthetic vision
Sacheta wanted to buy footwear, so there we were, in Kala Niketan, Janpath on a Saturday evening looking for bellies and such. As usual, I was wearing my Vision 800 glasses running the vOICe. One advantage in footwear shopping is that the customer needs to sit to try it. The shop was not too crowded and we did not have a problem in finding a seat. However, before sitting, we looked around the shop, asking the staff for what she wanted. There were shelves packed with footwear. I was unable to understand the shapes until I touched a slipper. It had been stacked on its end such that the strap that comes on the top of your foot was facing the customer. This is different from how shoes are stacked because shoes are kept with their backs to the customer or at least that was the way they were kept the last time I checked.
The shapes were uniform from a far and the shelf boundaries formed hard edges in the scene. The shop had a large range of footwear in several colors. Once I was seated, I began to play with the color filter. Blue, green and red did not yield much feedback. I hit pay dirt when I chose orange. This was strange. I could hear shoppers asking for a colors like “rose gold”, whatever that is. Where was this color? I don’t think anyone wears orange shoes but then what do I know? The analyze option came in really handy. I sat back letting the scan tell me what filters were working. I then enabled the live OCR which introduced a new wrinkle. As I panned, I heard “fresh stock.” Hmm, what could they mean? Were they referring to the latest fashion? Was someone baking shoes? I could not ask Sacheta because she was engaged with a persistent sales person.
Once she had completed her shopping I was able to clear up some of the mysteries. The orange filter worked probably because the shop used a lot of yellow light. The “fresh stock” meant that there was no sale on those items. Don’t ask me why they could not say this up front.
I did have a chance to look at shoes and to distinguish details, my palm remains the best tool. However, with some more practice, I think I will be able to reliably distinguish between shelves full of slippers and shelves where shoes are stacked.
I did not buy anything so did not get a chance to try walking but I can see myself creating a visual landmark of a shelf or something else and walking independently to test shoes.
Some may ask, what is the point of it all? The simple way to buy footwear is to ask for what you want and try until you like something. Yes, this approach works well but my scene reader helped me to get a better idea of what was in the shop and thereby make a more informed choice.
Note
Photography is not allowed in the shop so I did not take any images.
Note 2
Be careful when looking and searching for a place to sit. These shops are full of humans sitting and not paying attention to their surroundings. Stay in the middle of the isle as much as you can. Let the staff guide you to a seat.
Mauritius: the cradle of my state change
I visited Mauritius for my honeymoon in March 2018. It is a beautiful country with rivers, the sea, mountains and volcanoes. Yes, all the geology I wanted packed in a little island. The locals are friendly and most speak English so Sacheta and I did not experience any translation challenges. The weather was warm and it did rain unexpectedly which called for fast reflexes because I was wearing the vOICe. My vision 800 glasses proved to be quite rugged and the splashes they got did not damage them. In terms of accessibility, there isn’t any. People will help but there is no accessible infrastructure. If you are blind, then keep a sighted companion handy or go with a specialized travel provider. Moreover, the group tours are inaccessible. In many cases, you are shown pictures especially if you go to a winery. I was fortunate to have a mechanism where I could experience shapes at a distance namely the vOICe else I would have been left out of many of the attractions of the tours. In addition, if you take a group tour, you need a way to experience the scenery as you are driven in a buss. Sacheta described everything but audio description has its limitations. For example, how do the double walled tanks look? How are the pipes laid out? Moreover, some of those group tours move fast therefore you do not have the time to get a full audio description. I was doing my best to follow the guide as she explained things to the rest of the group. All Sacheta had to do was to point me in the right direction and I was fully included in the tour, no accessibility infrastructure required. The other thing about Mauritius is that it is a honeymoon destination which means that everyone else is also honeymooning. You can get lost in the crowd and get your privacy since the locals are friendly but not intrusive. The highways are clean and the drivers know how to avoid traffic jams.
Ganga Talao
A crater lake situated in South Mauritius. Plenty of fresh air and the water is clean. There is also a popular Hindu temple with friendly priests.
The valley of 23 colors also known as Vallée des Couleurs
The 23 colors refers to the color of the soil in the valley. The geology and wind have created unique conditions for the formation of mineral deposits in the soil. I tried iMusic and the musical scale mode of the vOICe. I did not count 23 colors but could tell the shades of colors though I cannot name them. There are a number of waterfalls. None of them are high. Getting to them is a bit of a hike but is well worth it.
North Mauritius
This is where you go if you want a break from nature. Most of the government offices and shopping malls are here.
The Tea house museum
The place for you if you love tea. There is a demonstration factory where the staff shows you how tea is made. The staff is knowledgeable and be prepaired for facts and figures before that perfect cup of tea.
The valley of the 7 colored earths
Once again, we have soils with minerals but with 7 colors this time.
A great place for having fun with animals. There are several activities such as feeding the giraffes and walking with lions. The park is meant mostly for kids but if you are blind, there is a lot of tactile experience here. However, you should have sighted assistance with you because you need to walk through the jungle to go between activities. There is no accessibility here and the busses are old and creaky.
Thank you
There are too many people who made this trip the smashing success it was.
The incomparable Sacheta Lal
for everything.
Travel Savvy
for the trip, sound advice and seamless experience.
Planet Abled for accessibility advice
The staff at the hotel Le Meridien in particular Sam and Shazia for exceptional service and a superb accessibility workaround for hotel key cards.
The staff of Solis the local support partner, in particular drivers Viki and Edlib (I hope I am spelling your name correctly).
The members of our tour group in particular Jatin, Harish, Rushil for being who you are and for navigation assistance.
House hunting with artificial vision
I was recently looking at places to rent for my mother in-law. I was wearing the vOICe as my wife and I looked at prospective houses. For those unfamiliar with the Indian real estate market, here are a few things to note
- Real estate is an investment for many people. Landlords construct houses specifically for renting.
- Many houses are little more than shells with plumbing.
- You need to check carefully because maintenance is bad here. The landlord’s idea is to get the maximum return for the lowest cost.
- Be careful about the furniture because it can be old and unusable.
- Real estate agents seldom give you all the facts about a place up front.
I used passive echo location to get a sense of the size of the house.
I used my nose to tell how well the air was circulating in the house which was a key to ventilation.
I did not want to touch anything because the houses were not being cleaned regularly. The vOICe however came in handy to ask about bits of furniture. I was also able to see and ask about the paint on the walls because I was able to perceive texture differences. In addition, I was able to explore independently and supplement my other senses and see the quality of doors.
I was unable to confirm if objects were dusty visually but I expect if you see something hazy, assume it is dusty.
I was also able to get an idea of how the common staircase was maintained by scanning the walls. I did feel them while ascending and descending the staircase but the vOICe gave me a larger field of view.
One example of detecting furniture was when I spotted a stack of something. It turned out to be a wall rack cut out of the slab of the open kitchen.
You may well ask me, why not ask my sighted wife to describe things to me? I could have done that but she was making her own observations, talking to the agent and navigating me. We did however had a discussion in the car where I was able to compliment some of her observations.
Our hunt continues but I am glad I have the ability to get data about my environment at a distance.
Better selfies with synthetic vision
I am in a situation where I am a participant in taking selfies. I can take them if I must but they are not my preferred form of photography. Yes, human expression can be interesting but I know what I am feeling and do not need to capture it in pixels. However, a large part of the rest of the world in particular my fiancee believes differently. The basic procedure of taking a selfie is something like
- Find the right background.
- Figure out your pose and angle.
- Move your arm to get the “right” angle.
- Smile or adjust your facial expression.
- Take the picture.
There is a variation in the above procedure where you find another random human to take the picture. The problem of course is that given that it is only you and perhaps one other person, you can’t slack off and hope for the group to compensate for your photogenic shortcomings. Facing the camera is also rather important. Yes, the old sighted technique of moving your head in the right direction works but keeping there is another matter. No, this is not the blindness thing where some blind people keep moving their head. This is about looking relaxed and being relaxed at the crucial moment when the picture is taken.
The vOICe is handy to have. If I have it running and am wearing my Vision 800 glasses, I can see the camera to focus on. So, there is no need for anyone to position my head and I can keep my neck muscles relaxed. I can correct drift and if the picture is taken when I know I am incorrectly aligned with the camera, I can ask for a retake instantaneously.
The keyboarding buz
I went for the pots and Pens writing retreat planning to write the great Indian novella. The retreat was conducted at the Shilaroo Project. I did write but the retreat turned into a writing research trip which according to Aditi is still writing. I experienced farming, the forest, plenty of photo opportunities, superb people, pottery and some challenging navigation situations. I was running the vOICe on my vision 800 smart glasses and used them extensively to get a feel of the place.
The navigation
The house at The Shilaroo Project is situated upon multiple levels thanks to it being on a hill. There were many staircases. The staircases inside the house were easy to find and navigate due to the use of railings. The risers were large and visually distinct. However, things were different outside. Yes, some of the main staircases did have railings but the steps were not uniform, and vision was not the best tool to use in this situation especially when descending. I had to bend my neck and really study the staircase, for which I did not have patience. However, I had human guides with me, so I did not have a significant problem. The farm is full of interesting places such as the blue bridge over the pond. It is terrific for photography due to the contrast of light and shade. There is a variety of plants including some large apple trees. The multiple levels also make for great photography angles.
Light independent pottery
One of the attractions of pottery is its physical nature. You hold the clay in your hands to work with it. Vision does not play a significant role at the initial stage. You need to determine the right amount of water to put, the texture of the clay etc., by feel. Yes, looking at delicate clay pots is a visual activity. I experimented with a manual potter’s wheel and a variety of carving tools.
a
Clay is an excellent material for teaching blind people geometry. I could carve straight lines and other shapes into clay. The best thing is that erasing my drawing is as simple as rolling the clay into a ball and mushing it. You can then use your palms to press the clay into a new shape. The manual wheel is a lot of fun. You sit on a stool like contraption and then use one leg to push the bottom plate of the wheel. There is a ball bearing that will rotate the upper wheel. I had to be careful here. I could spin the wheel fast, but I had to first center the clay. In addition, I had to avoid touching the clay as I pushed the wheel else it would jerk and go off center. The other thing I found was that touching the spinning wheel was a mistake. I had to touch only the clay. Muscle memory was enough for this because I had placed the clay. I did splash a fair bit of clay around. None of it hit the camera. However, getting different shapes conceptually did take some knowledge of geometry and of 2d vs. 3d. For example, we were discussing the shaping of cup handles. Virangna suggested that they looked like human ears. I felt my ear and tried comparing it to a cup handle and failed. The way I understood this comparison was to think about drawing the handle and my ear on a sheet of paper and converting from 3d to 2d.
Solving the mystery of terrace farming
The high-point for me was when Virangna demonstrated how terraces are cut for farming. It was one of those things that was never fully explained in geography class and I was unable to imagine what the process would be. Yes, the mountain side would be cut but then where would the cutting machinery stand? She and Arun Cherian, the architect of the Shilaroo project created a model of a mountain in clay. On the side of the mountain facing me, they then cut a trench like path to the base of the mountain. Finally, they took a trimming tool and cut away the side of the mountain by widening the trench. That explained the cutting of the mountain. The mountain had to be re-enforced by adding metal plates and building walls usually out of Roller-compacted concrete. They then took small cubes of clay and added them to the mountain creating houses.
I go unplugged with yoga
The yoga studio is a large hall with about 22 electrical wall outlets. The irony is that I did not need to use them. The space has large glass windows that let in the sun. Wearable technology is almost forbidden in class. The idea is to listen to your body. It may be possible to watch a teacher do the steps of each exercise because Upa yoga is done very slowly. However, verbal instructions and quick corrections with some extra time worked. The highlight here was that Shubhangna, the yoga teacher was willing to have a conversation and to respect contrary points of view. Moreover, she explained the reason behind each exercise and could change it where necessary based on my needs.
The forest
The forest walk conducted on top of the Hatu peak was advertised as one of the highlights of the trip and it more than lived up to that expectation. The hike was easy. I took plenty of pictures. This is where I ran into a challenge in path finding. I had limited time therefore could not experiment extensively. Detecting obstacles on the ground is a challenge due to low light levels because of the litter of dead leaves on the ground.
I had to identify tree roots and other objects. I also tried some quick scanning through the trees to find a path but did not get very far. I need to test a wide-angle view in this situation. There were also safety concerns. There were sudden drop offs and one slip meant a fall of about 200 feet.
We had a picnic lunch and then Aditi asked us to use synesthesia to write. I had live synesthesia sounding in my ears which made for some creative work. However, this is where the bees interfered.
We were seated in a meadow like area surrounded by trees and flowers. The highway was a distant memory and there were almost no other people around. You would think that would be the perfect environment for writing. Perhaps yes, for some of you but for me, it was not. I have read in literature of the comforting droning of bees but with respect, the author of those words does not know what he is talking about. I could hear the high-pitched buzzing noise as they flew. The noise would drop in pitch as they came near me and then they would accelerate away. There were indeed flowers where we were sitting. I was using a Logitech K480 keyboard with my iPhone SE which worked like a charm. I wrote 3 paragraphs and then realized that my temptation to use the keyboard as a bee swat was too strong. I knew this was a bad idea. The bees were ignoring me, and the rest of the group did not appear to have a problem. We read our pieces and hiked back with me taking a few more photos.
I see the moon
We had a camp fire night.
The sky was clear with the stars and moon shining. I tilted my head up to see the stars. No go. I did not see any light. However, the moon was different. Thanks to Virangna and Arun for the apple pie walk and helping me find the moon. The farm had tiny lights to facilitate night time navigation. We found a clear area and then they pointed my head in the right direction to see that pinpoint of light. It was a spec in the camera view, but I did see the moon. As a child, I was told that the moon was in the sky. The sky was above me, so I expected to see the moon when I turned my head to the sky. This is almost correct. I had to look at an angle to see the moon. I also had a look at the kitchen because we had to check the status of the apple pie.
Other views
Acknowledgements
Aditi Rao and my writing group for the fantastic support and terrific stories
Vidula Sonagra for logistics and image descriptions
Brig. Anuj Kainthla, Vsm (Retd.)- for clearing my concepts on stellar navigation and the use of blankets as well as for gadget charging heaven thanks to the plethora of electrical sockets
Anita Kainthla for her hospitality, food and desserts
Virangna and Shubhangna Kainthla for art, yoga and fascinating conversation
The staff at the Shilaroo project for back end support