Sunday, August 21, 2011

Visual experiences of 3d: the Museum of Modern Art

In the museum I've got an interesting new feeling that it is a space full of people that came to see art. I already wrote about this phenomenon. Before it was about me going to a museum and seeing art that's over there. Now it is a place full of people, and I am one of them, wandering around in between pieces of art.

Let me write about good things. First of all, Kandinsky. I am not sure if I have seen this painting today at MoMA, but you get the idea, what kind of paintings by Kandinsky I am talking about.


If we take it for granted that Kandinsky had synesthesia, then it's so simple. No more worries trying to understand his pictures. You know how people look at his pictures trying to figure out what he meant? Picking up lines, circles, splashes. That's how I had been looking at the "Magic Eye" pictures, trying to discover something in the patterns, hoping that it will suddenly show me that hidden picture. I still cannot see them, by the way, but now I can look through, and at least I see that it is possible to see something else, not just whatever is printed on the page.

I can try to understand synesthesia through my understanding of stereopsis. Just like it is virtually impossible to imagine stereopsis unless and until you have it, it should be virtually impossible to imagine synesthesia unless and until you have it. That is, you may be thinking for hours about how sounds can be colored, and not get anywhere. However, I can relate to it by interpreting stereopsis as synesthesia. Then I can project it further and get at least some sense of what seeing sounds or hearing colors may be like. Furthermore, there is the natural smell-taste synesthesia that virtually everyone has but hardly anyone recognizes as synesthesia. In summary, if you want to understand Kandinsky, relax and look at the painting non-habitually.

I also noticed, as I looked at his paintings longer and longer, trying to connect to various parts of the visual system, how sometimes the whole room got darker. At this point the picture would sometimes disassociate into two or three layers, that is, each contour would belong to one of the layers, and sometimes one of the layers would be shifting with respect to the others. The layers were not separated in space, though. Also, at the same time as it got darker, all colors would disappear, and the picture would become brown-grey instead of red-yellow-blue-green-and-who-knows-what-else.


Then, Claude Monet. Look at the lilies. Those are not the ones that are at MoMA, just whatever is easy to find in the Internet.






I don't think I had ever realized that all those paintings showed the surface of the water at an angle. You just have to take my word for that... I had surely realized those were lilies on water. But you can actually see that there is an angle. You can see what angle the surface of the pond makes with the surface of the picture. This is new.

In fact, now as I looked at a huge painting with those lilies, I could easily see how the pond continued outside, from out the picture. I am not sure normal people can do that. I guess, a normal person would need to close one eye in order to suppress the feeling that the canvas is flat and to see the volume. I would assume that Monet himself was able to see volume with both eyes open. I can certainly switch back and forth with both eyes open: to see just the picture or to allow the water to continue out into the space of the gallery, with the lilies.

I tried the same with Picasso - it didn't work quite well, but it seems possible. That is, instead of just conceptualizing, what a cubist painting may be about, one can simply see the space in it as it is, albeit different from our space. I recently had to exercise my ability to see distorted space when I noticed my reflection in the faucet in my bathroom with one eye deviating to the side. As I looked in the regular mirror, however, the eyes were fairly well aligned. I guess, fusing two curved images was still a little bit too much for my brain. However, I was able to improve it, to a degree, by looking into the reflection in the faucet and seeing there the space in the bathroom, but curved. The same technique can be applied to Picasso: look at the painting, perhaps with one eye only, and see the curved space inside it. Not sure if it has to do with the observation that Les Demoiselles d'Avignon actually have strabismus, at least the three of them whose eyes we can clearly see. Of course, their eyes are not the only thing in the painting that can remind me about strabismus: with a moderate stretch of imagination, the whole picture may be seen as the result of switching between the views from two eyes.

After the museum I went to have dinner in a place called Lindy's on 7th avenue. Just a warning if you decide to go there: read the menu and the prices before ordering. The pricing is counterintuitive. I had a great dinner there and paid about $35 including a very generous tip, but once again, the prices are totally random, so you have to choose wisely. One interesting experience with binocular vision was when I went to the bathroom... On my way back I looked at the landscape of the cafe and felt a little bit lost, because the landscape didn't look like anything familiar. However, then I recognized that it didn't look like anything familiar because I was at a different angle, and I still used my old and ineffective navigation habits. Instead, I looked at the structure of what I see, realized what was where, and as I turned to the right, the environment rotated, showing me the familiar picture with my table, just what I was waiting for.

As another interesting experience, after I had my dinner I was thinking what I wanted to drink or if I wanted a desert. I took some time because of the random prices - I spent several minutes reading it over and over. I noticed the waiter in my peripheral vision and thought he was going to ask me if I had finally made some decision. At this time I was drinking water from a glass, so I automatically stopped drinking and barely started moving the glass from my face. Almost simultaneously I noticed that I noticed - that is, I became aware of my very reaction, and started deciding if I wanted to inhibit it, to go back to drinking, put the glass on the table, or something else. Of course, all that took only a split second. Yet at almost the same time the waiter slightly shifted his direction so, as I recognized in my peripheral vision, he was now moving a little more away from me, and said something like "Don't worry. Please, take your time." - and left.

This impressed me so much. This guy noticed my reaction so early that by the time I started inhibiting it or otherwise deciding what to do with it, the glass still an inch or two from my mouth, he had already changed the trajectory of his walk, and was ready to start saying something to me. It was probably an automatic response on his part. In other words, the only possible explanation is that he did what he did subconsciously, as a result of his experience, after having served to many different people and learning to pick up all kinds of signals. Anyway, that's why I left him a tip in excess of 20%.  Good job.


Thursday, August 18, 2011

Suppressing stereopsis

I decided to try to suppress stereopsis to see if I am still able to push everything on a flat screen.

I started trying outside, on the street. The method I used is the following: I tried to conscious reinterpret whatever I was seeing as a flat picture. I tried looking with one eye and looking with both eyes. I found it particularly useful to look at the road, thinking that as the road moved away from me, it was going up. I was also trying to see people coming towards me as going down and growing, increasing in their size. I was trying to see people going away from me as going up and decreasing in their size. In addition, I was trying to soften the outlines of the objects to see people and other objects as pasted on top of the background.

Sometimes the illusion was starting to work, but then something happened, and I went back to stereopsis. I found the following triggers:

Moving person. If there was a person walking close enough to me, then it almost inevitably triggered stereopsis. It was easier to see the person two-dimensionally if he or she was moving either towards me, or away from me, or perpendicularly (the easiest). Even then I had to remind myself that I was seeing a flat picture pasted on a flat screen and to constantly inhibit any 3D interpretation. If the person was moving diagonally, and fairly close to me, I basically had to look away, because I couldn't push such a person onto a flat screen.

Trees. I was somewhat able to view trees as flat. However, as soon as I looked up on the interweaving branches and the complex patterns of the leaves, the stereopsis became very strong, and there was virtually no way of suppressing it. It was like looking at something red and saying to myself "It is blue! It is blue!" in the face of evidence to the contrary.

Sharp outlines. This is a very strong reflex. I would start to feel I was going back to a flat way of looking at least in some respects, then I would suddenly see a plant, a person, or anything else, with a very sharp, clear outline, and the sharpness of the outline will collide with the flatness I was trying to look at face to face. The stereopsis gets restored suddenly, and I feel as if a bubble suddenly appeared in my brain and was rising to the surface. In order to keep some flatness it is necessary to soften the outline and to repeat to myself that this is just a flat picture, not a 3D object, but this still does not quite work. Basically, I had to look away from all sharp outlines if I were to get at least some flat effect.

Shadows. This reflex is also quite strong. If I see a shadow that is a particularly good cue for volume, that is, its relation to the object casting the shadow highlights the three-dimensionality of the object and its location in space, it is again very difficult to see a flat picture. It is not enough to ignore the shadow. I have to imagine that the shadow goes at a wrong angle in order to keep some flatness. I have to constantly keep reminding myself that the shadow is slanted and to constantly inhibit the 3D interpretation of the shadow.

Perspective. This is perhaps the strongest reflex. A few times I felt like I was starting to see a flat screen again, that is, my previous reflexes were starting to work. Then I would suddenly notice that I was seeing a path going away from me, or an arch enclosing the entrance to some building. This would elicit a strong sense of perspective immediately restoring the stereopsis. It is very difficult to suppress the stereoscopic interpretation of perspective. I have to constantly remind myself that the verticals I am seeing are not verticals, but slanted lines.

Overall, when there were many of those triggers, it was virtually impossible to maintain any kind of flatness. It was much easier if I turned away from most such objects and tried to only look at things that were not strong stereoscopic triggers. It was easier to see flatness if I was not moving and if other things were not moving either, at least not very close to me. I found many more stereoscopic triggers outside than inside. Now I am in a cafe with Internet writing down these notes. Here there are not so many triggers so it is easier to suppress stereopsis. In fact, here it is even difficult to say whether stereopsis is active or not, since for this environment it doesn't make that much difference. The organization of space in this cafe really encourages seeing everything as a big mess of pictures pasted on top of each other. Also, the coloring scheme used in this cafe allows me to see the floor and the walls as continuations of each other, which also makes it easier to suppress stereopsis.

I conclude that it is better to work on developing stereopsis outside.

Another conclusion is that it is virtually impossible or at least very difficult for a normal person to experience flat vision, given that it is already so difficult for me. There are so many triggers of a stereoscopic worldview, and most of those triggers have to be inhibited in order to gain a different perspective. If you are interested, I suggest you start from a painting or a photograph. Look at it with one eye and try to alternate between the flat interpretation and the 3D interpretation. When I say "alternate", I mean "consciously switch back and forth between two interpretations", just like you can do with this picture:

You can see how looking at one or the other mouth or nose triggers one or the other interpretation. In much the same way certain objects, shades, or outlines can trigger 3D or 2D interpretation of the whole scene.

This reminds me of my work with a speech therapist a little less than a year ago. I was working to improve my English pronunciation, since even though I was and am completely fluent, I had gotten tired of the imperfections of my speech.

When people live abroad and use a foreign language in their daily activities, they usually pick up more and more words, so their vocabulary grows, their understanding of the subtleties of the meaning of the words and of the grammar gets refined. However, for many people their pronunciation does not get better. A lot of Russians, for example, live in the United States for decades, and still pronounce words in the same way. They will say "bus" with the same vowel sound as in "father", over, and over, and over again. In fact, many Russians will not even hear the difference if you ask them to pay attention and compare the vowel sounds, and then pronounce "bus" and "father" very clearly. So strong are the habits of the mother tongue.

Similarly, a lot of Russians will pronounce the word "very" with a sound [w], even though [v] is almost identical to its Russian counterpart, while [w] is quite unusual. There is something in the way people learn and conceptualize Russian and in the way Russian native speakers learn and conceptualize English that makes many Russian native speakers incorrectly deduce that "very" should be pronounced as "wery". Again, it is difficult to hear the difference, because once you have a framework in your conscious or subconscious mind, you hear what you expect to hear.

As I was working with my speech therapist, I was recognizing more and more of my linguistic habits. It was not so much about being able to say a particular sound, more about simply hearing the sounds of the English language as they were. I recall one particularly successful session when I felt I made a lot of progress. At some point my teacher was saying some words or simple sentences, and I was repeating them. If it was not good enough, he would say again, otherwise he would move on to some other word or sentence. I remember how things started to really work when I was able to stop listening to the language and start listening to the sounds. I disengaged from the meaning and was just reproducing the phonetic patterns that I was hearing. As
I was able to let go of the meaning more and more, I stopped recognizing the words, and the process became easier and easier. A few times my teacher was very satisfied with how I repeated some word or sentence, and then I asked him to explain, what was the word or the words that I was repeating. In most cases words were very simple, yet I couldn't get them. When after a few repetitions I would understand the word, I was often surprized that this word or expression can also be heard or pronounced in this new way. It was probably essential that I did not have written words in front of me, for my habitual way of saying and hearing was strongly connected with how a word is written. I subconsciously applied some of the principles of Russian language and it made me hear and say English words in a typically Russian way. For example, when seeing the written word "letter", I would naturally try to pronounce the sound [t] twice. Similarly, I would make a longer sound [s] when saying "massive" than is necessary. When saying "baby", I would hear and pronounce the second vowel sound as [ə], the second vowel second in "after" or "matter", instead of pronouncing it like the vowel sound in "tree".


Wednesday, August 17, 2011

Why relaxation changes habits

 In Alexander Technique people often talk about habitual tension and how you can release the tension in your neck, in your shoulders, in your back, and learn to do the ordinary things or whatever it is that you do every day without this tension. Dr. Bates, the creator of the Bates method, was also writing how most difficulties with vision come from excess tension, and we can only relax the eyes, our vision will, in many cases, become very good. This makes sense for myopia if we assume that the eyeball is elongated because of the excess tension in extrinsic eye muscles. Similar explanations can be constructed to explain why double vision, or lack of binocular vision, or poor night vision also come from excess tension. However, there is something unsatisfactory about this explanation.

It seems that "excess tension" often denotes "poor use", where the word "use" is to be understood in the context of Alexander Technique. "Tension" just refers to an effort, conscious or subconscious, to interfere with the natural course of things to gain some end. In many cases what is called "tension" is really an adaptation.

I've been recently thinking about breathing and relaxation and, particularly, why is it that when I take a lunchtime yoga class in a fitness club at work, it is as I noticed more difficult to breathe freely during that class, than when I take a yoga class at some other time, perhaps during a weekend. Even though the fitness club in question is underground, I thought that perhaps I picked up some tension from other people at work, or even tensed myself, and so it affected my breathing.

On another occasion I was looking myself in the mirror while at work and noticed with disappointment that one of my eyes again turned away. Then I somehow recalled what I had been thinking about breathing, and started to breath deeply, trying to slow down and relax. To my amazement, the eye started turning back to the aligned position.

I think now I understand it. The eye turns away as an adaptation, when there is a contradiction between the input from both eyes that is difficult to resolve. If the situation is urgent and requires an immediate action, it is essential to provide as accurate visual input as possible, thus the eye turns away. However, if I am more relaxed as there is no immediate threat, the need for adaptation will be less, and the eyes may be able to work together, and this ability will develop further and further.  A change of habit, and learning in general, is only possible when the situation is not critical for survival, and imperfect functioning is acceptable. Relaxation allows for the habits to change and for learning in general because it decreases the need for adaptations.


Every time you are learning to do things in a new way, there will be a transitional period during which the old way will be more efficient than the new way. For example, you have used a certain computer program as your text editor for years, and now you are switching to a new one. The new one may be better in every imaginable way, but since it is different, you will have to struggle for some time until you eventually become as productive and later even more productive than you were with the old program. The transitional period will be shorter if you make the change instantly and fully commit to using the new program. However, if you keep using the old program when you need to do something quickly, because you really need it, you may never complete the switch. Furthermore, you will be much more successful with the new program if you embrace the philosophy of the new program as if you have never seen a text editor before. Most people, however, will start learning the new program by finding ways to do things that they often did in the old program.

People who develop and sell computer software, as well as engineers in general, have to acknowledge this human tendency, if they want their products to sell. If they come up with something radically new, it will either result in complete success as was the case with Apple iPod, or in complete failure, as happens with most other projects.

Why is it that people are frustrated when a program takes forever to load? Why is it that people are annoyed when they install a new program and all buttons are in different places, and they cannot find anything in the menu? Most people use computers because they want to accomplish something: write a poem, edit a picture in Photoshop, check train schedule in the internet. They are preoccupied with action out of doing, rather than out of being, and their way of acting will be necessarily habitual. They will keep doing things for years the same old way, because it works. You know how people say that they are bad at computers because they cannot accomplish XYZ. The most successful computer users are young kids who are using their computer without any intent to accomplish something, it is just their way of being.

When a computer user is trying to accomplish something, the immediate need or desire to finish the task prevents him from seeing other possibilities. Learning is prevented by the need to accomplish. If you want to learn, you have to be fine with failing, even if you know you can succeed the old way. Now, if we are talking about a survival scenario such as a war, then it may be inappropriate to learn to shoot in a new way and better to rely on the established skills of shooting in the face of an immediate danger. A computer user may also have a survival situation if he is, for example, a flight dispatcher. Then he will naturally use his established skills to deal best with his immediate environment, sacrificing any chance for learning. Similarly, if you are undergoing vision therapy, but your environment strongly requires you to see as clearly as possible, you will probably rely on your established visual skills, and there may be little progress. Evaluate every task, situation, and environment that you encounter. Either classify it as critical and use your best abilities as of now, or classify it as non-critical, relax, stay present, and allow for learning. Choose wisely: sometimes it may be better to sacrifice learning.


If you are interested in the subject of software and frustrated users,  read this blog post by Joel Spolsky: Controlling your environment makes you happy This post is included in his excellent book "User Interface Design for Programmers". Even if you are not a programmer but merely an active computer user, you may enjoy reading this book. For example, this is one thing that I learned from that book. If you are using Windows, you are probably familiar with the Recycle Bin. In Windows 95 when there was something in the Recycle Bin, it looked messy. Even though it was meant to allow people to recover the files that they accidentally deleted, research has shown that most people emptied it on a regular basis, because they wanted their computer desktop to look neat and organized.


Coming back to the original discussion: this is the other side of the coin. Not forcing people to change their habits too much or to learn too much when they are trying to accomplish something allows them to relax a little bit. Then, once they relax, a little bit of learning may be possible. This is why, when you teach, say, how to dance salsa to somebody who has never danced before, it is essential to first create a comfortable and supportive environment so learning can take place, for otherwise they will focus very hard on looking their best in this embarrassing situation, and no learning will take place. Clearly, during the transitional period they will have to look like they don't know that they are doing, and people like to feel in control. On the other hand, if you are that person who is trying to learn some salsa, understand that this is probably not a survival situation, and without reframing it, simply let go of the need to be in control.

Sunday, August 14, 2011

Visual experiences of 3d: modern dance class

These are my observations after today's modern dance class (Hawkins technique).

Overall, for watching modern dance it makes more difference whether you have stereopsis or not, as opposed to whether you have ballet. In other words, if you have never had stereopsis, you are not missing as much when watching ballet, as you are missing when watching modern dance. You are still missing a lot in both cases, as well as in case of theatre. There is even more difference with architecture and especially sculpture.

Two weeks ago, when my stereopsis was just making its first steps, I had a lot of difficulties in this spacious studio on Lexington Avenue. The studio has some style: it has large pictures on at least two walls, it has chandeliers, it has various other decorations on the walls and the ceiling. However, I recall how difficult it was for my stereovision there, particularly in relative darkness, since there were not many objects to see in 3d to support my stereovision, and the room fitted quite well into the 2d view.

This time it was much better. If you studied mathematics for a long time, you may have heard that there was a certain shift of perspective that took place in the XX-th century. Previously mathematicians focused on studying the properties of various objects: points, numbers, groups, fields, manifolds. Then the focus shifted to studying the transformations of various objects: functions, operators, morphisms. The properties of functions became more important than the objects themselves, since once you know all the ways how a certain space of points or objects can be transformed, it gives you a great deal of insight into what may be considered interesting or essentials properties of this space, while leaving out the uninteresting or accidental properties. (Of course, no such formal distinction can be made, since any function or operator is also a point in the appropriate functional space, and conversely every point or object x is a function on the space of all functions whose domain includes this point, via the natural duality x(f) = f(x). )

Quite similarly, every day I am seeing all those various objects. Sometimes some of those objects can be useful or, indeed, necessary for my survivial. Yet the vast majority of the objects that I am seeing are not important for me in themselves. Various objects come together to form one visual impression, in which every particular objects may be of little importance. However, as I am walking or simply moving my head, I see how my vision of all objects is transformed. The objects move in the direction opposite to the shift of the gaze and, because of the motion parallax, objects that are closer to me shift more in my visual field than those objects that are farther away from me. This shift of all the objects that I am seeing, this transformation of the objects in my visual field, gives me the feeling of being and moving in the space.

When I first acquired stereopsis, my attention was mostly focused on the three-dimensionality of individual objects, such as a tree with its leaves, an animal, or a person. When there were few objects with obvious three-dimensional features, such as in the studio on Lexington Avenue, it was difficult to maintain binocular vision, or when it was already established, was difficult to maintain good quality, strong binocular vision, because binocular vision was not really required. It hardly made any difference. However, now that I understand and feel, how movement is an essential part of binocular vision and of the experience of stereopsis, particularly after my time on a ship and later on the ferries to and from the Governor's island, I can sense volume even in an empty room if only I can notice how the room flows relative to my movement or to the movement of my head. This is, of course, not something that happens automatically, but rather I have to remind myself to notice this optic flow of the environment, as well as the motion parallax, and the more I am noticing it, the easier and smoother it becomes.

I already wrote about it in an earlier post: watching the optic flow is tremendously helpful for dance if you want, for example, to move your legs but to keep your head in one place in space. Then you simply see what you see and make sure that whatever you see is fixed, that there is no movement of the objects that you see in any direction, which would mean that your head is also fixed in space. Of course, once you feel it in the body, you can probably do whatever such movement you are trying to do with your eyes closed, but the technique I described should allow to learn the movement much faster than by other means. This is in agreement with my philosophy that stereopsis is a learning tool, and for humans this confers more advantages than any real-time aspects for catching the ball, with the possible exception for driving, flying a plane or a helicopter.

However, even when the movement is already in your body, binocular vision, more specifically the movement aspect of stereopsis - optic flow with the motion parallax, provides very valuable real-time input. This input can be used for better technique even as you are performing and not thinking about the technique. For example, yesterday I noticed that when you relevé, that is, when you lift your heels off the floor, the ceiling comes closer to you, even if it is very far. Yesterday was he first time in my life when I noticed it. How had I seen it prior to yesterday? Prior to yesterday I had certainly recognized the change in the visual field that happens when you life your heels off the floor and go on half-point, and then come back down. However, I had not interpreted this change as the ceiling coming closer to me or moving away from me. Since I lacked such a natural and obvious interpretation, the changes appeared mostly random. Of course, when something appears random and you cannot conceptualize what you see, then you can not notice anything. Imagine someone showing you a computer sceen with many patches of random colors, generated entirely at random, without any visible pattern. Do you notice anything? Will you able to recall anything of what you see? Probably, not. Of course, you can consciously look at the points in the four corners of the monitor, and memorize their color in the hope that you will later relate it to the big picture, and I had often tried to "notice" things in this way, but this approach takes a lot of work, and the chance of success is small. This was pretty much how I was learning to drive: I was looking at what seemed like a random picture, not very correlated with what I was doing with the steering wheel or with other control, and I was trying to find such patterns, such as where on the windshield glass should I see a car on my left to make sure I pass it safely withe enough distance between us, or where on my windshield glass should I see the sidewalk to make sure that I am ready to stop and my distance to it is adequate. In this context "where" means "how many inches from the rightmost end of the windshield glass", and make no mistake, I really learned to use such cues.

Going back to the topic of dance, I found the optic flow and the motion parallax very useful for turning. Even though people say that you need to spot to not get dizzy, in a sense, you first need to be able to turn and get dizzy in a certain way, that is, get dizzy because you see how things are moving around you in a circle, with motion parallax. That is, spotting only makes sense after you engage with the environment in a certain way. Figure skaters, for example, do not spot, but they see the environment as they are turning, and they decide when they will exit and where the will move after the turn.

To be fair, I am not quite sure if the optic flow and the motion parallax are intrinsically helpful for turning, or if this merely engages the visual system, which in turn coordinates the whole body. Similarly, when I was writing my older post titled "up, down, and other directions", I was not sure if it was the actual stereovision that was giving me the direct feelings of up and down, perhaps via a greater sensory integration with the vestibular system, or if it was simply a matter of bringing both sides of the visual system and both sides of the brain into agreement or harmony, which then allowed me to do all kinds of things.


However, from an emotional point of view, seeing the optic flow of the environment and the motion parallax are important, since they give a feeling of being in the space, a feeling of being in the world, a feeling of engagement. This is, therefore, as important for dance as for anything else, theatre, public speaking, cooking, you name it.
I am abandoned in the world ... in the sense that I find myself suddenly alone and without help, engaged in a world for which I bear the whole responsibility without being able, whatever I do, to tear myself away from this responsibility for an instant.
Jean-Paul Sartre
I do not think that this being or not being in the world is only a function of binocular vision. This is probably more a function of being present. If, for example, you have never danced, or sang in public, or played table tennis, and then you decide to try, you may feel awkward, very uncomfortable, embarrassed. You will feel detached from your body, you will almost not want to be responsible for your body at that moment. In some subtle sense this feeling is similar to the experience of not having stereopsis: you are hear, and everything else is over there, in this picture. Conversely, if you can invert this feeling to its opposite, to the feeling of being engaged, then this is what stereopsis can give you, a feeling of being in the world. 

I guess that even people with normal vision have stronger stereoacuity, color perception, sound perception, when they are present and engaged with the environment. This is because when we are not present, when we want to hide, to be somewhere else, we are actively intending to be out-of-the-world, and this may result in suppressing some depth perception, some color perception, or even closing one's eyes. 

Next time when you feel like you want to be somewhere else, whether it is a difficult dance class, an unpleasant conversation with your manager, sorting things out in your relationship, an argument with a police officer, think about what you are doing for yourself. Unless you are being tortured and you know you are going to die in the end of the torture anyway, in which case it is understandable that you want to die underfocused instead of dying with full awareness, including the awareness of suffering, unless this is what is happening to you, think, what is it that you are doing for yourself. You are taking yourself out of an experience. Even if you are not willing to make the choice to live with full awareness and authenticity, think what it is that you are doing for your brain. You are teaching your brain this mode, of not-being-here. You are disconnecting all those nervous circuits that integrate the sensory information and provide you with the feeling of being here and now. This involves vision with depth and color and motion perception, this involves hearing, and all other senses, as well as perceiving body language, perceiving the emotions, and more, and more, and more. If there is no immediate danger, we want to have a better living experience, just as Peter says: thriving, not surviving. 

Friday, August 12, 2011

Lessons from binocular summation

Binocular summation is a very useful feature of binocular vision. With two eyes the threshold for noticing a stimulus is much lower than with one eye. As I walk down the street, I notice birds, flies, mice or insects on the sidewalk. I sense the movement, and I recognize that my threshold for detection is now unusually low. I notice movement, and I notice how subtle it is. I watch dance and I see subtle movements, and I recognize them as subtle; I see that I was not able to notice such subtleties in the past. It may, of course, be that my visual system has been educated, and those skills may still persist with one eye closed - not sure.

What makes a subtle movement stand out is that both eyes receive coherent inputs. I also suspects that every time I notice a subtle movement and the object that is moving is small, such as a dust particle, my eyes have to be sufficiently aligned. Conversely, when the inputs from both eyes are too different as is common because of strabismus, this results in confusion, and a general feeling of discomfort.

Recall that we can interpret binocular vision as a sensory integration of the inputs from both eyes, at least I propose this approach. Here is a quote that triggered my thinking of how we can apply it to other areas:

For example, winking when you talk to someone adds extra weight to your message, as does touching them. However, combining both behaviours has a synergistic effect that makes you stand out. It seems this is a key factor on how to stage presence.

(Source: link )

I suspect this is the reason why it may feel so uncomfortable and unsettling when somebody is saying one thing, but the body language or the eyes say the other. We perceive disagreement between the senses, and the responses are probably the same as with the vision. One possibility is suppression: we are only listening to what the person is saying, with an uneasy.  feeling, but generally ignoring the body language that does not match the words. This is analogous to monovision. Another possibility is ambiocular vision. Both sensory inputs can be perceived and interpreted independently, despite the contradiction. This should be easier for someone whose senses are not very integrated. I guess that people in certain occupations such as work in police or in CIA or another similar organizations can benefit from a certain lack of integration of senses, perhaps even certain autistic traits.

When different senses are in agreement, the effect is similar to binocular summation. The threshold is naturally lower, so if you want to reach people, it is advisable to use multiple senses. If what you say is in agreement with your eyes or with your body language, then you will be relying on the audiovisual integration of your listeners to reach them more effectively. When dance and music are in agreement, the whole is greater than the sum; but if there is disagreement, this results in confusion and partial suppression of what you see or of what you hear, or both. This is why it is easier to clap on the beat of the music by yourself than together with the people who are clapping off beat.

This is why if you eat too much garlic in certain social situations, this can be a problem. The people you are meeting with will have a difficult time integrating their various sensory impressions of your person. Even if they understand that this garlic smell is just an accident and does not characterize you as a person, they will still have to suppress the sense of smell, which will weaken the impression from the other senses. Furthermore, if you do not eat garlic, and leave an overall good impression, they are likely to complete your sensory image by attaching it to an appropriate pleasant smell that they happen to come across after meeting you.

Thursday, August 11, 2011

Visual experiences of 3d: Central Park

I was in the Central Park shortly after my stereopsis had just appeared, on the 30th and the 31st of July. I recall a fountain that took a lot of space, more than usually, both in terms of height and in terms of covering the ground. Fountains in general are much more interesting with stereopsis because they often involve complicated configurations of streams of water, and the appreciating of the whole downward movement of the water in the fountain also came to me with stereopsis.  I recall street lamps hanging above the sidewalk, even though the stands were standing on the side, not on the path. I had always known that the stands of the streetlamps were not on the sidewalk, but had failed to notice that the actual lamps were actually above the sidewalk that they were supposed to lighten. It actually makes sense from an engineering point of view.

Yesterday I went for another walk. I took the subway to Columbus Circle, and even though I had seen it with stereopsis, was impressed by the open space and how subway arrives right in the middle and under the ground level. Just like I previously explained about gravity and the directions "up" and "down", I never really felt that subway was underground, I only understood it.  This is, in spite of the fact that St. Petersburg has a very deep subway - I guess, it is difficult to construct tunnels in a swamp.

From Columbus Circle I went towards the Lincoln Center. It is indeed quite impressive, much more than I had thought during the previous visits. It is interesting how the size of the buildings matches with what I know is inside. You can look at it and imagine what the space inside feels like. Previously I did not have such a feeling of space. For example, I remember many years ago there was a discussion of how high was the ceiling in some apartment. I don't remember if it was our apartment or not, and I don't remember the discussion either. What I do remember is how I wondered if the height of the ceiling made any difference, except if you had very tall people coming to visit you.

Then I went to the park. I think that the stereopsis for distant periphery and generally large objects had already been established well enough, so that now those objects started to form surfaces and configurations. I was no longer just seeing in 3d that one object was on top of another, or that there was space under a bridge, or that a streetlamp was hanging above the road, but this information was sometimes coming together to create an awareness of a more complex landscape, with a deeper understanding of the spatial relationships between the parts involved. It could be comparing to studying any discipline, to any learning: at first you see isolated relationships, then those come more and more together to form a big picture. Here "big picture" is not just peripheral vision.

I cannot quite explain the feeling. Imagine that you are visiting a foreign country, but you do not know the language. You see a sign over a door, but you do not know what it means. However, if you know that this sign means "coffee", then seeing this sign can and often bring to your mind whatever it is that you associate with coffee - taste, smell, childhood memories. Even if you do not start thinking specifically about coffee with your conscious mind, there can still be an awareness that tells you: you remember the smell and the taste of coffee, even though you are not actively recalling this smell and this taste at the moment.

I think that with vision we see different parts of land filled with different objects, such as a park filled with trees, or a city filled with buildings, and we sense, we extrapolate that the space around those trees or buildings carries some of the same properties. Then when we physically are in this space between the trees or between the buildings, we feel that we come in touch with something. So this is why being in a room can feel very different from being in the forest, which can feel very different from being in a cathedral, which can feel very different from being in a parking lot. I had never really felt this difference as acutely as during the last few weeks. I had probably started to get this feeling of space a few days before my vision transformed.

Even though everything is now so interesting, I still have to make an effort to take it in. I still have to make an effort to look around, to see what's in front of my eyes, just as I have to make an effort to walk, because, technically speaking, walking requires some amount of effort. Fortunately, I have taught myself that walking is important, so I am spending energy on it without further questions. That is, I do not have to push myself to walk or make a conscious will; however, I do have to consciously see things in front of my eyes, even though it may take a comparable amount of energy or of mental energy. This analogy is not quite valid; walking is physical, while looking is mental. However, I hope to learn to see things, hear things, and so on, without such a significant conscious effort.

When years ago I first heard about these ideas of staying present, of not wasting your life reflecting on past joys or sorrows, I couldn't understand it. It then seemed to me that life consisted exactly in joys and sorrows, and that focusing on them was the very manifestation of being alive. However, I am no quite sure any more, whether reflecting on past experiences can be more authentic or can make you feel more alive than new experience. I mean, of course, reflecting with attachment. I also do not want to include situations when you are in too much pain, physically or otherwise, and have no intention of staying present or alive.

Monday, August 8, 2011

The advantages of binocular vision for dance

It is not entirely clear, which of the advantages requires functioning binocular, and which will be present with sufficient binocular experience in the past or after having studied dance in the past with the benefit of binocular vision. Also, it might be argued that some of the advantages I am writing about are not really advantages of binocular vision and that the changes that I observed are simply a natural progress. I am ready to dismiss this argument. People do not become better dancers overnight, and people do not become better learners of dance overnight, yet this is exactly what happened.

1. I already wrote about this one. Binocular vision creates an immediate sense of gravity, of the directions "up" and "down".

This means that after I acquired binocular vision, it came with an immediate sensation of what is "up" and what is "down", as I already described in a previous post "up, down, and other directions". I was taking a modern dance class on Saturday, the 30th of July, and was able to observe how, as the binocular vision got stronger, and then weaker, the same happened with the sensation of gravity. The sensation of gravity allows you to stand on one leg and feel how the weight is going directly down, through the leg. The sensation of gravity allows you to do a hand stand and feel how the weight of the body is going directly down through the arms. When you bend forward from your hips, in any style of dance, yoga, or any other discipline, the sensation of gravity allows you to feel your legs as vertical possible, with weight going down through your legs, so your pelvis is only moving back as much as necessary.

Surely, such awareness requires training. However, the level of immediacy of this awareness is so strong, it appeared so suddenly, and then got weaker and stronger at the same time as the stereo perception got respectively weaker and stronger, that I have to conclude that it is immediately linked to binocular vision, perhaps, more specifically to stereopsis. What surprizes me the most is that the sense of gravity is as clear with the eyes closed as with the eyes open.

A natural assumption would be that the vestibular system was contradicting the input from the visual system and was suppressed, but now they are harmonizing. However, once again, this contradicts my direct experience. First of all, I had a glimpse of this verticality a little before acquiring stereopsis - if I am correct, on Wednesday, July the 27th. One of the assistants in the class told me to, perhaps go directly down in plie, or do something else directly down or directly up, I don't remember. However, as she said that, she suggested to imagine a vertical string or thread in the air. She showed how the thread would go, and I saw it, indeed, going vertically, through the never. I had never had such a clear image of verticality in my life. The vertical line, or thread, or string that I saw, was not parallel to anything, not parallel to the wall, not perpendicular to the floor. Maybe it was, but I did not notice it. It was just going directly up and directly down. Was it possible that my vestibular system had already changed that much even before I actually acquired stereopsis? Is imagining a vertical string a function of the binocular system at all?




2. This one is even more amazing. Binocular vision creates three-dimensional body awareness.

This means that now I can feel, for example, the shape of my pelvis more directly, in a way, that was not previously accessible to me. This is true even when I close my eyes. I can perceive its shape and position in three dimensions directly, and yes, I can create pulsations in my visual cortex just by concentrating on the shape of my pelvis and its location and movement in space. (To be fair, right now I can do almost anything, as long as I do it with awareness and not automatically, and still create pulsations in my visual cortex.)

I can initiate movement in ways that were not accessible to me before. In fact, I feel that my flexibility is increasing. I thought I had limited flexibility in a number of places; however, now it seems that I was not able to direct my body precisely enough. This is why flexibility did not develop, because I introduced some random variations, and different muscles and ligaments were stretched, non-uniformly on the left and on the right.

It has, of course, nothing to do with seeing per se. However, it has to do with being able to imagine a three-dimensional shape. You know, I had such a peculiar feeling in my first couple of days with stereopsis, that I was not able to imagine anything, nor to recall anything. In fact, every time I was able to imagine a plant separated in space, I felt how my binocular vision improved from this act of imagination. Remembering was difficult, particularly on Friday the 29th and Saturday the 30th of July. As I already wrote, I learned to consciously create three-dimensional faces out of two-dimensional memories, but only for people I knew well. Mostly, it didn't work, or I could come out of stereopsis and imagine things on the left eye, or on the right eye, or across both eyes. In the spirit of Dr. Bates, I assume that to imagine a 3d-image is the same as to see a 3d-image, which is the same as to remember a 3d-image. All three tasks are equally difficult or equally easy, and require the same state of mind. This state of mind is probably what Dr. Frederick Brock (1899-1971) called "binocular posture". 

 Continuing with body awareness, my body awareness seems to increase very quickly from watching other people. That is, from sensing how other people's bodies move in three dimensions, I can feel it so much better for myself. Make no mistake: I studied various styles of dance and other disciplines for some years, and I studied anatomy and I have seen pictures with muscles and joints and thought about how they function. My understanding improved in a matter of days so much, and then after several more days it grew even further. I would say that such changes do not happen so quickly, even after years of work.



I am not sure what to say about people who have been blind from birth and somehow learned to dance or to do yoga. Are they capable of the same or better level of body awareness? How would they learn without vision, which is always a major tool for learning any movement discipline? I don't know. 




3. Just like with exploring the city, just like with learning the body language of the society where you are growing up, stereopsis is a learning tool.

I couldn't believe it when I realized, again in a dance class, how much more information I was getting. I also had to work less to get this information. Just like with other things, I could replace scanning for information by simply observing and taking in all the details. Perhaps, the observational skill can be learned without acquiring stereopsis. However, and it has to do with the body awareness advantage mentioned above, when you are learning dance, the 3d information you are receiving from observation is directly applicable. You are seeing a move in three dimensions and, with appropriate experience and training, you can directly project what you are seeing on your body. Of course, some people do it better, others do it worse, but now I can do it with the whole three-dimensional shape. I guess, if I continue to develop this ability along the Eyebody principles, I should learn to take in the mood or the artistic or spiritual qualities simultaneously with the technical details, which I cannot always do right now.

When I became aware of this faster learning, I did think about how unfair the world was. I recalled all those little girls who picked things up on the fly, and how I was spending hours looking at photographs at different angles, trying to understand a movement, and having no clue there there was a better way. However, this is not really a concern not that I have acquired binocular vision that already works quite well. What really scares me is this: what if I did not work on my vision? I am scared to think that the disadvantage of not having and having never had binocular vision cannot really be overcome by hard work - in dance, in martial arts, in basketball... I know that having no legs cannot be overcome either, but the thing is, I did not really know that I had some can of disadvantage that was inherent in the way my brain functioned. I did not realize why certain things were more difficult for me than for others, and I did not even realize the fact that those things were more difficult for me. This is what scares me - this limitation that was like an invisible wall in front of me, although, I guess, it may be much more depressing to live and know that you have a disability.


Stereopsis is helpful not just for learning by watching a teacher. You are watching yourself in the mirror, and you will see so much more with stereopsis and 3d-body awareness. I don't know if this is stereopsis or something in the brain that is connected with stereopsis or with appropriate centers in the visual cortex. However, I am absolutely certain the change that happened in me, in my brain, is fundamental, and is incomparable to changes that happen after hard work. This change is of a different kind. 


Stereopsis helps for learning dance not just when you are watching the mirror. It helps to watch other dancers, even as you are dancing. It takes a smart visual system to figure out your movement, figure out their movement, and allow you to perceive their movement as you are moving. Furthermore, with 3d-body awareness there is more attention left since movements in 3d are perceived directly, they are almost atomic. It takes much more mental space to represent a movement with two-dimensional thinking. I guess, to do a movement you really have to visualize it, consciously or not, and it is easier to connect to one three-dimensional image, static or in motion, than to multiple two-dimensional images.


Of course, with stereopsis you are learning more from watching dance, and you are enjoying it more, too. Particularly when the tempo is fast, you can see so much more. 


I even wanted to say that with stereopsis you are more likely to get interested in dance, because it is more beautiful in 3d, but this is simply not true. With stereopsis everything is more beautiful or, of course, uglier. So many other things to get interested in, other than dance. For example, trees or basketball...


4. Certain elements of technique are directly based on stereopsis. Have you seen thirty-two fouettés? Think about spotting for turns in dance. People think that the spotting technique is to prevent dizziness. Surely, it is much easier to get dizzy with than without binocular vision. However, spotting is clearly based on the eye-body patterns associated with binocular fixation. Once again think about a hunting owl. The owl fixes its eyes on a mouse, and this act of focusing, of fixation, brings a change in the entire body. The whole being of the owl gets directed towards the mouse in no time because of the organizing power of the binocular focus. The changes that vision brings in our body are beyond our consciousness. I do not think that one really can break down and reproduce the movements that are naturally arising as a consequence of looking somewhere with interest. You go where you look.

Sunday, August 7, 2011

On discovering stereopsis - part two

Do you know those people who live and, it seems, not notice, what is important in life? We all know them. There are so many books and movies about it. People worried about money, about power, about their reputation, or about how many people they slept with, or whatever. If you also come from the Western civilization, you know what I am talking about. Wise people will tell you: to understand what's important, thing what will be your thoughts in the end of your life. Did I love well? Did I let go?..

How many people never notice the beauty that surrounds them?

This is where the discovery of stereopsis starts; at least, this is how it was for me.

You are one of those people who do not notice the beauty that surrounds them. The three-dimensional world is out there, you just have to notice it.


Of course, if noticing beauty were easy, all those hardworking men would have noticed their wives and children, and how much their love was needed. You have probably already noticed all those things that were easy to notice. It may be easy to notice when your shirt is not very clean. It is much more difficult to notice that you are never on time, or that you are never listening to other people and are always interrupting them to say what you think, or that desperately need attention and understanding. When you meet a new person, you first notice superficial details such as appearance, manners, accent. Later you begin to see in-depth, and sometimes you begin to notice depth in the person. If you are looking to discover stereopsis, you will have to notice depth in the world around it. I would have called it "conscious depth perception", but this concept was already coined by Peter Grunwald to denote something much deeper than merely seeing. Even if you do have binocular vision with stereopsis, there are still a lot of things around you to notice, still a lot of depth. It is just more subtle. So many people can see 3d, yet they are still not seeing beauty, they are still not seeing depth in some deeper sense. I think this is what Peter had in mind. Either way, this combination of words, "conscious depth perception", certainly influenced my thinking about gaining stereopsis.

Discovering stereopsis does not have to start with two eyes, or with eyes at all. Normal people can somewhat perceive depth and receive a lot of spatial information through hearing. I only became able to do that after gaining binocular vision. I think that previously my sense of hearing interfered with my sense of seeing. When I went into St. Patrick's Cathedral and saw it with stereopsis for the first time, I immediately sensed how its height was related to the sounds, how the sounds communicated height. Previously I never saw height, and I would not allow myself to hear height.

Stereopsis is about perceiving the three-dimensionality of the world with all senses. When vision as the central sense lacks stereopsis, it breaks the integration of vision with other senses, and it does not allow other senses to be used for depth perception. This was not my approach, but one could probably start from the other senses, such as hearing, and to learn to hear the three-dimensionality of the world. Notice how the steps of a person sound when the person is coming closer or moving away. Notice how steps sound on different surfaces, and if you can hear an echo. Sense the space in the sounds of the cars. Lack of binocular vision is disorienting because the three-dimensionality of the world is not properly inferred from or perceived through the senses.

Coming back to the vision, I suspect that most people have a little bit of stereopsis, even with one eye. Discover where it happens for you. Maybe there is a tree where you can see a little more air between the branches than with all other trees. Maybe you have a cup, and strangely enough, you always feel there is some alive space inside this cup. Maybe there is a building or a statue that is very familiar to you, and you can create its three-dimensional image in your mind, and you can even rotate it in your mind, yet you can hardly do it with any other object. Maybe every time you add cream to coffee you see how the white color penetrates deeply inside the cup, not just on the surface, and then raises back up in a cloud. I personally had not noticed that the cream goes into the depth of the coffee until a few days ago. Whatever it is where you can notice some signs of stereopsis, where you can sense the three-dimensionality of the world, develop this sense. If this is a tree, keep examining this tree from different corners and at different distances. Try to find another one where you can also sense some air between the branches. If it is coffee, keep adding cream to coffee, then take another cup, then another. Perhaps try with hot chocolate. Keep repeating the stimulus, and keep expanding your awareness. Remember that the change happens right now or, more technically, your brain is rewiring right now. If you do not make your sense of stereopsis stronger, it will get weaker. Tomorrow you may take this cup with coffee and only see the cream spread flatly on the surface, so don't stop.

Alexander Technique taught me that when changing my habits, it is best to watch myself all the time I am awake. After I discovered how to look at the surface of the objects (instead of seeing the whole two-dimensional picture with this object or looking at a point),  after I noticed that it made my eyes converge, I would try to look at the surface of every single object. I understood that every time I looked at any object in the old way, I was coming back to the old habits, losing any positive changes that were taking place.


Think about racial segregation. Seeing and treating people as belonging to this or that race is a habit. This habit is difficult to notice, difficult to recognize that it is merely a habit. A person who supports racial segregation can still say that they understand that those other people are also humans, that they have feeling, human dignity, and so on. "But..." - they say - and you see that their so-called understanding is not worth much.

Seeing things without stereopsis is somewhat similar. Of course, there is nothing unethical about seeing without stereopsis, that's not what I have in mind. The idea is: you see things the way you see them, and you think that your way is correct, and you interpret everything else to support your worldview. Yet you may not realize, just how wrong and unnatural your worldview is.

How can a person without stereopsis understand that something is wrong? After all, if we are in a closed system of thought, how can we move beyond this system. Actually, we can. We can show that the system is inconsistent, even from the inside. We can find contradictions. (If you know what I am talking about, think about Russell's paradox.) This means, if you are seeing without stereopsis, you may be able to notice things that are just logically wrong. Understand that what you think you see is what your brain shows you. You are not seeing things upside down, even though this is how the light falls on the retina. If you recall my post about spherical mirrors, it impressed me greatly when I realized that the retina was spherical, yet I was seeing straight trees, straight roads, rectangular buildings. I started to view everything as a little bit curved, and I started to notice empty space almost immediately. I am not sure exactly which image I used. Maybe I imagined that I was inside a ball, and that everything that I was seeing was drawn on the inside surface of this ball. Of course, there were separate balls for the right and the left eye. Maybe I imagined the whole three-dimensional content of those balls by creating little copies of all objects inside my eye. Maybe I sensed how things I was seeing were just impressions on the spherical retina. It doesn't really matter. However, I had a very clear sensation that the things that I was seeing were just my perception. They were just artifacts of the way my visual system works, not the way the world really is. Peter certainly communicated this idea to me in the context of unclear sight: "the grass does not know that it is blurry, and the trees do not know that they are blurry".

On discovering stereopsis - part one

I want to try to explain in more detail, how I was able to develop binocular vision with stereopsis.

First of all, I have to give proper credit to Peter Grunwald, the author of the Eyebody method, whose retreat I attended a month ago, and to the other participants of the Eyebody retreat. I even remember a moment during the retreat when I was moving my eyes from the trees far away towards me and saw the road with what I now recognized as focused vision, although at that time I just noticed that it was brighter and crisper than usual. I also absolutely have to give credit to the Alexander Technique and its creator, Frederick Matthias Alexander, as well as to the Bates method and its creator, William Horatio Bates.

I would also like to give credit to those whose thinking influenced my understanding of the problem and allow me to even conceive of not having stereopsis, of what it may be like to have it, and of how to get there.   I have to give credit to the philosophers Paul Feyerabend, Willard Van Orman Quine, to some extent Ludwig Wittgenstein and Bertrand Russell, and , of course, Gottlob Frege's "On Sense and Reference". 




I start from the premise that stereopsis, the way of interpreting the things we see in three dimensions, is a purely habitual reaction that has to do solely with our brain's learning. I am not even sure that it is necessary to have two eyes to originally acquire stereopsis. Surely, having two eyes naturally creates certain habits essential to the establishment of stereopsis, but it does not mean that those habits cannot be created by other means. The most critical is, I would say, the fact that two eyes are constantly measuring distances to all objects, thus calibrating the sense of space, at least until it is firmly established. Yet, nothing prevents us from creating a device or an implant that would measure distances and convert them into different pitches of sound, thus allowing a person who has always had only one functioning eye to still calibrate the stereopsis, even if only after several years of hard work. Stereopsis within arm's length should be available to everyone, even with one eye, as should be the ability to focus the eyes on an object - this is clearly just a matter of habit.

I am using the word habit because it is traditionally used in Alexander Technique, as well as, for example, in Feldenkrais method. Of course, everything is a habit, and habits are not discrete, so this word may be misleading. As I see it, every time we are learning, we are making minimal sufficient changes in our worldview in order to integrate new information. Children don't have that much old information that would contradict new information, so they take in everything. It is also well-known with teaching any discipline that if you establish the foundations well, the rest of the learning process will be fast and smooth, and vice versa.

However, as we get older, it becomes increasingly difficult to learn fundamentally new things, since so much of our previous knowledge has to be reorganized. This is why it is difficult to acquire stereopsis as an adult, but same goes, for example, for languages. Do you know many adults who started learning a second language at a fairly late age and became as fluent in this second language as in their original language? Do you know many dancers who started dancing at a late age and became famous? Probably not, and let me tell you, the reason is not body flexibility, the reason is the flexibility of the mind. Do you know many people who became world famous musicians but did not start at an early age? Not so many. Surely, there are practical considerations, but again, I believe that the primary reason is the flexibility or the inflexibility of the mind - or I can use the word "neuroplasticity", if you prefer.

As part of this effect of reduced neuroplasticity, people tend to solidify their opinions as they get older. People don't see things afresh, so to say, but see the things like they have seen them before, be it politics or poetry. Of course, I have used the metaphor of seeing intentionally. So as the first step to discovering stereopsis, and any learning, any positive changes that you would like to bring, I suggest the following:

Understand that your perception may be wrong.

Perhaps, you have always thought that scientologists are dishonest people who are just trying to make money, and this may well be true; but how did you come to this conclusion? Can you support it? Perhaps, you had a physics course and have always thought that the entropy in the universe is increasing. Why? Perhaps, you have always thought that you couldn't sign or dance, or that you had had a happy or an unhappy childhood, or that you have to go out every weekend. Perhaps you have an opinion about democracy and think that those who disagree with you are wrong.

However, you have to understand: your perception is not the reality. Your perception is not even your sensory input. The sensory input may be a road with cars, but your perception will depend on whether you are used to driving on the left, or on the right, or both.

It is through some different state of mind that we can change our habits and our ways of thinking. You can call this state of mind being present. You can think of notice things around you, a sense of exploration; you can think about rewiring of the brain. Whatever it is, it is essential to learn to perceive things closer to how they really are or, more precisely, to perceive the sensory input rather than our expectations of the sensory input. If we are ignoring the sensory input, this is, in Peter Grunwald's terms, "underfocusing". The opposite is "overfocusing", which we do not want either. We want a sense of exploration that will allow us to notice and change our perception; you can call it habits. You can certainly learn this skill from the Alexander Technique, or from yoga, or from many other disciplines, or perhaps on your own. You can, but really, you may or may not. Some people study yoga or Alexander Technique, yet they do not learn how to change their perception, their habits, precisely because they already have some other perception or habits, somehow stopping the very possibility of a conscious change. I guess, this is what people mean what they say that you have to believe that a change is possible.

Every habit can be changed if we can only remain present, even if it is just for one breath.

Ideas for neuroscience

When the input from two eyes is not combined to form a single three-dimensional image, but rather the input from one or the other eye is suppressed, this can be viewed as a problem with sensory integration. In this case the two senses would be the sense of seeing with the left eye and the sense of seeing with the right eye. Even though both senses are of the same kind, their integration is a highly nontrivial process. The fusion of the images seen by two eyes is markedly different, as I now know, from whatever is seen by each eye in isolation. I think it is fair to say that this is directly analogous to fusing the smell and the taste of an apple into a single perceptual unity. There could be similar disorders with fusing the input from both ears.

This should explain, why people with normal vision cannot experience monocular vision by simply closing one eye. When you are buying apples, you are not allowed to taste them. Yet you can still feel to some degree, what this apple tastes like, from the way it looks, smells, and responds to touch. Someone who never tasted an apple would not have the same experience. Even someone who did taste an apple, but with the eyes and nose closed, and without knowing that that was an apple, would not have the same experience either. 

You may be able to try the following experiment. Take a trip within your town or city, or even go to some other country, and find ten kinds of fruit that you have never seen before. It doesn't have to be fruit, ten other kinds of food should be fine, too, just make sure that those are very much unlike anything you have experienced before. Start by watching, touch, smelling every fruit. Then, sometime later, close your eyes, close your nose or isolate it from smells (or get a flu), and make someone feed you pieces of these fruits from a spoon, in random order.

When you will later look at the fruits, touch and smell them, you will have no idea, which fruit has which taste. You can surely have some cues: you can sense their response to pressure, and recall what it felt like eating them (although this means using the sense of touch with the lips and tongue and the inside of the mouth, not the same as the sense of taste). Yet once you taste each fruit with your eyes open, this should be a very different experience. It can also feel very satisfactory to finally establish a matching between the experiences of sight,smell,touch and the experiences of taste. 


Experiments on animals could be designed along the same lines as experiments for other kinds of sensory integration, such as glasses that shift or rotate the image seen, breaking the integration of the sense of touch and of the muscular reflexes needed to accomplish a specific task with the sense of vision. Similarly, one could make glasses where the image for one eye would be, say, rotated by 180 degrees. Then those can be tried on birds, kittens, and, ultimately, human volunteers, to see if and how the adaption will happen. One can even device electronic glasses that will slowly rotate the image seen by the right eye, but the left eye will receive undisturbed input. If put on, indeed, a young kitten, it will probably lead to the kitten using only the left eye. However, this method has an important advantage as opposed to simulating strabismus by cutting one of the eye muscles: glasses can be removed at some point, so the possibility of recovery can be analyzed.



If autism is indeed a problem with sensory integration, we should be able to learn a lot by comparing autism to binocular disorders.

For example, face recognition had been markedly more difficult for me than it is now. Recognizing three-dimensional faces is much easier; it takes much longer to establish the correspondences to recognize faces "two-dimensionally". Of course, what I am writing is nothing more than pure speculation, however, informed by personal experience. One can argue that after seeing a face from two angles, its three-dimensionality can surely be recovered. I actually suspect that ones you become able to form a continuous image of someone's face in your mind, with the shape of the surface, this would develop the circuitry in the visual cortex that is used for seeing, remembering, and imagining 3-dimensional objects. In dance classes I repeatedly failed to perceive shapes as identical from different angles. I understood them as identical, but I did not perceive them this way. I would study photographs in a book or a video, and I would see how a shape or a movement unfolds from different angles. However, I still had a very clear feeling that I was seeing different things. That is, I was recognizing the shape, but I clearly felt that I looked very different from different angles, and that I had to learn that. Similarly, I remember many occasions when I would look into the mirror and adjust my posture by, say, looking at my pelvis. Yet I would make the adjustment using as a reference the way the pelvis should look when facing the mirror en face, yet I would be standing at an angle, or vice versa. After many, many, many times, I started to recognize that this was not working, and I started to see that the same shape looked different at different angles: one part of my body was maybe above another at one angle, but below at another angle. The angles between different parts of my body looked differently when viewed from different directions. After I recognized it, I allowed myself to learn to correctly retrieve information from different views, and achieved some success in it. Yet, every once in a while I would meet a little girl who would imitate a movement and it would take her seconds to pick up and imitate things that took me many hours to figure out. Usually, though, such a little girl missed many other things, so I did not make any significant conclusions from such cases.

Of course, autism is a much more severe disorder than any binocular problem. However, I still feel we can learn from the parallel, and, perhaps, both ways. Say, a child with an autism looks at a pointing hand instead of at the pointed-at object, whereas a child with a binocular disorder tries to look at the pointed-at object, yet often fails to notice the object because of not understanding the direction of the pointing. Autistic problems with communication are very severe, yet maybe we can find an analogy with the issues with reading body language and determining social distance that I described in a previous post.

I still notice my own patterns of incorrect space perception. Say, I am walking down the street, and suddenly seem annoyed by one of the people in front of me. I would look at this person and feel quite distinctly that this person is in my way or too close to me. Yet I will see, at the same time, that the person is quite far from me, not in my way, and is going in a different direction. If I move to a different point so that the person is seen at a different angle, the sensation of the person being in my way would typically disappear.

Lack of certain sensory integrations can explain the unusual abilities of many individuals with autism. Just how I had to develop a much finer perception and control of certain muscle groups to improve my coordination in dance and other similar activities, being unable to properly rely on my eyes, so people with autism may develop extremely strong compensations to deal with some deficiencies of sensory integration. Then those compensations can become an unusual skill or ability in their own domain .The motivation for the development of these compensations is much higher than the motivation for the development of similar skills in a healthy person, and the distractions are fewer. It is clearly easier to focus on learning basic (survival) things like walking and eating, than playing chess or doing gymnastics.

Saturday, August 6, 2011

Panoramic vision revisited

Remember, I have been playing with seeing the optic flow of the environment and with the motion parallax for a few days, even though the motion parallax is not yet automatic, and I have to remind myself to see it. Directly or indirectly, those two things seem to induce a sense of being "in" the environment. I first had this sensation on Friday after the Thursday when I have been playing with a ball. I was walking through a small park in the morning. The trees were going high above, their crowns interconnected, and I was inside this magical land that they created by merging their branches above my head. I was still seeing people, birds, grass, bushes, yet the trees shaped the whole view and the whole experiences.

Similarly, as I went to the tango event described in the previous post, I had a few times a feeling that I was "in" the room. This means that I was looking at different people, or couples, or furniture, yet I was still somehow aware of the room, and I could see the ceiling and the walls, and where inside those walls those people or couples were. I suspect that this is much closer to what Peter calls "panoramic vision" or "peripheral vision" than merely whatever is sensed by the rods outside the fovea. (I assume that those two concepts are the same or close enough.)  Being in my flat mindset, I had assumed that increasing or widening the peripheral vision was simply about seeing another ring of visual information outside the circular area used at some given moment. However, since we see in three dimensions, and we would like to see things that we consider interesting, not just colored pixels, "another ring" is not particularly useful.

Seeing the room all the time or seeing the trees merging above seems to be related to the ways in which I am shifting the gaze and to focusing versus over-or under-focusing. When I am shifting my gaze from an object to another object, even if I am not doing it along the diagonal from a point to a point, like I had used to, I still have a tendency to first stop seeing or disconnect from the first object, then shift, then start seeing or reconnect. When I am shifting my gaze like that, it usually feels that the very process of shifting the gaze is more important than whatever it is that I am looking at.

I found that when I am able to look with this new panoramic vision that includes the whole room or the trees above, I am still able to do some kind of soft focus. This focus is probably still perceived by others as binocular focusing. However, the key is to keeping it soft. Once the focus becomes stronger, not so soft, then I have to disconnect from my vision in order to shift the gaze - or to soften the focus before shifting the gaze. However, it seems that when I change a soft focus to a stronger, harder focus, I become able to see the object under focus better than before. The amount of highlighting that is present every time the eyes focus on an object is larger when the focus is harder and smaller when the focus is softer. Also, I can sense some physical changes in the eyes when this quality of the focus changes. When I am looking with a soft focus, I see shades moving over the object, suggesting to pick this object and focus on it. As I focus harder, the eyes open wider and take in the object. If I shift my gaze from this state, I feel a little lost, probably because the room or, in general, the environment was outside the field of my attention.

When I was practicing shifting my soft focus from object to object without disconnecting from the environment, I realized, informed by the idea of the optic flow of the environment, that it should feel like the objects are moving in the direction, opposite to the direction of my eyes. So if I am shifting my eyes from an object on the left to an object on the right, it should feel that the object that was on the left moved further left, the object that was on the right moved into focus, and I guess, it could also feel that the gaze did not move at all, like when I was running and felt that I was running in one place, but everything else was moving. As I started thinking about it, I immediately realized that Bates was writing about this phenomenon, in the context of shifting the gaze from a letter to another letter: feel how the letters are moving in the direction opposite to the direction of the gaze.

Visual experiences of 3d: Argentine Tango

I went to another milonga (Argentine Tango social dance party). This time many things were different from last time I described in this blog, so let me describe again.

First of all, this time there was a performance. A typical performance during a milonga is done by a couple who are usually professional tango teachers and performers at the same time, often out of town. Performance takes place in the middle of the night, everyone stops dancing, the space is cleared, the light turns on, and the couple performs, that is, dances to two or three or four songs.

What was different this time compared to the last time I was watching such a performance, which was some time ago, without binocular vision? This time watching was easier. It was easier to pay attention, and I did not want so much to close my eyes, or to blink, or to shift my gaze away from the performing couple. I still wanted to do something like that, but much less, and I enjoyed watching quite a bit, which didn't happen that often in the past.

The perception was more continuous, more like I was watching a river, as opposed to a sequence of discrete observations or a sequence of 1-second video clips, which is what my previous tendency was. The fine motion detection is also a great thing for watching dance. Fine motion detection was certainly enhanced by binocular summation, since I had sometimes the same feeling as when I first started noticing subtle motions after gaining stereopsis. Also, I feel that a different kind of attention is more appropriate here, the one that I described in the post on safety. Dance is, after all, motion. Watching motion, particularly with binocular vision, is probably best done with calm attention, instead of the mode in which all the details of the picture are scanned as quickly as possible.

Even more surprising was that sometimes I was able to notice more than one thing at a time, in a seeming contradiction with the very notion of focus. For example, I was able to notice the mood of the performers without trying to notice it or looking specifically on their faces to check it. This awareness just came to me, of course, through seeing their faces, but I was not asking for this information. This kind of awareness is very much in the style of Peter Grunwald's philosophy, however, I was usually hesitant to believe him that such things were possible. Returning normal vision without glasses to most people seemed and seems to me quite possible, however, the importance of vision for one's emotional state is something I will have to further discover for myself before I can fully embrace and accept it.

I also paid attention to the audio-visual integration and noticed at times how I was more aware of the agreement of the music with the dancers. However, at other times I was not so sure. Did I miss their interpretation, or are they slightly off music? Previously such questions did not arise that often since I was not able to notice movements with such subtlety. Now that I am thinking it, can it be that my new calibration between audial and visual input still cannot perform temporal integration, so even at small distances that 1/20 of a second that passes after the light waves come in but before the sound waves come in actually creates a feeling that something is wrong? How does it work in general - how are people watching dance in huge theaters, where the difference in time between the moments when the light waves come in and when the corresponding sound waves come in can have an order of magnitude of a second? Does it take some experience on part of a spectator to perform the temporal integration, perhaps having seen some performances from comparable distance? If there is just one performer who is a little bit ahead of the music, does it mean that the audience will still perform audio-visual integration as if the performer was on the music? Does it depend on the audience's previous experiences? - perhaps someone exposed to a lot of jazz is more likely to perform the integration with the performer being slightly before or after the music? Then, if we have a dance critic who is always watching certain styles, he or she will see the same timing when watching other styles, even if this timing is not there? Of course, this only applies if the distance is large enough so the distance estimation is only approximate. I am not actually sure if the audio-visual temporal integration takes the actual distance into account or not. Probably it does, if it helps to do the integration, - and it should help.


I have heard that after many years in the tango subculture in the U.S., one of the most satisfying experiences is being a D.J. at a large tango festival. As I recall, this person explained what you are trying to achieve: to play such music so you can see the whole room moving together, as one, stopping as one at some moments, moving smoothly at other moments, and sharply at other moments, sensing, picking up from and sharing the interpretation of the music with each other. I am still not quite sure how to see the whole room in this way. It is possible that as the room harmonizes and becomes more of a unity, it becomes easier to see the room as such. In other words, when everyone is moving together, you notice it, but when everyone is doing their thing, you just cannot take the whole room in, you just see that there is chaos.

It would be interesting to hear from a D.J., not necessarily one specializing in tango music, what is it like to apply the Eyebody principles to his or her work.





Audiovisual sensory integration

I am watching the cars pass by, and I hear the sound, and I (now) understand how it relates to the car's movement. I hear a person talking, see the movement of the lips, and I perceive the connection. It seems at possible to learn lipreading, that is, understanding speech by visually interpreting the movements of the lips, face, and tongue. Before I had always noticed, how unrelated those movements were to the words actually uttered. This became not exactly so after my work with a speech therapist to improve my English pronunciation, and I think that after that I learned to connect the sound of English and the look of an English-speaking person much better. Hence, I could improve my English pronunciation, because I would sometimes habitually hear some English sound in a Russian way, yet the facial expression of the speaker would tell me I was wrong, inhibiting my habitual way of language perception.

However, right now it strikes me, how stronger is my connection of the look of a speaking person with the sound. I see a group of people walking in the street, and I hear the sound of their steps, particularly as they walk on different surfaces. I notice that I had hardly ever made such connections. I turn away and still hear their steps, and their steps stand out from the overall sound background. The sounds of cars start to stand out too, and as I keep watching them, I start to sense how the sounds of cars tell me more about their direction, the distance to them. I see a woman walk in high heels, I hear the sound, and I start to hear this sound and to discern it from the rest. As I keep walking down the street, the world of sounds transforms, and now I understand much more, which sound means what. Why does it happen only now, even though hearing had probably been the most acute of my senses for my whole life?

I have always categorized myself as a person with predominantly audial perception of the world, as opposed to visual or kinesthetic. This included sensitivity to noise as well as sensitivity to beautiful music. However artificial is the distinction between different learning styles, I have always been able to listen to an explanation of something complicated and understand the meaning, and memorize what I was told, sometimes memorizing some sentences exactly as they were. (However, I have always been able to read very quickly - I never tried to fix the gaze, but instead scanned the page almost diagonally, taking in groups of several words each and converting those groups directly into meaning. When I was about 8, we has to read a read aloud test with reading a passage aloud and trying to get as many words as possible in a given segment of time. I did very well.)


Why is it that I did not allow my sense of sound to tell me about things around me, about the geometry of the space around me, about the movement of people and objects around me? I suspect that the sense of vision is, in some sense, primary to other senses, and as we are learning about the world and creating new concepts, we tend to ground those concepts in vision. Therefore, when other senses contradict the vision, the vision dominates, however, misleading or imperfect. If my explanation it correct, it should support the empirical findings of Peter Grunwald, the creator of the Eyebody method, that harmonizing the visual system often has profound impact on all aspects on a person's being: physical, emotional, mental, and spiritual. Seeing is believing, and if we don't see well or correctly, we don't believe. Even if all other senses could come together and provide a coherent picture, perhaps even more useful than the one that we see, this will not happen as long as the person can see anything at all.

Vision often defines our whole way of thinking, if not our whole way of being. I remember when I was first reading the mentioned Quine's "Word and object", I found it interesting, if not peculiar, that according to him, the world consisted of objects: desks, apples, umbrellas, even people. It had never occurred to me prior to that to divide the world into objects. However, after I first gained stereopsis, on that night when I was playing with a ball, it immediately became clear to me that, indeed, the world consisted of objects. Those objects were very well separated in space, their boundaries were well-defined, and the object that I was looking at was highlighted. The brain or the mind, it seems, really likes to create those sensory unities such as a desk, an apple, so we can do something with them - use, eat, talk to. Vision is most suitable for dividing everything into objects. When my vision was not dividing things into objects, my sense of hearing was not dividing the totality of perceived sounds into sounds coming from various causes or objects. I guess, this may also be a good thing...