Immersion and Motion

E3 is behind us and we safely say that this year's convention was dominated by two big elements: 3D and motion control. What is even more amazing is how PR and marketing decided to sell us those two things. The big buzzword was immersion. 3D and motion control will totally immerse you into the gaming experience and the gaming world.


I am not going to linger on 3D here. It's hard to judge something like this based solely on 2D images. Right now, I am more interested in the new motion control craze that is coming with Kinect and Move, but mostly the former. From what we know about our relationship with the current controllers and the Wii, how can we assume that the Kinect is going to help us be more immersed in games? What is more immersive, holding a controller or jumping in front of your television?


Two schools of thought basically go toes-to-toes here; on one side, the controller is a physical object that exists outside the boundaries of the games and it is anchoring you to the real world, but on the other, the controller is a tool that helps you take control of an avatar and puts you directly in control of the fiction. Depending on which side of the fence you are, you will see motion control in different lights.


"Traditional" motion control such as the Wii and the Playstation Move are controllers that also requires, most of the time, extra movement in the "real world" in order to control the game. Games such as Mario Galaxy requires you to waggle the Wiimote to spin Mario, and the Move will probably require that you point at the screen in order to kill something. So either you will see these extra "real world" movements as something that breaks the immersion even more, or something that helps you immerse yourself even more in the game by giving more faithful control over your avatar.


I think you can split immersion in games in two different categories: immersion in the narrative (the kind you could get watching a movie, reading a book, or playing a good narrative-driven game), and immersion in the system (feeling that you have full control over your avatar). What decides the level of immersion in both categories is mostly the game and what is the level of control the player has over his avatar.

A game like Heavy Rain will immerse the player in the narrative by creating interesting situations that will draw you inside the fiction and make you feel scared or happy for the characters. Narrative immersion can also be created by gameplay, although it will mostly capitalize on emergent narrative. A good example of this is Far Cry 2. You become immersed in the adventures of your avatar not because of your search for the Jackal, but because of the perils linked to your trip through a country that does not wants you.


Even though Heavy Rain lets you do a counter-clockwise quarter rotation of the thumb-stick to open a door, this movement has about as much to do with the real world as a counter-clockwise quarter rotation of the thumb-stick to throw a fireball from your fist. System immersion is present mostly in motion-controlled games. You will not be immersed in the narrative track of a Wii Sports boxing match (well, maybe the emergent narrative linked to punching your brother in the face), but you will be immersed in the system, the gameplay, as the movements you make in the real world will be mimicked in the game. You will feel you have full control over your avatar.

With Kinect, the game literally changes. The control is removed and replaced with more faithful body recognition. As they like to say at Microsoft: "Your body becomes the controller". What is the effect on immersion though?


I am not saying that narrative immersion will be impossible with Kinect, but system immersion will certainly be the focus for many game developers. We can now look back and see that with the Wii, games focusing on system immersion, such as party games, became third party developers’ genre of choice. Many of the game shown so far for Kinect also reflect that.


Narrative immersion also becomes harder to maintain when your whole body is the controller. If a plastic controller was anchoring you to the real world, Kinect will certainly do it even more so. In a movie theatre, you get immersed in the narrative because you are in a state of "over-perception and under-mobility"(French: sur-perception et sous-motricité). It basically means that the optimal conditions of a movie theatre will fill your field of vision with images and your ears with sounds but also keep you in your seat. When you play a game with a controller, you are still in a similar situation. You cannot move away from the television or else the action would stop, and your physical movement is limited to the movement of your fingers. Maybe it's not to the level of a movie theatre, but it certainly is close enough to watching a DVD.


With that in mind, games that would be played with Kinect (and to an extent those which uses the Wiimote and Move more actively) will rather put you in a state of "over-mobility". In that state, you become more self-aware of your presence as a player, as a controller. In that sense, you are fully immersed (Could we even say integrated?) into the system. You are in total control of your avatar. Narrative immersion, in turn, becomes harder to keep. The more complex the movements you have to do to interact with the virtual environment, the more aware you are that this whole thing is a game that you control.


It is not to say that developers who will choose to make full use of the Kinect's features won't be able to write deep, meaningful and interesting stories, it's just that I have an hard time imagining being moved by a story if I have to mimic a fight scene, or scream JASON at my television while walking around my living room. Games truly exist on multiple levels, and motion control integration is just another challenge that game developers will have to work with.