the
AUGMENTED BODY STUDENT: GIUSEPPE D’ALESSANDRO R.N.: P/16 DRAWING TECHNIQUES CLASS 2016 TEACHER: PROF. ARCH. ALESSANDRA PAGLIANO
360° VIDEOMAPPING BY RABARAMA
WHY THE BODY? -
Body can be an interesting surface to be mapped. In addiction to being the way we express ourselves through gestures and movements, it is the medium between our thoughts and the space, seen as a complex system of sensory stimuluses, that surround us. Videomapping can be an useful technology to imagine our body as a canvas, but also to imagine our body that changes the spacial concrete certainties around it.
INK MAPPING OSKAR & GASPAR
HISTORY -
In 1950 Bruno Munari was one of the first to draw with lights, with his “Proiezioni Dirette”, an installation of video projection with the most disparate materials (coloured plastic pieces, plumage, cutted paper) inside two slides of glass. Everyone could interact with the projection and with the film, like a game.
2012 - APPLICATION OF THE MUNARI’S METHOD INTO SCHOOLS
HISTORY -
In the 1960s the technique was referred to as video mapping, spatial augmented reality, or shader lamps. In 1966 James Turrel, leased an abandoned hotel, in which he projected his “Cross Corner Projection”, with metal sheets that created, in the corner of the rooms, the illusion of suspending solids of light. J. TURRELL - FIGURE D 1967
J. TURRELL - “SHANTA II” BLUE 1970
HISTORY One of the first public displays of projections onto 3D objects was debuted in 1969, when Disneyland opened their Haunted Mansion ride. The ride used fake disembodied heads as objects which had 16mm film projected onto them to make them appear animated. Videomapping was used in the Haunted Mansion upon “sacred” portraits too.
Thank to the constant movement of the rails of the carousel, the projection fits with the passenger’s seat giving the illusion, in the mirror, to have a ghost sitting next to you.
HISTORY The next projection mapping instance comes in 1980, with the immersive film installation Displacements by Michael Naimark. In this art installation a living room with two performers were filmed with a rotating camera, then the camera was replaced with a projector. The result is rotating projection mapping.
RECORDING SESSION
PROJECTION SESSION
In 1995, Michael Naimark recorded variuos cities around the world, creating the first 360째 interactive video.
HISTORY Disney not only pioneered the technology of projection mapping, they also have the earliest patent in the space, in 1991. Entitled “Apparatus and method for projection upon a three-dimensional object“. It essentially describes a system for digitally painting an image onto “a countoured, three-dimensional object.”
HISTORY Ramesh Raskar is a Massachusetts Institute of Technology Associate Professor and head of the MIT Media Lab's Camera Culture research group. In 1998 he recorded “Shader Lamps: Animating Real Objects With Image Based Illumination” on static objects. In 2010 he drew upon movable 3d object in “Dynamic Shader Lamps”. Before in 2009, at the UNC Chapel Hill (University of North Carolina) he introduced a new approach for robotic avatars of real people: the use of cameras and projectors to capture and map the dynamic motion and appearance of a real person onto a humanoid animatronic model.
2011 DYNAMIC SHADER LAMPS BY R.RASKAR
2009 ANIMATRONIC SHADER LAMPS BY R.RASKAR
1998 SHADER LAMPS BY R.RASKAR
INTERACTION ADAPTATION -
Thanks to motion capture we can map the relationship between human body and space in real time. The body changes the projection, and the projection stimulates the body.
This kind of performance gives the opportunity to variuos artists to intervene concurrently in one single stage.
2012 - THE MIDAS PROJECT - MIDAS #1
ADAPTATION -
Hakanai is a dancing performance by Adrien Mondot & Claire Bardainne in which body’s movement generates structured visual design.
2013 - HAKANAI DE ADRIEN M / CLAIRE B | TEMPS D'IMAGES
2014 - PIXEL DE ADRIEN M / CLAIRE B
PLAYING AND DRAWING -
2011, Turin. For the opening of Nike’s new store in Turin, ToDo projected on the baroque facade of a building in one of the city’s historical squares. An electronic music machine, open to all who felt like getting into the game, stepping up to the control platform, and letting a Kinect-equipped station sense their body’s contour and movements. Interactivity was literally in their hands, as they discovered the power to turn windows on and off with a mere touch, revealing musical notes and samples that combined into ever-changing audio loops.
2011 - LASER GRAFFITI IN IRELAND
Laser graffiti can be an interactive, instant, creative and social way to draw upon architecture without intervene on the buildings with aggressive materials. In 2011 Vodafone Ireland armed some of Ireland’s leading street artists with laser graffiti technology to create events where public could join in.
SCULPTURE -
Sculptures give us the opportunity to map a static body and project a “moving soul” upon it. When the artist of the statue carved the stone he had to fix that moment in a single shape, but through augmented reality those statues can wink to us. In the GOLEM project we can see statues come back to life, as a time expansion of that fixed moment. 2015 GOLEM X APOLLO
2016 GOLEM X MBA
2016 GOLEM X MBA
MASKS OF FUTURE -
THE
GUILLEM CASTELLVI F A C E PROJECTION MAPPING WITH KAT VON D
22nd October 2015: first-ever real-time face tracking and projection mapping performed at a live event, on stage. All images recorded live, No post-production added. A live / real-time face projection mapping event where 3D rendered images were projected over Kat Von D’s face, following accurately her movements. Custom software and a high-end tracking system were used to track her body movements and adapt the projection content in real-time to her torso, neck and face. OMOTE / RE AL-TIME F A C E TRACKING & PROJECTION MAPPING
One year ago Nobumichi Asai first projected, onto the mapped face of the model, reflexions of the environment.
AUGMENTED SKIN -
2015 - The first live event of Tattoo Video Mapping. No post-production was used. Created and Produced by Oskar & Gaspar. movements. Custom software and a high-end tracking system were used to track body movements and adapt the projection content in real-time to body’s parts. INK MAPPING OSKAR & GASPAR
C I C R E T PROJECTOR BRACELET
In a nutshell, the Cicret Projector Bracelet is a smart bracelet that can actually “project” a smartphone onto your wrist.Designed to look like a fitness band, the Cicret Projector Bracelet houses a little pico projector along with a row of proximity sensors.
THE FUTURE IS IN THE AIR -
The idea of abandoning surfaces and project directly in the air is now closer to be realized. The Hungarian-British physicist Dennis Gabor was awarded the Nobel Prize in Physics in 1971 "for his invention and development of the holographic method". His work, done in the late 1940s, is still evolving in new ways of mapping and projecting useful technology.
A SCENE FROM THE 2013 MOVIE “HER”
2016 - AUTODESK “TACTUM” PERCEIVE LIGHT AND MOVEMENT TO CREATE MESHES
2016 - MICROSOFT HOLOLENS IS STILL DEVELOPING
LINKS -
8 PROJECTION-MAPPED PERFORMANCES THAT HAVE US DANCING WITH OUR COMPUTERS http://thecreatorsproject.vice.com/blog/8-projection-mappped-performances-that-have-us-dancing-with -our-computers MESH - THE FRAGILITY OF PRIVATE SPACE https://fedora.phaidra.bibliothek.uni-ak.ac.at/fedora/get/o:6677/bdef:Content/get http://www.munart.org/index.php?p=15