Augmented Reality & HCI

AUGMENTED REALITY & HCI‐KINECT HUMAN COMPUTER INTERACTION AUGMENTED REALITY BARCELONA ‐ MEETUP‐03 2013‐december‐12 La Salle Campus Barcelona

03

ISIDRO NAVARRO AR & VR - Architect

By ISIDRO NAVARRO

INTRODUCTION #meetupARHCI

Augmented Reality & HCI‐KINECT

• Introduction – ‘Augmented Reality Barcelona’ – Blogs, Communities and Groups

• • • • •

HCI Research Industry Applications Related Themes

AUGMENTED REALITY BARCELONA

2

By ISIDRO NAVARRO

INTRODUCTION

Augmented Reality Barcelona Who we are? ...more than 110 members from more than 35 entities La Salle, LAYAR, Catchoom, Engidia, INAR, Tetravol, Mitjans Digitals, T‐Systems, Alt64, Bienetec, Aumentaty, Namastech, MKTCultural, Augmate, BOC, Ltc&group, EspiRA, Funky Whale Games, BeMyApp, FoolHead Studio, FEZOO, TEF, Medialab Barcelona, PANGEA Reality, Iris Control Systems, Mobile World Center, Innovae Vision, UPC, Aumentasolutions, AR Dirt Podcast, Doubleyou, Amplified Robot, Merchlar, Boston Scientific, Einnova, AR Standards, ENTI,…

AUGMENTED REALITY BARCELONA

3

#meetupARHCI

Augmented Reality & HCI‐KINECT

Augmented Reality & HCI‐KINECT

By ISIDRO NAVARRO

INTRODUCTION #meetupARHCI

BLOGS & PEOPLE http://www.ardirt.com http://augmentedpixels.com/blog/ http://augmentation.wordpress.com http://augmentedblog.wordpress.com http://www.augmented.org/blog http://www.augmentedlegality.com http://gamesalfresco.com http://medicalaugmentedreality.com http://augmentedrealityoverview.blogspot.com

AUGMENTED REALITY BARCELONA

4

Augmented Reality & HCI‐KINECT

By ISIDRO NAVARRO

INTRODUCTION

AUGMENTED REALITY BARCELONA

#meetupARHCI

COMMUNITIES in Google+

5

Augmented Reality & HCI‐KINECT

By ISIDRO NAVARRO

INTRODUCTION #meetupARHCI

GROUPS in Linkedin Mobile Augmented Reality (3500+) AR Glasses (2700+) Immersive 3D Environments & Augmented Reality (1000+) Geospatial Augmented Reality (400+) Layar Reality Browser (400+) AR‐UX : Augmented Reality User Experience (250+) ARE: Augmented Reality Educators (50+) La Salle AR (40+)

AUGMENTED REALITY BARCELONA

6

By ISIDRO NAVARRO

INTRODUCTION

AR market studies Virtual Reality & Augmented Reality Market worth 1.06 Billion by 2018 “Virtual Reality & Augmented Reality Market – By Technology (Mobile & Spatial AR, Semi & Fully Immersive VR); By Sensors & Components (Accelerometer, Data Glove, HMD, ICs); By Applications (Medical, Military, Gaming), By Geography (2013 – 2018) ”, published by MarketsandMarkets

WEB

AUGMENTED REALITY BARCELONA

7

#meetupARHCI

Augmented Reality & HCI‐KINECT

Augmented Reality & HCI‐KINECT

HUMAN COMPUTER INTERACTION

CONCEPT

#meetupARHCI

By ISIDRO NAVARRO

Human‐Computer Interaction (HCI) is a discipline concerned with the design, evaluation and implementation of interactive computing systems for human use and with the study of major phenomena surrounding them.

1992, SIGCHI Curriculum Development Group

AUGMENTED REALITY BARCELONA

8

Augmented Reality & HCI‐KINECT

SIXTHSENSE ‐ MIT Media Lab

Haptic System 'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. Author: Pranav Mistry

WEB

VIDEO

AUGMENTED REALITY BARCELONA

9

#meetupARHCI

RESEARCH

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

OCULUS RIFT & Motion Capture System This projects details a stereo camera rig that I've built for the Oculus Rift, and showcases a series of augmented reality demonstrations. The video also covers a method to use the Rift wirelessly (Virtual Environments and Computer Graphics group at University College London) Author: William Steptoe

WEB

VIDEO

AUGMENTED REALITY BARCELONA

10

#meetupARHCI

RESEARCH

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

SANDBOX – KeckCAVES

Science education, Keck Foundation, California The sandbox is equipped with a Kinect 3D camera and a projector to project a real‐time colored topographic map with contour lines onto the sand surface.

The sandbox lets virtual water flow over the surface using a GPU‐based simulation of the Saint‐Venant set of shallow water equations.

Authors: Oliver Kreylos, Buraz Yikilmaz & Peter Gold from KeckCAVES

VIDEO

WEB

AUGMENTED REALITY BARCELONA

11

#meetupARHCI

RESEARCH

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

RESEARCH

By ISIDRO NAVARRO

#meetupARHCI

REALITY EDITOR ‐ MIT Media Lab

Internet Of Things The Reality Editor is a system that supports editing the behavior and interfaces of socalled “smarter objects”, i.e. objects or devices that have an embedded processor and communication capability. Author: Valentin Heun

WEB

VIDEO

AUGMENTED REALITY BARCELONA

12

By ISIDRO NAVARRO

RESEARCH

Gestural Interface for Remote Spatial Perception Wearable device GIST helps the blind ‘see’ what’s around them.

Authors: Vinitha Khambadkar and Eelke Folmer are computer scientists from the University of Nevada

WEB

VIDEO

AUGMENTED REALITY BARCELONA

13

#meetupARHCI

Augmented Reality & HCI‐KINECT

Augmented Reality & HCI‐KINECT

Kinect Sign Language Translator – Microsoft Research The prototype system understands the gestures of sign language It displays the signer and renders a written and spoken translation of the sign language in real‐time, and it also takes the non‐signer's spoken words and turns them into accurate, understandable sign language.

Author: Xilin Cen, Professor, Chinese Academy of Sciences

WEB

VIDEO

AUGMENTED REALITY BARCELONA

14

#meetupARHCI

RESEARCH

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

RESEARCH

By ISIDRO NAVARRO

#meetupARHCI

inFORM – MIT

Dynamic Shape Display inFORM can render 3D content physically, so users can interact with digital information in a tangible way. It also interact with the physical world around it, for example moving objects on the table's surface. Remote participants in a video conference can be displayed physically, allowing for a strong sense of presence and the ability to interact physically at a distance.

Authors: Daniel Leithinger, Sean Follmer & Hiroshi Ishii from MIT VIDEO

AUGMENTED REALITY BARCELONA

WEB

15

Augmented Reality & HCI‐KINECT

PRIMESENSE labs SMART TERRAIN Apps powered by Vuforia can now enable users to create their own play space and interact with the physical world in ways not experienced before by enabling game physics to apply to real world surfaces and objects.

WEB

VIDEO

AUGMENTED REALITY BARCELONA

16

#meetupARHCI

INDUSTRY

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

OMEK OMEK BECKON & GRASP Omek Beckon and Grasp are a full‐featured set of middleware and tools that enables you to quickly and efficiently deploy full‐body and hands gesture and tracking interfaces in your applications and devices, for operation at ranges from 1.5 to 3.5 meters and 10 cm.

VIDEO

WEB

AUGMENTED REALITY BARCELONA

17

#meetupARHCI

INDUSTRY

By ISIDRO NAVARRO

By ISIDRO NAVARRO

INDUSTRY

XBOX ONE – Microsoft

Kinect‐Game The console includes a newly upgraded Kinect motion sensing peripheral.

New features such as a built‐in Skype client for videoconferencing, user recognition and tracking, and the ability to use voice commands and gestures to navigate the console's user interface.

VIDEO

AUGMENTED REALITY BARCELONA

18

#meetupARHCI

Augmented Reality & HCI‐KINECT

By ISIDRO NAVARRO

INDUSTRY

PLAYGROUND – Playstation 4 Player interaction for immersive gaming.

The Playroom, an alternate reality game that comes pre‐loaded on PlayStation 4 projects the miniature machines into players' living rooms.

Using the PlayStation Camera, players can interact with them, kicking, flicking, and cradling them as they frolic and cower.

VIDEO

AUGMENTED REALITY BARCELONA

19

#meetupARHCI

Augmented Reality & HCI‐KINECT

By ISIDRO NAVARRO

INDUSTRY

RAZER HYDRA – Sixense Entertainment

Magnetic motion sensing It uses a weak magnetic field to detect the absolute position and orientation of the controllers with a precision, as stated by its developers, of 1 mm and 1°; it has six degrees of freedom. The current release is wired, but a wireless version is in development.

VIDEO

AUGMENTED REALITY BARCELONA

20

#meetupARHCI

Augmented Reality & HCI‐KINECT

By ISIDRO NAVARRO

INDUSTRY

REACTIVE GRIP – Tactical Haptics

Friction controller Reactive Grip touch feedback works by mimicking the friction and shear forces that we feel in the real world when holding an object or touching a surface. This is accomplished by measuring the movements of the player’s hand and actuating small sliding plates in the grip of the controller to recreate the friction and shear forces you expect

VIDEO

AUGMENTED REALITY BARCELONA

21

#meetupARHCI

Augmented Reality & HCI‐KINECT

Augmented Reality & HCI‐KINECT

STREET MARKETING ‐ Appshaker Interaction in public spaces for street marketing.

Projects using augmented reality, motion/body tracking and gesture control.

WEB

VIDEO

AUGMENTED REALITY BARCELONA

22

#meetupARHCI

APPLICATIONS

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

LEAP MOTION & Kinect The Leap Motion controller senses how users moves their hands over the device.

Author: Yhosinaga Takashi

WEB

VIDEO

AUGMENTED REALITY BARCELONA

23

#meetupARHCI

APPLICATIONS

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

IRIS – Hybe Interactive mirror with Arduino and Kinect RIS is a media canvas with matrix of conventional information display technology ‐ a monochrome LCD. Through the phased opening and closing of circular‐segmented black Liquid Crystal, IRIS can create various patterns and control the amount (size) of passing lights. Seoul Art Space_Geumcheon, KOREA

VIDEO

AUGMENTED REALITY BARCELONA

24

#meetupARHCI

RELATED THEMES

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

EYEBORG – Cyborg Foundation Eyeborg is a cybernetic eye that allows you to hear colours from infrared to ultraviolet.

The current eye is based on a chip that transmits sounds via bone conduction.

Author: Neil Harbisson

WEB

VIDEO

AUGMENTED REALITY BARCELONA

25

#meetupARHCI

RELATED THEMES

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

EPOC nuroheadset ‐ EMOTIV EMOTIV + KINECT CONTROLLED ROBOT The Microsoft Kinect RGB‐Depth camera overlays the floor in relation to the robot's position and orientation. The user selects a location on the floor with the mouse by moving his head.

WEB

VIDEO

AUGMENTED REALITY BARCELONA

26

#meetupARHCI

RELATED THEMES

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

RELATED THEMES

By ISIDRO NAVARRO

#meetupARHCI

OLIMPIC CHANGES Contest for the best idea of projects about the olimpic winter games in Rusia.

People interacts with the tickets machine to get it for free while they do sport.

WEB

VIDEO

AUGMENTED REALITY BARCELONA

27

Augmented Reality & HCI‐KINECT

NEUROCAM – Neurowear Wearable camera system that detects your emotions.

It automatically records moments of interest based on an analysis of the users brainwaves..

Author: Mitsukura, professor of Keio University

WEB

VIDEO

AUGMENTED REALITY BARCELONA

28

#meetupARHCI

RELATED THEMES

By ISIDRO NAVARRO

Augmented Reality & HCI‐KINECT

RELATED THEMES

By ISIDRO NAVARRO

#meetupARHCI

SHIPPO – Neurowear & Kiluck Neuro tagging map – Wearable device registers your emotions and tag the map for sharing in social apps.

WEB

VIDEO

AUGMENTED REALITY BARCELONA

29

Augmented Reality & HCI‐KINECT #meetupARHCI

By ISIDRO NAVARRO

ISIDRO NAVARRO LinkedIn Youtube Slideshare Google+ Twitter Facebook Scholar Meetup

AUGMENTED REALITY BARCELONA

30