3D INTERACTION: REAR-SCREEN AND 3D VISUAL CUES

3D INTERACTION: REAR-SCREEN AND 3D VISUAL CUES Yang Li Prof. Shih-Chung Kang Department of Civil Engineering +2 Laboratory Research @ NTU

Spatial Metaphor Reducing: Natural User Interface (Metaphor-Free Computing)

Augmented Reality (AR)

Virtual Reality (VR)

HoloDesk & SpaceTop: See-through Display + Leap Motion

SpaceTop

HoloDesk

Virtual

Real

QUESTION: How to enhance interactive experience with ordinary PC?

Motion Sensor, Hand Simulation and 3D Vision

Front-Screen Interaction

Rear-Screen Interaction

Spatial Map & Working Memory ● Hippocampus plays important roles in the consolidation of information from short-term memory to long-term memory and spatial navigation. ● Visual Materials ○ Spatial ○ Nonspatial ● Working Memory ○ Capacity: “chunks” ○ The “magical number seven” (Miller, 1956)

Inference: Reducing Metaphors à Reducing working memory chunks (節約 認知資源) à Enhance spatial memory performance.

2D Visual Cues of Perceiving Depth ● Pictorial Depth ○ ○ ○

Occlusion Perspective Relative Size

● Kinesthetic Depth ○ ○

Relative motion parallax Motion perspective

3D Visual Cues of Perceiving Depth â—? Binocular Disparity

Software Setup ● ●

● ● ●

Set perspective environment Add 3D vision (3D glasses) Enrich scenarios

3dsMax Unity

Physical Setup

Red-Blue Glasses

Leap Motion Controller Laptop

Experiment Design

Scene 1

Scene 2

Experiment Design Condition

Interactive Space Front

1

Rear

● 20 Participants ● Design:

3D Glasses With

V

Without

V

2

V

3

V

V V

○ ○

Within-Subjects Two scenes for each condition

● Measure: ○ ○

Overall grabbing time of placing objects in order Aggregation of Depth

Discussion ● Other factors ○ ○ ○ ○

Eye-object(target) distance Occlusion Operation Difficulty Individual Differences

● For Future Research ○ ○

Use multiple gestures DNP HoloScreen

Thanks