Escolar Documentos
Profissional Documentos
Cultura Documentos
Module IN 2018
Overview
Agenda
1. Introduction
2. Organizational Issues: Exercises
3.
4.
5.
6.
Applications
AR-Related Trends/Enablers
Research Issues
Requirements
Overview
1. Introduction
1.1 Motivation
1.2 Definition
1.3 Different Approaches
1.1 Motivation
1. Introduction
2005
1.1 Motivation
1. Introduction
1. Introduction
1.1 Motivation
2005
2010
Trend for AR
2011
2012
2013
2014
2015
http://www.gartner.com/newsroom/id/3114217
1. Introduction
1.1 Motivation
Annotated Mountains
(Wikitude 2008++)
http://www.youtube.com/watch?v=8EA8xlicmT8
http://www.youtube.com/watch?v=tpaJBu4BEuA
http://www.youtube.com/watch?v=7vfzkFfIK1U
Hotels Now!
(HRS, Layar 2009++)
www.hotels-now.de
1. Introduction
1.1 Motivation
AR at Kiosks in Lego Stores (metaio GmbH, 2003-2015)
AR in SZ Magazin (metaio)
GmbH)
http://www.youtube.com/watch?v=mUuVvY4c4-A
http://www.youtube.com/watch?v=YKN7G9X9pIU
1.1 Motivation
1. Introduction
Card Games
World of Warcraft
http://www.youtube.com/watch?v=UlH8Kv2fOzQ&feature=related
http://www.youtube.com/watch?v=eP4TjzUfOeU
1.1 Motivation
1. Introduction
http://www.youtube.com/watch?v=MIGH5WGMnbs
10
1. Introduction
1.1 Motivation
TUM: AR Master Praktikum, Bachelor or Master Theses
http://www.youtube.com/AugmentedRealityTUM
ARace 2010
fARm 2011
Towering Defense 2015
AR Paint 2011
Lord of Elements 2014
3DUIs 2010
Minions 2014
11
Overview
1. Introduction
1.1 Motivation
1.2 Definition
1.3 Different Approaches
12
1.2 Definition
1. Introduction
Real + virtual
Interactive in real-time
Registered in 3 Dimensions
[Azuma 98]
[ECRC 93]
13
1.2 Definition
History: First HMD by Ivan Sutherland (1968)
[Sutherland 68]
Ivan Sutherland: A Head-Mounted Three Dimensional Display. Proc. Of the Fall Joint Computer Conference, 1968, 354-356.
Ivan Sutherland: The Ultimate Display. Proc. Of the IFIP Congress, 1965, 505-508.
14
1. Introduction
Technology-Oriented Definition of AR
Provides users with computer information within their real
environment
Three-dimensional
Immersive
Interactive
In real-time
Mobile
15
1. Introduction
16
Real-Time
Distributed Systems
Wearable Devices
Wireless
Communication
Virtual World
(Computer network)
Real World
Information
Data security
Sensor data
AR-System
Manipulation
of Real
Objects
Dynamic Modelling
Multi-modal HCI
Dynamic Visualization
Simulation
Tracking
User
Ergonomics
Scene Analysis
Adaptation
17
Overview
1. Introduction
1.1 Motivation
1.2 Definition
1.3 Different Approaches
18
Head-based
On real surfaces
Hand-based
Multi-touch
Introduction to AR: Introduction and Overview
1. Introduction
Desktop-based
1.4 HMDs
AR-Rift
(Photo: Manuel Huber,
Frieder Panktratz)
Google Cardboard
(Photo: SLASH GEAR)
HTC VIVE
(Photo: ibtimes.co.uk)
20
1.4 HMDs
MagicLeap
(Photo: www.magicleap.com)
Microsoft HoloLens
(Photo: microsoft.com)
21
1.5 Sensors
Optical
Inertial
Radio-based
Acoustic
Mechanical
22
1. Introduction
MacWilliams, Sandor, Wagner, Bauer, Klinker, Brgge: Herding Sheep: Live System Development for Distributed Augmented Reality. ISMAR 2003,
Sandor, MacWilliams, Wagner, Bauer and Klinker: SHEEP: The Shared Environment Entertainment Pasture. Demo at ISMAR 2002, Darmstadt.
23
Human-Computer Interaction
1. Introduction
Physical World
User
Input
Device
Output
Device
This class
System
Signals System goals
System transfer function
Introduction to AR: Introduction and Overview
Virtual World
24
Overview
Agenda
1. Introduction
2. Organizational Issues: Exercises
1.
2.
3.
4.
Applications
AR-Related Trends/Enablers
Research Issues
Requirements
25
2. Organizational Issues
26
2. Organizational Issues
More than 260 Participants:
Informatik (Bachelor, Master)
Informatik: Games Engineering (Bachelor, Master)
Computational Science and Engineering (Master)
Wirtschaftsinformatik
ESPACE
Industrial Design
Robotics, Cognition, Intelligence (Master)
Biomedical Computing (Master)
Techn. U. Management BWL
Maschinenwesen; Ergonomie: Human Factors Engineering (Master)
Elektrotechnik und Informationstechnik
Mathematik
27
2. Organizational Issues
Content of this Course
Coordinate systems
Basic computer vision
Camera calibration
PTAM
Trackers
Kalman filters
Sensor fusion
OpenGL
Displays
Display calibration
AR-based user interfaces
Introduction to AR: Introduction and Overview
28
Overview
Agenda
1. Introduction
2. Organizational Issues: Exercises
3.
4.
5.
6.
Applications
AR-Related Trends/Enablers
Research Issues
Requirements
29
Mechanical Engineering
3. Applications
30
Mechanical Engineering
3. Applications
http://www.youtube.com/AugmentedRealityTUM
[IGD 97]
[ECRC 94]
31
3. Applications
32
Mechanical Engineering
3. Applications
33
3. Applications
Mechanical Engineering
Car maintenance on tablets
34
3. Applications
http://www.youtube.com/AugmentedRealityTUM
[IGD 97]
[IGD 97]
35
3. Applications
http://www.youtube.com/AugmentedRealityTUM
Project Acquisition
[IGD 97]
[IGD 97]
36
Marketing: 3D Projections
3. Applications
[Extend3D 2013]
Introduction to AR: Introduction and Overview
37
3. Applications
Education
http://ivanpoupyrev.com/e-library/2001/chi2001demo.pdf
Magic Book
Magic Book Projekt, Billinghurst et al 2001, HitLab Washington, US, and New Zealand, http://www.hitlabnz.org/
Introduction to AR: Introduction and Overview
38
Education
3. Applications
http://www.youtube.com/AugmentedRealityTUM
Problem:
Generally, more than two hands are required
to control the chemical process
Selection of a binding
Committing the action
39
3. Applications
Education
Illuminating Light, Tic Tac Toe
http://tangible.media.mit.edu/project/73
http://www.youtube.com/AugmentedRealityTUM
[IGD 97]
40
3. Applications
Games
http://www.youtube.com/watch?v=yNYfkxqiB6g
http://wearables.unisa.edu.au/projects/arquake/
[MR-Lab 99]
[UniSA 00]
41
3. Applications
Tourism
http://graphics.cs.columbia.edu/projects/mars/touring.html
MARS and Situated Documentaries projects: S. Feiner, T. Hllerer et al, Columbia University, NY, 1999
http://www1.cs.columbia.edu/graphics/projects/mars/
Introduction to AR: Introduction and Overview
42
3. Applications
Tourism
http://www.youtube.com/watch?v=DY26p9paxSY
http://www.youtube.com/watch?v=oDiFTIW5e5w
Pompeii
43
HCI in Cars
2. Applications
44
Virtual Studios
3. Applications
45
3. Applications
Medicine
46
Overview
Agenda
1. Introduction
2. Organizational Issues: Exercises
3.
4.
5.
6.
Applications
AR-Related Trends/Enablers
Research Issues
Requirements
47
4. AR-Related Trends/Enablers
Wireless Networks
Wearable/mobile Devices
Multi-media (sound & speech, video)
Virtual Reality (3D)
Tracking Systems (GPS, Kinect, leap motion, )
Tele-presence, Tele-manipulation
Tele-collaboration
Games
48
5. Research Issues
Sensor Analysis
Information Presentation
multi-modal interaction
Efficient Algorithms
distributed systems
Mobile Communication
real-time
Software Engineering
49
6. Requirements
Efficiency
Flexibility
Quality of Service in Networks
Load Balancing
Adaptive System Behavior
System Security (Datenschutz)
User Safety, Acceptance
50
Real-Time
Distributed Systems
Wearable Devices
Wireless
Communication
Virtual World
(Computer network)
Real World
Information
Data security
Sensor data
AR-System
Manipulation
of Real
Objects
Dynamic Modelling
Multi-modal HCI
Dynamic Visualization
Simulation
Tracking
User
Ergonomics
Scene Analysis
Adaptation
51
Thank you!
More Applications
2. Applications
http://www.youtube.com/AugmentedRealityTUM
Model Design
[IGD 97]
Introduction to AR: Introduction and Overview
54
Marketing: AR in Kiosks
55
2. Applications
Games
http://www.youtube.com/AugmentedRealityTUM
56
2. Applications
Games
Munich Hunt
57
HCI in Cars
2. Applications
http://www.youtube.com/AugmentedRealityTUM
Sensor Visualization
58
HCI in Cars
2. Applications
http://www.youtube.com/AugmentedRealityTUM
59
2. Applications
Medicine
Bone Surgery
[CMU 94]
Introduction to AR: Introduction and Overview
60
2. Applications
Medicine
Virtual Patient (Preparing for Catastrophic Events)
Nestler, Dollinger, Echtler and Klinker: Design and Development of Virtual Patients,, Gi AR/VR Workshop, Weimar, July. 2007.
61
2. Applications
Medicine
Triaging in Catastrophic Events
Nestler and Klinker: Using Mobile Handheld Computers in Disasters, UbiWell (workshop at UbiComp) Innsbruck, Sept. 2007.
62