Augmented Reality
Why the IETF Should Care"
• Prepare the “ground” for discussion with some terminology and frameworks – Define AR – Use Case Categories – Standards activities
• Provide some parameters that could be relevant to IETF
PEREY Research & Consulting
This Session will"
• Recommend that AR use cases be part (or the focus of) future IETF work March 3, 2014
2
Mont Blanc
Geneva
Lake Geneva
Overl
ay
Mim(oTebxit, ag l e dgreavphiciecss, e, 3D ob j witehcts)
Arriving in Montreux in 15 min
seonns tohe real w rs o
rld
camera, GPS, compass, accelerometer, microphone
March 3, 2014
PEREY Research & Consulting
The User is the Point
Devices 4
User’s Multi-Modal Context Sounds Touch
Geo-‐ SpaHal
Smell
Vision
PEREY Research & Consulting
Taste
Devices 5
AR Enhances User Experiences Sounds Touch
Geo-‐ SpaHal
Smell
Infra-‐ structure
Vision
Content
Devices
PEREY Research & Consulting
Taste
User’s perception of reality altered using digital assets 6 synchronized with reality
Tissot Watch campaign on High Street in GQ and T3 http://www.youtube.com/watch?v=sM70yME1OLk&
Hostage Wear http://site.layar.com/company/blog/layer-of-the-weekshop-till-you-drop-in-the-new-hostage-virtual-shoppinglayer
Adidas Neighborhood http://www.adidas.com/campaigns/originals_ss10/content/microsites/neighborhood/default.aspx
March 3, 2014
PEREY Research & Consulting
Retail Shopper
7
DNP Japan http://augmentedblog.wordpress.com/2010/04/09/metaioand-dnp-japan-develop-first-augmented-reality-iphoneapp-for-the-collectible-card-market/
Sosro (Indonesia)
PEREY Research & Consulting
Entertainment/Game Applications
Acrossair Virus killer 360 http://www.youtube.com/watch?v=qssUKAVN2kI Coke Zero and Avatar http://www.youtube.com/watch?v=APQ2OxgCNzE 8 March 3, 2014
PEREY Research & Consulting
Overcoming barriers due to vision or language
http://opcoders.com/#colorblind-vision
March 3, 2014
http://www.questvisual.com/us
9
PEREY Research & Consulting
Medical/Healthcare
http://www.readwriteweb.com/archives/ how_augmented_reality_helps_doctors_save_lives.p hp
March 3, 2014
Above, operating room with the MAGI system. Below, enhanced view perceived by the surgeon with overlaid virtual anatomical structure in blue. Source: Edwards et al. Guy’s Hospital, London
10
Novartis campus and the river Urban Design and Planning Department of Basel-Stadt and LifeClipper project http://www.lifeclipper.net/EN/general2.html
PEREY Research & Consulting
Design/Architecture
iLiving application for furniture http://www.metaio.com/iliving/ http://www.youtube.com/watch?v=pM_tXqH-vVM
March 3, 2014
11
Emergency response systems: • fire fighting • police • natural disaster recovery
Public utilities (energy, water) using AR to aid with infrastructure deployment and maintenance
PEREY Research & Consulting
Public Sector
Bay Area Rapid Transit and metaio Many others (e.g., Tokyo, Portland’s Transit Agency)
March 3, 2014
12
PEREY Research & Consulting
AR-assisted Service
Mitsubishi Electric MeView https://www.youtube.com/watch?v=iz4ykMn3UR4
March 3, 2014
Slide 13
Three Categories of AR Use Cases
• Simplest • Largest
Publish • AR married with Web 2.0 tools • aka “Social AR”
March 3, 2014
Collaborate • Complex • Future of games
PEREY Research & Consulting
Guide
14
• System leads the user through a path or process in step-by-step (sequential) manner
March 3, 2014
PEREY Research & Consulting
The “Guide” Use Cases
15
• System furnishes the user the ability to attach or introduce (annotate) personal digital data in association with people, places and things in the real world
March 3, 2014
PEREY Research & Consulting
The “Publish” Use Cases
16
• System permits two or more people to interact with one another at a distance and some digital data in the real world in real time
https://www.youtube.com/watch?v=X-GXO_urMow (6min 30 sec)"
March 3, 2014
PEREY Research & Consulting
The “Collaborate” Use Cases
17
Key Mobile AR Enablers – Sensors – Compute power (devices) – High speed networks
• Cloud and content management systems • Personal and shared display technology
PEREY Research & Consulting
• Low cost, high performance, low power
• Mobile application distribution platform (aka “the AppStore”) March 3, 2014
18
• Multi-core CPU smartphones with GPU acceleration are capable of • Tracking physical world in 3D • Rendering 3D digital assets in real time
• Problems remain with – Sensor quality, stability, reliability – Interference of natural world with sensors – User interaction – Power consumption (battery life) – Thermal threshold March 3, 2014
PEREY Research & Consulting
Mobile Handsets for AR
19
Device + Network Requirement: Capture the Physical World – 10 Standards Development Organizations participating >250 people
PEREY Research & Consulting
The numbers
All resources are on the portal http://www.arstandards.org March 3, 2014
32
X3D X3Dom Mobile software interfaces Graphics Representation Virtual Worlds 3D
Browser Standards Networking Software Architectures
Acceleration APIs Sensor APIs 3D Data Formats
Location/Geospatial SensorWeb POI
Content Publishers Libraries Discovery
Mobile Hardware Interfaces
3 3
PEREY Research & Consulting
X3D X3Dom
Network Protocols
Mobile software interfaces Graphics Representation Virtual Worlds 3D
Automotive Aviation
Browser Standards
Healthcare
Networking Software Architectures
Acceleration APIs Sensor APIs 3D Data Formats
Location/Geospatial SensorWeb POI
Display Technologies Metadata for Digital Objects Mobile Device Radios and Com
March 3, 2014
Construction
PEREY Research & Consulting
Embedded Vision Algorithms
Building Management
Content Publishers Libraries Discovery
Mobile Hardware Interfaces
34
National Standards Organizations
PEREY Research & Consulting
34
• IEEE SA is developing assets for market education and awareness programs • IEEE SA seeks, where applicable, to engage with IETF to increase the support for AR in existing and future standards • IEEE SA is leading AR awareness across IEEE societies and members
March 3, 2014
PEREY Research & Consulting
IEEE SA Role in Augmented Reality
Slide 35
IEEE SA Emerging Technologies – Information about how IEEE specifications can advance AR – Domain specific uses for AR
• Organize – Information and demonstration events – Community and expert discussions
March 3, 2014
PEREY Research & Consulting
• Will publish
Slide 36
Proposals – Evaluate where IETF may add value – Mobile AR use cases in future work
• Collaborate with the AR Community and AREA – Obtain and develop specifications that will meet mobile AR requirements
March 3, 2014
PEREY Research & Consulting
• Explore
37
Christine Perey
[email protected] +41 79 436 6869 @cperey