Augmented Reality. Why the IETF Should Care"

Augmented Reality
 Why the IETF Should Care" •  Prepare the “ground” for discussion with some terminology and frameworks –  Define AR –  Use Case C...
Author: Jonah Richard
2 downloads 0 Views 9MB Size
Augmented Reality


Why the IETF Should Care"

•  Prepare the “ground” for discussion with some terminology and frameworks –  Define AR –  Use Case Categories –  Standards activities

•  Provide some parameters that could be relevant to IETF

PEREY Research & Consulting

This Session will"

•  Recommend that AR use cases be part (or the focus of) future IETF work March 3, 2014

2

Mont  Blanc  

Geneva  

Lake  Geneva  

Overl

ay

  Mim(oTebxit,   ag l e dgreavphiciecss,     e,       3D  ob j witehcts)  

Arriving  in   Montreux  in   15  min  

  seonns  tohe   real  w rs   o

rld  

camera,  GPS,  compass,   accelerometer,  microphone  

March 3, 2014

PEREY Research & Consulting

The User is the Point

Devices   4

User’s Multi-Modal Context Sounds     Touch  

Geo-­‐   SpaHal  

Smell  

 

Vision    

PEREY Research & Consulting

Taste  

Devices   5

AR Enhances User Experiences Sounds     Touch  

Geo-­‐   SpaHal  

Smell  

 

Infra-­‐   structure  

Vision    

Content  

Devices  

PEREY Research & Consulting

Taste  

User’s perception of reality altered using digital assets 6 synchronized with reality

Tissot Watch campaign on High Street in GQ and T3 http://www.youtube.com/watch?v=sM70yME1OLk&

Hostage Wear http://site.layar.com/company/blog/layer-of-the-weekshop-till-you-drop-in-the-new-hostage-virtual-shoppinglayer

Adidas Neighborhood http://www.adidas.com/campaigns/originals_ss10/content/microsites/neighborhood/default.aspx

March 3, 2014

PEREY Research & Consulting

Retail Shopper

7

DNP Japan http://augmentedblog.wordpress.com/2010/04/09/metaioand-dnp-japan-develop-first-augmented-reality-iphoneapp-for-the-collectible-card-market/

Sosro (Indonesia)

PEREY Research & Consulting

Entertainment/Game Applications

Acrossair Virus killer 360 http://www.youtube.com/watch?v=qssUKAVN2kI Coke Zero and Avatar http://www.youtube.com/watch?v=APQ2OxgCNzE 8 March 3, 2014

PEREY Research & Consulting

Overcoming barriers due to vision or language

http://opcoders.com/#colorblind-vision

March 3, 2014

http://www.questvisual.com/us

9

PEREY Research & Consulting

Medical/Healthcare

http://www.readwriteweb.com/archives/ how_augmented_reality_helps_doctors_save_lives.p hp

March 3, 2014

Above, operating room with the MAGI system. Below, enhanced view perceived by the surgeon with overlaid virtual anatomical structure in blue. Source: Edwards et al. Guy’s Hospital, London

10

Novartis campus and the river Urban Design and Planning Department of Basel-Stadt and LifeClipper project http://www.lifeclipper.net/EN/general2.html

PEREY Research & Consulting

Design/Architecture

iLiving application for furniture http://www.metaio.com/iliving/ http://www.youtube.com/watch?v=pM_tXqH-vVM

March 3, 2014

11

Emergency response systems: •  fire fighting •  police •  natural disaster recovery

Public utilities (energy, water) using AR to aid with infrastructure deployment and maintenance

PEREY Research & Consulting

Public Sector

Bay Area Rapid Transit and metaio Many others (e.g., Tokyo, Portland’s Transit Agency)

March 3, 2014

12

PEREY Research & Consulting

AR-assisted Service

Mitsubishi Electric MeView https://www.youtube.com/watch?v=iz4ykMn3UR4

March 3, 2014

Slide 13

Three Categories of AR Use Cases

•  Simplest •  Largest

Publish •  AR married with Web 2.0 tools •  aka “Social AR”

March 3, 2014

Collaborate •  Complex •  Future of games

PEREY Research & Consulting

Guide

14

•  System leads the user through a path or process in step-by-step (sequential) manner

March 3, 2014

PEREY Research & Consulting

The “Guide” Use Cases

15

•  System furnishes the user the ability to attach or introduce (annotate) personal digital data in association with people, places and things in the real world

March 3, 2014

PEREY Research & Consulting

The “Publish” Use Cases

16

•  System permits two or more people to interact with one another at a distance and some digital data in the real world in real time

https://www.youtube.com/watch?v=X-GXO_urMow (6min 30 sec)"

March 3, 2014

PEREY Research & Consulting

The “Collaborate” Use Cases

17

Key Mobile AR Enablers –  Sensors –  Compute power (devices) –  High speed networks

•  Cloud and content management systems •  Personal and shared display technology

PEREY Research & Consulting

•  Low cost, high performance, low power

•  Mobile application distribution platform (aka “the AppStore”) March 3, 2014

18

•  Multi-core CPU smartphones with GPU acceleration are capable of •  Tracking physical world in 3D •  Rendering 3D digital assets in real time

•  Problems remain with –  Sensor quality, stability, reliability –  Interference of natural world with sensors –  User interaction –  Power consumption (battery life) –  Thermal threshold March 3, 2014

PEREY Research & Consulting

Mobile Handsets for AR

19

Device + Network Requirement: Capture the Physical World –  10 Standards Development Organizations participating >250 people

PEREY Research & Consulting

The numbers

All resources are on the portal http://www.arstandards.org March 3, 2014

32

X3D X3Dom Mobile software interfaces Graphics Representation Virtual Worlds 3D

Browser Standards Networking Software Architectures

Acceleration APIs Sensor APIs 3D Data Formats

Location/Geospatial SensorWeb POI

Content Publishers Libraries Discovery

Mobile Hardware Interfaces

3 3

PEREY Research & Consulting

X3D X3Dom

Network Protocols

Mobile software interfaces Graphics Representation Virtual Worlds 3D

Automotive Aviation

Browser Standards

Healthcare

Networking Software Architectures

Acceleration APIs Sensor APIs 3D Data Formats

Location/Geospatial SensorWeb POI

Display Technologies Metadata for Digital Objects Mobile Device Radios and Com

March 3, 2014

Construction

PEREY Research & Consulting

Embedded Vision Algorithms

Building Management

Content Publishers Libraries Discovery

Mobile Hardware Interfaces

34

National Standards Organizations

PEREY Research & Consulting

34

•  IEEE SA is developing assets for market education and awareness programs •  IEEE SA seeks, where applicable, to engage with IETF to increase the support for AR in existing and future standards •  IEEE SA is leading AR awareness across IEEE societies and members

March 3, 2014

PEREY Research & Consulting

IEEE SA Role in Augmented Reality

Slide 35

IEEE SA Emerging Technologies –  Information about how IEEE specifications can advance AR –  Domain specific uses for AR

•  Organize –  Information and demonstration events –  Community and expert discussions

March 3, 2014

PEREY Research & Consulting

•  Will publish

Slide 36

Proposals –  Evaluate where IETF may add value –  Mobile AR use cases in future work

•  Collaborate with the AR Community and AREA –  Obtain and develop specifications that will meet mobile AR requirements

March 3, 2014

PEREY Research & Consulting

•  Explore

37

Christine Perey [email protected] +41 79 436 6869 @cperey