Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Measuring People Using Mobile Technology, gy Analysing the Data Using Emerging GIS Web App Tools Prepared by: Bill Johnstone, Ph.D., P.Eng. Spatial Vision Group, Inc. North Vancouver, BC h February 18, 2015 www.spatialvisiongroup.com
Measuring People: da Vinci’s Vitruvian Man & Human‐Factors Engineering The Roman architect Vitruvius described the human figure as being the principal source of proportion among the Classical orders of architecture. Leonardo's drawing is traditionally named in honour of the architect. Source: Wiki
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
2
February 18, 2015 1
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Agenda Agenda 1. Measuring People Using Mobile Technology –
How can we measure the movements of people across their geography?: •
–
2.
Commute / Work / Shop / Health / Exercise / Lifestyle / Well being Commute / Work / Shop / Health / Exercise / Lifestyle / Well‐being
Group Discussion of Tracking Apps
Analysing the Tracks Data Using Simple Web GIS Tools –
How can we use emerging web‐GIS products to compile / display / analyse this information?
–
Group Discussion of Web Apps
Vancouver GIS User Group: 2015‐FEB‐18
3
Part 1
MEASURING PEOPLE USING MOBILE TECHNOLOGY Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
4
February 18, 2015 2
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Context: Internet of Things (IoT) “Industrial Internet”, “Embedded Technology”
• Built on the convergence of wireless, micro‐electromechanical systems ( (MEMS) and the Internet. ) • Objects / people / animals are provided with unique identifiers and the ability to transfer data over a network without requiring human‐to‐human or human‐to‐computer interaction (H2H, H2M, M2M).
Vancouver GIS User Group: 2015‐FEB‐18
5
Current World • Mobile measurement methods well established / many different domains: – Industrial/Utility & Natural Resources – Site surveys, Construction, Inspections, Maintenance
• Sensor webs gather real‐time data: – – – –
State of natural environment (weather, river flows, seismic) State of infrastructure/built environment (traffic, power demand, asset condition) Intersection cameras, Traffic cameras Shopping / Location‐Based Services
• Many private sector and government players act as data providers • API’s allow internal / external users to query/analyse this data
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
6
February 18, 2015 3
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Example of a Public Sensor Web: Translink Open API Regional Traffic Data System:
•
1. 2. – – – – –
Real‐Time traffic data / speed profiles Travel time by corridor and roadway segment Get Tile Get Live Data Timestamp Get All Live Data Get Live Data At Point Get Colour Legend
Return a map tile for provided position, show roadways Return date and time of last live data update Return real‐time data for all links (length, speed, travel time) Return real‐time data for the specified point Colour legend details
Real‐Time Transit Information:
•
1. 2. – – – – –
Provide services for Stops, Buses, Stop estimates and Route details. Return XML or JSON data Stops Stop Estimates Buses Routes Status
Stop identity, Location (lat/lon), City, At/On street, Distance, Routes, … Next Buses, NextBus, RouteNo, RouteName, Direction, … Vehicle ID, Location (lat/lon), RouteNo, Direction, … RouteNo Name OperatingCompany Patterns RouteNo, Name, OperatingCompany, Patterns, … Statuses, Name, Value
BusLink Runty Laboratories Inc.
Vancouver GIS User Group: 2015‐FEB‐18
7
Emerging: Middle World to New World Measurement “Middle World” technology for locating / position measurement
www gpscentral ca/products/handheldgpscomparison htm www.gpscentral.ca/products/handheldgpscomparison.htm
“New World” technology that can be used to measure people
LUKEW Ideation + Design | www.lukew.com Thx to A. Durnin – Dist NorthVan
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
8
February 18, 2015 4
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Everything from this 1991 RadioShack Ad You Can Now Do With Your Smartphone … and way more! and way more! • • • • • • • • • • • • •
All weather personal stereo AM/FM clock radio In‐Ear Stereo Phones Microthin calculator Tandy 1000 TL/3 VHS Camcorder Mobile Cellular Telephone Mobile CB Mobile CB 20‐Memory Speed‐Dial Deluxe Portable CD Player 10‐Channel Desktop Scanner Easiest‐to‐Use Phone Answerer Handheld Cassette Tape Recorder
Source: Huffington Post
Vancouver GIS User Group: 2015‐FEB‐18
9
Emerging World (Measurement of Things) • • • •
Smartphones have many onboard sensors Wi‐Fi / Bluetooth can link to other devices carried by/on/near the person Smartphones can download & render maps via 3G/4G LTE Time‐Location positional measurement: –
•
Properties of the person: – – – – – – – –
•
Geographic location, orientation, elevation, speed
Heart rate Body temperature Blood pressure Blood chemistry Weight Breathing rate Sleep Caloric intake
Heart Rate
Properties of the surrounding environment / other machines / devices: (examples of M2M) – –
Ambient temperature, humidity Properties of car / boat / bicycle/house
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
10
February 18, 2015 5
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Samsung S3 Teardown: What’s Inside? Required Tools Spudger $2.95 Phillips #00 Screwdriver $5.95 Plastic Opening Tools $2.95 Tweezers ~= $17.‐‐ $4.95
Cost of basic parts: ~=$240.00
www.ifixit.com/Teardown/Samsung+Galaxy+S4+Teardown/13947
GPS: BCM4750, 4751 Cost ~= plink, plink, plink! Privacy / Sharing your location with Google Post‐processing (see next part of talk)
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
24
February 18, 2015 12
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Discussion: Is Self‐Measurement a Good Thing? Note to self: Get a Fitbit
Ernest Hemingway Hemingway recorded his weight & blood pressure on the wall of his bathroom Other issues: privacy, value of your personal data, correlations with other sources. Vancouver GIS User Group: 2015‐FEB‐18
25
Discussion: What Mobile Device OS and Measuring Apps Are You Using? • OS: – – – – –
Android iOS Blackberry Windows Phone / Mobile Firefox / Sailfish / Tizen (Linux)
www.idc.com
85,000+ attendees 3,000+ vendors 2,000+ media Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
26
February 18, 2015 13
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Discussion: What Mobile Device OS and Measuring Apps Are You Using? Category Tracking/Field Data Tracking/Field Data Tracking/Field Data Tracking/Field Data Tracking/Field Data Tracking/Field Data Tracking/Field Data Tracking/Field Data Driving Driving Driving Driving Driving Driving Driving Commuting Commuting Commuting Commuting Commuting Commuting Commuting Sports / Fitness Sports / Fitness Sports / Fitness Sports / Fitness Sports / Fitness Sports / Fitness Sports / Fitness
Name
Creator
Google Play Rating Installs
My Tracks OsmAnd OpenGISTracker Collector Google Location History Google Location History
Google OsmAnd Rene de Groot ESRI Google
GasBuddy ‐ Find Cheap Gas GPS Navigation & Maps Sygic SpeedView: GPS Speedometer MapFactor: GPS Navigation MapQuest GPS Navigation and Maps
GasBuddy.com Sygic Code Sector MapFactor MapQuest
4.6 4.4 4.3 4.2 4.1
BusViewer BusLink Arrivo Vancouver Live Transit Vancouver Live Transit Vancouver The Transit App
? Runty Laboratories Inc. TripMate ILH TransitApp, Inc.
5.0 4.6 4.5 43 4.3 4.2
Strava Running and Cycling ‐ GPS Run aStrava, Inc. Map My Run MapMyFitness, Inc. Runtastic Runtastic RunKeeper FitnessKeeper, Inc. Nike+ Running Nike, Inc.
10M to 50M 1M to 5M 100k to 500k 50k to 100k All
4.3 4.2 4.1 3.9 ‐
4.6 4.5 4.5 4.4 4.4
Vancouver GIS User Group: 2015‐FEB‐18
27
Part 2
ANALYSING MOBILE DATA MEASUREMENTS USING SIMPLE WEB GIS TOOLS Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
28
February 18, 2015 14
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
We now have tracks data … what’s next? Render, Analyse, Publish using simple Web GIS Tools 3. Download (GPX), 4. Analyse
3. Download/Sync (GPX)
5. Publish
2. Track 4. Author
1. Basemap Sources: boundlessGeo.com and P. Ramsey, “Open Source & the Spatial Web” Web Map and Apps, Feb 20, 2014, URISA BC
Vancouver GIS User Group: 2015‐FEB‐18
29
Popularity Contest: Statistics for Websites Using Web Mapping Technologies Summary Vendor % Market • Google (Maps API, My Maps, Earth, Maps Engine, ESRI?) 91.28 • Microsoft (Bing, MapPoint) 2.27 • MapBox/Leaflet [growing] p / [g g] 1.52 • MaxMind (Geo IP’s, declining) 0.39 • ESRI ArcGIS (Pro, Server, Portal, Javascript) 0.04 • CartoDB [growing] 0.00 All Mapping 100.‐‐ Total Websites Worldwide: Mapping Market Share:
Special cases for British Columbia (examples): • iMap BC 2.0 • MapPlace , BC Mines & Energy • GE Digital ‐ GE Di it l Smallworld Web S ll ld W b • DataBC Mashup Framework (DMF) • iMap 4 Mobile • DNV’s GeoWeb App (emerging) • GeoScience BC Earth Science Viewer (new!)
# Sites 3,100,000 77,000 51,000 , 13,000 1,500 150 3,243,000
1,203,000,000 0.27%
Silverlight Plug‐In Autodesk MapGuide Plug‐In J Javascript? i t? Google Maps Javascript API HTML5 HTML5, Leaflet, Javascript HTML5
This is an emerging part of the total market. Firms like ESRI, Smallworld & others still largely dominate the “conventional” GIS market sectors. Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
30
February 18, 2015 15
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
1. Simplest: Google Location History
Example of “aGPS” issue? Example of “aGPS” issue?
Vancouver GIS User Group: 2015‐FEB‐18
31
2. Google My Tracks Google My Maps
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
32
February 18, 2015 16
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
3. ArcGIS Online: Track Import, Cartography, Spatial Analysis Roads, Structures, Zones
Origins to Destinations
Hazards
Overlay of Evac Tracks from Smartphone
ArcGIS Online Has Many Spatial Analysis F’ns
Vancouver GIS User Group: 2015‐FEB‐18
33
Sean’s Maps: Wineries & Distilleries in NS & PEI
http://www.arcgis.com/home/webmap/viewer.html?webmap=93655196c69d4e6daf93fcb77c034ce5 Thx to Sean Smith
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
34
February 18, 2015 17
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Sean’s Maps: BC Wineries
http://www.arcgis.com/home/webmap/viewer.html?webmap=77ff315fbc194fbd8b4c3c3fb2d5d7dd Thx to Sean Smith
Vancouver GIS User Group: 2015‐FEB‐18
35
Sean’s Maps: Burrard Civic Marina
http://www.arcgis.com/home/webmap/viewer.html?webmap=bb15845d2c9a49ea9ef1bccc60dc5dec&ext ent=‐123.1412,49.2737,‐123.1353,49.2766 Thx to Sean Smith
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
36
February 18, 2015 18
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
4. CartoDB
Vancouver GIS User Group: 2015‐FEB‐18
37
CartoDB: Je Suis Charlie Tweets
http://srogers.cartodb.com/viz/123be814‐96bb‐11e4‐aec1‐0e9d821ea90d/embed_map Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
38
February 18, 2015 19
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
CartoDB: Super Bowl 2015 Tweets
http://t.co/8jDXejaces Vancouver GIS User Group: 2015‐FEB‐18
39
CartoDB: Community Points, Lines, Areas
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
40
February 18, 2015 20
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
CartoDB: Lifestyle Tracks: Exploring Basic Cartographic Tools
Vancouver GIS User Group: 2015‐FEB‐18
41
CartoDB: Cycling Track: Animating Time‐Dependent Track Data
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
42
February 18, 2015 21
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Post‐Processing Impressions: Good, Bad, Otherwise The Good:
The Bad:
1. Some apps have supporting web GIS apps to post‐process the data: – Google My Tracks My Maps – ESRI Collector ArcGIS Online – OsmAnd QGIS 2. Some offer very very simple import and cartographic rendering (e.g., CartoDB) 3. Some offer more capable analytical functions (e.g., ArcGIS Online) 4. Significant use of the simpler tools by publications: publications:
1. Some smartphone apps cannot export multiple tracks at one time 2. Freemium software products only have very limited capabilities bili i 3. Very quickly run into functional limitations:
– –
5.
Guardian New York Times
Integration with advanced visualization tools (e.g., D3js)
–
–
need to move to full‐function track editing methods (cannot ask the user to constantly start/split/stop tracking) track / time display summary is still very limited
4. Need ability to correlate / integrate with other datasets (e.g., still need to explore Bluetooth feeds) 5. Need a more capable space‐time data model Otherwise: 1. Some of the key emerging products are built on Free and Open Source (FOSS) software implications?
Vancouver GIS User Group: 2015‐FEB‐18
43
Looking Under the Hood: Example of a GIS Web Stack
GeoExt‐ExtJS / Flex / Silverlight
Sources: boundlessGeo.com and P. Ramsey, “Open Source & the Spatial Web” Web Map and Apps, Feb 20, 2014, URISA BC
OpenGeo Suite / ArcGIS Server / MapGuide / Map Server
boundlessGeo.com
PostGIS / SQLServer / Oracle Spatial / DB2 Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
44
February 18, 2015 22
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Looking Under the Hood Content Layout Behaviour
DNV’s GeoWeb Stack (?)
CartoDB Stack
MapBox Stack
Google API’s 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
Google Maps Android API v2 Google Maps JavaScript API v3 Google Maps API for Work Google Maps SDK for iOS Google Places API Google Places Autocomplete Google Static Maps API v2 Google Street View Image API Google Maps Embed API Google Directions API Google Distance Matrix API Google Distance Matrix API Google Elevation API Google Geocoding API Google Time Zone API Google Maps Tracks API
Vancouver GIS User Group: 2015‐FEB‐18
45
Discussion: Which Web GIS Apps Are You Using? Category Track Import/Editing/Analysis Track Import/Editing/Analysis Track Import/Editing/Analysis Track Import/Editing/Analysis Track Import/Editing/Analysis Track Import/Editing/Analysis Track Import/Editing/Analysis Track Import/Editing/Analysis Track Import/Editing/Analysis General WebGIS General WebGIS General WebGIS General WebGIS General WebGIS General WebGIS General WebGIS BC WebGIS BC WebGIS BC WebGIS BC WebGIS BC WebGIS BC WebGIS BC WebGIS BC WebGIS BC WebGIS
Name ArcGIS QGIS Google Earth Pro FME OpenLayers ModestMaps PolyMaps
Creator / Vendor ESRI QGIS Community Google Safe Software ModestMaps PolyMaps
URL www.esri.com/software/arcgis www.qgis.org www.google.ca/work/mapsearth/products/earthpro.html www.safe.com openlayers.org modestmaps.com polymaps.org
Google My Maps ArcGIS Online CartoDB MapBox GeoCommons
Google ESRI CartoDB MapBox ESRI
www.google.com/mymaps http://www.arcgis.com/home/webmap/viewer.html?useExisting=1 cartodb.com www.mapbox.com geocommons.com
iMap BC 2.0 MapPlace , BC Mines & Energy DataBC Mashup Framework (DMF) iMap 4 Mobile Earth Science Viewer Smallworld Web GeoWeb
DataBC BC Mines & Energy DataBC DataBC GeoScience BC GE Digital District North Vancouver
maps.gov.bc.ca/ess/sv/imapbc/ www.empr.gov.bc.ca/Mining/Geoscience/Mapplace/pages/default.aspx http://www.data.gov.bc.ca/dbc/about/spatial_data_infrastructure/data_visual_platform.page maps.gov.bc.ca/ess/hm/imap4m/ www.geosciencebc.com/s/webmaps.asp www.gedigitalenergy.com/geospatial/catalog/smallworld_web.htm www.geoweb.dnv.org/
Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
46
February 18, 2015 23
Vancouver GIS User Group
Measure People Using Mobile Technology, Analysing the Data Using Emerging WebMap Apps
Summary 1.
Measuring People Using Mobile Technology We can measure the movements of people across a geography, asset locations, status, behaviours Many useful free apps for your smartphone St Strengths / limitations / opportunities th / li it ti / t iti A very very big market Free GIS data is key (e.g., Google, OpenStreetMap) Data firehose a very very large amount of data to manage
– – – – – –
2.
Analysing the Points & Tracks Data Using Simple Web GIS Tools We can find web‐GIS products we can use to compile / display / analyse this information Freemium Full pay model Strengths / limitations / opportunities Gaps: Functions need to be added in order to make the tracks into data p HTML5 / CSS / Javascript Free and Open Source Software & Data ******** Flux / Major changes:
– – – – – – – • •
deprecation of Google Maps Engine Deprecation of Silverlight support in Chrome
Vancouver GIS User Group: 2015‐FEB‐18
47
bill.johnstone .spatialvisiongroup.com www.spatialvisiongroup.com Vancouver GIS User Group: 2015‐FEB‐18
Spatial Vision Group, Inc. North Vancouver, BC
48
February 18, 2015 24
