28
Computational Analytics ESRI User Conference Smart Search and Insights for GIS

ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

  • Upload
    lynhi

  • View
    214

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 1 Computational Analytics

ESRI User Conference

Smart Search and Insights for GIS

Page 2: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 2 Computational Analytics

EVOLUTION OF DATA

Page 3: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 3 Computational Analytics

Big Data

Big Data

Structured –Databases,

Spreadsheets etc

Unstructured –Docs, Images, Videos, Social

Media

Spatial – Spatial layers

Page 4: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 4 Computational Analytics

Spatial Big Data

All types of data objects or elements that havegeographical information present

Enables the global finding and locating of individuals ordevices

Also known as geospatial data, spatial information,geographic information

(Partially based on Dasgupta, 2013)

Page 5: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 5 Computational Analytics

Sources of Spatial Big Data

GPS GPS-enabled devices Satellite remote sensing Aerial surveying Radar Lidar Sensor networks Digital cameras Location of readings of RFID IOTs

(Partially based on Dasgupta, 2013)

Page 6: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 6 Computational Analytics

Five V’s of Spatial Big Data

Volume Variety Velocity

Veracity Value

Page 7: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 7 Computational Analytics

Spatial Big Data Analytics

Track and correlate the location of items in very precise ways Use geospatial data

to fuel analytics in the real world GIS tools run

operations that aggregate terabytes and more of spatial information, run analysis, and visualize results as maps.

Page 8: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 8 Computational Analytics

Data-Driven, Real-Time Science for Spatial

New types of geospatial data generated continuously at a very high speed; Need to look at the incoming data on the fly and make decisions in time Need interactive (real-time) or dynamic analysis on geospatial big

data, such as complex event processing and spatial online analytical processing

Data-intensive hypothesis generation (via spatial statistics, machine learning, spatial data mining, and geo-visual analytics)

Page 9: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 9 Computational Analytics

Finding Spatial Data is Complicated

• Metadata is required for GIS search, but while preached, it’s rarely practiced

• Complex file formats are not understood by search or generic data management tools

• Critical relationships between items are not maintained

• Content is scattered across repositories and duplicated

Page 10: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 10 Computational Analytics

Spatial Big Data Analytics Platform

CEP = complex event processing, SOLAP = spatial online analytical processing. ETL = extract, transform and load, UI/UX = user interface/user experience design.

Search and Index

Page 11: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 11 Computational Analytics

Applications of Spatial Big Data Search and Analytics

Climate modeling and analysis Location analytics Retail and E-commerce Intelligence gathering Terrorist financing Aviation industry Disease surveillance Disaster response Political campaigns and elections Banking Insurance and Fraud analysis

Page 12: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 12 Computational Analytics

STATWORKS SOLUTION

SMART SEARCH AND INSIGHTS FOR GIS

Page 13: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 13

TTIBCO SPOTFIRE Analytics Applications

Solution Overview

Analytics

Solution Gallery

ContentMiner

Studio

Analyze Applications

ESRI ArcGIS Web and Apps

Page 14: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 14 Computational Analytics

Use Case Study

Oil and Gas Enterprise Search and Workflow Management Providing easy to use search capabilities across documents, GIS,

and subsurface data stores allows users to readily find relevant data

Providing a workflow application helps propagate standard workflows, increases project visibility, and support key business decisions

Linking data and documents to workflow tasks provides an auditable record of key assumptions and encourages reuse of prior work

Linking context based visualizations and analysis to the search and workflow apps supports efficient decision making

Page 15: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 15 Computational Analytics

Use Case Study

Oil and Gas Enterprise Search and Workflow Management

Page 16: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 16 Computational Analytics

ROYAL MALAYSIANCUSTOM DEPARTMENT

Search

LOGIN

MISSIONCollect revenue and provide

trade facilitation through enforcement of and

compliance with applicable law to spur economic

growth, maintain national security and public welfare

MALAYSIAN GOVERNMENT AGENCYSEARCH

VISIONA World Class Administration

Page 17: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 17 Computational Analytics

Searching via Map (Geo-Location)

Documents that are geospatially tagged and have bounding boxes.

Page 18: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 18 Computational Analytics

Searching via Text

Search through file path, title and content.

Page 19: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 19 Computational Analytics

Locations Example, Folder

Page 20: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 20 Computational Analytics

Locations Example, RSS Feed

Page 21: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 21 Computational Analytics

Saved Searches Example, Duplicate Data

Example, Duplicate Data that uses the MD5 algorithm to compare files bit by bit, regardless of path and title.

Page 22: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 22

Voyager Extension - ArcGIS Desktop

Page 23: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 23

Voyager Extension - ArcGIS WebApps

Page 24: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 25

Example : Spotfire with ArcGIS map layers25

Page 25: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 26

Spatial Big Data Analytics using ArcGIS and Spotfire–Example of Obama vs. Romney Tweets

Example of Spatial Big Data using social media is a live feed of number of tweets with “Obama” keyword and tweets with “Romney” keyword for largest 30 U.S. cities from Oct. 14-Nov 3, 2012.

There is a major shift towards Obama during this two week interval, which is more prominent in the northeast.

Page 26: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 27 Computational Analytics

Smarter and Faster Spatial Analytics with IOT

Page 27: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 28 Computational Analytics

Summary: Big Data, Analytics, & GIS28

A technical, algorithmic, and software base of the intersection of big data, analytics, and GIS has been set.

Since the preponderance of data is, or can be, geo-referenced, the size of spatial big data is vast.

Analytics are needed since the extent of map visualization is overwhelming.

Page 28: ESRI User Conferenceesrimalaysia.com.my/u/lib/esrimy/mob/20171208083935_c2501bfdbd... · (Partially based on Dasgupta, 2013) Page 6 ... TIBCO SPOTFIRE Analytics Applications

Page 29 Computational Analytics

THANK YOU

For further information, please contact us at

STATWORKS GROUP3 Two Square, Suite A-28-06

No. 2 Jalan 19/1, 46300 Petaling JayaSelangor Darul Ehsan, MALAYSIA

Phone : +60379555288Fax : +60379555388

Email : [email protected]://www.statwks.com