Decoding the Readiness of Big DataVincent Ng

The Hong Kong Institution of EngineersInformation Technology Division

Big D tBig DataTB (1012 bytes) → PB (1015 bytes) → EB (1018 bytes)→ ZB (1021

bytes) ... 

The World creates about 2.5EB data every day h l f l b l d h d The total amount of global data reached 2.8ZB  report by International Data Corporation(IDC) in Dec. 2012 

Where does the data coming from Where does the data coming from  Internet & Web  Sensing & IoT (M2M)Sensing & IoT (M2M)  Enterprises  Government 

Big D tBig Data

Big VolumeSi es of the data Sizes of the data

Big Velocity Speed of data processingp p g

Big VarietyBig Variety Large number of diverse data sources to integrateintegrate

Will Big Data change our LifeWill Big Data change our Life

Computers in cars know where you go, when you go, how fast you go, how many times you stop along the way, whether you stay in your lane what your average MPG is how you like youryour lane, what your average MPG is, how you like your temperature, how close you get before stepping on the brake, and tens of thousands of other facts….instantly.y

Analyzing all of this data rapidly allows a self‐driving car to: Anticipate where you are going by looking at driving history

Check road signs using sensors to know what the speed limit is or if a stop sign is approaching

Alert and activate your braking and steering systems if pedestrians are in Alert and activate your braking and steering systems if pedestrians are in the street or you’re too close to the curb or you drift into another lane or you doze off.

Will Big Data change our LifeWill Big Data change our Life

Opportunities of Big DataOpportunities of Big Data 

Answer formerly unanswerable questions  Traditional applications but with real‐time processing of big volume of 

data, faster and more accuratedata, faster and more accurate 

Formulate new questions  New applications where solutions exist only when volume of data becomes New applications where solutions exist only when volume of data becomes 

big enough 

Discover invisible knowledge Discover invisible knowledge  New knowledge is discovered from different separate sources of data 

M k id b d di ti / d i i Make evidence based predictions / decisions  In particular, shift from causality (why) to correlations (what happens) 

Elderly Care – LivingWell@HomeElderly Care – LivingWell@Home

LivingWell@Home program of the Evangelical Lutheran Good Samaritan Societyy Proactively monitor and manage for home‐based eldercare

Using sensor technology to identify developing medical conditions before they b blbecome problems

Big Data analytics software consolidates sensor information along with clinical and operational data on patients. The data is collected 24/7 and delivered securely online via an integrated dashboard to a licensed nurse who reviews it daily.

http://www.infotechlead.com/2014/07/31/ibm‐big‐data‐analytics‐support‐elderly‐care‐good‐samaritan‐i t 24552society‐24552

Are you readyAre you ready

5 Stages of analytical capability Analytically impairedAnalytically impaired

Localized analytics

A l i i i Analytic aspirations

Analytic companies

Analytic competitors

Ernest and Young 2014

Are you readyAre you ready

To what extent does the organization possess analytics skills?

To what extent do the organizations’ technology tools enable l ti biliti ?analytics capabilities?

To what extent has the organization set analytical objectives? To what extent has the organization set analytical objectives?

To what extent is the organization’s senior leadership supportive of analytics initiatives, or taking a lead on them?

To what extent has the organization embedded a culture of analytics?

To what extent has the organization developed analytics?

To what extent has the organization considered the legal challenges of big To what extent has the organization considered the legal challenges of big data?

To what extent has the organization sought to mitigate other potential risks, including cybersecurity issues, related to big data?

Ernest and Young 2014

Are you readyAre you ready

Data

BiBig data

ToolsPeople

culture How to start

DataData

Your data

Hong Kong PSI Dataset 

PeoplePeople

5 key roles (Internal/External) Data Hygienistsyg

Data Explorers

Business Solution Architects Business Solution Architects

Data Scientists

Campaign Experts

Big Data Technologies/ToolsBig Data Technologies/Tools

Joint IBM/PolyU Enterprise Data Analytics Laboratory EDAL focuses on the big data research on design of software tools, and analytical algorithms for enterprise and social media data. 

Aim to support knowledge transfer to the communities and enterprises 

Thank You!Thank You!