Decoding the Readiness of Big DataVincent Ng
The Hong Kong Institution of EngineersInformation Technology Division
Big D tBig DataTB (1012 bytes) → PB (1015 bytes) → EB (1018 bytes)→ ZB (1021
bytes) ...
The World creates about 2.5EB data every day h l f l b l d h d The total amount of global data reached 2.8ZB report by International Data Corporation(IDC) in Dec. 2012
Where does the data coming from Where does the data coming from Internet & Web Sensing & IoT (M2M)Sensing & IoT (M2M) Enterprises Government
Big D tBig Data
Big VolumeSi es of the data Sizes of the data
Big Velocity Speed of data processingp p g
Big VarietyBig Variety Large number of diverse data sources to integrateintegrate
Will Big Data change our LifeWill Big Data change our Life
Computers in cars know where you go, when you go, how fast you go, how many times you stop along the way, whether you stay in your lane what your average MPG is how you like youryour lane, what your average MPG is, how you like your temperature, how close you get before stepping on the brake, and tens of thousands of other facts….instantly.y
Analyzing all of this data rapidly allows a self‐driving car to: Anticipate where you are going by looking at driving history
Check road signs using sensors to know what the speed limit is or if a stop sign is approaching
Alert and activate your braking and steering systems if pedestrians are in Alert and activate your braking and steering systems if pedestrians are in the street or you’re too close to the curb or you drift into another lane or you doze off.
Will Big Data change our LifeWill Big Data change our Life
Opportunities of Big DataOpportunities of Big Data
Answer formerly unanswerable questions Traditional applications but with real‐time processing of big volume of
data, faster and more accuratedata, faster and more accurate
Formulate new questions New applications where solutions exist only when volume of data becomes New applications where solutions exist only when volume of data becomes
big enough
Discover invisible knowledge Discover invisible knowledge New knowledge is discovered from different separate sources of data
M k id b d di ti / d i i Make evidence based predictions / decisions In particular, shift from causality (why) to correlations (what happens)
Elderly Care – LivingWell@HomeElderly Care – LivingWell@Home
LivingWell@Home program of the Evangelical Lutheran Good Samaritan Societyy Proactively monitor and manage for home‐based eldercare
Using sensor technology to identify developing medical conditions before they b blbecome problems
Big Data analytics software consolidates sensor information along with clinical and operational data on patients. The data is collected 24/7 and delivered securely online via an integrated dashboard to a licensed nurse who reviews it daily.
http://www.infotechlead.com/2014/07/31/ibm‐big‐data‐analytics‐support‐elderly‐care‐good‐samaritan‐i t 24552society‐24552
Are you readyAre you ready
5 Stages of analytical capability Analytically impairedAnalytically impaired
Localized analytics
A l i i i Analytic aspirations
Analytic companies
Analytic competitors
Ernest and Young 2014
Are you readyAre you ready
To what extent does the organization possess analytics skills?
To what extent do the organizations’ technology tools enable l ti biliti ?analytics capabilities?
To what extent has the organization set analytical objectives? To what extent has the organization set analytical objectives?
To what extent is the organization’s senior leadership supportive of analytics initiatives, or taking a lead on them?
To what extent has the organization embedded a culture of analytics?
To what extent has the organization developed analytics?
To what extent has the organization considered the legal challenges of big To what extent has the organization considered the legal challenges of big data?
To what extent has the organization sought to mitigate other potential risks, including cybersecurity issues, related to big data?
Ernest and Young 2014
Are you readyAre you ready
Data
BiBig data
ToolsPeople
culture How to start
DataData
Your data
Hong Kong PSI Dataset
PeoplePeople
5 key roles (Internal/External) Data Hygienistsyg
Data Explorers
Business Solution Architects Business Solution Architects
Data Scientists
Campaign Experts
Big Data Technologies/ToolsBig Data Technologies/Tools
Joint IBM/PolyU Enterprise Data Analytics Laboratory EDAL focuses on the big data research on design of software tools, and analytical algorithms for enterprise and social media data.
Aim to support knowledge transfer to the communities and enterprises
Thank You!Thank You!