Beyond Big DataOpportunities & Challenges

MOBILE | PERSONAL | NATURAL | TRUSTED

THE DISRUPTIVE DIGITAL REVOLUTION

Big data+

IoT44 ZBBy 2020, IoT will include

26B units causing explosion

in the amount of data

available.

Mobile

>50% More than half of information workers across 17 countries report using 3+ devices for work

Social HyperScale

Cloud

~50%Nearly half of total IT spend will be cloud-related by 2020

Devices: “Info Workers Will Erase Boundary Between enterprise And Consumer Technologies.” Forrester Research. August 30, 2012

Apps: Gartner: “Predicts 2013: Business Impact of Technology Drives the Futures Application Services Market.” Nov. 21, 2012

Big data: Paraphrased from "The Impact of the Internet of Things on Data Centers." Gartner Research, Feb 27, 2014

Cloud: “Prepare For 2020: Transform Your IT Infrastructure And Operations Practice.” Forrester Research. Oct. 24, 2012

*Microsoft: Cyberspace 2025: Today’s Decisions, Tomorrow’s Terrain

The combination is Disruptive & Game Changing

“Third Platform” (IDC), “Nexus of Forces” (Gartner),

Internet Plus (China PM)

Cloud

Social

Big data

Mobility

Mobility

Cost-effective, innovative processing…

Level setting – What is Big Data?

VOLUME(>500GB?)

VARIETY(Unstructured,

unexpected etc)

VELOCITY(RT, changes in

related data sets at

different speeds)

http://www.gartner.com/it-glossary/big-data/

http://www.forbes.com/sites/gartnergroup/2013/03/27/gartners-big-data-definition-consists-of-three-parts-not-to-be-confused-with-three-vs/

https://www.datanami.com/2015/08/26/why-gartner-dropped-big-data-off-the-hype-curve/

442020

ZETTABYTES

OF DATA4.42013

0.162006

1 ZETTABYTE = 1 B TERABYTES

“Data creates opportunity. It's the oil of the 21st century.

Whoever has the right data will ultimately win.”

Peter Sondergaard, senior vice president of Global Research at Gartner

https://www.nyse.com/network/article/Gartner-Whats-Next

Data analytics:

Refers to qualitative and quantitative techniques and processes used to enhance productivity and business gain from data.

Predictive

• Perform predictions of outcomes and behaviors.

Prescriptive.

• How to achieve something (self driving car)

Descriptive++

• Reports.

• Measurement

• Trends

Diagnostics++

• Web logs.

Data analytics:

Refers to qualitative and quantitative techniques and processes used to enhance productivity and business gain from data.

Descriptive

(What

happened).

Diagnostic.

(Why it

happened)

Predictive.

(What may

happen)

Prescriptive.

(What will happen)

Is it A or B?

e.g Will the HDD fail

next month? Yes/No.

How much/how

many?

e.g. what is the

temperature next

Tuesday?

Which option?

e.g. do the car stop

or go on an orange

light.

Is it weird?

e.g. Fraud Detection.

Which groups? e.g.

which viewers like

the same type of

movie.

Reinforcement Learning

EXAMPLE SOLUTIONS

Get more

data

Ask a

sharp

question

Put data

in a table

Check for

quality

Transform

features

Answer

the

question

no no no no no

Use the

Answer

no

Data Science Team

Data Engineering

Math/Stats Algorithms

Application Development

Business Acumen

Data Management

Data

Dividend

Transform data into intelligent action at lower cost , time and skilled resources.

DATA INTELLIGENCE ACTION

Reusable

Intelligence

Dashboards &

Visualizations

Information

Management

Data Stores Machine Learning

and Analytics

Event HubsHDInsight

(Hadoop and

Spark)

Stream

Analytics

SQL Data

WarehouseData Catalog

Data Lake

Analytics

Data Factory Machine

LearningData Lake Store

Power BI

Cortana

Web

Mobile

Bots

Bot

Framework

Cognitive

Services

SQL Server

MICROSOFT CONFIDENTIAL

Continuous Rapid DisruptionWhat’s next (The 4th Platform)?

Mobile

Social

“Internet of

Things”

Natural interfaces

Machine Learning

Quantum computing

Delivering

crowdsourced

services

Bridging

physical and

digital worlds

Reinventing the

value chain

Achieving

continuous

uptime

Advancing

human-centric

design

Delivering

faster, smarter

serviceGrowing

sustainably

Cloud

Data

3-D Printing

• Went viral : 50 Million Users in 7 Days, 1.2M users/hour.

www.botframework.com

• Embrace Open Source

• Evolutionary Path to Cloud

• Democratize Data Science

• Skill Re-Use

• Transparent Scaling

• Facilitate Collaboration

• Decouple Data Science from Platforms

• Leverage Hybrid Cloud Architecture

• Accelerate Experimentation

• Streamline Deployment

Broaden The

Talent Pool

Increase

Productivity

Modernize

Infrastructure

Maximize

Innovation

Drive Down

TCO

“CYBER SECURITY IS A CEO ISSUE .”

Cyber threats are a material risk to your business

200+DAYS

Median number of days attackers are present on a victims network before detection

$3 TR ILL ION

Impact of lost productivity and growth

Average cost of a data breach (15% YoY increase)

$3.5 MILL ION

Attacks are fast, efficient, and easier than you think

46%

of compromised systems had no malware on them

23%

of recipients openedphishing messages

50%

of those who open, click attachments within the first hour

Benefits

Balancing Big Data

Data Governance and

Progressive Privacy Policy

Security and Privacy Controls

BenefitsBenefits Privacy RisksConsumer ExperienceConsumer ExperienceEnabling people to work the way they want

Benefits Privacy Risks

28

Real-time access

to reliable data

Self-service access

for everybody

within the

organization

Data-driven

decisions

First (1800’s) Second (1900’s) Third (1960) Fourth (TBD)

Steam power took over

horse powered transport

and hand made goods.

Electricity, etc (plane,

engine, movies)

1st and 2nd Platforms

(Digital technology, PC and

Internet)

3rd and 4th Platforms

(Cloud, Big Data, Social,

Mobility, IoT, ML,

Quantum)

Improved logistics and

Manufacturing.

Mass production and

Globalization of products.

Digitally enabled business,

manufacturing and

commerce.

Artificial Intelligence, 3D

printing manufacturing.

Cottage industry to

Manufacturing.

Increased manufacturing

efficiency, enhanced

logistics, Local business to

global business.

Business efficiency,

productive and move from

physical business to online

business.

Digitally powered Physical

would automation,

Innovative business model.

Cottage industry became

irrelevant.

Steam based industry

become irrelevant.

Only 11% of F500

companies in 1950s exist.

TBD

Industrial Revolution

30

Summary

• Big Data is now pervasive – one of the many tools that is used for processing data.

30