Embed Size (px)
Citation preview
Open Data :: From Insight to Visualization
Thomas Park :: developer, Google BigQueryLinuxCon Japan 2016
1
2
3
4
Introduction
Open Data : value
Open Data : applications
Examples and demos
ここはどこ？ 私はだれ？
Data is moneyFree and open data is everywhere
LET’SMAKE
MONEY
Director, OECD (Organisation for Economic Co-operation and Development)
Graham Vickery
The estimated value of Open Data in the European Union in 2006 was 27 billion Euro.
Ben Wellington
Statistician, Analyst (Pratt Institute NYC, Two Sigma)
David Eaves
Berkman Centre for Internet and Society (Harvard University)
« Open Data » What is it,
and why now ?
Foto Jeremy Thomas - https://unsplash.com/photos/rMmibFe4czY
«Open Data» is raw data published in a manner that is :
● Complete● Primary● Timely● Accessible● Exploitable● Non-Discriminatory● Non-Proprietary● Rights-free● Permanent● Free
(definition by LiberTIC, Nantes)
1979. 250 MB45.000 USD
1980.
2016.
1 GB / month:
Foto CC https://www.flickr.com/photos/slgc/8213370161
«Open Data» applications
Foto https://unsplash.com/photos/45sjAjSjArQ
Participationand community
MapMyWalk (mapmywalk.com)
Civicimprovements
Ben Wellington
Who are these mysterious hydrants ?
Foto
CC
http
s://w
ww
.flic
kr.c
om/p
hoto
s/w
smon
ty/4
1817
3863
3
Bicycle path
Ben Wellington
No Parking
Foto AP Images
STREAMING INGESTION
SEPARATE BILLING !
STORAGE AND QUERY ?
Foto
CC
http
s://w
ww
.flic
kr.c
om/p
hoto
s/ca
lliop
e/51
7716
589
速いいいいい~~~!
のぞみ のように
Foto
CC
http
s://w
ww
.flic
kr.c
om/p
hoto
s/sh
odan
/211
6587
15
https://bigquery.cloud.google.com/dataset/gdelt-bq:full
Foto
CC
http
s://w
ww
.flic
kr.c
om/p
hoto
s/th
raxi
l/291
5977
5
7月14日は何だ?
ヒント：
フランス
http://opendata.paris.fr/explore/dataset/accidentologie/
7月14日: パリ祭
https://cloud.google.com/bigquery/query-reference#windowfunctions
Lukas Eder
10 SQL TRICKS YOU DIDN’T
THINK WERE POSSIBLE
#3 : WINDOW FUNCTIONS
https://www.youtube.com/watch?v=yuuhkHORzfM&t=15m34s
東京ありがとう !
@thmsprk
Foto
http
s://u
nspl
ash.
com
/pho
tos/
h3vR
1F8-
caI
