Pilot Project for Big Data Use

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~25, Bangkok)

Pilot Project for Big Data Use

Mining and Manufacturing Production Index

April 2013

Ki-bong Park


1. Establishment of a Big Data Roadmap of the Korean

Government

2. Beginning of Big Data Use

3. KOSTAT Countermeasures against Big Data Use

4. KOSTAT Pilot Project for Big Data Use in Official Statis-

tics

5. Future Plans

Contents


1. Establishment of a Big Data Roadmap of the Korean Gov-ernment

1 / 12

International trend of establishing big data-related strategies at the na-tional level

Establishment of a ‘Big Data Master Plan’ of the Korean Government

U.S.A.: ‘Big Data Research & Development Initiatives’ , investment in big data research & development (March 2012)

England: ‘Open Data Strategy’, Strengthen data access (March 2012)

Japan: Published ‘Strategy for Big Data Use’, Selected as a major goal for ‘Active Japan’(May 2012)

Cope with big data issues- March 15, 2012: Big data national strategy forum (Participation by industries, universities, research institutes and governmental agencies)- Sep. 16, 2012: Big data forum (Participation by the public and private sectors)

Establish a ‘Big Data Master Plan’ (National Science & Technology Commission, Nov. 28, 2012)- Step-by-step big data use by considering benefits and utilities- Establishment of infrastructure for big data sharing, provision of technical support and expert training


Big data use when analyzing welfare and complaints from the general publicBeginning of big data use in terms of policy support and customized services- (Policy support) Link and share data that is located in several ministries, and support policy-making via data analysis- (Customized services) Provide user-focused services via an integrated analysis (e.g. qualification and history)

2. Beginning of Big Data Use

2 / 12

Pub-lic

sec-tor

Holding World-class ‘IT infrastructure’ and ‘data production and dis-semination’ - World-best infrastructure including high-speed Internet, 3G smart phones and LTE phones- Sharp increase in mobile data due to the popularity of smart phones and SNS

Poor data use by businesses when considering the production and dissemination of a huge amount of data- Just a few enterprises properly understand and use big data. - Mobile and portal service providers started to use big data based on their own data.

Pri-vate

sector


2. Beginning of Big Data Use -Case 1

3 / 12

Complaints analysis system of the Anti-Corruption Civil Rights Commission

Collect, classify, analyze and forecast online complaints of the public to facilitate communication between the government and the public

Produce a complaints calendar by month and region after analyzing past complaints and pro-duce a complaints map showing social issues형태로 제공

Seoul and Gyeonggi

Daejeon and Chungcheong

Unemployment bene-

fits, use of public

transportationApartment sales

Strengthen poli-cies


Give assistance when making policies for adolescents by analyzing social data

Policies for adolescents are too passive to prevent their extreme behaviors.

Help to make policies to prevent suicides of adolescents by analyzing buzz patterns related to suicides in social data and reflecting their situations and psychology

(Source) Pilot Project of the National Information Society Agency (July ~ Sep. 2012)

2. Beginning of Big Data Use -Case 2

4 / 12

Indentify a danger sign via a suicide context analysis

Identify harmful contents by ana-lyzing URLs that are spread via SNS

Cooperation with big mouths in a network

e.g.) Suicide context pool e.g.) Online spread of harmful con-tents

e.g.) Ripple effect of big mouths in a network


Collec-tion and analysis of Inter-net data

Provision of visualized analysis function

3. KOSTAT Countermeasures against Big Data Use

5 / 12

KOSTAT Countermeasures against Big Data Use

Pilot project for big data use

Research on big data use in official statistics and pilot production of statisticsEstablish a task force responsible for big data use and train human resources

Support rapid and accurate production of the Mining and Manufacturing Production Index

Media data is automatically collected and used for objective editing (checking changes in es-tablishments and items, finding outliers) before finalizing the Index.

“Earlier dissemination of the Mining and Manufacturing Production Index by using media data”

Easier understanding of time-series data (index and volume) by providing visualized analy-

sis function


Data collection and input

(3rd ~19th every month)

Finalization of input and the preliminary

index(20th every month)

Edit and inquiry(20th ~ 23rd every

month)

Finalization of the index and data

upload(23rd every month)

Analysis of the in-dex and publica-tion of a report(24th ~26th every

month)

4. KOSTAT Pilot Project for Big Data Use in Official Statistics (1/5)

9 / 12

AS-IS and TO-BE of the Mining and Manufacturing Production In-dex

AS-IS TO-BE (Big data use)Workflow

Volume information by establishment and itemIndex information by industry and item

Visualized analysis of sur-vey data

Integrated Internet information on items and establishments

Analysis of media non-typi-cal data

Individual verifica-

tion of In-ternet data

Inquiry over the phone

Volume table-fo-

cused edit


Analysis range

Industry Source Contents

C21(Pharmaceutical products)

Korea Pharmaceutical Manufacturers Association www.kpma.or.kr / Pharmaceutical newsChong Kun Dan Pharm. Major production and commodities

Internet newspapers Related articles

C24 (Basic metal products)

Korea Metal Journal new.kmj.co.kr / New by product

Korea Iron & Steel Association www.kosa.or.kr / Iron & steel information / Survey report, Iron & Steel Journal

Internet newspapers Related articles

C26(Electronic components, com-

puter, radio, television and communication equipment and

apparatuses)

Ministry of Knowledge Economy Website / Press releases, notices, policyKorea Customs Service Website / Policy, press releases

Korea Semiconductor Industry Association Real-time news on semiconductorSemiconductor Network News

Korea Display Industry Association News on display industryInternet newspapers Related articles

C28 (Electrical equipment) Internet newspapers Related articles

※ 4 industry groups (C21, C24, C26, C28, 162 items, 1438 establishments) that are surveyed in the Monthly Survey of Mining and Manufacturing


6 / 12

(Media data) Notices on the related websites and Internet news arti-cles

(Survey data) Time-series index and volume data by industry, item and es-tablishment from 2005 to the current month for the Monthly Survey of Min-ing and Manufacturing



7 / 12

Collection and analysis of media data

Data collection Scrolling of articles and documents on the Internet from the previous month to the current month- Collect Internet data that contains words such as increase and decrease for survey items and establishments- Scroll Internet news on a real-time basis- Analyze attached documents in the PDF or MS word format on the websites and load data into the analysis server

Data analysis

Integrated analysis of attached docu-ments from the websites and Internet news articles- Improve retrieval accuracy by registering search words (e.g. items) in advance- Provide website and Internet news according to the order of accuracy

Analysis of non-typical data



8 / 12

Collection and analysis of survey data

Data collection

Online link to the DB for the Mining and Manufacturing Survey System

Data analysis

Visualization of time-series index and vol-ume data by industry, establishment and item (e.g. in graphs)

- Volume graph by item and establish-ment(Volume/month-on-month/year-on-year)

- Index graph by industry and item(Volume/month-on-month/year-on-year)

Index by in-dustry

Index by

item

Volume by establish-

ment

Vol-ume by

item

Visualization of typical data



10 / 12


5. Future Plans

11 / 12

Big data governance is recommended to ensure better production and dissemination of official statistics by using big data.Define business processes and responsibilities

Results of pilot projects

Examine applicability and efficiency in statistical production/ accumu-late big data use techniques

Establishment of infrastructure for statistical production via big data use, and ongoing research

Expand the system (e.g. expand analysis range)Expand to all industries in Monthly Survey of Mining and Manufactur-ingExpand to the Monthly Service Industry Survey


Thank you for watching

Documents

Pilot Project for Big Data Use