The concept of the new organization of statistical surveys

Janusz DygaszewiczDirector

Programming and Coordination of Statistical Surveys DepartmentCSO Poland

Meeting on the Management of Statistical Information Systems Paris, France 23 - 25 April 2013

• Conceptual model of functioning of official statistics• Reformation concept• The Integrated Statistical Business Process Model• Framework plan of reaching the Integrated Statistical

Business Process System in Poland• Summary

The presentation’s schedule

22

Conceptual model of functioning of official statistics

3

Processes

Organization

structure

Tools

The Knowledge Base

DostawcyDostawcySuppliers

DostawcyDostawcy

Customers

Products

Services

Products

Services

Needs

Regulations

• Process approach– Holistic – looking from the angle of all surveys and using the synergy effect– „From the outside to the inside” - based on forecast expectations of the

customer– Focused on the analysis and improvement of relations (i.e. interface)

between composite elements of the organization

• Reorganization of the statistical survey process– Optimalization and standardization of working processes– Optimalization of data collection – single collection of a variable used in

several surveys– Maximal use of secondary data – f.ex. from administrative sources

• Integration, consolidation and standardization IT solutions– Including adaptation of solutions to the new working processes,

organizational structure

• Improvement of organizational structure of official statistics – units organization according to the GSBPM

Reorganization Concept

4

Tools

Organizational structure

Processes

Reorganization conceptImplementation the Integrated Statistical Business Process

Model (ISBPM)

5

The

Inte

grat

ed

Stat

istic

al B

usin

ess

Proc

ess

Mod

el

The

Knowledge

Base

Survey 1 (dedicated organizational unit 1 and dedicated IT system 1)

Survey 2 (dedicated organizational unit 2 and dedicated IT system 2)

Survey N (dedicated organizational unit N and dedicated IT system N)

…

Data processing Data analysis

Data collection Data processingData analysis

Datacollection Data analysis

Data dissemination

Data dissemination

Data disseminationData processing

Datacollection

Stove-pipes model of current surveys organization

6

Survey 1

Survey 2

Survey N

…

Data processingData analysis

Datacollection

Data processingData analysis

Datacollection

Data analysis

Data dissemination

Data dissemination

Data dissemination

Data processing

Datacollection

Reorganization process concept Determination of the main stages

7

Survey 1

Survey 2

Survey N

…Data

collectionData processing Data analysis

Datacollection

Data processing Data analysis

Datacollection

Data processing Data analysis

Data dissemination

Data dissemination

Data dissemination

Reorganization process concept The main stages standarization

8

Survey 1

Survey 2

Survey N

…

Data dissemination

Data processing

Data collection Data analysis

Reorganization process concept Integration of standardized processes

9

Survey 1

Survey 2

Survey N

…Dat

a co

llec

tio

n

Dat

a p

roce

ssin

g

Dat

a an

aly

sis

Dat

a d

isse

min

atio

n

Reorganization process concept Grouping of integrated global processes and databases

10

Reorganization process concept Framework for corporate architecture

11

Survey 1

Survey 2

Survey N

…Dat

a co

llec

tio

n

Dat

a p

roce

ssin

g

Dat

a an

aly

sis

Dat

a d

isse

min

atio

n

Organization, coordination and control

IT services and tools community

Produkty statystyczne

Informacje od respondentów

Zbiory wartości zmiennych

zbieranych dla Grupy produktów

statystycznych

Grupy agregatów publikacyjnych

Grupy produktów statystycznych

Wynikowe mikrodane dla

Grupy produktów statystycznych

Analityczne struktury danych

Grupy agregatów

Produkty statystyczne

Zbiory danych administracji

publicznej

Inne zbiory danych

Informacje od respondentów

Zbiory wartości zmiennych

zbieranych dla Grupy produktów

statystycznych

Grupy agregatów publikacyjnych

Grupy produktów statystycznych

Wynikowe mikrodane dla

Grupy produktów statystycznych

Analityczne struktury danych

Grupy agregatów

Produkty statystyczne

Zbiory danych administracji

publicznej

Inne zbiory danych

Statistical products repository

Operational micro data repository

Raw data repository

Analytical micro and macro data repository

Information from respondents Set of variables

values collected for the statistical

product group

Publication aggregate groups

Statistical products groups

Resultant micro data for the

statistical products group

Analytical data structures

Aggregate groups

Produkty statystyczne

Administrative sources

Other data sets

Produkty statystyczne

Produkty statystyczne

Statistical products

ISBPM– Grouping Concept of statistical product process

DesigningProduction

12

Tools

Organizational structure

Processes

13

The

Inte

grat

ed

Stat

istic

al B

usin

ess

Proc

ess

Mod

el

The

Knowledge

Base

Preparing

Production

Data collection Data

ProcessingData Analysis

Data Dissemination

Specify needs Design Build ArchiveEx-post

evaluation

Organization, coordination and control

Development and maintenance tools/ IT services

ISBPM – Main Processes

14

Organization, coordination and control of design

Tools designing/ IT services

Organization, coordination and control unit

Data collection unit

Data processing unit

Analysis data unit

Customer service unit

IT services providingunit

Designing of data collection

Designing of data analysis

Designing of statistical products

Designing of processing of

operational micro data

Designing of processing of

analytical micro data

ISBPM - Design Processes

Plans of organization

(partial)

An cumulative plan

for the whole

organization

15

Organization, coordination and control of designong

Tools / IT services designing

Organization, coordination and control unit

Data collection unit

Data processing unit

Analysis data unit

Customer service unit

IT services providingunit

Designing of data collection

Designing of processing of

analitical micro data

Designing of data analysis

Designing of statistical products

Designing of processing of

operational micro data

Adjustment concerning the data collection

Adjustment concerning

processing of analytical micro

data

Adjustment concerning data

analysis

Adjustment concerning

processing of operational micro

data

Adjustment concerning data dissemination

Organization, coordination and control of build

Tools/ IT services adjustment

Designing Build

ISBPM – Build Process

An cumulative

build plan

16

Organization, coordination and control of designing

Tools designing / IT services

Organization, coordination and control unit

Data collection unit

Data processing unit

Analysis data unit

Customer service unit

IT services providingunit

Designing of data collection

Designing of processing of

analytical micro data

Designing of data anaysis

Designing of statistical products

Designing of processing of

operational micro data

Data collection

Processingof analytical micro data

Data anaysis

Processingof operational

micro data

Data dissemination

Organization, coordination and control of produce

Tools maintenance/ IT services

Designing ProductionBuild

ISBPM – Production Process

An cumulative

produce plan

17

ISBPM –Corporate architecture for main production process

18

act Statistical production model

statistical products group

update

Information on taskimplementation

Data collection

Variable valuecollection of the

Register

Informationon errors

Information onavailabilityof datafor analysis

implementation

Data processing

Information ontask

Information ontaskimplementation

Information onerrors

Data dissemination

Information onerrors

Publication aggregation Group, Statistical products Group

Information ontaskimplementation

Data analysis

«datastore»Raw data repository

«datastore»Operationalmicro datarepository

«datastore»Analytical micro and macro data repository (Data Warehouse)

«datastore»Statistical products

repository

Data collection

«datastore»Statistical units

register

taskindex

Data collection production plan

Data processingproduction plan

Data analysisproduction plan

Data disseminationproduction plan

«datastore»Metainformation repository

Public administration data repositories

Other data repositories

CAxI Data

«datastore»Statististical repositories of source data

Organization, coordination and production control

Data collection unit Data processing unit Data analysis unit

(Survey authors)

Customer service unit

Organization, coordination

and control unit

Tools

Organizational structure

Processes

19

The

Inte

grat

ed

Stat

istic

al B

usin

ess

Proc

ess

Mod

el

The

Knowledge

Base

ISBPM – Organization of new architecture

20

Organization , coordination and control unit

Data collection unitData processing

unit Data analysis unitCustomer service

unit

The unit providing IT services

Supporting units

Primary units

Tools

Organizational structure

Processes

21

The

Inte

grat

ed

Stat

istic

al B

usin

ess

Proc

ess

Mod

el

The

Knowledge

Base

Basic elements of the IT environment ISBPM

22

Knowledge Management

System

Education System

Infrastructure Service System

Metainformation Repository

Statistical Units RegisterRaw Data Repository Micro Data

Repository

Analytical Micro and Macro Data Repository

Statistical Products Repository

Knowledge Repository

Designing, Planning and Control System

Metainformation System

Service System CAxI

Service System of the Statistical Units

Register

Data Collection System

Micro data Processing

Operation System

Analytical System of Micro Data

Processing

Analysis and Decisions

Supporting System

Dissemination of Statistical

Information System

Archiving System Archive Repository

Tools

Organisational structure

Processes

23

The

Inte

grat

ed

Stat

istic

al B

usin

ess

Proc

ess

Mod

el

The

Knowledge

Base

The Knowledge Base – capacity building

24

Processes

Organization

structure

Tools

The Knowledge Base

Dostawcy

Products

Services

Products

Services

Needs

Regulations

The Knowledge Base

Wisdom

Supported by „IT”

Information

Data

Knowledge

The Knowledge Base

Suppliers

Suppliers

Suppliers Customers

Customers

Customers

• Phase 1 – Preparation• Phase 2 – Pilot concept along with transformation

preparation• Phase 3 – Verification• Phase 4 – Transformation• Phase 5 – Destination state

Framework plan of reaching the Integrated Statistical Business Process

System in Poland

25

The principal rules:

• Gradual increase of surveys performed with the new methods

• Evolutionary transformation of the organization

• Evolutionary transformation of the IT environment

• Successive implementation of new work processes

Framework plan of reaching the Integrated Statistical Business Process

System in Poland

26

2012 2013 2014 2015 2016 2017 2018 2019 2020

Phase 1 - Preparation

Phase 2 - Pilot concept along withthe preparation of the transformation

Edition 2014

Edition 2015

Edition 2016

Phase 4 - Transformation Edition 2017 Edition 2018 Edition 2019

Phase 5 – Destination state Edition 2020

Phase 3 - Verification

Gradual increase of share of surveys performed with the new methods in relation to the general number of surveys

Evolutionary transformation of the organization

Evolutionary transformation of the IT environment

Transformation plan

27

• Several connected and integrated IT systems instead of hundreds existing.

• Several specialized organizational units, extracted according to task specialization, concentrating specialist competences instead of many „independent” organizations.

• Instead of the knowledge dispersed in organization it is proposed that it be concentrated and employed with the use of the Knowledge Base which will support more efficiently capacity building.

• Instead of using independent and individual approach to the realization of each of the surveys – standardize of realization statistical surveys processes, preparing common methods and the best practices, used for the various stages (plug&play technology).

• Comprehensive look at all conducted surveys – elimination of structural ineffectiveness sources by proper products grouping.

Summary (1)

28

• Instead of collection data independently for each survey, and lack of cooperation for the needs of other surveys – using dedicated system which would support collection data for many surveys.

• Instead of individual, dispersed communication between particular leader units and statistical products customers, establish a dedicated unit – a connection point with statistical customer.

• Instead of dispersed information on the primary needs reported by customers, creating a single place for storing and analyzing data.

• Instead of expensive data, collected from direct surveys, increasing obtaining cheaper data – from administrative sources and sharing data within the organization and many surveys from different fields (including Big-data).

Summary (2)

29

30

Thank you for attention

Janusz DygaszewiczDirectorProgramming and Coordination of Statistical Surveys DepartmentCSO Polandj.dygaszewicz@stat.gov.pl