chapter2_Datawarehouse V1+mining

Chapter 3

Data Management

(Data, Information and Knowledge) (Data Source) (Database) (Database Management System: DBMS) (Database Technology)

(Data, Information and Knowledge) (1/3) (Data) Multimedia

(Information) DataProcess & TransformInformation (Data, Information and Knowledge) (2/3)

(Knowledge) DataKnowledgeInformationWisdom (Data, Information and Knowledge) (3/3)

(Data Source) (Internal Data Source) (External Data Source)

(Time Study) (Survey) (Observation) (Interview)

(Data Quality)

(Database)

(Data Independence) (Data Redundancy) (Data Inconsistency) (Data Integrity) (Data Security) (Easy Reporting) (Concurrency Control)

(Database Management System: DBMS)

DBMSDBMS : Application (DBA) (User)

DBMS : (User View)

DBMS :

(Hierarchical Database) (Network Database) (Relational Database) (Object-Oriented Database)

: (Hierarchical Database) A1250A215A3150A2100A350B110

: (Network Database) A1250A2115A3200B110

: (Relational Database)CustomerProductOrder

Cust_IDCust_Name001 002

Prod_IDProd_NameA1A2A3B1

Cust_IDProd_IDQuantity001A1250001A215001A3150002A2100002A350002B110

: (Object-Oriented Database)Cust_ID = 001Cust_Name = Cust_ID = 002Cust_Name =

CustomerAttribute:Cust_IDCust_NameMethods:Print();getName();

(Database Technology) (Data Warehouse) (Online Analytical Processing: OLAP) (Data Mining)

: (Data Warehouse) /

(Data Warehouse) :

(Data Warehouse) : Subject-Oriented : Integrated : Time-Variant : 5-10 Non-Volatile :

(Data Warehouse) : /

(Data Warehouse) : (1/2)Data Acquisition SystemData Staging AreaData Warehouse DatabaseData Provisioning AreaDataMetadata RepositoryMetadataDataDataMetadataMetadataMetadataDataTerminal

Data Acquisition System : /Data Staging Area : Cleansing & Filtering Data Warehouse Database : Data Provisioning Area Data Mart : Data Warehouse Database End Users Terminal : Simple Reporting Tools, Multi-Dimensional Tools Data Mining Tools Metadata Repository : (Data Warehouse) : (2/2)

(Data Warehouse) : (1/2)Query and ReportMultidimensionalData AnalysisData Mining

(Data Warehouse) : (2/2)OLAPGeneratorData WarehouseReportGeneratorData MiningTools

: OLAP OLAPMultidimensional Database OLAP OLAP

OLAP : OLAP (Multidimensional Data Analysis)

OLAP : Multidimensional Database (1/4)


1750,0002800,0003825,0004680,000

1750,000550,0002800,000600,0003825,000650,0004680,000500,000

1550,0002600,0003650,0004500,000


.1750,000.1350,000.2800,000.2300,000.3825,000.3280,000.4680,000.4380,000

.1550,000.1250,000.2600,000.2200,000.3650,000.3260,000.4500,000.4325,000

OLAP : Multidimensional Database (4/4).1234

OLAP : OLAPRoll up Drill Down Roll up Drill Down Slice and Dice Slice Dice

OLAP : Roll up Drill Down (1/2)Roll upRoll upDrill DownDrill DownRegionRegion-Product TypeRegion-Shop-Product Type

Region SumNorth61,000South41,500

Product Type GlossaryMisc.RegionNorth55,0006,000South31,00010,500

Product Type GlossaryMisc.RegionShopNorthABC30,000NorthPlatter25,0006,000SouthFive Mart31,00010,500

OLAP : Roll up Drill Down (2/2)Roll upDrill DownRegion-Shop-Product TypeRegion-Shop-Product Type-Product Type

Product Type GlossaryMisc.RegionShopNorthABC30,000NorthPlatter25,0006,000SouthFive Mart31,00010,500

Product TypeGlossaryGlossaryGlossaryMisc.Misc.ProductFishMeatPorkMedicinePencilRegionShopNorthABC10,00020,000NorthPlatter25,0006,000SouthFive Mart8,00023,00010,000500

OLAP : Slice (1/2)

OLAP : Slice (2/2)Slice:-Glossary

Product TypeGlossaryGlossaryGlossaryMisc.Misc.ProductFishMeatPorkMedicinePencilRegionShopNorthABC10,00020,000NorthPlatter25,0006,000SouthFive Mart8,00023,00010,000500

Product TypeGlossaryGlossaryGlossaryProductFishMeatPorkRegionShopNorthABC10,00020,000NorthPlatter25,000SouthFive Mart8,00023,000

OLAP : Dice (1/2)

OLAP : Dice (2/2)Shop-Product TypeDate-Product Type

Product TypeGlossaryMisc.ShopABC30,000Platter25,0006,000Five Mart31,00010,500

Product TypeGlossaryMisc.Date6/07/200443,00010,0007/07/200443,0006,500

OLAP : OLAP

: (Data Mining)

(Data Mining) : (Knowledge Discovery) (Rules)

(Data Mining) : ClassificationClusteringAssociationVisualization

: Classification (1/4) (Predictive Modeling) Supervised Learning 2 Tree InductionNeural Induction

: Classification (2/4) ?

225YES322YES128NO530YES427NO221NO323NO......

: Classification (3/4) 2 25 Tree Induction

: Classification (4/4)InputHidden Processing LayerOutputNeural Induction0.50.40.60.30.70.4 >= 25 ?

: Clustering Unsupervised Learning

: Association

2 25 40 35 35

: Visualization 3

(Data Mining) : Client/Server Spreadsheet

(Data Mining) :

(Data Mining) : (1/4)?

(Data Mining) : (2/4)

(Data Mining) : (3/4)

(Data Mining) : (4/4) Disk Drive

(1/2)

1 (: )35%26%22%17%

Chart1

0.35

0.26

0.22

0.17

1

1

1 (: )

A B C D

70101465159

908599110384

95126111115447

1209810328349

60225219150654

4355445464681993

1

1 (: )

254412,500.0022,500.0013,500.008,500.0059,544.00

254514,000.0023,400.0016,250.0010,000.0066,195.00

254615,250.0026,500.0020,000.0012,500.0076,796.00

254717,250.0030,000.0018,400.0011,750.0079,947.00

59,000.00102,400.0068,150.0042,750.00282,482.00

1

1 2544-2547

1

1 (: )

35%

26%

22%

17%

1

1

35,000,000.0042,000,000.00

72,000,000.0086,400,000.00

23,000,000.0027,600,000.00

48,000,000.0057,600,000.00

68,000,000.0081,600,000.00

52,000,000.0062,400,000.00

45,000,000.0054,000,000.00

33,000,000.0039,600,000.00

43,000,000.0051,600,000.00

51,000,000.0061,200,000.00

47,000,000.0056,400,000.00

36,000,000.0043,200,000.00

43,000,000.0051,600,000.00

68,000,000.0081,600,000.00

35,000,000.0042,000,000.00

47,000,000.0056,400,000.00

45,000,000.0054,000,000.00

23,000,000.0027,600,000.00

36,000,000.0043,200,000.00

33,000,000.0039,600,000.00

48,000,000.0057,600,000.00

51,000,000.0061,200,000.00

52,000,000.0062,400,000.00

72,000,000.0086,400,000.00

43,000,000.0068,000,000.0035,000,000.00146,000,000.00

51,600,000.0081,600,000.0042,000,000.00175,200,000.00

47,000,000.0045,000,000.0023,000,000.00115,000,000.00

56,400,000.0054,000,000.0027,600,000.00138,000,000.00

36,000,000.0033,000,000.0048,000,000.00117,000,000.00

43,200,000.0039,600,000.0057,600,000.00140,400,000.00

51,000,000.0052,000,000.0072,000,000.00175,000,000.00

61,200,000.0062,400,000.0086,400,000.00210,000,000.00

177,000,000.00198,000,000.00178,000,000.00553,000,000.00

212,400,000.00237,600,000.00213,600,000.00663,600,000.00

43,000,000.0047,000,000.0036,000,000.0051,000,000.00177,000,000.00

51,600,000.0056,400,000.0043,200,000.0061,200,000.00212,400,000.00

68,000,000.0045,000,000.0033,000,000.0052,000,000.00198,000,000.00

81,600,000.0054,000,000.0039,600,000.0062,400,000.00237,600,000.00

35,000,000.0023,000,000.0048,000,000.0072,000,000.00178,000,000.00

42,000,000.0027,600,000.0057,600,000.0086,400,000.00213,600,000.00

146,000,000.00115,000,000.00117,000,000.00175,000,000.00553,000,000.00

175,200,000.00138,000,000.00140,400,000.00210,000,000.00663,600,000.00

(2/2)

1 (: ) 2544 12,500 22,500 13,500 8,500 59,544 2545 14,000 23,400 16,250 10,000 66,195 2546 15,250 26,500 20,000 12,500 76,796 2547 17,250 30,000 18,400 11,750 79,947 59,000 102,400 68,150 42,750 282,482

(2/2)

Chart2

1250022500135008500

14000234001625010000

15250265002000012500

17250300001840011750

1 2544-2547

1

1 (: )

A B C D

70101465159

908599110384

95126111115447

1209810328349

60225219150654

4355445464681993

1

1 (: )

254412,500.0022,500.0013,500.008,500.0059,544.00

254514,000.0023,400.0016,250.0010,000.0066,195.00

254615,250.0026,500.0020,000.0012,500.0076,796.00

254717,250.0030,000.0018,400.0011,750.0079,947.00

59,000.00102,400.0068,150.0042,750.00282,482.00

1

1 2544-2547

1

1 (: )

35%

26%

22%

17%

1

1

35,000,000.0042,000,000.00

72,000,000.0086,400,000.00

23,000,000.0027,600,000.00

48,000,000.0057,600,000.00

68,000,000.0081,600,000.00

52,000,000.0062,400,000.00

45,000,000.0054,000,000.00

33,000,000.0039,600,000.00

43,000,000.0051,600,000.00

51,000,000.0061,200,000.00

47,000,000.0056,400,000.00

36,000,000.0043,200,000.00

43,000,000.0051,600,000.00

68,000,000.0081,600,000.00

35,000,000.0042,000,000.00

47,000,000.0056,400,000.00

45,000,000.0054,000,000.00

23,000,000.0027,600,000.00

36,000,000.0043,200,000.00

33,000,000.0039,600,000.00

48,000,000.0057,600,000.00

51,000,000.0061,200,000.00

52,000,000.0062,400,000.00

72,000,000.0086,400,000.00

43,000,000.0068,000,000.0035,000,000.00146,000,000.00

51,600,000.0081,600,000.0042,000,000.00175,200,000.00

47,000,000.0045,000,000.0023,000,000.00115,000,000.00

56,400,000.0054,000,000.0027,600,000.00138,000,000.00

36,000,000.0033,000,000.0048,000,000.00117,000,000.00

43,200,000.0039,600,000.0057,600,000.00140,400,000.00

51,000,000.0052,000,000.0072,000,000.00175,000,000.00

61,200,000.0062,400,000.0086,400,000.00210,000,000.00

177,000,000.00198,000,000.00178,000,000.00553,000,000.00

212,400,000.00237,600,000.00213,600,000.00663,600,000.00

43,000,000.0047,000,000.0036,000,000.0051,000,000.00177,000,000.00

51,600,000.0056,400,000.0043,200,000.0061,200,000.00212,400,000.00

68,000,000.0045,000,000.0033,000,000.0052,000,000.00198,000,000.00

81,600,000.0054,000,000.0039,600,000.0062,400,000.00237,600,000.00

35,000,000.0023,000,000.0048,000,000.0072,000,000.00178,000,000.00

42,000,000.0027,600,000.0057,600,000.0086,400,000.00213,600,000.00

146,000,000.00115,000,000.00117,000,000.00175,000,000.00553,000,000.00

175,200,000.00138,000,000.00140,400,000.00210,000,000.00663,600,000.00

(1/4)

35,000,000.00 42,000,000.00 72,000,000.00 86,400,000.00 23,000,000.00 27,600,000.00 48,000,000.00 57,600,000.00 68,000,000.00 81,600,000.00 52,000,000.00 62,400,000.00 45,000,000.00 54,000,000.00

(1/4)

33,000,000.00 39,600,000.00 43,000,000.00 51,600,000.00 51,000,000.00 61,200,000.00 47,000,000.00 56,400,000.00 36,000,000.00 43,200,000.00

(2/4)

43,000,000.00 51,600,000.00 68,000,000.00 81,600,000.00 35,000,000.00 42,000,000.00 47,000,000.00 56,400,000.00 45,000,000.00 54,000,000.00 23,000,000.00 27,600,000.00 36,000,000.00 43,200,000.00 33,000,000.00 39,600,000.00 48,000,000.00 57,600,000.00 51,000,000.00 61,200,000.00 52,000,000.00 62,400,000.00 72,000,000.00 86,400,000.00 553,000,000.00663,600,000.00

(3/4)

43,000,000.00 68,000,000.00 35,000,000.00 146,000,000.00 51,600,000.00 81,600,000.00 42,000,000.00 175,200,000.00 47,000,000.00 45,000,000.00 23,000,000.00 115,000,000.00 56,400,000.00 54,000,000.00 27,600,000.00 138,000,000.00

(3/4)

36,000,000.00 33,000,000.00 48,000,000.00 117,000,000.00 43,200,000.00 39,600,000.00 57,600,000.00 140,400,000.00 51,000,000.00 52,000,000.00 72,000,000.00 175,000,000.00 61,200,000.00 62,400,000.00 86,400,000.00 210,000,000.00

(3/4)

177,000,000.00198,000,000.00178,000,000.00553,000,000.00212,400,000.00237,600,000.00213,600,000.00663,000,000.00

(4/4)

43,000,000.00 47,000,000.00 36,000,000.00 51,000,000.00 177,000,000.00 51,600,000.00 56,400,000.00 43,200,000.00 61,200,000.00 212,400,000.00 68,000,000.00 45,000,000.00 33,000,000.00 52,000,000.00 198,000,000.00 81,600,000.00 54,000,000.00 39,600,000.00 62,400,000.00 237,600,000.00

(4/4)

35,000,000.00 23,000,000.00 48,000,000.00 72,000,000.00 178,000,000.00 42,000,000.00 27,600,000.00 57,600,000.00 86,400,000.00 213,600,000.00 146,000,000.00 115,000,000.00 117,000,000.00 175,000,000.00 553,000,000.00 175,200,000.00 138,000,000.00 140,400,000.00 210,000,000.00 663,600,000.00

Reference , . : , 2546 .Decision Support Systems [Online]. Available: http://www.ict.pyo.nu.ac.th/uthais

Documents

chapter2_Datawarehouse V1+mining