A Classification Approach for Movie Recommender System

A Classification Approach A Classification Approach for Movie Recommender for Movie Recommender SystemSystem

指導教授：黃三益　 老師學生： M964020007 黃于珊

M964020011 李界寬 M964020022 程尚文

AgendaAgenda

IntroductionMotivation and backgroundDetermination of data setThe Data Mining ProcedureConclusion and Limitation

1.MOTIVATION AND 1.MOTIVATION AND BACKGROUND BACKGROUND2.DETERMINATION OF 2.DETERMINATION OF DATA SET DATA SET

INTRODUCTION

Motivation and backgroundMotivation and background

Dataset 來源自 GroupLens◦ (Research lab in the Department of Computer

Science and Engineering at the University of Minnesota ; http://www.grouplens.org/)

線上電影推薦系統 -MovieLens

( http://www.movielens.org/ ) ◦加入會員，評價隨機選出的數部電影，即可享

受到網站給予的五部電影之推薦，並附上預測使用者喜好該電影的程度。

We all loves movies Find the rule

Determination of data setDetermination of data set

使用 MovieLens 目前提供兩種Datasets 的其中一種。◦內容包含 1682 部電影， 943 使用者，共

100,000 ratings 。◦提供足夠的樣本規模，讓我們可以適當的

建立和測試模型。

1.DATA MINING 1.DATA MINING PROCEDURE:10 STEP PROCEDURE:10 STEP2. CONCLUSION AND 2. CONCLUSION AND LIMITATION LIMITATION

The Data Mining Procedure

Step 1. Translate the business Step 1. Translate the business problem into a data mining problem into a data mining problemproblem電影種類與數目相當繁多，如何在眾

多的電影中可以快速的找到符合自己偏好的電影 ?◦電影推薦系統◦縮短搜尋時間 ◦Find the Rule

年齡、職業、性別等之偏好那些種類的電影◦Potential customers

Step 2. Select appropriate Step 2. Select appropriate datadata線上電影推薦系統 -MovieLens

Research lab in the Department of Computer Science and Engineering at the University of Minnesota ; http://www.grouplens.org/)

資料來源自加入其網站的會員對電影所作的評價與會員的相關個人資料

其所提供的 Dataset 內容包含 1682 部電影， 943 使用者，共 100,000 ratings 。

Step 3. Get to know the Step 3. Get to know the data(1/2)data(1/2)This data has been cleaned up

◦ users who had less than 20 ratings ◦ did not have complete demographic

information

Step 3. Get to know the Step 3. Get to know the data(2/2)data(2/2)

Attribute name Description Domain

Age User 年齡1: “Under 18” ， 18: "18-24“ 25: “25-34” ， 35: "35-44" 45: “45-49” ， 50: "50-55“56: "56+”

Gender User 性別 "M" 代表男性， "F" 代表女性

Occupation User 職業

0: "other" or not specified 1: “academic/educator” 2: "artist" 3: “clerical/admin” 4: "college/grad student“And so on……

Movie Kind 電影類型

* Action * Adventure * Animation * Children‘s * Comedy * Crime* Documentary * Drama * Fantasy * Film-Noir * Horror * Musical* Mystery * Romance * Sci-Fi * Thriller * War * Western

Step 4. Create a model setStep 4. Create a model set

• Data Source–MovieLens (The GroupLens Research

Project at the University of Minnesota)• Data Characteristics:–100,000 ratings (1-5) from 943 users

on 1682 movies–Each user has rated at least 20 movies–seven-month period from September

19th, 1997 through April 22nd, 1998–With complete demographic

information

Step 5. Fix problems with the Step 5. Fix problems with the datadataVariable with too many values

◦Movie kind◦Occupation◦We do not consider variables such

as ZipCode and rate

Step 6.Transform data to bring Step 6.Transform data to bring information to the surfaceinformation to the surfaceWe skip this step due to the

uselessness of transforming data into different formats

Step 7. Build modelsStep 7. Build models

Data mining tool: ◦Weka Explorer 3.4.12

Classifier◦Decision tree methods◦using C4.5 algorithm

Performs well on both accuracy and speed

Weka: the softwareWeka: the software

Step8. Assess ModelStep8. Assess Model

Confusion Matrix

Table 1. Confusion Matrix of Classifier C4.5 from Training Set

The Kind of Movie Romance Thriller War

Romance 2,576 7,465 38

Thriller 1,742 15,643 53

War 1,095 6,428 90

Step8. Assess ModelStep8. Assess Model

Detailed Accuracy

Table 2. Detailed Accuracy of Classifier C4.5 from Training Set

Class TP Rate FP Rate Precision Recall F-Measure

Romance 0.256 0.113 0.476 0.256 0.333

Thriller 0.897 0.785 0.53 0.897 0.666

War 0.012 0.003 0.497 0.012 0.023

Step8. Assess ModelStep8. Assess Model

Other Information

Table 3. The Results of Classifier C4.5 from Training Set

Correctly Classified Instances 18,309 Rate ： 52.1178%

Incorrectly Classified Instances 16,821 Rate ： 47.8822%

Kappa statistic 0.1089

Mean absolute error 0.4023

Root mean squared error 0.4485

Relative absolute error 96.6655%

Root relative squared error 98.3189%

Total Number of Instances 35,130

Step 8. Assess ModelStep 8. Assess Model

Decision Tree◦Number of Leaves ： 118◦Size of the tree ： 216

Step 9. Deploy ModelStep 9. Deploy Model

It’s difficult to deploy, because ◦Computer’s resources are not

enough◦Difficult to implementation

Conclusion and LimitationConclusion and Limitation

Classification Approach : C4.5 → Decision Tree

Data Set : 35,130 dataLimitation

◦Hardware and software don’t support enough to mining more data to find more interest and complete rules.

Thanks For Your Attention.