Capability Maturity Model® (CMM®) Integrationsm

Appraisals Methods

วรวุฒิ รามจันทร์เทคโนโลยีสารสนเทศและการจัดการ

AGENDAS

2

SCAMPI คืออะไร?

ใครเป็นใครในกระบวนการ SCAMPI

ขอบเขตและแผนงาน

การสัมภาษณ์

การชีแจงและตอบคําถาม

Q & A

3

“The Standard CMMI Appraisal Method for Process Improvement (SCAMPI) is an

invaluable tool for organizations seeking to drive quantifiable improvements in systems and

software engineering. ”

ByDennis M. AhernJim ArmstrongAaron ClouseJack FergusonWill HayesKenneth Nidiffer

CMMI SCAMPI Distilled: Appraisals for Process Improvement

4

Definitions

Appraisal An examination of one or more processes by a trained team of professionals using a model as a basis for determining strengths and weaknesses

SCAMPI Standard CMMI® Appraisal Method for Process Improvement

5

Appraisal Principles

Start with a Process Reference Model Use a Defined Appraisal Method Involve Senior Management as Appraisal Sponsors Observe Non-Attribution Approach the Appraisal Collaboratively Focus on Action

6

Basic Appraisal Precepts

Non-Attribution Nothing seen or heard during an appraisal will be attributed to a person or project

Confidentiality All artifacts provided to the team during the appraisal will either be returned to the appraised organization, destroyed, or deleted

Appraisal findings are the property of the appraisal sponsor(s) and will not be divulged or used outside the context of the appraisal without the specific permission of the sponsor(s)

7

Appraisal Method Classes

8

CMMI® -DEV v1.2

9

Continuous Representation

•Organizational Process Focus•Organizational Process Definition•Organizational Training•Organizational Process Performance•Organizational Innovation and Deployment

•Project Planning•Project Monitoring and Control•Supplier Agreement Mgmt.•Integrated Project Mgmt.•Risk Management•Quantitative Project Mgmt.

•Requirements Mgmt.•Requirements Dept.•Technical Solution•Product Integration•Verification•Validation

•Configuration Mgmt.•Process and ProductQuality Assurance• Measurement & Analysis•Decision Analysis andResolution• Causal Analysis and Resolution

10

Generating Maturity Level or Capability Level Ratings (A) Status of Process Implementation (B) Evaluation for Award or Incentive Fee (B) Internal Snapshot, Mini-Appraisal (B/C) Education, Gap Analysis (B/C) Contract Monitoring (B/C)Planning an Improvement Strategy (C)

Reasons for Appraisals

11

Resource Requirements - 1

Certified Lead Appraiser or Team Leader Qualified Team Members Training Requirements

• Introduction to CMMI®• SCAMPI Team Training

Team Knowledge/Experience Requirements• 5 Yrs Engineering, 3 Yrs Management• Domain Knowledge is necessary and At Least Half of the team should have appraisal experience

Logistic Support at the Appraisal Site

12

Resource Requirements - 2

Travel

Resource Requirements depend on: Mode of Evidence Review (Discovery or Verification) Scope Other Sponsor Information Requirements

Scope Determines: Team Size and Composition Time Required

13

Typical Appraisal Activities

Planning and Preparation Appraisal Input and Plan Team Selection and Training Readiness Review

Conduct Appraisal Document Review Interviews Collation of FindingsPreliminary Findings Presentation

Report Results Final Findings Presentation Executive Level OutbriefAppraisal Disclosure Statement

14

Generic SCAMPI C Timeline

15

Preliminary Steps

With the Appraisal Sponsor:

Review and discuss program work requirements in terms of processes

Decide which Process Areas are most critical to the success of the program and should be appraised

Other important Program Information Needs

16

What is Scope?

Scope is The Number of Process Areas to be Appraised and Other important Program Information Needs

Scope should include Process Areas most critical to the success of the programWhatever else the sponsor wants, e.g.,

• Strengths and Weaknesses• Observations• Recommendations for Implementation• Process Improvement Plan

Scope Determines: Appraisal Team Size and Composition Time Required

17

Scope: “You Must Decide”

Business and Technical Objectives Program RisksWhere Failure Is UnacceptableWhat Is Negotiable/Not-Negotiable Dependencies and Constraints Historical Information Other Program Information Needs

SCAMPI Process Flow - Plan & Prepare

Plan for appraisal

Prepare appraisal team & participants

trained team, participants oriented

scope, appraisal plan

Obtain/analyze initial objective evidence (OE)

1 questionnaires, mapping, documents,2 PII (mapping) database,

Prepare to collect OE

1 Questionnaires - optional2 PII = practice implementation indicator

Conduct appraisal

readiness review, data collection plan

18

SCAMPI Process Flow - Conduct

Verify OE

Examine OE

Questionnaire results, PII database, documents, interviews

Validate practice implementation gaps

Characterize implementation of practices

Document OE

Generate assessment results

Report results

Direct & indirect artifacts, affirmations, gap observations, strengths

Instantiation-level & organizational unit -level characterizations

Prelim. findings, findings feedback

Note: Verify & validate data is an iterative process

Recorded/updated appraisal data (e.g., tagged notes, PII database, gaps)

Final findings, ratings

19

SCAMPI Process Flow - Report Results

Deliver appraisal results

Findings presentation, * final report

Package & archive appraisal results

Conduct appraisal

Lessons learned, appraisal record (sponsor), appraisal report/feedback (SEI)

* Final report is optional

20

21

Role of Interviews

Draw on existing expertise and knowledge of resident management, engineering, and support professionals

Supplement knowledge gained from review of organizational and project documents

Start the thinking process about what it would really take to further improve the organization's development capabilities

Obtain buy-in of discussion participants in assessment outcome

22

Types of Interviews

Project Leader interviews If multiple projects are being appraised in an organization, one session for each project

Functional area interviews Management group or groups Engineering group or groups Support group or groups Process group or groups

Organizational Roles Senior/Middle Managers Project Leaders Practitioners

23

Format of Interviews

Who will be there? For some interviews, the entire team will be present; for others, a team sub-set will be present Follow-up interviews may be with a team sub-set

What to bring with you? You may bring a few items that are particularly helpful in your daily work, or that typify what you produce

What kind of questions will be asked? There may be some broad, general questions; however, interview questions will generally be narrowly focused and rather detailed

24

About Interviews

It is OK to say I don’t know.We are not at that stage yet

The only bad answer is a disingenuous answer

Characterizing Practice Implementation

• Assign characterization values reflecting the extent of practice

implementation for each instance

– For practices implemented by projects, an instance = each project

– For practices implemented organization-wide, the instance

• Aggregate practice characterizations to organizational unit (OU) level using defined method aggregation rules

25

Rules for Characterizing Practice Implementation –Instantiation Level

Label MeaningFully Implemented (FI) Direct artifacts present & appropriate

• Supported by indirect artifact &/or affirmation• No weaknesses noted

Largely Implemented (LI)

• Direct artifacts present & appropriate• Supported by indirect artifact &/or affirmation• One or more weaknesses noted

Partially Implemented (PI)

Direct artifacts absent or judged inadequate• Artifacts or affirmations indicate some aspects of the practice are implemented• One or more weaknesses noted

Not implemented (NI) Any situation not covered by above

26

Rules for Aggregating Practice Implementation - *OU Level

Condition Outcome RemarksAll X (e.g., all LI) X All instantiations have the same

characterization.

All (LI or FI) LI All instantiations are characterized LI or higher.

Any PI, No NI LI or PI Team judgment is applied to choose LI or PI for the OU.

Any NI NI, PI, or LI

Team judgment is applied to choose NI, PI, or LI for the OU.

* OU = organizational unit

27

28

29

Rules

Short answers

Trade answer sheets and grade your neighbor

Top 4 go to the tie-breaker rounds

Top 2 go to the final tie-breaker

30

Ready?

31

Questions

1. Name the seven Level 2 Process areas in the Staged Presentation of CMMI® (1 pt per correct answer)

2. How does any organization get a Maturity Level 3 Rating? (2 points)

3. What are the 3 phases of a SCAMPI Appraisal?

4. Name the 3 hard prerequisites for being a SCAMPI Appraisal Team Member

32

Answers

1. REQM, PP, PMC, CM, SAM, MA, and PPQA (1 pt per correct answer)

2. Successfully pass a SCAMPI Class A Appraisal (1)

3. Plan and Prepare, Execute, Report Findings (1 pt/correct answer)

4. Intro to CMMI Course, 5 years of Engineering Experience and 3 years of Management Experience (2 pts/correct answer)

Perfect Score = 20

33

Tie Breakers Round 1

1. What three things comprise the scope of an appraisal

2. What is the sunset date for CMMI® v1.2?

34

Tie-Breaker Answers

First question: The projects or instantiations to be

appraised The process areas to be appraised and

to what level Additional products requested by the

sponsor

35

CMMI ML3 Certified Company

36

Q & AQ & A

THE END

นักศึกษาสามารถดาวน์โหลด เอกสารประกอบการเรียน ได้ที

http://www.rabbitthailand.com

37

Q & A

38