32
Using Excel for Test Metrics

Excel Metrics

Embed Size (px)

Citation preview

Page 1: Excel Metrics

Using Excel for Test Metrics

Page 2: Excel Metrics

AgendaUnderstanding Excel

BasicsText to columns and backRelative and absolute

valuesNamesCountIf / sumIfSubtotal vs consolidatePaste specialAutofillFormulas – if, thenAudit formulasFilterConditional formatting

Application to MetricsUnderstand the numbersTypes of reportsGas gaugeProgress chartDefect find / fix rate

Page 3: Excel Metrics

Understanding Excel

Page 4: Excel Metrics

Basics Auto sizing columns and rows Entering formulas Editing formulas Cell formatting View or hide formulas, gridlines, row and column

headers Hyperlinks Worksheet / workbook relationships Status Bar calculator Help

Page 5: Excel Metrics

Text to Columns

George Jetson

Sally Johnson

Joe Smith

Chris Murray

-- TO --

1. Select the cells that you want to split apart (be sure the columns to the right are empty as they will be overwritten).

2. Click on Data, Text to Columns.

3. Choose Delimited.

4. Choose Space (or the delimiter that you are using).

5. Click Finish.

George Jetson

Sally Johnson

Joe Smith

Chris Murray

Page 6: Excel Metrics

Combining Text Fields

-- TO --

1. Click on a blank cell (usually to the right of the existing cells).

2. Type in one of the following formula examples:

a. =A1&" "&B1 to list first name, then a space, then the last name

b. =B4&", "&A4 to list last name, then a comma, then the first name

3. The ampersand (&) character allows you to concatenate text fields together. The quotes will show up as text as in “ “ for a space or “, “ for a comma and a space.

George Jetson

Sally Johnson

Smith, Joe

Murray, Chris

Page 7: Excel Metrics

Relative and Absolutes$ symbols in formulas allow you to “lock” a column or row.

This is a must if you try to copy and paste or autofill a formula.

When the cell is selected in the formula, press F4 to have it cycle between $C$R, C$R, $CR, CR

B C D

2   Pay Rate Bill Rate

3 George Jetson 10 =C3*$B$9

4 Sally Johnson 10.5 =C4*$B$9

5 Joe Smith 9.75 =C5*$B$9

6 Chris Murray 10.25 =C6*$B$9

8 OT multiplier

9 1.5

Page 8: Excel Metrics

Name a Cell ReferenceMake your formulas more “readable” by naming cells

1. Click on a cell

2. In the Formula bar where it shows the Column / Row reference, type in name and press enter.

3. Reference that name in a formula.

To view the list of names, click on Insert, Name, Define

B C D

2   Pay Rate Bill Rate

3 George Jetson 10 =C3*OTx

4 Sally Johnson 10.5 =C4*OTx

5 Joe Smith 9.75 =C5*OTx

6 Chris Murray 10.25 =C6*OTx

8 OT multiplier

9 1.5

Page 9: Excel Metrics

CountIf / SumIfCountIf: =countif(range,criteria)SumIf: =sumif(range,criteria,[sum_range]) Range = the range of cells you want evaluated / counted Criteria = the criteria in the form of a number, expression, or text that defines which cells will be

added. For example, criteria can be expressed as 32, "32", ">32", "apples". Sum_range = the actual cells to sum.

B C D

2 Position Name Hours Worked

3 tech 1 George Jetson 40

4 tech 2 Sally Johnson 40

5 engineer Joe Smith 50

6 tech 1 Chris Murray 50

7

8 Tech 1 =COUNTIF($B$3:$B$6,"tech 1") =SUMIF($B$3:$B$6,"tech 1",$D$3:$D$6)

9 Tech 2 =COUNTIF($B$3:$B$6,"tech 2") =SUMIF($B$3:$B$6,"tech 2",$D$3:$D$6)

10 Engineer =COUNTIF($B$3:$B$6,"engineer") =SUMIF($B$3:$B$6,"engineer",$D$3:$D$6)

11

12 Tech 1 =COUNTIF($B$3:$B$6,B12) =SUMIF($B$3:$B$6,B12,$D$3:$D$6)

13 Tech 2 =COUNTIF($B$3:$B$6,B13) =SUMIF($B$3:$B$6,B13,$D$3:$D$6)

14 Engineer =COUNTIF($B$3:$B$6,B14) =SUMIF($B$3:$B$6,B14,$D$3:$D$6)

Page 10: Excel Metrics

Subtotal vs. Consolidate

Subtotal Dynamic (if linked to source data, when source data updates,

subtotals update) Ideal for a set number of rows (if referencing this data in another

sheet) Adjusts existing data

Consolidate Static (no change when source data is updated) Ideal for a varying set of rows (if referencing this data in another

sheet) Results are stored in a different location

Page 11: Excel Metrics

Subtotal Select a cell in the range Click Tools, Subtotal Choose the reference column Choose the function (sum,

average, etc.) Choose the column(s) to

subtotals

Page 12: Excel Metrics

Consolidate Select a blank cell (usually a

new sheet or below the existing data)

Click Tools, Consolidate Choose the function (sum,

average, etc.) Choose the range(s) to

consolidate; click on Add after each one

Choose Left Column Note: if you check “create

links to source data,” it will do a subtotal

Page 13: Excel Metrics

Paste SpecialAccessible from the right

click menu after a copy

Some options available from the from the icon after a paste

Page 14: Excel Metrics

Paste Special Formulas – pastes formulas only, no formatting Values – pastes the results of the formula (can

also use F9) Formats – pastes the format (no data); can also

use the format painter Skip blanks – pastes the values of cells containing

data, skips blank cells Transpose – transposes the data – converts rows

to columns or columns to rows

Page 15: Excel Metrics

AutoFill

Type in the first two items in a series; autofill the rest by dragging the cells

Make your own autofill lists under Tools, Options, Custom Lists

Use the CTRL to adjust the autofill

Downfall: the list is static

Jan Jan 1 1 1/1/05 1/1/05

Feb Feb 2 2 1/2/05 1/2/05

  Mar   3   1/3/05

  Apr   4   1/4/05

  May   5   1/5/05

  Jun   6   1/6/05

  Jul   7   1/7/05

  Aug   8   1/8/05

  Sep   9   1/9/05

  Oct   10   1/10/05

  Nov   11   1/11/05

  Dec   12   1/12/05

Page 16: Excel Metrics

Alternatives to AutoFill

Formulas, of course

1/1/05 1/1/05

=A1+1 =B1+7

=A2+1 =B2+7

=A3+1 =B3+7

=A4+1 =B4+7

=A5+1 =B5+7

=A6+1 =B6+7

=A7+1 =B7+7

=A8+1 =B8+7

=A9+1 =B9+7

Page 17: Excel Metrics

Formulas – if / then Use conditional statements in formulas

Error handling (avoid div/0 errors) Create “smart” formulas that can adjust on the fly

  Possible Pass Fail % Pass % Fail

Cell Formatting 115 110 5 =C2/$B2 =D2/$B2

Basic Formulas 28 0 0 =C3/$B3 =D3/$B3

Complex Formulas 205 112 0 =C4/$B4 =D4/$B4

Charts 0 0 0 =C5/$B5 =D5/$B5

  Possible Pass Fail % Pass % Fail

Cell Formatting 115 110 5 =IF($B8>0,C8/$B8,0) =IF($B8>0,D8/$B8,0)

Basic Formulas 28 0 0 =IF($B9>0,C9/$B9,0) =IF($B9>0,D9/$B9,0)

Complex Formulas 205 112 0 =IF($B10>0,C10/$B10,0) =IF($B10>0,D10/$B10,0)

Charts 0 0 0 =IF($B11>0,C11/$B11,0) =IF($B11>0,D11/$B11,0)

Page 18: Excel Metrics

Formula Audit

Select the formula you want to audit Click on Tools, Formula Auditing, Evaluate

Formula

Page 19: Excel Metrics

Filter

Select a cell in the data range Click on Data, Filter, Auto Filter

Page 20: Excel Metrics

Conditional Formatting

Based on the value of a cell / cells, adjust the formatting on the fly

Click the cell / cells, click on Format, Conditional Formatting

Note: trial and error is necessary in here; accepts absolute and relative values, accepts some formulas

Page 21: Excel Metrics

Application to Metrics

Page 22: Excel Metrics

Understanding Numbers

"Get your facts first, then distort them as you please." ~ Mark Twain

"Facts are stubborn, but statistics are more pliable." ~ Mark Twain

Torture numbers, and they'll confess to anything.  ~Gregg Easterbrook

98% of all statistics are made up.  ~Author Unknown

Page 23: Excel Metrics

What does this mean?

Choice of formulas makes a difference Using averages vs. totals based on number of tests

will show different results One view of numbers is never enough

%pass, %fail numbers don’t mean much if you don’t know kind of defects are logged

Numbers alone are never enough Tests can’t cover everything Gut feel should still mean something – sometimes

numbers are hard to grasp

Page 24: Excel Metrics

Types of Metrics Gas Gauge – overview of pass, fail, blocked reports

Progress Report – historical view of pass, fail, and blocked reports

Defect Find / Fix Report – how fast are we finding defects vs. how fast are they being fixed

Release Criteria – what are the criteria to release the project Pass rate for all components must be 97% or higher Submit rate of high priority defects must be less than x% of the

average defects logged in the last x weeks. Stress test GUI errors per 1,000 hours must be less than .02

Page 25: Excel Metrics

Gas Gauge

Page 26: Excel Metrics

How to build the gas gauge Gather the raw data Organize it by test area / category / test type Create the following for each line:

% complete of planned % pass of planned -- % pass of complete % fail of planned -- % fail of complete % block of planned -- % block of complete

Determine whether to use % of planned or % of complete (may use both depending on the report)

Determine whether totals should be averages or based on the actual number of tests

Develop the gas gauge

Page 27: Excel Metrics

Progress Chart – Ideal world

Page 28: Excel Metrics

Progress Chart – real world

Page 29: Excel Metrics

How to build the progress chart

Determine the total number of tests possible for each area

Determine milestones for 100% execution, 60% pass, 80% pass, 90% pass

Weekly, track the number of passes, fails, and blocks

Page 30: Excel Metrics

Find / Fix Rate – Ideal World

Page 31: Excel Metrics

Find / Fix Rate – Real World

Page 32: Excel Metrics

Find / Fix Rates

Track for all defects Track for just high priority (must fixes for a

product to ship) Track number of defects submitted and

resolved each week Chart the results