Embed Size (px)
Citation preview
Measuring FlowEnabling scientific approach to DevOps
Anton WeissOtomato Software Delivery
Deliver Better
SoftwareFaster
Why Do DevOps?
•Velocity•Quality
• Culture
• Automation
• Lean Principles
• Measurement
• Sharing
C.A.L.M.S.
John Willis, Damon Edwards, Jez Humble
Lean Management
• Flow
• Value Stream Mapping
• Continuous Improvement
• Visualisation
• Removal of Waste
DEFINE FLOW?
the amount of change we can move through our pipeline in a given unit of time
FLOW
12 DevOps Flow Metrics http://devopsflowmetrics.org
Velocity
Velocity
MLTMean Lead Time
how long does it take for a bit of code to get built, tested and deployed
Velocity
DCRDaily Change Rate
number of changes getting committed to mainline and tested per day
Velocity
MTTEMean Time To Environment
how long does it take devs/testers to bring up a testing environment for verifying changes
Velocity
MTTDMean Time To Detect
how much time passes since the original commit of the code until the bug it introduced gets detected
Velocity
MTTRMean Time To Resolve
how much time it takes to resolve an issue once it’s been detected
Velocity
MTTAMean Time To Approve
how much time it takes to verify and approve a release
Quality
Quality
BFRBuild Failure Rate
% of failed builds
Quality
DFRDeployment Failure Rate
% of failed deployments
Quality
IRFRInfra-Related Failure Rate
% of builds/deployments failures related to infrastructure issues
Quality
RWRRework Rate% of tickets being reopened
Quality
ADRAutomated Detection Rate
% of issues being detected by automated testing cycles
Quality
UWRUnplanned Work Rate
% of unplanned issues
Where’s the Data?
● Project Mgmt Tools● SCM
● Monitoring● CI Server● Humans
Prerequisites
● Integrated Tools● App-aware Monitoring● Change Tracing
Where to put Data?
•ELK (G) (Use Jenkins Logstash Plugin?)
•Dashboards•Knowledge Sharing
don’t forget why
•Continuous Improvement
Word of Warning
It is wrong to suppose that if you can’t measure it, you can’t manage it
– a costly myth.
W.E.Deming
Спасибо!!!
