17
votes
Accepted
What are some methods to measure the ROI for DevOps?
Great question! Most of us know investing in DevOps practices is a highly worthwhile pursuit for myriad reasons; we don't often justify DevOps on the impact to the bottom line alone, though.
Note: ...
- 1,338
12
votes
Accepted
What Key Performance Indicators (KPIs) are used to measure DevOps?
I don't think there are any "universal" DevOps KPIs. For example, velocity is great, unless it's not a key driver for your business. Amazon cares a lot about velocity because they have a massive ...
- 4,068
12
votes
What are some methods to measure the ROI for DevOps?
The key metric for a DevOps pipeline is Cycle Time (also called Lead Time). This is the time it takes for a change (or a change request, tracking all the way to the inception of the idea). The best ...
- 779
11
votes
Accepted
What exactly is the cloud term 'a Firehose'?
The fire hose is a reference to an old Weird Al Yankovick movie, UHF (1989). In this movie, George Newman (portrayed by Yankovick) starts a local TV channel in the UHF band and is responsible for ...
- 3,742
8
votes
What are some methods to measure the ROI for DevOps?
Captain obvious : by reducing time to market and defects on releases.
To extend on this one liner, the usual pitfall is being an organization change without any reference.
Engaging a culture or ...
- 11.4k
7
votes
pre-DevOps deployment metrics challenge
A technique we've used in the past in similar situations is to get "management commitment" that imposes these rules to every team member:
Access to perform updates to the target deployment areas (i.e....
- 7,215
7
votes
Accepted
How to model Man, Machine, Measures, and Process in a DevOps world?
What they are talking about is Kaizen 5M (Man, Machine, Material, Method, Measurement). It is approach to continuous improvement at every station in the process and the Ms are possible points of ...
- 5,837
6
votes
pre-DevOps deployment metrics challenge
The 2017 state of devops report says there's about a 31-45% "change failure rate." While that intuitively sounds about right, are they tracked as incidents? Nah. Because they get fixed pretty quickly, ...
- 2,841
3
votes
Accepted
Definition of change failure rate and mean time to recovery DORA metrics
You are asking the right questions and hitting on a very important aspect of these metrics. Individual metrics are not super helpful and measurements need to be defined. Having worked with these ...
- 181
3
votes
What are benefits of using third party app metrics tools versus custom build tools?
A third party app metrics tools is great if it already covers all (or most of) the parameters you want to monitor and it presents the information in a convenient enough manner for your use case - you ...
- 6,750
3
votes
What Key Performance Indicators (KPIs) are used to measure DevOps?
DevOps does not have any KPI. It would be like asking what are the KPI of Love. But some of the things you mentioned (Problem and Incident Management, Capacity Management, Change and Release ...
- 5,837
3
votes
Accepted
What are the best logging/metrics reporting tools for use with OpenShift?
The question hasn't had an answer in seven months so I will promote my upvoted comment to an answer:
Finding the lifecycle of a specific message across services is known as "distributed tracing". ...
- 1,172
2
votes
What is the proper relationship between rollback/rollforward and MTTR metrics?
Yes, MTTR is/should always be tied to the business outcome: if things are not stable the very business is at risk.
The fact that the expected code/feature/change is still stuck in process in scenario ...
- 6,750
2
votes
Identifying a benchmark to compare overall performance of VM virtualization vs hardware
You should do a comparison of commercial virtualization products on the same hardware resources, OR benchmarking commercial virtualization products individually, there are ways to do it, you can even ...
- 271
2
votes
Accepted
Which libraries generate observability metrics for applications in the cluster to prometheus?
For Application specific calls you need to use a Prometheus client and create the metrics yourself. The Prometheus client will allow you to create a /metrics endpoint where you can output the current ...
- 1,279
2
votes
Accepted
How do I measure invisible work?
There is a brilliant talk and blog on this "invisible work" called Being Glue.
Every senior person in an organisation should be aware of the less glamorous - and often less-promotable - ...
- 316
1
vote
How do I measure invisible work?
Keep track of your time in a spreadsheet--I use LibreOffice Calc or Microsoft Excel to do this. I usually round to the nearest 15 minutes in the Start and End columns. The Time column automatically ...
- 618
1
vote
Getting error while trying to communicate with apiserver in kube-state-metrics pod
This doesn't look like kube-state-metrics but your node configuration/networking issue. You will need to debug node to node communication. I would start by checking on which nodes the kube-state-...
- 186
1
vote
Accepted
Is there a way to make Prometheus to scrape only the metrics which are present in Grafana?
I haven't found any way to do that, so I created a simple CLI based on Python, which can assist with the task - make sure you don’t scrape metrics in Prometheus, which you don’t present in Grafana ...
- 151
1
vote
Accepted
Are there cheaper alternatives to cloud watch logs for creating dash boards?
Grafana was not really built to view logs from the get go.
They however introduced this feature in v6.0 via the Explore tab
This can be leveraged in 2 ways.
Via Elasticsearch data source (in v6.3+)
...
- 148
1
vote
Is there an established metric to describe optimal/needed ressources for a specific computational task?
As far as I'm aware, there is no universal standard amongst cloud providers. One reason for this is because most cloud providers like to abstract how their backend infrastructure, that their instances ...
- 3,278
1
vote
Identifying a benchmark to compare overall performance of VM virtualization vs hardware
IMHO an absolute benchmark can be rather useless/misleading, I'd always consider the specific context of the application intended to be executed on the platforms being benchmarked and its performance ...
- 6,750
1
vote
What is the proper term for lead time from commit to deployment?
From code repository to any environment, as a running software would be "Time to Deploy" ( which is different from deployment time, btw ).
From code repository all the way to production environment, ...
1
vote
What is the proper relationship between rollback/rollforward and MTTR metrics?
The mean time to recover has an implied subject - the mean time to recover what? Defining this is key to using the metric effectively.
Are you recovering the general availability of your production ...
- 2,841
1
vote
What Key Performance Indicators (KPIs) are used to measure DevOps?
Deployment frequency
Speed of deployment
Deployment success rate
How quickly service can be restored after a failed deployment
And ...
- 119
1
vote
What are some methods to measure the ROI for DevOps?
Late to the game here but thought I'd chime in.
You can't manage what you don't measure, so for starters, here are the key metrics devops teams should be tracking for incident response:
Uptime % : ...
- 11
Only top scored, non community-wiki answers of a minimum length are eligible