Hot answers tagged

17 votes
Accepted

What are some methods to measure the ROI for DevOps?

Great question! Most of us know investing in DevOps practices is a highly worthwhile pursuit for myriad reasons; we don't often justify DevOps on the impact to the bottom line alone, though. Note: ...
user avatar
12 votes
Accepted

What Key Performance Indicators (KPIs) are used to measure DevOps?

I don't think there are any "universal" DevOps KPIs. For example, velocity is great, unless it's not a key driver for your business. Amazon cares a lot about velocity because they have a massive ...
user avatar
  • 3,973
12 votes

What are some methods to measure the ROI for DevOps?

The key metric for a DevOps pipeline is Cycle Time (also called Lead Time). This is the time it takes for a change (or a change request, tracking all the way to the inception of the idea). The best ...
user avatar
11 votes
Accepted

What exactly is the cloud term 'a Firehose'?

The fire hose is a reference to an old Weird Al Yankovick movie, UHF (1989). In this movie, George Newman (portrayed by Yankovick) starts a local TV channel in the UHF band and is responsible for ...
user avatar
  • 3,674
8 votes

What are some methods to measure the ROI for DevOps?

Captain obvious : by reducing time to market and defects on releases. To extend on this one liner, the usual pitfall is being an organization change without any reference. Engaging a culture or ...
user avatar
  • 11.1k
7 votes
Accepted

How to model Man, Machine, Measures, and Process in a DevOps world?

What they are talking about is Kaizen 5M (Man, Machine, Material, Method, Measurement). It is approach to continuous improvement at every station in the process and the Ms are possible points of ...
user avatar
  • 5,627
7 votes

pre-DevOps deployment metrics challenge

A technique we've used in the past in similar situations is to get "management commitment" that imposes these rules to every team member: Access to perform updates to the target deployment areas (i.e....
user avatar
  • 6,963
6 votes

pre-DevOps deployment metrics challenge

The 2017 state of devops report says there's about a 31-45% "change failure rate." While that intuitively sounds about right, are they tracked as incidents? Nah. Because they get fixed pretty quickly, ...
user avatar
3 votes
Accepted

What are the best logging/metrics reporting tools for use with OpenShift?

The question hasn't had an answer in seven months so I will promote my upvoted comment to an answer: Finding the lifecycle of a specific message across services is known as "distributed tracing". ...
user avatar
  • 1,162
3 votes

What are benefits of using third party app metrics tools versus custom build tools?

A third party app metrics tools is great if it already covers all (or most of) the parameters you want to monitor and it presents the information in a convenient enough manner for your use case - you ...
user avatar
2 votes

What is the proper relationship between rollback/rollforward and MTTR metrics?

Yes, MTTR is/should always be tied to the business outcome: if things are not stable the very business is at risk. The fact that the expected code/feature/change is still stuck in process in scenario ...
user avatar
2 votes

What Key Performance Indicators (KPIs) are used to measure DevOps?

DevOps does not have any KPI. It would be like asking what are the KPI of Love. But some of the things you mentioned (Problem and Incident Management, Capacity Management, Change and Release ...
user avatar
  • 5,627
2 votes

Identifying a benchmark to compare overall performance of VM virtualization vs hardware

You should do a comparison of commercial virtualization products on the same hardware resources, OR benchmarking commercial virtualization products individually, there are ways to do it, you can even ...
user avatar
  • 201
2 votes
Accepted

How do I measure invisible work?

There is a brilliant talk and blog on this "invisible work" called Being Glue. Every senior person in an organisation should be aware of the less glamorous - and often less-promotable - ...
user avatar
2 votes
Accepted

Which libraries generate observability metrics for applications in the cluster to prometheus?

For Application specific calls you need to use a Prometheus client and create the metrics yourself. The Prometheus client will allow you to create a /metrics endpoint where you can output the current ...
user avatar
  • 1,269
1 vote

How do I measure invisible work?

Keep track of your time in a spreadsheet--I use LibreOffice Calc or Microsoft Excel to do this. I usually round to the nearest 15 minutes in the Start and End columns. The Time column automatically ...
user avatar
1 vote

Is there an established metric to describe optimal/needed ressources for a specific computational task?

As far as I'm aware, there is no universal standard amongst cloud providers. One reason for this is because most cloud providers like to abstract how their backend infrastructure, that their instances ...
user avatar
  • 2,993
1 vote

Getting error while trying to communicate with apiserver in kube-state-metrics pod

This doesn't look like kube-state-metrics but your node configuration/networking issue. You will need to debug node to node communication. I would start by checking on which nodes the kube-state-...
user avatar
  • 176
1 vote
Accepted

Definition of change failure rate and mean time to recovery DORA metrics

You are asking the right questions and hitting on a very important aspect of these metrics. Individual metrics are not super helpful and measurements need to be defined. Having worked with these ...
user avatar
  • 161
1 vote
Accepted

Is there a way to make Prometheus to scrape only the metrics which are present in Grafana?

I haven't found any way to do that, so I created a simple CLI based on Python, which can assist with the task - make sure you don’t scrape metrics in Prometheus, which you don’t present in Grafana ...
user avatar
1 vote
Accepted

Are there cheaper alternatives to cloud watch logs for creating dash boards?

Grafana was not really built to view logs from the get go. They however introduced this feature in v6.0 via the Explore tab This can be leveraged in 2 ways. Via Elasticsearch data source (in v6.3+) ...
user avatar
1 vote

Identifying a benchmark to compare overall performance of VM virtualization vs hardware

IMHO an absolute benchmark can be rather useless/misleading, I'd always consider the specific context of the application intended to be executed on the platforms being benchmarked and its performance ...
user avatar
1 vote

What is the proper term for lead time from commit to deployment?

From code repository to any environment, as a running software would be "Time to Deploy" ( which is different from deployment time, btw ). From code repository all the way to production environment, ...
user avatar
1 vote

What is the proper relationship between rollback/rollforward and MTTR metrics?

The mean time to recover has an implied subject - the mean time to recover what? Defining this is key to using the metric effectively. Are you recovering the general availability of your production ...
user avatar
1 vote

What are some methods to measure the ROI for DevOps?

Late to the game here but thought I'd chime in. You can't manage what you don't measure, so for starters, here are the key metrics devops teams should be tracking for incident response: Uptime % : ...
user avatar

Only top scored, non community-wiki answers of a minimum length are eligible