Skip to main content

Questions tagged [monitoring]

For questions about observing, tracking, and recording activities or data to measure progress towards achieving objectives.

Filter by
Sorted by
Tagged with
17 votes
1 answer
5k views

How to create a centralised dashboard to monitor multiple cloud (Amazon and Google)?

I'm looking for a single product or service which can be used as a centralized dashboard to monitor cloud infrastructure provide by Amazon Web Services and Google Cloud Platform in addition to the ...
ck reddy's user avatar
  • 273
14 votes
2 answers
23k views

How to check Jenkins build executor free memory?

In Jenkins when clicking on Build Executor Status I can only see free disk space related statistics (URI: /computer). How I can monitor free system memory (RAM) in Jenkins? I'm asking, because ...
kenorb's user avatar
  • 7,911
14 votes
3 answers
15k views

How do I troubleshoot missing data in my Prometheus database?

I have been gradually integrating Prometheus into my monitoring workflows, in order to gather detailed metrics about running infrastructure. During this, I have noticed that I often run into a ...
Sander's user avatar
  • 241
10 votes
1 answer
728 views

What exactly is the cloud term 'a Firehose'?

I found a Firehose definition from Overview of the Loggregator System Cloud Foundry docs. The Firehose is a WebSocket endpoint that streams all the event data coming from a Cloud Foundry ...
Sybil's user avatar
  • 452
9 votes
4 answers
248 views

Monitor program progress on multiple servers

We have three servers that are running python programs that are running data analysis tasks inside a tmux session. The method we are using at the moment is ssh'ing into each of them connecting the ...
guano's user avatar
  • 93
9 votes
2 answers
2k views

How to change PagerDuty incident name?

I have AWS Cloudwatch hooked up with PagerDuty. Whenever an alert goes out, it goes to PagerDuty, which then sends us a message in Slack. The problem is, this is what it shows in the chat: ...
Tam N.'s user avatar
  • 191
8 votes
2 answers
19k views

Prometheus alert CPUThrottlingHigh raised but monitoring does not show it

I have installed Prometheus to monitor my installation and it is frequently raising alerts about CPU throttling. The Prometheus alert rules to identify this alert is : alert: CPUThrottlingHigh expr: ...
jobou's user avatar
  • 183
8 votes
1 answer
6k views

Why is Prometheus not a good choice for data with high cardinality?

I have a background in relational databases and new to Prometheus. I wonder why Prometheus is not a good choice for high cardinality data? Why do I need to use low cardinality data? It's exact ...
Sybil's user avatar
  • 452
8 votes
4 answers
3k views

Monitoring checklist - What things should I be monitoring?

We are building a (Zabbix-based) monitoring system for our applications; hovewer, I'm having difficulties in defining what to monitor? I have so far come up with the following general categories: ...
krisy's user avatar
  • 181
8 votes
1 answer
1k views

Sensu TCP Connection Issue

I have a fresh sensu/uchiwa stack running on a virtual machine. It is a "standalone" installation - redis, rabbitmq, sensu-server, sensu-api, sensu-client, and uchiwa are all installed on the same ...
fildred13's user avatar
  • 313
7 votes
2 answers
1k views

How do you monitor Node Micro services running inside of Docker Containers?

This article about "How healthy is your Dockerized application?" explains the trouble with monitoring, but it doesn't provide any good examples of how to actually monitor a microservice inside of the ...
avi's user avatar
  • 1,279
7 votes
1 answer
905 views

Are there any best practices and/or tools for 'nohup' monitoring?

I use nohup for starting Ansible playbooks inside the Master which is spawned via boto3 from AWS Lambda. This playbook creates multiple workers, make them do some tasks, and terminates them. So, I ...
Dawny33's user avatar
  • 2,816
7 votes
1 answer
783 views

How do you monitor and alert on thrashing containers?

Are there any proposed best practices for how to monitor for thrashing containers? We're in a situation where we have containers that might try to come up and will crash -> restart a few dozen times ...
MrDuk's user avatar
  • 295
7 votes
2 answers
144 views

Site monitoring browser-only tool running in frontend only?

Infrastructure monitoring tools like Nagios or much more "low-level" curl are well known in the DevOps community. But, given I would like just to track some APIs in similar manner just in frontend, ...
Ta Mu's user avatar
  • 6,782
6 votes
2 answers
998 views

What is alert fatigue?

Recently, we hear the term "alert fatigue" a lot. I have a few questions regarding this: where did this term come from? was it invented by a company like PagerDuty? what is alert fatigue actually?
codeforester's user avatar
6 votes
3 answers
3k views

Alarms management with Elasticsearch and Kibana

I'm working on my first implementation of the Elasticsearch-Logstash-Kibana stack. I have everything working, but now I need to: Set alarms on certain thresholds/events Send notifications on alarms (...
niglesias's user avatar
  • 205
6 votes
5 answers
1k views

What tools do you use to monitor applications and business-specific data? (apart from Jenkins)

Currently, we use Jenkins to run small node.js scripts in order to check if applications are doing what they're supposed to. Like, we have some routines which should run in an interval and we need to ...
user3220's user avatar
6 votes
1 answer
2k views

Deriving an item value from a structured file in Zabbix

Zabbix's builtin items for monitoring system parameters are reasonably rich, but there are occasionally things it doesn't seem to make trivial to obtain, such as how many dirty cache pages there are. ...
Michael Mol's user avatar
  • 1,045
6 votes
1 answer
212 views

What are benefits of using third party app metrics tools versus custom build tools?

With tools like Riemann, New Relic, etc., is there any benefit to building custom app metrics tools for monitoring application health?
soundslikeodd's user avatar
5 votes
4 answers
633 views

monitoring/alerting system which can support very arbitrary data source and logic

I am looking for a monitoring/alerting tool/system which can support very arbitrary data source and logic. (following is a made up example to more easily demonstrate my needs) I have a database ...
Fai Ng's user avatar
  • 153
5 votes
1 answer
3k views

How fast does Prometheus data grow?

This may sound like a vague question so I will provide some context below. The basic question is : What parameters describe the growth in size of a Prometheus database over time? To tie the question ...
Bruce Becker's user avatar
  • 3,623
5 votes
4 answers
1k views

How do you monitor status of multiple docker containers?

My home server has about 15 distinct services running, each represented by a Docker container. Depending on how the developers implemented the Dockerfile, some services have health checks, but most do ...
void.pointer's user avatar
5 votes
3 answers
3k views

How to monitor AWS S3 cross-region replication process?

Amazon S3 has a cross-region replication which will handle copy of new/updated objects to additional region. The problem is that solution does not provide visibility on state for replication process, ...
rombob's user avatar
  • 657
5 votes
1 answer
348 views

What opensource solutions can be used to implement anomaly detection based on Riemann metrics?

When Riemann used as system and/or application metrics collector, what are opensource tools can be used in order to implement anomaly detection monitoring?
rombob's user avatar
  • 657
5 votes
2 answers
432 views

Trigger PagerDuty alert after a number of incidents

Is it possible to only have an alert triggered after a certain number of incidents from an integration? For example, if my application reports a single non-critical failure of a kind, that's worth-...
dovetalk's user avatar
  • 151
4 votes
2 answers
13k views

How to get memory usage per process with sar, sysstat?

Can I get memory usage per process with Linux? we monitor our servers with sysstat/sar. But besides seeing that memory went off the roof at some point, we can't pinpoint which process was getting ...
kokito's user avatar
  • 161
4 votes
1 answer
53 views

Laptop Internet connection monitoring

I have a need to monitor laptops both Linux and Windows that are deployed to remote locations which we don't have physical access to all the time. The laptops are used for different services but need ...
Grimlockz's user avatar
  • 149
4 votes
3 answers
250 views

What is the Prometheus and Grafana ideal setup?

I am just wondering. If I have many environments monitored via Prometheus, what will be the best configuration? The security and efficiency are already important for on-premise installations but ...
gervais.b's user avatar
  • 155
4 votes
1 answer
3k views

monitor for docker stats similar to htop?

I'm in the need for this and my google leaded me to this post on SO I guess it's helpful to boost the beta for our sister site DevOps Stackexchagne here. I quote the original question docker stats ...
Nam G VU's user avatar
  • 195
4 votes
1 answer
113 views

Infrastructure Stability Report

We are using Azure IAAS to host our applications, and these are hosted on a number of virtual machines for different tiers Our client have recently asked us to provide monthly report on the ...
Yogi's user avatar
  • 141
4 votes
1 answer
384 views

Is Serf an added value when a container orchestration platform like kubernetes is used?

When the Hashicorp's website was checked it seems that there is another tool, i.e. Serf. Back in the day there was another tool called otto, but that was deprecated at a certain moment. After reading ...
030's user avatar
  • 13.2k
4 votes
1 answer
4k views

How to get EC2 instance tags when pulling CloudWatch data?

For monitoring purposes, we're pulling AWS/EC2 instances statistics data from CloudWatch and save it to InfluxDB. We're using Telegraf to do this. However, when pulling the data from Cloudwatch, ...
Yossale's user avatar
  • 141
4 votes
0 answers
886 views

Kubernetes metric or command to show liveness delay time (app startup time)

HTTP Kubernetes liveness and readiness checks are configured as per the documentation. The initialDelaySeconds field tells the kubelet how long it should wait before performing the first liveness / ...
JamesJJ's user avatar
  • 171
3 votes
5 answers
121 views

Health monitoring of web pages without using GET check

I am looking for a solution to monitor the health (DOWN or UP) of my web pages. Let's say I have three services, site.com/data site.com/user site.com/id Now, what I can do is that I can create a GET ...
Dinesh Ahuja's user avatar
3 votes
1 answer
707 views

Why would graphite-webapp browser not display any body content?

I have used 0.9.x Graphite in the past as the basis of my monitoring system, and am trying a fresh install of 1.0.1 prior to upgrading across my systems (Ubuntu, 14.04, though I doubt that matters). ...
fildred13's user avatar
  • 313
3 votes
1 answer
61 views

Is there any way to get New Relic or PagerDuty to not alert during nightly maintenance?

Initial Problem We have some badly behaved overnight maintenance jobs that cause alerts for AppDex and error rates for our apps. These are metrics that would be problematic if they happened during ...
chicks's user avatar
  • 1,878
3 votes
1 answer
80 views

How to monitor a micro-service oriented solution?

I run a micro-service oriented system, running under a private network, composed mainly of: databases (clusters) internal API's external/public API's workers (services) monitoring servers All are ...
Alexandru R's user avatar
3 votes
1 answer
1k views

Logging & Monitoring on multiple servers

I lead a small project with 2 groups of servers (servers in a single group are clones with the same microservices, like pods in the k8s), a balance loader, and a DB. Docker & k8s aren't used ...
AivanF.'s user avatar
  • 181
3 votes
1 answer
388 views

tools to gather variant information from thousands of servers and update into database

Recently, I use ansible to gather information periodically from thousands of servers(which already installed collectd to gather CPU, memory, disks, netowrking info) in our company. For example: I ...
CSJ's user avatar
  • 131
3 votes
0 answers
96 views

Monitoring SSRS report server with AppDynamics

I've spent several days trying to figure out how to set up AppDynamics to monitor our SQL Server Reporting Servers, and am encountering the issue where multiple nodes for the same server and ...
Stuart Ainsworth's user avatar
3 votes
0 answers
46 views

Is there an all-in-one control center software that can be used to manage build and test execution and to visualize test results?

If there are no constraints with regards to other components used in the system at all, do you know a software that can be used as a sort of "cockpit" / control center to visualize test ...
Hunter2's user avatar
  • 31
3 votes
0 answers
367 views

How to deploy StatsD listening on UDP in kubernetes with external loadbalancer on AWS?

Our goal is to have StatsD deployed on k8s cluster running on AWS. Currently all existing applications using UDP to send StatsD metrics. As we understood from the kubernetes docs and tests we ...
rombob's user avatar
  • 657
2 votes
3 answers
179 views

Automatic periodic conditional checks

I need a simple tool that will carry out some conditional checks periodically and give me a red/green status that I can use as an indication that something is wrong. These are examples of checks that ...
Silas Hansen's user avatar
2 votes
1 answer
188 views

Monitoring immutable infrastructure virtual machines

Currently I am using the HashiCorp stack (Packer, Terraform) and Ansible, to generate Immutable Infrastructure and Infrastructure as Code. This builds a Virtual Machine from a base image, provisions ...
Rekovni's user avatar
  • 933
2 votes
1 answer
109 views

What is a good strategy to reliably and automatically perform remote system tests of a web service?

In a company I work for, we have deployed many services: a major part of them are small and rather rarely used, but an outage would be a problem nonetheless. At some point I realized that manual ...
d33tah's user avatar
  • 71
2 votes
2 answers
1k views

Log/Data rotation in Docker Container

My question is more on the concept or best practices to follow. I have two docker containers running InfluxDB and Grafana (monitoring applications). I have mounted external volume to each. now, the ...
Chandella07's user avatar
2 votes
2 answers
245 views

How to get Memory Usage from Windows Server 2012 R2 in OpenStack

I have an Rocky OpenStack cluster, I want to monitor memory usage of instances. monitoring of Linux instances is OK but Windows Server instances do not provide any data for memory usage. I've ...
Milad Yarmohammadi's user avatar
2 votes
2 answers
115 views

What do you tell someone new to going oncall or PagerDutyl?

[[ Based on tags and the wording this sounds like a PagerDuty-specific question, but it could apply to any tech or monitoring stack in my mind.... PagerDuty is just so dominant in SF-based jobs I've ...
chicks's user avatar
  • 1,878
2 votes
2 answers
3k views

Is there a standard way to check if a web API is alive?

As a developer, I have been involved in producing a number of assorted web-APIs, both for internal and public use. Is there a standard (or de facto) way of checking if a web API is up and running? (...
Reyhn's user avatar
  • 129
2 votes
2 answers
3k views

Monitoring Kubernetes CronJob & Job in Grafana for today day only

I'm trying to create a Dashboard in Grafana that will show the status of Cronjob & Job success & fail. Currently i'm using kube_job_status_succeeded to get a status job, but the issue here ...
DagaReiN's user avatar