Questions tagged [monitoring]
For questions about observing, tracking, and recording activities or data to measure progress towards achieving objectives.
92
questions
17
votes
1
answer
5k
views
How to create a centralised dashboard to monitor multiple cloud (Amazon and Google)?
I'm looking for a single product or service which can be used as a centralized dashboard to monitor cloud infrastructure provide by Amazon Web Services and Google Cloud Platform in addition to the ...
- 273
14
votes
2
answers
23k
views
How to check Jenkins build executor free memory?
In Jenkins when clicking on Build Executor Status I can only see free disk space related statistics (URI: /computer). How I can monitor free system memory (RAM) in Jenkins?
I'm asking, because ...
- 7,941
14
votes
3
answers
16k
views
How do I troubleshoot missing data in my Prometheus database?
I have been gradually integrating Prometheus into my monitoring workflows, in order to gather detailed metrics about running infrastructure.
During this, I have noticed that I often run into a ...
- 241
10
votes
1
answer
753
views
What exactly is the cloud term 'a Firehose'?
I found a Firehose definition from Overview of the Loggregator System Cloud Foundry docs.
The Firehose is a WebSocket endpoint that streams all the event data
coming from a Cloud Foundry ...
- 452
9
votes
4
answers
265
views
Monitor program progress on multiple servers
We have three servers that are running python programs that are running data analysis tasks inside a tmux session. The method we are using at the moment is ssh'ing into each of them connecting the ...
- 93
9
votes
2
answers
2k
views
How to change PagerDuty incident name?
I have AWS Cloudwatch hooked up with PagerDuty. Whenever an alert goes out, it goes to PagerDuty, which then sends us a message in Slack. The problem is, this is what it shows in the chat:
...
- 191
8
votes
2
answers
20k
views
Prometheus alert CPUThrottlingHigh raised but monitoring does not show it
I have installed Prometheus to monitor my installation and it is frequently raising alerts about CPU throttling.
The Prometheus alert rules to identify this alert is :
alert: CPUThrottlingHigh
expr: ...
- 183
8
votes
1
answer
7k
views
Why is Prometheus not a good choice for data with high cardinality?
I have a background in relational databases and new to Prometheus. I wonder why Prometheus is not a good choice for high cardinality data? Why do I need to use low cardinality data? It's exact ...
- 452
8
votes
4
answers
3k
views
Monitoring checklist - What things should I be monitoring?
We are building a (Zabbix-based) monitoring system for our applications; hovewer, I'm having difficulties in defining what to monitor?
I have so far come up with the following general categories:
...
- 181
8
votes
1
answer
1k
views
Sensu TCP Connection Issue
I have a fresh sensu/uchiwa stack running on a virtual machine. It is a "standalone" installation - redis, rabbitmq, sensu-server, sensu-api, sensu-client, and uchiwa are all installed on the same ...
- 313
7
votes
2
answers
1k
views
How do you monitor Node Micro services running inside of Docker Containers?
This article about "How healthy is your Dockerized application?" explains the trouble with monitoring, but it doesn't provide any good examples of how to actually monitor a microservice inside of the ...
- 1,279
7
votes
1
answer
914
views
Are there any best practices and/or tools for 'nohup' monitoring?
I use nohup for starting Ansible playbooks inside the Master which is spawned via boto3 from AWS Lambda.
This playbook creates multiple workers, make them do some tasks, and terminates them.
So, I ...
- 2,816
7
votes
1
answer
835
views
How do you monitor and alert on thrashing containers?
Are there any proposed best practices for how to monitor for thrashing containers? We're in a situation where we have containers that might try to come up and will crash -> restart a few dozen times ...
- 295
7
votes
2
answers
147
views
Site monitoring browser-only tool running in frontend only?
Infrastructure monitoring tools like Nagios or much more "low-level" curl are well known in the DevOps community.
But, given I would like just to track some APIs in similar manner just in frontend, ...
- 6,782
6
votes
2
answers
1k
views
What is alert fatigue?
Recently, we hear the term "alert fatigue" a lot. I have a few questions regarding this:
where did this term come from?
was it invented by a company like PagerDuty?
what is alert fatigue actually?
- 391
6
votes
3
answers
3k
views
Alarms management with Elasticsearch and Kibana
I'm working on my first implementation of the Elasticsearch-Logstash-Kibana stack. I have everything working, but now I need to:
Set alarms on certain thresholds/events
Send notifications on alarms
(...
- 205
6
votes
5
answers
1k
views
What tools do you use to monitor applications and business-specific data? (apart from Jenkins)
Currently, we use Jenkins to run small node.js scripts in order to check if applications are doing what they're supposed to. Like, we have some routines which should run in an interval and we need to ...
- 61
6
votes
1
answer
2k
views
Deriving an item value from a structured file in Zabbix
Zabbix's builtin items for monitoring system parameters are reasonably rich, but there are occasionally things it doesn't seem to make trivial to obtain, such as how many dirty cache pages there are.
...
- 1,045
6
votes
1
answer
213
views
What are benefits of using third party app metrics tools versus custom build tools?
With tools like Riemann, New Relic, etc., is there any benefit to building custom app metrics tools for monitoring application health?
- 173
5
votes
4
answers
639
views
monitoring/alerting system which can support very arbitrary data source and logic
I am looking for a monitoring/alerting tool/system which can support very arbitrary data source and logic.
(following is a made up example to more easily demonstrate my needs)
I have a database ...
- 153
5
votes
1
answer
3k
views
How fast does Prometheus data grow?
This may sound like a vague question so I will provide some context below. The basic question is :
What parameters describe the growth in size of a Prometheus database over time?
To tie the question ...
- 3,693
5
votes
4
answers
1k
views
How do you monitor status of multiple docker containers?
My home server has about 15 distinct services running, each represented by a Docker container. Depending on how the developers implemented the Dockerfile, some services have health checks, but most do ...
- 183
5
votes
3
answers
3k
views
How to monitor AWS S3 cross-region replication process?
Amazon S3 has a cross-region replication which will handle copy of new/updated objects to additional region.
The problem is that solution does not provide visibility on state for replication process, ...
- 657
5
votes
1
answer
349
views
What opensource solutions can be used to implement anomaly detection based on Riemann metrics?
When Riemann used as system and/or application metrics collector, what are opensource tools can be used in order to implement anomaly detection monitoring?
- 657
5
votes
2
answers
518
views
Trigger PagerDuty alert after a number of incidents
Is it possible to only have an alert triggered after a certain number of incidents from an integration?
For example, if my application reports a single non-critical failure of a kind, that's worth-...
- 151
4
votes
2
answers
13k
views
How to get memory usage per process with sar, sysstat?
Can I get memory usage per process with Linux? we monitor our servers with sysstat/sar. But besides seeing that memory went off the roof at some point, we can't pinpoint which process was getting ...
- 161
4
votes
1
answer
53
views
Laptop Internet connection monitoring
I have a need to monitor laptops both Linux and Windows that are deployed to remote locations which we don't have physical access to all the time.
The laptops are used for different services but need ...
- 149
4
votes
3
answers
253
views
What is the Prometheus and Grafana ideal setup?
I am just wondering. If I have many environments monitored via Prometheus, what will be the best configuration?
The security and efficiency are already important for on-premise installations but ...
- 155
4
votes
1
answer
3k
views
monitor for docker stats similar to htop?
I'm in the need for this and my google leaded me to this post on SO
I guess it's helpful to boost the beta for our sister site DevOps Stackexchagne here.
I quote the original question
docker stats ...
- 195
4
votes
1
answer
113
views
Infrastructure Stability Report
We are using Azure IAAS to host our applications, and these are hosted on a number of virtual machines for different tiers
Our client have recently asked us to provide monthly report on the ...
- 141
4
votes
1
answer
388
views
Is Serf an added value when a container orchestration platform like kubernetes is used?
When the Hashicorp's website was checked it seems that there is another tool, i.e. Serf. Back in the day there was another tool called otto, but that was deprecated at a certain moment.
After reading ...
- 13.3k
4
votes
1
answer
4k
views
How to get EC2 instance tags when pulling CloudWatch data?
For monitoring purposes, we're pulling AWS/EC2 instances statistics data from CloudWatch and save it to InfluxDB.
We're using Telegraf to do this.
However, when pulling the data from Cloudwatch, ...
- 141
4
votes
0
answers
891
views
Kubernetes metric or command to show liveness delay time (app startup time)
HTTP Kubernetes liveness and readiness checks are configured as per the documentation.
The initialDelaySeconds field tells the kubelet how long it should wait before performing the first liveness / ...
- 171
3
votes
5
answers
129
views
Health monitoring of web pages without using GET check
I am looking for a solution to monitor the health (DOWN or UP) of my web pages.
Let's say I have three services,
site.com/data
site.com/user
site.com/id
Now, what I can do is that I can create a GET ...
- 131
3
votes
1
answer
711
views
Why would graphite-webapp browser not display any body content?
I have used 0.9.x Graphite in the past as the basis of my monitoring system, and am trying a fresh install of 1.0.1 prior to upgrading across my systems (Ubuntu, 14.04, though I doubt that matters).
...
- 313
3
votes
1
answer
62
views
Is there any way to get New Relic or PagerDuty to not alert during nightly maintenance?
Initial Problem
We have some badly behaved overnight maintenance jobs that cause alerts for AppDex and error rates for our apps. These are metrics that would be problematic if they happened during ...
- 1,893
3
votes
1
answer
80
views
How to monitor a micro-service oriented solution?
I run a micro-service oriented system, running under a private network, composed mainly of:
databases (clusters)
internal API's
external/public API's
workers (services)
monitoring servers
All are ...
- 131
3
votes
1
answer
1k
views
Logging & Monitoring on multiple servers
I lead a small project with 2 groups of servers (servers in a single group are clones with the same microservices, like pods in the k8s), a balance loader, and a DB. Docker & k8s aren't used ...
- 181
3
votes
1
answer
389
views
tools to gather variant information from thousands of servers and update into database
Recently, I use ansible to gather information periodically from thousands of servers(which already installed collectd to gather CPU, memory, disks, netowrking info) in our company.
For example: I ...
- 131
3
votes
0
answers
98
views
Monitoring SSRS report server with AppDynamics
I've spent several days trying to figure out how to set up AppDynamics to monitor our SQL Server Reporting Servers, and am encountering the issue where multiple nodes for the same server and ...
- 998
3
votes
0
answers
48
views
Is there an all-in-one control center software that can be used to manage build and test execution and to visualize test results?
If there are no constraints with regards to other components used in the system at all, do you know a software that can be used as a sort of "cockpit" / control center to visualize test ...
- 31
3
votes
0
answers
389
views
How to deploy StatsD listening on UDP in kubernetes with external loadbalancer on AWS?
Our goal is to have StatsD deployed on k8s cluster running on AWS.
Currently all existing applications using UDP to send StatsD metrics.
As we understood from the kubernetes docs and tests we ...
- 657
2
votes
3
answers
181
views
Automatic periodic conditional checks
I need a simple tool that will carry out some conditional checks periodically and give me a red/green status that I can use as an indication that something is wrong.
These are examples of checks that ...
- 171
2
votes
1
answer
190
views
Monitoring immutable infrastructure virtual machines
Currently I am using the HashiCorp stack (Packer, Terraform) and Ansible, to generate Immutable Infrastructure and Infrastructure as Code.
This builds a Virtual Machine from a base image, provisions ...
- 933
2
votes
1
answer
109
views
What is a good strategy to reliably and automatically perform remote system tests of a web service?
In a company I work for, we have deployed many services: a major part of them are small and rather rarely used, but an outage would be a problem nonetheless. At some point I realized that manual ...
- 71
2
votes
2
answers
1k
views
Log/Data rotation in Docker Container
My question is more on the concept or best practices to follow.
I have two docker containers running InfluxDB and Grafana (monitoring applications). I have mounted external volume to each.
now, the ...
- 123
2
votes
2
answers
250
views
How to get Memory Usage from Windows Server 2012 R2 in OpenStack
I have an Rocky OpenStack cluster, I want to monitor memory usage of instances.
monitoring of Linux instances is OK but Windows Server instances do not provide any data for memory usage.
I've ...
2
votes
2
answers
115
views
What do you tell someone new to going oncall or PagerDutyl?
[[ Based on tags and the wording this sounds like a PagerDuty-specific question, but it could apply to any tech or monitoring stack in my mind.... PagerDuty is just so dominant in SF-based jobs I've ...
- 1,893
2
votes
2
answers
3k
views
Is there a standard way to check if a web API is alive?
As a developer, I have been involved in producing a number of assorted web-APIs, both for internal and public use.
Is there a standard (or de facto) way of checking if a web API is up and running?
(...
- 129
2
votes
2
answers
4k
views
Monitoring Kubernetes CronJob & Job in Grafana for today day only
I'm trying to create a Dashboard in Grafana that will show the status of Cronjob & Job success & fail.
Currently i'm using kube_job_status_succeeded to get a status job, but the issue here ...
- 21