Questions tagged [monitoring]
For questions about observing, tracking, and recording activities or data to measure progress towards achieving objectives.
93
questions
0
votes
0
answers
17
views
Method or Tool monitoring traffic error rate
I have implemented Canary deployment using istio service mesh.
Here is the Canary deployment step:
I have combined routing traffic by traffic weight and header. The detailed configuration is like the ...
0
votes
1
answer
12
views
Virtual Machine Monitoring KQL yielding empty results
I have enabled Azure Monitoring in one of our virtual machine. Is been 4 days the virtual machine is on, below is the query:
Perf
| where ObjectName == "Memory" and
(CounterName == "...
- 128
0
votes
0
answers
20
views
Azure Metrics Table
I want to understand how various rows in Azure Monitor Metrics logs Table get generated. Can you please share a detailed documentation regarding the same?
0
votes
0
answers
29
views
Do I need to use Azure Application Insights SDKs to make Application Insights collect data of an AKS cluster about network requests and responses?
I have an Azure Kubernetes Service (AKS) cluster and I already use Azure Container Insights to collect data about the health of the cluster. However, I'd like to integrate the cluster also with Azure ...
- 101
1
vote
0
answers
180
views
What are the good metrics to collect for frontend application?
Context:
We have some features that rarely calls any backend service and the logic stays in the frontend.
Most of the tools we have can calculate SLI/SLO status based on latency and error code return ...
- 111
0
votes
0
answers
84
views
Loki-stack helm chart is not allowing to edit grafana.ini
I have deployed Loki-stack using helm charts. For configuring email alerts, I need to modify grafana.ini. I am not able to edit grafana.ini as it has read-only permissions.
Even I could find a way to ...
0
votes
1
answer
1k
views
Grafana NGINX reverse proxy not functioning correctly
I seem to be having trouble with Grafana behind an nginx proxy. I'm getting console errors and errors in Grafana, and the changes I try to make in Grafana are not working.
Errors:
From within Grafana ...
- 1
0
votes
0
answers
31
views
Which monitoring tool for NestJs
I'm searching for a monitoring tool that can record every error on NestJs server. For each error I want to access to the associated payload, body, request object etc etc...
I used to use Azure Insight ...
- 101
0
votes
0
answers
41
views
Restricting one module for one tf file
So I have file called main.tf in which I am calling the existing module for iam_role, but in same main.tf I have called one more module for service_role but I want to restrict that service_role module ...
- 1
2
votes
2
answers
2k
views
Monitoring Kubernetes CronJob & Job in Grafana for today day only
I'm trying to create a Dashboard in Grafana that will show the status of Cronjob & Job success & fail.
Currently i'm using kube_job_status_succeeded to get a status job, but the issue here ...
- 21
1
vote
1
answer
582
views
What means "Reconciliation" from Argo CD
I m looking a metric in Grafana from a official Dashboard from Argo CD, the panel its named "Reconciliation Activity" and use the following metric:
argocd_app_reconcile_count
I look for a ...
1
vote
0
answers
24
views
How do I monitor response times with sprint actuator metrics and Telegraf?
We are using micrometer with the statsd flavor in our Spring Boot applications to send metrics to Telegraf for visualization in the Grafana dashboard.
However, I notice that the most valuable metrics ...
- 111
1
vote
1
answer
558
views
How to monitor ELK using metricbeat on kubernetes (v8 compatible and simple solution)
For probably more than a year there's been a deprecation warning on xpack monitoring in elasticsearch, logstash, kibana etc. saying the built-in monitoring is going to disappear.
Since I don't like ...
- 131
2
votes
1
answer
96
views
What is a good strategy to reliably and automatically perform remote system tests of a web service?
In a company I work for, we have deployed many services: a major part of them are small and rather rarely used, but an outage would be a problem nonetheless. At some point I realized that manual ...
- 71
0
votes
3
answers
562
views
What is the best way to monitor job status?
I would like to monitor for recent spike in failed application jobs at my company.
Job statuses are stored in a MySQL table. We have on order of 50 different types of jobs, and sometimes, one of ...
- 101
3
votes
0
answers
57
views
Monitoring SSRS report server with AppDynamics
I've spent several days trying to figure out how to set up AppDynamics to monitor our SQL Server Reporting Servers, and am encountering the issue where multiple nodes for the same server and ...
- 998
2
votes
2
answers
617
views
Log/Data rotation in Docker Container
My question is more on the concept or best practices to follow.
I have two docker containers running InfluxDB and Grafana (monitoring applications). I have mounted external volume to each.
now, the ...
- 123
1
vote
1
answer
217
views
Where to install Prometheus for Kubernetes monitoring
I'm considering using Prometheus to monitor and analyze different metrics from my AWS EKS Kubernetes cluster running in Fargate, as it seems to be the standard tool during these times. However, ...
3
votes
0
answers
43
views
Is there an all-in-one control center software that can be used to manage build and test execution and to visualize test results?
If there are no constraints with regards to other components used in the system at all, do you know a software that can be used as a sort of "cockpit" / control center to visualize test ...
- 31
1
vote
1
answer
579
views
Pagerduty API integration and auto-resolution
It is possible to implement auto-resolution with Pagerduty API integration. When a monitoring system detects an issue based on some metric and a threshold, it would create a Pagerduty incident through ...
- 381
0
votes
1
answer
47
views
Simple service to check infrastructure status
I have a very simple setup here (solo IT guy): we have a on-prem server which runs some services. They should produce e.g. a daily logfile. I'd like to get a notification if this doesn't happen for ...
- 103
3
votes
1
answer
862
views
Logging & Monitoring on multiple servers
I lead a small project with 2 groups of servers (servers in a single group are clones with the same microservices, like pods in the k8s), a balance loader, and a DB. Docker & k8s aren't used ...
- 181
1
vote
1
answer
209
views
Is there a way to make Prometheus to scrape only the metrics which are present in Grafana?
As a customer of Grafna Cloud, I need to minimize the number of DataSeries that are being sent (remote_write) to Grafana Cloud, to avoid being overcharged for metrics that I don't really use.
This can ...
- 151
3
votes
0
answers
231
views
How to deploy StatsD listening on UDP in kubernetes with external loadbalancer on AWS?
Our goal is to have StatsD deployed on k8s cluster running on AWS.
Currently all existing applications using UDP to send StatsD metrics.
As we understood from the kubernetes docs and tests we ...
- 657
1
vote
1
answer
33
views
Monitoring K8s Pods in case of outage
K8s has self-healing builtin features, if a pod crash then it will be replaced with the new pod but its log is gone. So what is the best way to monitor K8s pods in case of outage?
- 213
1
vote
1
answer
60
views
Production grade methodology for alerts
Background
Our code is written with:
Unit tests
End to end tests
Code review
Staging process
Deployment process
On the contrary, our alerts are just written and then modified occasionally manually. ...
- 113
4
votes
3
answers
194
views
What is the Prometheus and Grafana ideal setup?
I am just wondering. If I have many environments monitored via Prometheus, what will be the best configuration?
The security and efficiency are already important for on-premise installations but ...
- 155
3
votes
1
answer
1k
views
monitor for docker stats similar to htop?
I'm in the need for this and my google leaded me to this post on SO
I guess it's helpful to boost the beta for our sister site DevOps Stackexchagne here.
I quote the original question
docker stats ...
- 175
0
votes
1
answer
2k
views
SQS: What could high number of visible messages mean if messages received & deleted are normal?
I'm new to SQS.
I recently noticed the ApproximateNumberOfMessagesVisible in my SQS queue started rising. What was interesting though is that there was no sudden surge in the number of messages ...
1
vote
1
answer
28
views
Are there any tools to monitor custom console applications on Windows Server?
Are there any DevOps tools or known practices to monitor custom made console application on an on premises (Windows Server) environment?
We developed an exe that needs to be continuously running, ...
- 113
1
vote
2
answers
89
views
Gather resource usage by process in a kubernetes cluster
I am searching for a tool similar to Prometheus + Grafana that gather and record resource usage especially memory usage by process-ID or process-name.
We have two components that are running ...
- 205
0
votes
2
answers
56
views
How to define Service Level Objectives without historical data?
Assuming I can define Service Level Indicators for a user journey are there any structured methods for setting a Service Level Objective within that SLA without any historical data to indicate what is ...
- 11.3k
0
votes
1
answer
220
views
How to get Docker Container stats using DataDog API?
I have a running DataDog-Agent on a Docker server.
Is there a function in the DataDog API to get the stats of every single container, so I could print the stats to an external Webpage?
Or is there ...
- 1
2
votes
2
answers
144
views
How to get Memory Usage from Windows Server 2012 R2 in OpenStack
I have an Rocky OpenStack cluster, I want to monitor memory usage of instances.
monitoring of Linux instances is OK but Windows Server instances do not provide any data for memory usage.
I've ...
6
votes
2
answers
959
views
What is alert fatigue?
Recently, we hear the term "alert fatigue" a lot. I have a few questions regarding this:
where did this term come from?
was it invented by a company like PagerDuty?
what is alert fatigue actually?
- 381
1
vote
1
answer
56
views
What considerations should be taken into account for a good log file format?
We have a practical question I struggle to answer :
What is a good logfile schema?
Here are the caveats:
There are several workloads, each writing more than one log file
Applications are on more ...
- 3,241
0
votes
1
answer
75
views
Azure monitor and deployment slots
My question is actually quite simple: if I have a webapp with a deployment slot and a monitor that checks the health of webapp in some way (connections, cpu time or the like) , if I do a swap, what is ...
- 177
1
vote
2
answers
191
views
What is the advantage of using Prometheus over ingesting metrics using logs?
I want to setup monitoring on our environment. I am wondering on what are the advantages of using something like Prometheus for making metrics vs. just using something like the ELK stack for creating ...
- 13
0
votes
1
answer
62
views
How to scale the control plane of a service mesh?
Scalability in the data plane is easy to achieve by simply having more replicas. The configuration the proxies receive from the control plane makes that possible . However, if the number of services (...
- 76
0
votes
1
answer
205
views
Reset time vs alerting window size in alerting strategies for SLOs
In https://landing.google.com/sre/workbook/chapters/alerting-on-slos/#pros_and_cons_of_alerting_based_on_burn_r I don't understand how the reset time can be 58 min when the alerting window size is one ...
3
votes
0
answers
781
views
Kubernetes metric or command to show liveness delay time (app startup time)
HTTP Kubernetes liveness and readiness checks are configured as per the documentation.
The initialDelaySeconds field tells the kubelet how long it should wait before performing the first liveness / ...
- 161
7
votes
1
answer
406
views
How do you monitor and alert on thrashing containers?
Are there any proposed best practices for how to monitor for thrashing containers? We're in a situation where we have containers that might try to come up and will crash -> restart a few dozen times ...
- 295
8
votes
1
answer
6k
views
Why is Prometheus not a good choice for data with high cardinality?
I have a background in relational databases and new to Prometheus. I wonder why Prometheus is not a good choice for high cardinality data? Why do I need to use low cardinality data? It's exact ...
- 452
1
vote
1
answer
262
views
What are the levels of monitoring and their importance?
We are going through a process of change in our IT Operations Management. One of the items we are trying to improve is our monitoring of our infrastructure.
So far I've been thinking of only 3 levels ...
2
votes
0
answers
16
views
What Monitoring Dashboards do exist with customizable actions like handles, levers and actionable buttons? [closed]
Are there DevOps web dashboards (open-source preferably) or dashboard frameworks that allow setting up custom buttons, levers which execute custom actions from browser?
Think of "Plus" button which ...
- 121
7
votes
2
answers
15k
views
Prometheus alert CPUThrottlingHigh raised but monitoring does not show it
I have installed Prometheus to monitor my installation and it is frequently raising alerts about CPU throttling.
The Prometheus alert rules to identify this alert is :
alert: CPUThrottlingHigh
expr: ...
- 173
5
votes
4
answers
935
views
How do you monitor status of multiple docker containers?
My home server has about 15 distinct services running, each represented by a Docker container. Depending on how the developers implemented the Dockerfile, some services have health checks, but most do ...
- 183
0
votes
1
answer
224
views
Specifying branch name for jenkins job through AnyStatus
I am wondering if anyone else has integrated before a parameterized Jenkins build with AnyStatus.
When removing the parameter above, I am able to run builds using the branch specified previously from ...
- 101
2
votes
1
answer
55
views
Is there any way to get New Relic or PagerDuty to not alert during nightly maintenance?
Initial Problem
We have some badly behaved overnight maintenance jobs that cause alerts for AppDex and error rates for our apps. These are metrics that would be problematic if they happened during ...
- 1,738
3
votes
1
answer
79
views
How to monitor a micro-service oriented solution?
I run a micro-service oriented system, running under a private network, composed mainly of:
databases (clusters)
internal API's
external/public API's
workers (services)
monitoring servers
All are ...
- 131