Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [logging]

Systematic recording of events from services and application is a key process within DevOps adoption. Use this tag to describe logging and telemetry questions.

0
votes
1answer
24 views

azure activity log, how to find releases

My security department has asked to ingest logs from Azure with the goal being to identity releases. The security team wants to be able to say: Hey, there was a release on mm/dd/yyyy at noon (...
0
votes
0answers
62 views

AWS Log Insights

I tried out this new service recently but I'm in trouble with the query syntax. Do you know how to Search for given error message types based on string snippets from @message, Visualize these ...
0
votes
0answers
24 views

Openshift EFK stack for custom application logging

I am new to DevOps and Openshift. I was looking for a pointer which could help me in understanding how to configure Openshift and EFK stack (on Openshift), so that logs generated from my java ...
1
vote
1answer
126 views

How to redirect tomcat logs TO console?

So I have a problem that is the reverse of what everyone else on the internet wants.. I want to take tomcat logs that are being written out to /usr/local/tomcat/logs and have them be output to console ...
0
votes
0answers
28 views

Pushing Docker application logs to Logentries

I see here some official docs for how to push a Docker container's logs to logentries. However, it is unclear whether this pushes application logs, or system logs internal to Docker. And if it does ...
0
votes
1answer
36 views

Dynamically grep with less/tail [closed]

when tailing a log file, we might use: tail -f foo.log | grep bar if we want to change the grep argument, we have to ctrl-c and then change the argument and then restart the command. my question is ...
0
votes
0answers
1k views

How to debug a docker on web app for containers in Azure which does not start

I am able to run my containers locally. I published them to container registry. And the deployment from container registry to web apps for containers is successful. But the service does not turn ...
1
vote
1answer
54 views

What are the best logging/metrics reporting tools for use with OpenShift?

OpenShift includes EFK and I'm looking into using that or ELK, but there are so many options (found a link with 50+ options) that I'm trying to narrow down. Ideally something free/cheap. What is the ...
1
vote
0answers
33 views

How can I easily convert logstash filters with grok to ingest pipelines?

Logstash has ingest-convert.sh to convert ingest pipelines to Logstash, but I'd like to convert the other way around. I have the 23-Tomcat-filters and grok_patterns file. Is there any smart way ...
2
votes
1answer
303 views

Should I use filebeat or an app-logging module with lumberjack capabilities to collect my logs

I have a pretty basic elk setup which aggregates logs from around 15 VMs that are running various services. All of them have configured filebeat syslog forwarder with a single input in logstash. I ...
2
votes
3answers
153 views

Automatic periodic conditional checks

I need a simple tool that will carry out some conditional checks periodically and give me a red/green status that I can use as an indication that something is wrong. These are examples of checks that ...
3
votes
3answers
68 views

Ideal methods of handling server logs on AWS

We currently have some ruby applications hosted on EC2 servers on AWS, and every few weeks we see the disk space get completely consumed by the app log as well as the worker logs. What are the best ...
9
votes
1answer
173 views

What exactly is the cloud term 'a Firehose'?

I found a Firehose definition from Overview of the Loggregator System Cloud Foundry docs. The Firehose is a WebSocket endpoint that streams all the event data coming from a Cloud Foundry ...
7
votes
6answers
29k views

How Do I Log Task Output To A File?

One of my ansible tasks imports an Oracle database using impdp. This generates a lot of output to the console so I have set no_log: True. However, when this fails I want to see the log! How can I ...
0
votes
3answers
5k views

How to get memory usage per process with sar, sysstat?

Can I get memory usage per process with Linux? we monitor our servers with sysstat/sar. But besides seeing that memory went off the roof at some point, we can't pinpoint which process was getting ...
7
votes
2answers
275 views

What strategies can be employed to secure sensitive data in log files?

Working in highly regulated environments data is classified in different ways depending on the sensitivity. In some cases, this is legally enforced and must be treated differently. Examples of a data ...
17
votes
2answers
4k views

How to have multiple log streams in docker

We have an application that writes three types of logs into three separate files: access logs, generic application logs and system logs. The format (and purpose) of these logs are very different. And ...
14
votes
2answers
271 views

What is a good logging practice for distributed tasks?

I have the following setting: Create multiple workers, do a computation and terminate them after the computation is done. So, every-time it’ll be a different instance running the task, so each ...