Questions tagged [logstash]
Logstash is a data processing pipeline tool that ingests, transforms, and sends data to various outputs.
12 questions
0
votes
1
answer
710
views
How do I troubleshoot a dateparsefailure when using Logstash's date plugin?
I'm getting a date parse failure when trying to parse a log that has the following format:
172.20.21.10 - - [29/Mar/2022:12:41:27 -0400] "some invalid request" 400 226
The event structure ...
- 1
1
vote
1
answer
1k
views
How to monitor ELK using metricbeat on kubernetes (v8 compatible and simple solution)
For probably more than a year there's been a deprecation warning on xpack monitoring in elasticsearch, logstash, kibana etc. saying the built-in monitoring is going to disappear.
Since I don't like ...
- 131
1
vote
1
answer
26
views
Store and analyize logs data from diffenrent application
We have different applications that generate logs intensively, We do a lot of analytics, visualizations, monitoring on these logs.
Currently, we are using azure app insights to do the visualization ...
- 111
0
votes
1
answer
1k
views
Multiple Logstash Pipelines outputting into same index
I have two Filebeat pipes inputting into Logstash. One parses out log errors that I actually care about from one service while the other takes each line in order to keep track of the health of another ...
3
votes
2
answers
8k
views
Logstash multiple pipelines going into same index
I'm trying to set up a centralized syslog for multiple log sources.
So I have a logstash that has two separate inputs and two separate outputs
However for some reason the data from one of the inputs ...
- 71
1
vote
1
answer
893
views
How effective is ELK than other Monitoring tools?
"ELK" is the acronym for three open source projects: Elasticsearch, Logstash, and Kibana. Elasticsearch is a search and analytics engine. Logstash is a server‑side data processing pipeline that ...
1
vote
1
answer
1k
views
Is it possible to load balance TLS/SSL based logstash communication to elasticsearch?
if i have filebeat -> logstash -> elasticsearch pipeline with TLS or HTTPS encryption , is it possible to load balance between 2 destination elasticsearch clusters in active-standby ?
what i mean is, ...
- 71
-3
votes
2
answers
893
views
Do I use Filebeat, Ingest or Pipelines to get rid of Logstash in my ELK stack?
I'm fairly new to filebeat, ingest, pipelines in ElasticSearch and not sure how they relate.
In my old environments we had ELK with some custom grok patterns in a directory on the logstash-shipper to ...
- 241
3
votes
1
answer
606
views
Should I use filebeat or an app-logging module with lumberjack capabilities to collect my logs
I have a pretty basic elk setup which aggregates logs from around 15 VMs that are running various services.
All of them have configured filebeat syslog forwarder with a single input in logstash.
I ...
- 133
3
votes
1
answer
510
views
Data sent from Logstash via elastic output plugin not showing in Kibana, but file output plugin works fine - what am I doing wrong?
I have an "ELK stack" configuration and, at first, was doing the standard 'filebeat' syslog feeding from logstash with the elasticsearch output plugin. It worked just fine.
Now I have added a TCP ...
- 41
2
votes
1
answer
3k
views
Where is the apache2 filebeat module configured?
I am setting up the Elastic Filebeat beat for the first time. I have followed the guide here, and have got the Apache2 filebeat module up and running, it's connected to my Elastic and the dashboards ...
- 249
10
votes
1
answer
1k
views
Should I use multiple beats input in Logstash?
After some researches around the beats input plugin and specially this rewrite I wonder if I should use only one beat input or multiples to handle multiples entry types.
I'll have events coming from ...
- 11.4k