Questions tagged [logstash]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
11 views

Log stash slows down after 1 hour

We are trying to use Log Stash to read from s3 and write to elastic. After roughly 1 hour (50-80 minutes), 100% of the time, it goes from ~25,000 records/second down to ~2,000 records/second. We've ...
1
vote
1answer
19 views

Store and analyize logs data from diffenrent application

We have different applications that generate logs intensively, We do a lot of analytics, visualizations, monitoring on these logs. Currently, we are using azure app insights to do the visualization ...
1
vote
0answers
66 views

Why does logstash not output to the correct elasticsearch index with date? [closed]

I have my system running with ElasticSearch 7.0 and Logstash 7.0 on an AWS EC2 machine. In my logstash configuration, I use the default index pattern (as described in outputs plugin): output { ...
0
votes
1answer
564 views

Multiple Logstash Pipelines outputting into same index

I have two Filebeat pipes inputting into Logstash. One parses out log errors that I actually care about from one service while the other takes each line in order to keep track of the health of another ...
3
votes
2answers
6k views

Logstash multiple pipelines going into same index

I'm trying to set up a centralized syslog for multiple log sources. So I have a logstash that has two separate inputs and two separate outputs However for some reason the data from one of the inputs ...
1
vote
1answer
572 views

How effective is ELK than other Monitoring tools?

"ELK" is the acronym for three open source projects: Elasticsearch, Logstash, and Kibana. Elasticsearch is a search and analytics engine. Logstash is a server‑side data processing pipeline that ...
1
vote
1answer
902 views

Is it possible to load balance TLS/SSL based logstash communication to elasticsearch?

if i have filebeat -> logstash -> elasticsearch pipeline with TLS or HTTPS encryption , is it possible to load balance between 2 destination elasticsearch clusters in active-standby ? what i mean is, ...
-4
votes
2answers
732 views

Do I use Filebeat, Ingest or Pipelines to get rid of Logstash in my ELK stack?

I'm fairly new to filebeat, ingest, pipelines in ElasticSearch and not sure how they relate. In my old environments we had ELK with some custom grok patterns in a directory on the logstash-shipper to ...
1
vote
0answers
642 views

Where is the modules folder under filebeat to configure as a slave? [closed]

I have installed ElasticSearch, LogStash and Kibana on my master server following the articles: https://www.howtoforge.com/tutorial/how-to-install-elastic-stack-on-centos-7/ https://www.digitalocean....
3
votes
1answer
512 views

Should I use filebeat or an app-logging module with lumberjack capabilities to collect my logs

I have a pretty basic elk setup which aggregates logs from around 15 VMs that are running various services. All of them have configured filebeat syslog forwarder with a single input in logstash. I ...
3
votes
1answer
388 views

Data sent from Logstash via elastic output plugin not showing in Kibana, but file output plugin works fine - what am I doing wrong?

I have an "ELK stack" configuration and, at first, was doing the standard 'filebeat' syslog feeding from logstash with the elasticsearch output plugin. It worked just fine. Now I have added a TCP ...
2
votes
1answer
3k views

Where is the apache2 filebeat module configured?

I am setting up the Elastic Filebeat beat for the first time. I have followed the guide here, and have got the Apache2 filebeat module up and running, it's connected to my Elastic and the dashboards ...
10
votes
1answer
880 views

Should I use multiple beats input in Logstash?

After some researches around the beats input plugin and specially this rewrite I wonder if I should use only one beat input or multiples to handle multiples entry types. I'll have events coming from ...