Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [logstash]

The tag has no usage guidance.

0
votes
0answers
7 views

Send logs to logstash from another swarm stack

I have 2 stacks in my docker swarm. One is elk (Elastic search, Kibbana, and Logstash) and the other is my web application. For some reasons, I don't want to use the same stack for elk and app ...
0
votes
0answers
46 views

Multiple Logstash Pipelines outputting into same index

I have two Filebeat pipes inputting into Logstash. One parses out log errors that I actually care about from one service while the other takes each line in order to keep track of the health of another ...
0
votes
0answers
115 views

How can I configure logstash-input-s3 in Dockerfile

I installed https://hub.docker.com/r/sebp/elk/ then looked at Installing Logstash plugins. I modified the example to install logstash-input-s3: FROM sebp/elk WORKDIR ${LOGSTASH_HOME} RUN gosu ...
2
votes
2answers
2k views

Logstash multiple pipelines going into same index

I'm trying to set up a centralized syslog for multiple log sources. So I have a logstash that has two separate inputs and two separate outputs However for some reason the data from one of the inputs ...
1
vote
1answer
303 views

How effective is ELK than other Monitoring tools?

"ELK" is the acronym for three open source projects: Elasticsearch, Logstash, and Kibana. Elasticsearch is a search and analytics engine. Logstash is a server‑side data processing pipeline that ...
1
vote
1answer
327 views

Is it possible to load balance TLS/SSL based logstash communication to elasticsearch?

if i have filebeat -> logstash -> elasticsearch pipeline with TLS or HTTPS encryption , is it possible to load balance between 2 destination elasticsearch clusters in active-standby ? what i mean is, ...
1
vote
0answers
53 views

Is it difficult to convert grok patterns with logstash to ElasticSearch's ingest pipelines?

Do I have to do just this? Configure all files to use a specific pipeline in filebeat Set up 1 or multiple grok patterns per pipeline by curls to ElasticSearch
-4
votes
2answers
457 views

Do I use Filebeat, Ingest or Pipelines to get rid of Logstash in my ELK stack?

I'm fairly new to filebeat, ingest, pipelines in ElasticSearch and not sure how they relate. In my old environments we had ELK with some custom grok patterns in a directory on the logstash-shipper to ...
1
vote
0answers
306 views

Where is the modules folder under filebeat to configure as a slave?

I have installed ElasticSearch, LogStash and Kibana on my master server following the articles: https://www.howtoforge.com/tutorial/how-to-install-elastic-stack-on-centos-7/ https://www.digitalocean....
2
votes
1answer
302 views

Should I use filebeat or an app-logging module with lumberjack capabilities to collect my logs

I have a pretty basic elk setup which aggregates logs from around 15 VMs that are running various services. All of them have configured filebeat syslog forwarder with a single input in logstash. I ...
4
votes
1answer
156 views

Data sent from Logstash via elastic output plugin not showing in Kibana, but file output plugin works fine - what am I doing wrong?

I have an "ELK stack" configuration and, at first, was doing the standard 'filebeat' syslog feeding from logstash with the elasticsearch output plugin. It worked just fine. Now I have added a TCP ...
2
votes
1answer
3k views

Where is the apache2 filebeat module configured?

I am setting up the Elastic Filebeat beat for the first time. I have followed the guide here, and have got the Apache2 filebeat module up and running, it's connected to my Elastic and the dashboards ...
9
votes
1answer
627 views

Should I use multiple beats input in Logstash?

After some researches around the beats input plugin and specially this rewrite I wonder if I should use only one beat input or multiples to handle multiples entry types. I'll have events coming from ...