Questions tagged [elastic]

Questions related to elastic.

Filter by
Sorted by
Tagged with
0
votes
0answers
35 views

connect_write timeout - Fluentbit (Processor), Fluentd (Aggregator) and Elasticsearch in Kubernetes

I'm having some troubles with setting up ElasticSearch with Fluentd and Fluentbit for log aggregation. I'm using the following chart: https://github.com/helm/charts/tree/master/stable/elastic-stack ...
0
votes
0answers
26 views

How to pull beats from logstash?

I am collecting logs with FileBeat to Logstash in ELK stack but some systems are running in DMZ behind a firewall and I am interested in reducing firewall rules to add/manage. After reading following ...
0
votes
0answers
19 views

How to shrink k8s node pool (GKE) and underlying stateful set in an orderly way

I have an ElasticSearch cluster running in GKE in a dedicated node pool. I want to shrink the size of the ElasticSearch cluster in an orderly way. The steps I'd like to follow are: Drain specific ...
1
vote
1answer
27 views

Elastic Beanstalk give error Root Object doesn't exist in Jenkins

I create a Jenkins job which uploads my war file to elastic beanstalk. But when I start to build it gives error java.lang.IllegalArgumentException: Root Object doesn't exist Below is my ...
0
votes
0answers
87 views

ElasticSearch Regex Query

I'm trying to do a regex search in ElasticSearch, and I'm not quite sure why it's not finding my data. Here's what I have: This query returns the data, but I'm fairly certain it's only matching on ([...
0
votes
0answers
10 views

elastic on k8s. What do you suggest?

I found the following charts: https://github.com/elastic/helm-charts/tree/master/elasticsearch https://github.com/helm/charts/tree/master/stable/elastic-stack Deploying the latter and consulting the ...
1
vote
1answer
33 views

Easiest way to manage an elasticsearch cluster in GCP?

I'm trying to create my own Elasticsearch cluster to use for security analytics. I'm familiar with the function and setup of a single instance deployment, but I'm having trouble figuring out the ...
5
votes
1answer
244 views

Connecting jaeger with elasticsearch backend storage on kubernetes cluster

I have a kubernetes cluster on google cloud platform, and on it, I have a jaeger deployment via development setup of jaeger-kubernetes templates because my purpose is setup elasticsearch like backend ...
0
votes
0answers
39 views

Openshift EFK stack for custom application logging

I am new to DevOps and Openshift. I was looking for a pointer which could help me in understanding how to configure Openshift and EFK stack (on Openshift), so that logs generated from my java ...
0
votes
0answers
49 views

How to safely change the config and restart a persistent ELK cluster with helm - GlusterFS Heketi

I am using this helm chart to manage my ELK stack on Kubernetes. https://github.com/clockworksoul/helm-elasticsearch I want to upgrade the config and keep my data intact. We use glusterfs and it is ...
1
vote
1answer
20 views

Backing up an ephemeral Elasticsearch installation

I have an installation of Elasticsearch without persistence running and I need to back it up so we can move it to a persistent setup. What are safe ways to do this and keep the data in the ES ...
0
votes
2answers
90 views

How to monitor ELK Stack Load?

We have tried Prometheus and Grafana. Currently it is not set up on our cluster and we are tight with resources. What are the best ways to monitor load on an ELK stack? Is there anything built in?
1
vote
1answer
75 views

Executing a command in running docker swarm service

I am trying to run a Django project in docker swarm mode. The problem is I want to index the Elastic search container which needs to be run only after postgres completes the SQL dumping process (only ...
2
votes
2answers
3k views

Logstash multiple pipelines going into same index

I'm trying to set up a centralized syslog for multiple log sources. So I have a logstash that has two separate inputs and two separate outputs However for some reason the data from one of the inputs ...
1
vote
1answer
389 views

How effective is ELK than other Monitoring tools?

"ELK" is the acronym for three open source projects: Elasticsearch, Logstash, and Kibana. Elasticsearch is a search and analytics engine. Logstash is a server‑side data processing pipeline that ...
0
votes
3answers
256 views

Logging ansible crons in kibana

I have set up some crons in ansible, and I want to log when they start, finish, and if they fail. How I could do it? I don’t know so much about ansible. Regards.
1
vote
0answers
81 views

What can explain ElasticSearch 2.4 not accepting to create watchers via curl?

[root@elk01 ~]# curl -XPUT 'http://127.0.0.1:9200/_watcher/watch/log_error_watch' -d '{ "trigger" : { "schedule" : { "interval" : "10s" } }, "input" : { "search" : { "request" : { ...
6
votes
1answer
323 views

How good are heartbeat, elasticsearch and kibana as a monitoring/alerting solution as a replacement for Nagios?

Since we already have filebeat, metricbeat and heartbeat configured and running. I wonder if people have successfully implemented the ELK stack for actual monitoring with alerting/notifications ...
1
vote
1answer
438 views

Is it possible to load balance TLS/SSL based logstash communication to elasticsearch?

if i have filebeat -> logstash -> elasticsearch pipeline with TLS or HTTPS encryption , is it possible to load balance between 2 destination elasticsearch clusters in active-standby ? what i mean is, ...
3
votes
1answer
252 views

Data sent from Logstash via elastic output plugin not showing in Kibana, but file output plugin works fine - what am I doing wrong?

I have an "ELK stack" configuration and, at first, was doing the standard 'filebeat' syslog feeding from logstash with the elasticsearch output plugin. It worked just fine. Now I have added a TCP ...
0
votes
1answer
313 views

What are best practices for implementing and using Elastic in an organization?

At the moment there are multiple microservices that log to individual files. If there is an issue then the team is debugging like headless chickens. In order to prevent this the aim is to introduce ...
1
vote
1answer
325 views

Autorun ElasticSearch with Docker Compose

All of the tutorials online say to manually start elasticsearch as a daemon with a docker command from the command line. Is there a way to auto run it like redis, postgres and other services do from ...