We changed our privacy policy. Read more.

Hot answers tagged

6

There is a protocol for this: RSS, Rich Site Summary. Technically, there are 3 protocols RSS, RSS2 and Atom, but most readers support all of them, and many servers mix RSS and RSS2 features. First, choose your RSS reader, from: browser add-ons like Feedbro, centralized aggregators like Feedly and FeedReader, stand-alone applications like RSSOwl mail ...


4

One best practice would be to log everything to the same location. Your "Current idea" suggests that you'd be running the Elastic stack locally, which is great for a local development environment, but for anything outside that you want to be shipping the logs from all your microservices to the same location. This enables you to do correlation between logs, ...


2

Probably not 100% comprehensive, but DevOps.com might fit the bill?


2

Changing logging driver form journald to json has fixed it. I edited /etc/sysconfig/docker, and set OPTIONS='--selinux-enabled --log-driver=json-file --signature-verification=false' Then restarted docker on the nodes I needed: systemctl daemon-reload && systemctl restart docker


2

There are two ways to accomplish this, though one of them was only available recently. The old-school version, the one you can do as far back as Logstash 1.5, is to pay attention to tags and use conditionals to separate your inputs. Roughly... input { tcp { port => 1525 codec => json_lines tags => [ 'tcp' ] } } input { file { ...


2

I've had good success with DZone: https://dzone.com/devops-tutorials-tools-news. This is a nice mix of articles, tutorials, and various publications. For Docker specific updates/news I follow: https://www.docker.com/blog/ Finally, for specific cloud platforms each one seems to have their own community blogers that post updates. For example: Amazon - ...


1

I realize these cover much broader ground, but I see lots of useful DevOps-related stories on https://slashdot.org/ and Hacker News. I also have created saved searches in Google News.


1

Restoring a snapshot simply creates a new RDS instance. So if you restore the prod DB snapshot to staging then you will be creating a new RDS instance with the restored data in it. If both of the RDS instances are in the same aws account then You will either have to delete/rename the staging DB and then restore the prod DB If both of the RDS instances are ...


1

Put the following setting in /etc/elasticsearch.yml and it will work. network.host: 0.0.0.0 discovery.type: single-node


1

Can you not use Kibana with Elasticsearch or does that not give you the 'advanced' features you need? Have you looked at this connector for ES and Tableau? https://www.dremio.com/tutorials/unlocking-tableau-on-elasticsearch/


1

I'm also a fan of DZone. Another good place is DevOps.com Also, the Sonatype blog and All Day DevOps regularly feature DevOps news, too [disclosure, I contribute to all of these]


1

I'd add https://opensource.com/ (from Redhat) and the O"reilly Newsletter related to Infrastructure and Ops : https://conferences.oreilly.com/infrastructure-ops/io-ca


1

There is https://www.infoq.com/devops/ which is a good news feed. I get the newsletter and it is a good overview of trends, etc. I also check https://aws.amazon.com/blogs/devops/ regularly, but that is AWS specific of course.


1

https://github.com/elastic/stack-docker/blob/master/docker-compose.yml This is an official docker-compose for running Elasticsearch, and will make a good starting point for whatever you're trying to achieve. This would be the key part: elasticsearch: image: docker.elastic.co/elasticsearch/elasticsearch:${TAG} environment: ['http.host=0.0.0.0', '...


1

ELK is pretty ineffective as a monitoring tool in a default configuration as it doesn't do monitoring - only reporting. ELK can only provide monitoring and alerting abilities if you configure additional add-ons such as ElastAlert. Then, you are impacted by your ability to log errors via syslog. If messages come in via, say, SNMP traps, you will be unable to ...


1

Ansible is an automation tool, so it can automate things you can do by hands. But as far as I know no existing cron-like services support sending logs to elasticsearch (Kibana is just a viewer, btw) out of the box. So at first, you should create some wrapper script that will execute your actual job and send it's result to elasticsearch. An then schedule ...


1

I haven't tried it myself, but in Alarms management with Elasticsearch and Kibana someone recommended Elastalert


1

You can do this a couple of ways, but I have never seen anyone do this with a CNAME. One option, if you have control over your IP addressing is to use BGP to fail-over (or load balance) an IP to your cloud hosting providers. A second option is to invest in a DNS-based geographic load balancing solution, such as the GTM from F5, the GSLB solution from A10, ...


1

Being unfamiliar with Kibana, I was not aware of the time constraint on data on the default search/display of just 15 minutes. The data coming in was timestamped (@timestamp key) via the 'date' plugin with the original open date, NOT the time of the, via TCP port to elastic, insertion event; thus, no data was showing and I had no idea that by default only ...


1

How do I send a structured message? If you want structured messages check out some of the recommended third party logging options. Some of these options have built-in support for Elasticsearch logging. For instance, Serilog provides a "sink" for putting logs directly into Elasticsearch. How do I configure it in code? These options all tie into the ...


1

It depends on what you're trying to accomplish but IMO if you're interested in reliably getting your exceptions you probably want something between Elasticsearch and your app - a queueing or logging system of some kind like Kafka or Redis. Send your exceptions there and then drain that to Elasticsearch. Otherwise you run the risk of overwhelming ES's ability ...


1

This error occurs because you used a variable ($) and wildcard name (*.war). Elastic Beanstalk plugin does not support Variable or wildcard name in the Value. I suggest a use full path of Jenkins job instead of ${WORKSPACE} and full war name like ROOT.war instead of *.war


1

We have been using elastic/helm-charts for more than a year for our product, and it is easy to manage and scale on-demand. Let me know if you need any help in deploying the helm chart.


1

When resolving a service in Kubernetes, Assume a Service named foo in the Kubernetes namespace bar. A Pod running in namespace bar can look up this service by simply doing a DNS query for foo. A Pod running in namespace quux can look up this service by doing a DNS query for foo.bar. Since Jaeger is in the same namespace, then yes, it can resolve the ...


1

ElasticSearch can backup itself when told to do so via an API call. You just need to configure a destination, and optionally credentials, for example you make ElasticSearch create snapshots of its database in AWS S3. https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-snapshots.html You can also automate these calls using a schedule ...


1

Load can mean a lot with an ELK stack. For ingestion load, the logstash parsing side, you're looking at a combination of one or two things: CPU load on the ingestion boxes. If used, back-pressure in your ingestion-queue (such as Redis, AMQP, or others) This can be simple stuff like queue-size, or a fancy number like age of the oldest member of the queue. ...


1

I suggest making a cronjob container that does the SQL dump and elastic index using docker exec commands toward the corresponding containers.


Only top voted, non community-wiki answers of a minimum length are eligible