How to aggregate logs and metrics from multiple modules accross different servers?

Question

We are thinking about setting up a solution for aggregating logs and metrics from multiple modules accross different servers. The problem is that it needs to run in a hospital and the logs may contain patient data when we debug a problem. So all external solutions are not possible. Also it needs to run as a windows service, as hospitals here usually only use Windows.

The modules are a normal Spring Boot application. The modules can connect to central server but not the other way around, so it needs to push the data to a central server.

Any suggestions?

Answer 1

I recommend looking into using Grafana, Loki, and Promtail on-premises. Because they are implemented in Go, cross-compiling to run in Windows is possible. For the past several years, I have been extremely pleased using Grafana in private, on-prem settings disconnected from external world.

Additionally, consider time series database systems for metrics. In your case, InfluxDB might be a more suitable choice than Prometheus because of push vs pull models.

Check out shared dashboards you can download and install.