BLUF: Is there a “datadog-for-home”?
I’ve a ton of stuff running at home ranging from a 5-node PI cluster with various containers running on them including things like self-written python scripts doing “super important” stuff, node-red running everything about my energy setup, pfsense, TrueNAS etc.
Logging is painful and I’ve just lost about 4 hours trying to find a fault which stopped car charging. Lots of rabbit holes were entered as I currently don’t have an end-to-end logging solution.
What does everyone else use?
Dozzle may be a bit basic for your needs, but it could be one tool in your toolbox.
Dozzle is fantastic!
You can also view application logs with Dozzle in addition to container logs.
Just write your logs as files on a centralized syslog server with good file structure and you’ll be good.
You may really underestimate how fast and convenient grep+less combo is in comparison to webui-based solutions.
s/grep/ripgrep 😉
Anyone here got a solution working in Unraid? I looked into this recently but got a bit stuck.
Opted for loki since it allows using the same interface for multiple purposes
Loki to Grafana.
It’s a hybrid solution but I prefer putting my logs with an S3 provider, it’s just cheap storage that I don’t have to care about. And there are a lot of tools to do it with, like loki for example.
Depending on your existing monitoring stack, some options might be:
- Grafana Loki
- Sentry can be self-hosted for application logging
- Logstash is self-explanatory, use with other parts of Elastic’s software like Kibana for visualization.
ELK
Graylog
I come from a Cybersecurity background which might explain my answer: Security Onion had proven adept at cross referencing logs and pcaps which is pretty awesome for troubleshooting
And +1 for Dozzle to see real-time Docker logs.
I like Grafana/Loki/promtail etc.
But Datalust Seq is also nice.
Graylog can do a lot but its too bloated and too hungry for my taste (damn elasticsearch).
A simple syslog server is ready.
Look into ELK stack. I personally hate it but if you can learn it there’s a chance you can build a career on it.
Also using Graylog, dead simple to set up with rsyslog and at work we even use the sidecar for window logs.
Another vote for graylog, runs well with opensearch instead of elastic.
OneUptime.com - looks like they have it on the roadmap to launch by Q4 of this year.
