Fluent-bit, Opensearch and Nginx-Proxy-forwarder

As I managed to increase my home-server-farm with two new HP t630 ThinClients, I also have the space now to finally do more with Opensearch.

The components

• Opensearch, in case you do not know, Opensearch is a full fork of Elasticsearch. AWS/Amazon has forked it during some license changes in Elastic in order to have a full open source version of it (Apache License 2.0)
  https://www.opensearch.org/
• Fluent-Bit, is a log-processer written by the CNCF (Cloud Native Computing Foundation). You can compare it to logstash or filebeat. License is also Apache 2.0.
  https://fluentbit.io/
• Nginx-Proxy-Manager, is an amazing docker container which lets you setup simple nginx based proxies including Lets Encrypt
  https://github.com/NginxProxyManager/nginx-proxy-manager

Fluent-Bit

In this blog post I want to focus on the fluent-bit part, honestly the Opensearch and Nginx setups are rather straight forward and I mainly struggled (for days) with getting the logs into Opensearch

[FILTER]
    Name modify
    Match *
    Add source nginx-proxy

[FILTER]
    Name parser
    Match nginx
    Key_Name log
    Parser nginx

[SERVICE]
    flush        1
    daemon       Off
    log_level    info
    parsers_file…