Custom Log Collection
There are several use cases for customized log collection. Since the entire central logging stack is deployed within your own environment just like any other application, we are allowed to make customizations easily.
- Control Plane Configuration changes like Open search version, EC2 host size, : The control plane configuration deployed is based off the configuration defined in Administrator --> System Settings --> Service Descriptions --> duplo_svd_logging_opensearch. You can edit this. These edits allow you to change various parameters of the control plane deployment.
- Log Collector Customization: At times there may be customizations required in the file beat configurations. This includes configuration like mounting different folder than just /var/lib/docker because the application may be writing logs in a different folder that just doing stdout. To make these changes you need to edit Administrator --> System Settings --> PlatformServices and pick the filebeat versions. There are two versions one for Kubernetes based and one for Native Container Management based.
- Third Party Logging Tools: Another common use case is to use tools like datadog, sumologic etc. This is rather agnostic to the DuploCloud platform. Typically users would deploy Docker containers that act as collectors and agents from these tools. Deployment of these containers is like any other application service.