Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Continuous monitoring of your cloud infrastructure in the DuploCloud Portal
DuploCloud contains a complete suite of monitoring, logging, and auditing tools to ensure the stability and integrity of your cloud environment and maximize performance and uptime. In addition, graphical charts and reports provide snapshots of critical data metrics, that can be tailored to your needs, while logging assists in troubleshooting and fine-tuning your infrastructures.
DuploCloud platform comes with an option of centralized metrics for Docker containers, Virtual machines as well as various cloud services like ELB, RDS, ECache, ECS, Kafka etc. These metrics are displayed through Grafana which is embedded into the DuploCloud UI. Just like central logging these are not turned on by default but can be setup with a single click.
Under Observability -> Metrics we have the various metrics per Tenant.
While there are 8-10 out-of-box dashboards for various services, one can add their own dashboards and make them appear in Duplo Dashboard through a configuration
Monitoring Kubernetes status with the K8s Admin dashboard
Use the k8s Admin dashboard to monitor various statistics and statuses for Kubernetes, including the number and availability of StatefulSets defined for a service.
In the DuploCloud Portal, select Administrator -> Observability -> Metrics.
Click the k8s tab. The K8s Admin dashboard displays.
Faults that happen in the system, be it Infrastructure creation, container deployments, Application health checks, or any Triggered Alarms can be tracked in the DuploCloud portal under Faults Menu.
You can look at Tenant-specific faults under Observability -> Faults or all the faults in the system under Administrator -> Faults.
You can set the AWS Alerts for the individual metrics, click on the bell icon on any of the metrics. A form to create an alert shows up. You can provide the necessary information and create the alert.
View general alerts from the DuploCloud Portal in the Observability -> Alerts.
Select the Alerts tab for alerts pertaining to a specific resource, such as Hosts.
Enable and view alert notifications in the DuploCloud Portal
DuploCloud supports viewing of Faults in the portal and sending notifications and emails to the following systems:
Sentry
PagerDuty
NewRelic
OpsGenie
You will need to generate an keys from each of these vendor systems, and then provide that key to DuploCloud to enable integration.
In the Sentry website, navigate to Projects -> Create a New Project.
Click Settings -> Projects -> project-name -> Client keys. The Client Keys page displays.
Complete the DSN fields on the screen.
Click Generate New Key.
In the DuploCloud Portal, navigate to Observability -> Faults.
Click Update Notifications Config. The Set Alert Notifications Config pane displays.
In the Sentry - DSN field, enter the key you received from Sentry.
In the Alerts Frequency (Seconds) field, enter a time interval in seconds when you want alerts to be displayed.
Click Update.
In the PagerDuty website home page, select the Services tab and navigate to the service that receives Events. If a Service does not exist, click New Service. When prompted, enter a friendly Name (for example, your DuploCloud Tenant name) and click Next.
Assign an Escalation policy, or use an existing policy.
Click Integration.
Click Events API V2. Your generated Integration Key is displayed as the second item on the right side of the page. This is the Routing Key you will supply to DuploCloud.
Copy the Integration Key to your Clipboard.
In the DuploCloud Portal, navigate to Observability -> Faults.
Click Update Notifications Config. The Set Alert Notifications Config pane displays.
In the Pager Duty - Routing Key field, enter the key you generated from PagerDuty.
In the Alerts Frequency (Seconds) field, enter a time interval in seconds when you want alerts to be displayed.
Click Update.
In the DuploCloud Portal, navigate to Observability -> Faults.
Click Update Notifications Config. The Set Alert Notifications Config pane displays.
In the NewRelic - API Key field, enter the key you generated from NewRelic.
In the Alerts Frequency (Seconds) field, enter a time interval in seconds when you want alerts to be displayed.
Click Update.
In the OpsGenie website, generate an API Key to integrate DuploCloud faults with OpsGenie.
In the DuploCloud Portal, navigate to Observability -> Faults.
Click Update Notifications Config. The Set Alert Notifications Config pane displays.
In the OpsGenie - API Key field, enter the key you generated from OpsGenie.
In the Alerts Frequency (Seconds) field, enter a time interval in seconds when you want alerts to be displayed.
Click Update.
All the activity in the DuploCloud is logged which can be used for auditing. All the logs are saved into Elasticsearch and can be visualized in Kibana. The URL for the Kibana is available under Diagnostics.
The Elasticsearch & Kibana will be sitting inside the VPC and cannot be accessed from outside. Connect to the VPN and access these URL.
The metrics setup is made up of two components:
Control Plane: This comprises a Grafana dashboard service and a Prometheus container for fetching VM and container metrics. Grafana directly pulls cloud service metrics from AWS without requiring Prometheus.
From the DuploCloud Portal, navigate to Administrator -> Observability -> Settings, and select the Monitoring tab to enable Metrics. Click on Enable Monitoring.
Metrics Collector: Once Metrics control plane is ready i.e. Grafana and Prometheus service has been deployed and are active, we have to enable Metrics on a per-Tenant basis. From the DuploCloud portal, navigate to Administrator -> Observability -> Settings. Click the Monitoring tab and enable monitoring per Tenant using the toggle buttons. This triggers the deployment of Node Exporter and CAdvvisor container in each Host in the Tenant similar to how Log Collectors like File beat were deployed for fetching central logs and sending to Open Search.
DuploCloud allows automatic generation of alerts for resources within a Tenant. This makes sure that the defined baseline of monitoring is applied to all current and new resources based on a set of rules.
As an Administrator:
From the DuploCloud portal, navigate to Administrator ->Tenants, and click the Alerting tab
Enable alerting, this will open an alerts template which has rules for each AWS namespace and Metric to be monitored.
Review the alerts template, and adjust the thresholds
Click on Update
Creating and Using a WAF
The creation of a Web Application Firewall (WAF) is a one-time process. Create a WAF in the public cloud Console, fetch the ID/ARN, and update the Plan in DuploCloud. Once updated, the WAF can be attached to the Load Balancer.
When you create a WAF in DuploCloud, an entry is added to the Web ACL. You use this entry in a later step to attach an ALB Load Balancer to your WAF.
In the DuploCloud Portal, navigate to Administrator -> Plans.
From the Name column, select the Plan you want to update.
Click the WAF tab.
Click Add. The Add WAF pane displays.
In the Name field, type the name of your WAF.
In the WAF ARN field, enter the Amazon Resource Name (ARN).
Click Create.
Only ALB Load Balancers can be attached to a WAF.
If you don't yet have an Application Load Balancer (ALB), create one.
In the Other Settings card, click Edit. The Other Load Balancer Settings pane displays.
From the Web ACL list box, select a WAF that you have added to DuploCloud.
Complete the other required fields in the Other Load Balancer Settings pane.
Click Update.
DuploCloud also provides a WAF Dashboard through which you can analyze the traffic that is coming in and the requests that are blocked. The Dashboard can be accessed from the left navigation panel: Observability -> WAF.