Currently, we support two monitoring solutions:
- Crow: A simple, lightweight, and built-in monitoring solution, that is enabled by default when you install Codacy.
- Prometheus + Grafana + Loki: A comprehensive third-party monitoring solution, recommended for more advanced usage.
The sections below provide details on how to set up each monitoring solution.
Setting up monitoring using Crow¶
Crow displays information about the projects that are pending analysis and the jobs currently running on Codacy.
Crow is installed alongside Codacy when the Helm chart is deployed to the cluster. By default, you can access Crow as follows:
http://<codacy hostname>/monitoring, where
<codacy hostname>is the hostname of your Codacy instance
We highly recommend that you define a custom password for Crow, if you haven't already done it when installing Codacy:
Edit the value of
values-production.yamlfile that you used to install Codacy:
crow: config: passwordAuth: password: <--- crow password --->
Apply the new configuration by performing a Helm upgrade. To do so execute the command used to install Codacy:
If you are using MicroK8s you must use the file
values-microk8s.yamltogether with the file
To do this, uncomment the last line before running the
helm upgradecommand below.
helm upgrade (...options used to install Codacy...) \ --values values-production.yaml \ # --values values-microk8s.yaml
Setting up monitoring using Grafana, Prometheus, and Loki¶
Prometheus is an open-source systems monitoring and alerting toolkit. Logs can be collected using Loki, which is a horizontally-scalable, highly-available, multi-tenant log aggregation system. Its data can be visualized with Grafana, a widely used open source analytics and monitoring solution.
This solution is considerably more resource demanding than Crow, and is recommended only for more advanced usage. Furthermore, its installation, configuration, and management require a deeper knowledge of Kubernetes as each component must be carefully tweaked to match your specific use case, using as starting point the
.yaml values files provided by us.
The instructions below cover the basic installation of the components in this monitoring stack.
1. Installing Prometheus¶
The simplest way to set up Prometheus in your cluster is by using the Prometheus Operator bundle.
Add the custom resources required for installing this bundle in your cluster:
If you are using MicroK8s use
microk8s.kubectl instead of
kubectl apply -f "https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_alertmanagers.yaml" kubectl apply -f "https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_podmonitors.yaml" kubectl apply -f "https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_prometheuses.yaml" kubectl apply -f "https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_prometheusrules.yaml" kubectl apply -f "https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_servicemonitors.yaml" kubectl apply -f "https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_thanosrulers.yaml"
2. Installing Loki¶
Obtain the configuration file for Loki,
values-loki.yaml, and install it by running the command below. While the default storage class setting for Loki persistence should suit most use cases, you may need to adjust it to your specific Kubernetes installation. For instance, for MicroK8s use
helm repo add loki https://grafana.github.io/loki/charts kubectl create namespace monitoring helm upgrade --install --atomic --timeout 600s loki loki/loki \ --version 0.28.1 --namespace monitoring --values values-loki.yaml
3. Installing Promtail¶
Promtail is an agent that ships the contents of local logs to a Loki instance.
Obtain the configuration file for Promtail,
values-promtail.yaml, and install it by running the command below.
helm upgrade --install --atomic --timeout 600s promtail loki/promtail \ --version 0.22.2 --namespace monitoring --values values-promtail.yaml
4. Installing Prometheus and Grafana¶
Edit the Grafana password for the
adminuser and the hostname for grafana in the
Install the bundle on your cluster by running the command below.
helm upgrade --install --atomic --timeout 600s monitoring stable/prometheus-operator \ --version 8.13.8 --namespace monitoring --values values-prometheus-operator.yaml
Follow the Kubernetes documentation to access the Grafana service that is now running on your cluster, using the method that best suits your use case.
5. Enable Service Dashboards¶
Now that you have Prometheus and Grafana installed you can enable
grafana_dashboards for Codacy components.
Create a file named
values-monitoring.yamlwith the following content:
codacy-api: metrics: serviceMonitor: enabled: true grafana_dashboards: enabled: true engine: metrics: serviceMonitor: enabled: true worker-manager: grafana: grafana_dashboards: enabled: true listener: grafana: grafana_dashboards: enabled: true remote-provider-service: metrics: serviceMonitor: enabled: true
Apply this configuration by performing a Helm upgrade. To do so append
--values values-monitoring.yamlto the command used to install Codacy:
helm upgrade (...options used to install Codacy...) \ --values values-monitoring.yaml