submit-social-housing-lettings-and-sales-data/docs/monitoring.md

Infrastructure Metric monitoring

We use self-hosted Prometheus and Grafana for monitoring infrastructure metrics. These are run in a dedicated Gov PaaS space called "monitoring" and are deployed as Docker images using Github action pipelines. The repository for these and more information is here: dluhc-data-collection-monitoring.

Application & Performance monitoring & alerting

For application error and performance monitoring we use managed Sentry. You will need to be added to the DLUHC account to access this. It triggers slack notifications to the #team-data-collection-alerts channel for all application errors in staging and production and for any controller endpoints that have a P95 transaction duration > 250ms over a 24 hour period.

Logs

For log persistence we use a managed ELK (Elasticsearch, Logstash, Kibana) stack provided by Logit. You will need to be added to the DLUHC account to access this. Longs are retained for 14 days with a daily limit of 2GB.

Logs are also available from Gov PaaS directly via cli cf logs <gov-paas-space-name> --recent.