PromQL Compliance Test Results: Overview
This page summaries PromQL compliance test results for the PromQL implementations of different vendors or projects. For more information on these tests, see the PromQL Compliance Tester tool as well as our blog posts about compliance tests:
- Comparing PromQL Correctness Across Vendors
- An Update on PromQL Compatibility Across Vendors
- PromQL Vendor Compatibility, Round Three
If you are a vendor or project implementing PromQL support outside of Prometheus and want to work with us to have your PromQL test results included here, please contact us at info@promlabs.com.
Test results from 2021-10-14:
| Test target | Passing | Cross-cutting issues | More details |
|---|---|---|---|
| Amazon Managed Service for Prometheus (hosted) | 596 / 596 cases (100.00%) | 1 | Detailed results |
| Chronosphere (hosted) | 596 / 596 cases (100.00%) | None | Detailed results |
| Cortex (v1.10.0) | 596 / 596 cases (100.00%) | None | Detailed results |
| Google Cloud Managed Service for Prometheus (hosted preview) | 517 / 548 cases (94.34%) | None | Detailed results |
| Grafana Cloud (hosted) | 548 / 548 cases (100.00%) | None | Detailed results |
| M3 (v1.3.0) | 596 / 596 cases (100.00%) | None | Detailed results |
| New Relic (hosted) | 162 / 596 cases (27.18%) | 2 | Detailed results |
| Promscale (0.6.2) | 596 / 596 cases (100.00%) | None | Detailed results |
| Sysdig Monitor (hosted) | 594 / 596 cases (99.66%) | 1 | Detailed results |
| Thanos (v0.23.1) | 596 / 596 cases (100.00%) | None | Detailed results |
| VictoriaMetrics (v1.67.0) | 442 / 596 cases (74.16%) | 1 | Detailed results |
Test results from 2020-12-01:
| Test target | Passing | Cross-cutting issues | More details |
|---|---|---|---|
| Chronosphere (hosted) | 525 / 525 cases (100.00%) | None | Detailed results |
| Cortex (v1.5.0 - chunks) | 523 / 525 cases (99.62%) | None | Detailed results |
| Cortex (v1.5.0 - blocks) | 525 / 525 cases (100.00%) | None | Detailed results |
| Grafana Cloud (hosted) | 525 / 525 cases (100.00%) | 1 | Detailed results |
| M3 (v1.0.0) | 525 / 525 cases (100.00%) | None | Detailed results |
| MetricFire (hosted) | 523 / 525 cases (99.62%) | 1 | Detailed results |
| New Relic (hosted) | 163 / 525 cases (31.05%) | 2 | Detailed results |
| Promscale (0.1.2) | 525 / 525 cases (100.00%) | None | Detailed results |
| Thanos (v0.17.0) | 525 / 525 cases (100.00%) | None | Detailed results |
| VictoriaMetrics (v1.47.0) | 312 / 525 cases (59.43%) | 1 | Detailed results |
Test results from 2020-08-06:
| Test target | Passing | Cross-cutting issues | More details |
|---|---|---|---|
| Cortex (v1.2.0) | 521 / 523 cases (99.62%) | 1 | Detailed results |
| Thanos (v0.14.0) | 523 / 523 cases (100.00%) | 1 | Detailed results |
| TimescaleDB (0.1.0-beta.1) | 523 / 523 cases (100.00%) | None | Detailed results |
| VictoriaMetrics (v1.39.1) | 356 / 523 cases (68.07%) | 1 | Detailed results |