PromQL Compliance Test Results: Overview

This page summaries PromQL compliance test results for the PromQL implementations of different vendors or projects. For more information on these tests, see the PromQL Compliance Tester tool as well as our blog posts about compliance tests:

If you are a vendor or project implementing PromQL support outside of Prometheus and want to work with us to have your PromQL test results included here, please contact us at info@promlabs.com.

Test results from 2021-10-14:

Test targetPassingCross-cutting issuesMore details
Amazon Managed Service for Prometheus (hosted)596 / 596 cases (100.00%)1Detailed results
Chronosphere (hosted)596 / 596 cases (100.00%)NoneDetailed results
Cortex (v1.10.0)596 / 596 cases (100.00%)NoneDetailed results
Google Cloud Managed Service for Prometheus (hosted preview)517 / 548 cases (94.34%)NoneDetailed results
Grafana Cloud (hosted)548 / 548 cases (100.00%)NoneDetailed results
M3 (v1.3.0)596 / 596 cases (100.00%)NoneDetailed results
New Relic (hosted)162 / 596 cases (27.18%)2Detailed results
Promscale (0.6.2)596 / 596 cases (100.00%)NoneDetailed results
Sysdig Monitor (hosted)594 / 596 cases (99.66%)1Detailed results
Thanos (v0.23.1)596 / 596 cases (100.00%)NoneDetailed results
VictoriaMetrics (v1.67.0)442 / 596 cases (74.16%)1Detailed results

Test results from 2020-12-01:

Test targetPassingCross-cutting issuesMore details
Chronosphere (hosted)525 / 525 cases (100.00%)NoneDetailed results
Cortex (v1.5.0 - chunks)523 / 525 cases (99.62%)NoneDetailed results
Cortex (v1.5.0 - blocks)525 / 525 cases (100.00%)NoneDetailed results
Grafana Cloud (hosted)525 / 525 cases (100.00%)1Detailed results
M3 (v1.0.0)525 / 525 cases (100.00%)NoneDetailed results
MetricFire (hosted)523 / 525 cases (99.62%)1Detailed results
New Relic (hosted)163 / 525 cases (31.05%)2Detailed results
Promscale (0.1.2)525 / 525 cases (100.00%)NoneDetailed results
Thanos (v0.17.0)525 / 525 cases (100.00%)NoneDetailed results
VictoriaMetrics (v1.47.0)312 / 525 cases (59.43%)1Detailed results

Test results from 2020-08-06:

Test targetPassingCross-cutting issuesMore details
Cortex (v1.2.0)521 / 523 cases (99.62%)1Detailed results
Thanos (v0.14.0)523 / 523 cases (100.00%)1Detailed results
TimescaleDB (0.1.0-beta.1)523 / 523 cases (100.00%)NoneDetailed results
VictoriaMetrics (v1.39.1)356 / 523 cases (68.07%)1Detailed results