PromQL Compliance Test Results: Overview

This page summaries PromQL compliance test results for the PromQL implementations of different vendors or projects. For more information on these tests, see the PromQL Compliance Tester repository as well as the blog posts about compliance tests:

If you are a vendor or project implementing PromQL support outside of Prometheus and want to work with us to have your PromQL test results included here, please contact us at info@promlabs.com.

Test results from 2020-12-01:

Test targetPassingCross-cutting issuesMore details
Chronosphere (hosted)525 / 525 cases (100.00%)NoneDetailed results
Cortex (v1.5.0 - chunks)523 / 525 cases (99.62%)NoneDetailed results
Cortex (v1.5.0 - blocks)525 / 525 cases (100.00%)NoneDetailed results
Grafana Cloud (hosted)525 / 525 cases (100.00%)1Detailed results
M3 (v1.0.0)525 / 525 cases (100.00%)NoneDetailed results
MetricFire (hosted)523 / 525 cases (99.62%)1Detailed results
New Relic (hosted)163 / 525 cases (31.05%)2Detailed results
Promscale (0.1.2)525 / 525 cases (100.00%)NoneDetailed results
Thanos (v0.17.0)525 / 525 cases (100.00%)0Detailed results
VictoriaMetrics (v1.47.0)312 / 525 cases (59.43%)1Detailed results

Test results from 2020-08-06:

Test targetPassingCross-cutting issuesMore details
Cortex (v1.2.0)521 / 523 cases (99.62%)1Detailed results
Thanos (v0.14.0)523 / 523 cases (100.00%)1Detailed results
TimescaleDB (0.1.0-beta.1)523 / 523 cases (100.00%)NoneDetailed results
VictoriaMetrics (v1.39.1)356 / 523 cases (68.07%)1Detailed results