Metric Views ¶
Apache Spark 4.2.0 introduces support for metric views.
Per the SPIP, Spark users can define business metrics (e.g., "active users", "revenue", or "revenue per customer") once and then ask for those metrics by dimension (date, country, product).
Metric views are created using CREATE VIEW WITH METRICS SQL statement.
How Metric Views Was Tested¶
[info] MetricViewFactorySuite:
[info] - fromYAML - parse basic metric view with asset source (282 milliseconds)
[info] - fromYAML - parse metric view with SQL source (74 milliseconds)
[info] - fromYAML - parse metric view with filter clause (5 milliseconds)
[info] - fromYAML - parse metric view with multiple dimensions and measures (8 milliseconds)
[info] - fromYAML - invalid YAML version (2 milliseconds)
[info] - fromYAML - malformed YAML (2 milliseconds)
[info] - toYAML - serialize basic metric view (17 milliseconds)
[info] - toYAML - serialize metric view with SQL source (3 milliseconds)
[info] - toYAML - serialize metric view with filter clause (7 milliseconds)
[info] - roundtrip - fromYAML and toYAML preserve data (9 milliseconds)
[info] - roundtrip - SQL source preservation (9 milliseconds)
[info] - column ordinals are preserved (3 milliseconds)
[info] - column metadata extraction (4 milliseconds)
[info] - empty source validation (3 milliseconds)
[info] - complex SQL expressions in measures (2 milliseconds)
[info] - special characters in column names and expressions (3 milliseconds)
[info] Run completed in 977 milliseconds.
[info] Total number of tests run: 16
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 16, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.