q1361

R-SET GOLD-ONLY float-aggregate-order

student_club · mini_dev_pg-00000-of-00001 from https://huggingface.co/datasets/birdsql/bird_mini_dev/resolve/f65faf4ae3b638c1fa6df1d3370c8d92c8366301/data/mini_dev_pg-00000-of-00001.json (commit f65faf4a, downloaded 2026-09-08)

The question

What is the total cost of the pizzas for all the events?

the hint the set supplies: total cost of the pizzas refers to SUM(cost) where expense_description = 'Pizza'

This question was audited without a prediction beside it, so there is nothing to compare the gold with. The probes below read the gold alone.

The statements

gold

SELECT SUM(cost) FROM expense WHERE expense_description = 'Pizza'

this statement states no ordering of its own

sha256:0755eee7cb5f3b509bba8df2e532e80cca0094942fe7905c819842bbede6fd84

The results

gold, 1 row

from evidence-gold.json, 1 row

sumfloat4
600.11

The probes

A smell is a mechanical reason to read this gold statement again. It is a heuristic: it does not state that the statement is wrong, and a maintainer decides.

ordering-over-numeric-text not applicable

this statement orders by a text column holding only numbers, and ordering it as a number gives a different answer, so the gold may be sorting 9.5 above 10

the statement states no top level ORDER BY

what it measured 
{
  "heuristic": true,
  "reason": "the statement states no top level ORDER BY"
}

arbitrary-cut not applicable

this statement cuts its result at a LIMIT that does not decide which rows come back, so a different but equally correct statement can return other rows and score zero

the statement states no LIMIT

what it measured 
{
  "heuristic": true,
  "reason": "the statement states no LIMIT"
}

float-aggregate-order fired

this statement aggregates floating point numbers, so its last digits depend on the order the rows were summed in; the values agree to six significant digits

from smells.json, 1 row

600.11005
what it measured 
{
  "heuristic": true,
  "rule": "R-SET",
  "baseline_result_hash": "sha256:0755eee7cb5f3b509bba8df2e532e80cca0094942fe7905c819842bbede6fd84",
  "baseline_result": {
    "columns": [
      {
        "name": "sum",
        "declared_type": "float4"
      }
    ],
    "row_count": 1,
    "truncated": false,
    "rows_shown": 1,
    "rows": [
      [
        {
          "type": "dec",
          "value": "600.11"
        }
      ]
    ],
    "result_hash": "sha256:0755eee7cb5f3b509bba8df2e532e80cca0094942fe7905c819842bbede6fd84"
  },
  "planner_statistics": {
    "expense": {
      "last_analyze": null,
      "last_autoanalyze": null,
      "n_mod_since_analyze": 32
    }
  },
  "shuffle": {
    "seed": "1",
    "row_limit": 300000,
    "tables": [
      "expense"
    ],
    "tables_not_shuffled": [],
    "tables_skipped_for_size": {
      "laptimes": 400524,
      "legalities": 427907,
      "posthistory": 303155,
      "trans": 1056320,
      "yearmonth": 383282
    },
    "tables_not_reached_by_a_copy": {}
  },
  "shuffled_copies": {
    "run": true,
    "verdict": "not_equal",
    "differs": true,
    "result_hash": "sha256:28a33fd0933dc8c2b7eb34dc1b147cee178aa7665999cce122d919d75a4750d2",
    "result": {
      "columns": [
        {
          "name": "sum",
          "declared_type": "float4"
        }
      ],
      "row_count": 1,
      "truncated": false,
      "rows_shown": 1,
      "rows": [
        [
          {
            "type": "dec",
            "value": "600.11005"
          }
        ]
      ],
      "result_hash": "sha256:28a33fd0933dc8c2b7eb34dc1b147cee178aa7665999cce122d919d75a4750d2"
    }
  },
  "plan_variant": {
    "run": false,
    "reason": "the plan variant was not asked for"
  },
  "float_cells": [
    {
      "row": 0,
      "column": "sum",
      "declared_type": "float4",
      "baseline": "600.11",
      "rerun": "600.11005"
    }
  ],
  "significant_digits": 6
}

The evidence records

gold: evidence-gold.json

SELECT SUM(cost) FROM expense WHERE expense_description = 'Pizza'
statement read from
data/questions/mini_dev_pg-00000-of-00001.json
digest
sha256:7fa740ef9225389cff6c34432120e8325d0ca3008d73db1ae38731234bc10da7
origin
https://huggingface.co/datasets/birdsql/bird_mini_dev/resolve/f65faf4ae3b638c1fa6df1d3370c8d92c8366301/data/mini_dev_pg-00000-of-00001.json (commit f65faf4a, downloaded 2026-09-08), 2026-01-18T08:44:25Z

result_hash sha256:0755eee7cb5f3b509bba8df2e532e80cca0094942fe7905c819842bbede6fd84 recomputed from this JSON: match

record_hash sha256:5e4dbc4bf8338deb8cd6f44aaab5f10eb02e08aabe15828910cb3a964816ebca recomputed from this JSON: match

the result this record holds, 1 row

from evidence-gold.json, 1 row

sumfloat4
600.11
what ran, and where
run
audit-ed50a84a-c286-4cbb-ac89-ab3111058ad5
executed at
2026-09-08T05:19:05.024120+00:00
data as of
2026-09-08T05:18:53.188748+00:00
backend at checkout
PostgreSQL 16.15 (Debian 16.15-1.pgdg13+2) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 14.2.0-19) 14.2.0, 64-bit | server=172.17.0.2/32:5432 | database=bird
backend that answered
PostgreSQL 16.15 (Debian 16.15-1.pgdg13+2) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 14.2.0-19) 14.2.0, 64-bit | server=172.17.0.2/32:5432 | database=bird
database role
auditor
replay rule
R-SET
question set version
sha256:7fa740ef9225389cff6c34432120e8325d0ca3008d73db1ae38731234bc10da7
validator
audit:libpg_query-parse
checks run
parses_as_exactly_one_statement, the_one_statement_is_a_select, no_placeholder_without_a_bound_parameter
statement timeout
30000 ms
rows
1 row
the session it ran under
engine
postgresql
time_zone
Etc/UTC
date_style
ISO, MDY
interval_style
postgres
extra_float_digits
1
database_collation
en_US.utf8
work_mem
4096
hash_mem_multiplier
2

recorded beside them

statement_timeout
0
search_path
"$user", public
server_version
16.15 (Debian 16.15-1.pgdg13+2)
server_version_num
160015
transaction_read_only
on
max_parallel_workers_per_gather
2
server_encoding
UTF8
datlocprovider
c
daticulocale
datcollversion
2.41
the rendering and the data
version
attestql/audit/2
numeric_scale
6
timestamp_format
%Y-%m-%dT%H:%M:%S.%fZ
timezone
UTC
null_rendering
NULL
encoding
utf-8
schema digest
sha256:a5daf32762f45b84cb307cafb40f9db2c596e0692047523ae5ece90c157a02c3
source file sha256
sha256:31b1da211849d24a57c9af7636da46a5b82fc8a3ca1542bb3ebd8775e9a31cec
rows in public.expense
32

Running these again

gold

re-run this statement read-only against PostgreSQL 16.15 (Debian 16.15-1.pgdg13+2) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 14.2.0-19) 14.2.0, 64-bit | server=172.17.0.2/32:5432 | database=bird under the session settings and over the data this record's fixture digest names, and compare the two results under R-SET

This question's run

run
audit-ed50a84a-c286-4cbb-ac89-ab3111058ad5
server
PostgreSQL 16.15 (Debian 16.15-1.pgdg13+2) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 14.2.0-19) 14.2.0, 64-bit | server=172.17.0.2/32:5432 | database=bird
question set
mini_dev_pg-00000-of-00001 from https://huggingface.co/datasets/birdsql/bird_mini_dev/resolve/f65faf4ae3b638c1fa6df1d3370c8d92c8366301/data/mini_dev_pg-00000-of-00001.json (commit f65faf4a, downloaded 2026-09-08)
replay rule
R-SET

the run this question belongs to

The JSON this page was rendered from