R-ORD GOLD-ONLY not-a-function-of-the-data
card_games · dev_20251106-00000-of-00001 from https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07)
Please list the Italian names of the cards in the set Coldsnap with the highest converted mana cost.
the hint the set supplies: card set Coldsnap refers to name = 'Coldsnap'; Italian refers to language = 'Italian'; highest converted mana cost refers to MAX(convertedManaCost)
This question was audited without a prediction beside it, so there is nothing to compare the gold with. The probes below read the gold alone.
read by hand, 2026-09-07: wrong the gold does not answer its question on this data
the gold orders by converted mana cost and never cuts, returning all 155 Italian cards of the set where 12 carry the highest cost the question asks for
a maintainer's reading of this question, out of classification.json, copied from plans/reports/bird-dev-sqlite-260907/classification.json. It is not a verdict and nothing above it was computed from it.
SELECT T2.name FROM foreign_data AS T1 INNER JOIN cards AS T2 ON T2.uuid = T1.uuid INNER JOIN sets AS T3 ON T3.code = T2.setCode WHERE T3.name = 'Coldsnap' AND T1.language = 'Italian' ORDER BY T2.convertedManaCost DESCsha256:6cb177cf8db2129b664ce2b6fe965cdb03d2d86213a5fe3be577041b134a28a1
from evidence-gold.json, 155 rows
| nameTEXT |
|---|
| Sunscour |
| Commandeer |
| Jokulmorder |
| Rimefeather Owl |
| Herald of Leshrac |
| Soul Spike |
| Tresserhorn Skyknight |
| Fury of the Horde |
| Rimescale Dragon |
| Allosaurus Rider |
| Panglacial Wurm |
| Garza Zol, Plague Queen |
| Adarkar Valkyrie |
| Darien, King of Kjeldor |
| Kjeldoran Gargoyle |
| Ronom Serpent |
| Void Maw |
| Greater Stone Spirit |
| Arctic Nishoba |
| Aurochs Herd |
| Shape of the Wiitigo |
| Deepfire Elemental |
| Phyrexian Snowcrusher |
| Boreal Griffin |
| Ursine Fylgja |
| Adarkar Windform |
| Drelnoch |
| Heidar, Rimewind Master |
| Gristle Grinner |
| Lovisa Coldeyes |
| Thermopod |
| Hibernation's End |
| Rimehorn Aurochs |
| Ronom Hulk |
| Steam Spitter |
| Diamond Faerie |
| Juniper Order Ranger |
| Sek'Kuar, Deathkeeper |
| Thrumming Stone |
| Glacial Plating |
| Woolly Razorback |
| Arcum Dagsson |
| Controvert |
| Krovikan Whispers |
| Rimewind Cryomancer |
| Surging Aether |
| Balduvian Fallen |
| Chill to the Bone |
| Disciple of Tevesh Szat |
| Zombie Musher |
| Balduvian Warlord |
| Icefall |
| Karplusan Minotaur |
| Magmatic Core |
| Ohran Yeti |
| Stalking Yeti |
| Brooding Saurian |
| Karplusan Strider |
| Mystic Melting |
| Simian Brawler |
| Blizzard Specter |
| Vanish into Memory |
| Zur the Enchanter |
| Cover of Winter |
| Field Marshal |
| Jötun Owl Keeper |
| Surging Sentinels |
| Balduvian Frostwaker |
| Frost Raptor |
| Frozen Solid |
| Survivor of the Unseen |
| Vexing Sphinx |
| Chilling Shade |
| Garza's Assassin |
| Gutless Ghoul |
| Haakon, Stromgald Scourge |
| Krovikan Rot |
| Phobian Phantasm |
| Phyrexian Etchings |
| Cryoclasm |
| Earthen Goo |
| Goblin Rimerunner |
| Lightning Storm |
| Orcish Bloodpainter |
| Frostweb Spider |
| Ohran Viper |
| Sound the Call |
| Surging Might |
| Tamanoa |
| Wilderness Elemental |
| Jester's Scepter |
| Phyrexian Ironfoot |
| Phyrexian Soulgorger |
| Jötun Grunt |
| Kjeldoran Outrider |
| Kjeldoran War Cry |
| Ronom Unicorn |
| Squall Drifter |
| Sun's Bounty |
| Swift Maneuver |
| Wall of Shards |
| White Shield Crusader |
| Counterbalance |
| Flashfreeze |
| Krovikan Mist |
| Perilous Research |
| Rimewind Taskmage |
| Rune Snag |
| Grim Harvest |
| Krovikan Scoundrel |
| Rime Transfusion |
| Stromgald Crusader |
| Surging Dementia |
| Braid of Fire |
| Goblin Furrier |
| Surging Flame |
| Boreal Centaur |
| Bull Aurochs |
| Freyalise's Radiance |
| Into the North |
| Resize |
| Sheltering Ancient |
| Coldsteel Heart |
| Gelid Shackles |
| Kjeldoran Javelineer |
| Luminesce |
| Martyr of Sands |
| Martyr of Frost |
| Thermal Flux |
| Deathmark |
| Feast of Flesh |
| Martyr of Bones |
| Rimebound Dead |
| Balduvian Rage |
| Karplusan Wolverine |
| Lightning Serpent |
| Martyr of Ashes |
| Rite of Flame |
| Skred |
| Boreal Druid |
| Martyr of Spores |
| Mishra's Bauble |
| Arctic Flats |
| Boreal Shelf |
| Dark Depths |
| Frost Marsh |
| Highland Weald |
| Mouth of Ronom |
| Scrying Sheets |
| Tresserhorn Sinks |
| Snow-Covered Plains |
| Snow-Covered Island |
| Snow-Covered Swamp |
| Snow-Covered Mountain |
| Snow-Covered Forest |
A smell is a mechanical reason to read this gold statement again. It is a heuristic: it does not state that the statement is wrong, and a maintainer decides.
this statement orders by a text column holding only numbers, and ordering it as a number gives a different answer, so the gold may be sorting 9.5 above 10
no ORDER BY key resolves to a text column
{
"heuristic": true,
"reason": "no ORDER BY key resolves to a text column",
"keys": [
{
"key": "T2.convertedManaCost",
"column": "cards.convertedManaCost",
"declared_type": "REAL",
"not_applicable": "the column is not declared as text"
}
]
}this statement cuts its result at a LIMIT that does not decide which rows come back, so a different but equally correct statement can return other rows and score zero
the statement states no LIMIT
{
"heuristic": true,
"reason": "the statement states no LIMIT"
}rerun over the same rows in another physical order this statement gives another answer, so its result depends on how the rows are stored and not only on the data
from smells.json, 10 rows
| Commandeer |
| Allosaurus Rider |
| Jokulmorder |
| Herald of Leshrac |
| Soul Spike |
| Fury of the Horde |
| Rimescale Dragon |
| Garza Zol, Plague Queen |
| Rimefeather Owl |
| Sunscour |
{
"heuristic": true,
"rule": "R-ORD",
"baseline_result_hash": "sha256:6cb177cf8db2129b664ce2b6fe965cdb03d2d86213a5fe3be577041b134a28a1",
"baseline_result": {
"columns": [
{
"name": "name",
"declared_type": "TEXT"
}
],
"row_count": 155,
"truncated": false,
"rows_shown": 10,
"rows": [
[
{
"type": "str",
"value": "Sunscour"
}
],
[
{
"type": "str",
"value": "Commandeer"
}
],
[
{
"type": "str",
"value": "Jokulmorder"
}
],
[
{
"type": "str",
"value": "Rimefeather Owl"
}
],
[
{
"type": "str",
"value": "Herald of Leshrac"
}
],
[
{
"type": "str",
"value": "Soul Spike"
}
],
[
{
"type": "str",
"value": "Tresserhorn Skyknight"
}
],
[
{
"type": "str",
"value": "Fury of the Horde"
}
],
[
{
"type": "str",
"value": "Rimescale Dragon"
}
],
[
{
"type": "str",
"value": "Allosaurus Rider"
}
]
],
"result_hash": "sha256:6cb177cf8db2129b664ce2b6fe965cdb03d2d86213a5fe3be577041b134a28a1"
},
"planner_statistics": {},
"shuffle": {
"seed": "1",
"row_limit": 300000,
"tables": [
"foreign_data",
"cards",
"sets"
],
"tables_not_shuffled": [],
"tables_skipped_for_size": {
"legalities": 427907
},
"tables_not_reached_by_a_copy": {}
},
"shuffled_copies": {
"run": true,
"verdict": "not_equal",
"differs": true,
"result_hash": "sha256:ddd506305d427d80eec09beb63617456833ae26bb72aa2728dc121049fb8364e",
"result": {
"columns": [
{
"name": "name",
"declared_type": "TEXT"
}
],
"row_count": 155,
"truncated": false,
"rows_shown": 10,
"rows": [
[
{
"type": "str",
"value": "Commandeer"
}
],
[
{
"type": "str",
"value": "Allosaurus Rider"
}
],
[
{
"type": "str",
"value": "Jokulmorder"
}
],
[
{
"type": "str",
"value": "Herald of Leshrac"
}
],
[
{
"type": "str",
"value": "Soul Spike"
}
],
[
{
"type": "str",
"value": "Fury of the Horde"
}
],
[
{
"type": "str",
"value": "Rimescale Dragon"
}
],
[
{
"type": "str",
"value": "Garza Zol, Plague Queen"
}
],
[
{
"type": "str",
"value": "Rimefeather Owl"
}
],
[
{
"type": "str",
"value": "Sunscour"
}
]
],
"result_hash": "sha256:ddd506305d427d80eec09beb63617456833ae26bb72aa2728dc121049fb8364e"
}
},
"plan_variant": {
"run": false,
"reason": "the plan variant was not asked for"
}
}SELECT T2.name FROM foreign_data AS T1 INNER JOIN cards AS T2 ON T2.uuid = T1.uuid INNER JOIN sets AS T3 ON T3.code = T2.setCode WHERE T3.name = 'Coldsnap' AND T1.language = 'Italian' ORDER BY T2.convertedManaCost DESCresult_hash sha256:6cb177cf8db2129b664ce2b6fe965cdb03d2d86213a5fe3be577041b134a28a1 recomputed from this JSON: match
record_hash sha256:af1c96a1252797e3c9d8b4aaec758e7f9898eb0abd70bbef4e3e879f65711f06 recomputed from this JSON: match
from evidence-gold.json, 155 rows
| nameTEXT |
|---|
| Sunscour |
| Commandeer |
| Jokulmorder |
| Rimefeather Owl |
| Herald of Leshrac |
| Soul Spike |
| Tresserhorn Skyknight |
| Fury of the Horde |
| Rimescale Dragon |
| Allosaurus Rider |
| Panglacial Wurm |
| Garza Zol, Plague Queen |
| Adarkar Valkyrie |
| Darien, King of Kjeldor |
| Kjeldoran Gargoyle |
| Ronom Serpent |
| Void Maw |
| Greater Stone Spirit |
| Arctic Nishoba |
| Aurochs Herd |
| Shape of the Wiitigo |
| Deepfire Elemental |
| Phyrexian Snowcrusher |
| Boreal Griffin |
| Ursine Fylgja |
| Adarkar Windform |
| Drelnoch |
| Heidar, Rimewind Master |
| Gristle Grinner |
| Lovisa Coldeyes |
| Thermopod |
| Hibernation's End |
| Rimehorn Aurochs |
| Ronom Hulk |
| Steam Spitter |
| Diamond Faerie |
| Juniper Order Ranger |
| Sek'Kuar, Deathkeeper |
| Thrumming Stone |
| Glacial Plating |
| Woolly Razorback |
| Arcum Dagsson |
| Controvert |
| Krovikan Whispers |
| Rimewind Cryomancer |
| Surging Aether |
| Balduvian Fallen |
| Chill to the Bone |
| Disciple of Tevesh Szat |
| Zombie Musher |
| Balduvian Warlord |
| Icefall |
| Karplusan Minotaur |
| Magmatic Core |
| Ohran Yeti |
| Stalking Yeti |
| Brooding Saurian |
| Karplusan Strider |
| Mystic Melting |
| Simian Brawler |
| Blizzard Specter |
| Vanish into Memory |
| Zur the Enchanter |
| Cover of Winter |
| Field Marshal |
| Jötun Owl Keeper |
| Surging Sentinels |
| Balduvian Frostwaker |
| Frost Raptor |
| Frozen Solid |
| Survivor of the Unseen |
| Vexing Sphinx |
| Chilling Shade |
| Garza's Assassin |
| Gutless Ghoul |
| Haakon, Stromgald Scourge |
| Krovikan Rot |
| Phobian Phantasm |
| Phyrexian Etchings |
| Cryoclasm |
| Earthen Goo |
| Goblin Rimerunner |
| Lightning Storm |
| Orcish Bloodpainter |
| Frostweb Spider |
| Ohran Viper |
| Sound the Call |
| Surging Might |
| Tamanoa |
| Wilderness Elemental |
| Jester's Scepter |
| Phyrexian Ironfoot |
| Phyrexian Soulgorger |
| Jötun Grunt |
| Kjeldoran Outrider |
| Kjeldoran War Cry |
| Ronom Unicorn |
| Squall Drifter |
| Sun's Bounty |
| Swift Maneuver |
| Wall of Shards |
| White Shield Crusader |
| Counterbalance |
| Flashfreeze |
| Krovikan Mist |
| Perilous Research |
| Rimewind Taskmage |
| Rune Snag |
| Grim Harvest |
| Krovikan Scoundrel |
| Rime Transfusion |
| Stromgald Crusader |
| Surging Dementia |
| Braid of Fire |
| Goblin Furrier |
| Surging Flame |
| Boreal Centaur |
| Bull Aurochs |
| Freyalise's Radiance |
| Into the North |
| Resize |
| Sheltering Ancient |
| Coldsteel Heart |
| Gelid Shackles |
| Kjeldoran Javelineer |
| Luminesce |
| Martyr of Sands |
| Martyr of Frost |
| Thermal Flux |
| Deathmark |
| Feast of Flesh |
| Martyr of Bones |
| Rimebound Dead |
| Balduvian Rage |
| Karplusan Wolverine |
| Lightning Serpent |
| Martyr of Ashes |
| Rite of Flame |
| Skred |
| Boreal Druid |
| Martyr of Spores |
| Mishra's Bauble |
| Arctic Flats |
| Boreal Shelf |
| Dark Depths |
| Frost Marsh |
| Highland Weald |
| Mouth of Ronom |
| Scrying Sheets |
| Tresserhorn Sinks |
| Snow-Covered Plains |
| Snow-Covered Island |
| Snow-Covered Swamp |
| Snow-Covered Mountain |
| Snow-Covered Forest |
re-run this statement read-only against SQLite 3.53.4 | file=/private/tmp/attestql-runs/data/dev/dev_databases/card_games/card_games.sqlite | size=261820416 under the session settings and over the data this record's fixture digest names, and compare the two results under R-ORD