The whole of this group is a release asset
This site holds 31 of the 35 question directories these 11 runs wrote; the archive holds every one:
- archive
- bird-dev-sqlite-dev-20251106.tar.gz
- size
- 375,933 bytes
- sha256
- 4f83fa6296273278933f9f1b7d726f813ac35f73a03e4aa15dce6ec7db0700bc
The sums of the 11 runs
One prediction file, audited once per database it names, because a connection here is one file. Each run below states its own counts; these are those counts added up, which they can be because no question is in two of the runs.
| what | how many |
|---|---|
| audited | 1,534 |
| compared | 0 |
| GOLD-ONLY | 1,531 |
| probes fired | 47 |
| credited by BIRD and NOT_EQUAL | 0 |
| ERROR | 3 |
The runs
Every group of bird-dev-sqlite is indexed a level up.
| database | date | engine | question set | question set digest |
|---|---|---|---|---|
| california_schools | 2026-09-08T05:05:54.087132+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |
| card_games | 2026-09-08T05:11:02.685988+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |
| codebase_community | 2026-09-08T05:12:17.158069+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |
| debit_card_specializing | 2026-09-08T05:08:50.068080+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |
| european_football_2 | 2026-09-08T05:13:55.178504+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |
| financial | 2026-09-08T04:59:11.063937+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |
| formula_1 | 2026-09-08T04:57:31.494463+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |
| student_club | 2026-09-08T04:59:09.216110+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |
| superhero | 2026-09-08T04:59:10.039543+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |
| thrombosis_prediction | 2026-09-08T04:58:55.059074+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |
| toxicology | 2026-09-08T04:58:56.286804+00:00 | sqlite | https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07) | sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb |