The whole of this group is a release asset
This site holds 7 of the 269 question directories these 11 runs wrote; the archive holds every one:
- archive
- minidev-sqlite-gpt-4.tar.gz
- size
- 12,384,631 bytes
- sha256
- 98b2e6ccc58e79221e0d18d0f55374a335256f85ff6a92f0f92793ebe8d39bd0
The sums of the 11 runs
One prediction file, audited once per database it names, because a connection here is one file. Each run below states its own counts; these are those counts added up, which they can be because no question is in two of the runs.
| what | how many |
|---|---|
| audited | 498 |
| compared | 472 |
| EQUAL | 209 |
| NOT_EQUAL | 263 |
| ERROR | 26 |
| probes fired | 26 |
| credited by BIRD and NOT_EQUAL | 32 |
The runs
Every group of minidev-sqlite is indexed a level up.
| database | date | engine | question set | question set digest |
|---|---|---|---|---|
| california_schools | 2026-09-08T05:02:35.069512+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| card_games | 2026-09-08T05:23:06.166754+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| codebase_community | 2026-09-08T05:23:59.821753+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| debit_card_specializing | 2026-09-08T05:02:52.181154+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| european_football_2 | 2026-09-08T05:02:56.958257+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| financial | 2026-09-08T05:02:58.110225+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| formula_1 | 2026-09-08T05:03:02.033537+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| student_club | 2026-09-08T05:03:08.129649+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| superhero | 2026-09-08T05:03:08.683211+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| thrombosis_prediction | 2026-09-08T05:03:09.647872+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| toxicology | 2026-09-08T05:03:10.450841+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |