The whole of this group is a release asset
This site holds 5 of the 158 question directories these 11 runs wrote; the archive holds every one:
- archive
- minidev-sqlite-mistralai-mixtral-8x7b-instru-4.tar.gz
- size
- 1,075,349 bytes
- sha256
- 7f34c38f4a2fbc7c9cfd7720ee1dcc8af8c27748e47e2bdd6ebe556f7e3703ea
The sums of the 11 runs
One prediction file, audited once per database it names, because a connection here is one file. Each run below states its own counts; these are those counts added up, which they can be because no question is in two of the runs.
| what | how many |
|---|---|
| audited | 498 |
| compared | 248 |
| ERROR | 250 |
| NOT_EQUAL | 157 |
| EQUAL | 91 |
| probes fired | 14 |
| credited by BIRD and NOT_EQUAL | 16 |
The runs
Every group of minidev-sqlite is indexed a level up.
| database | date | engine | question set | question set digest |
|---|---|---|---|---|
| california_schools | 2026-09-08T05:04:40.583767+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| card_games | 2026-09-08T05:28:29.387729+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| codebase_community | 2026-09-08T05:04:41.811133+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| debit_card_specializing | 2026-09-08T05:04:43.380030+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| european_football_2 | 2026-09-08T05:04:45.603103+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| financial | 2026-09-08T05:29:04.478800+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| formula_1 | 2026-09-08T05:04:56.081883+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| student_club | 2026-09-08T05:04:59.467125+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| superhero | 2026-09-08T05:04:59.960649+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| thrombosis_prediction | 2026-09-08T05:05:01.021515+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| toxicology | 2026-09-08T05:05:01.622412+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |