CCDD links transcripts of real Chinese competitive debate to the original adjudication produced under a predefined rubric: individual judge scores for every evaluated stage and side, match decisions, best-debater ballots and commentary, with linked appeal reassessments. Three benchmark tasks — winner prediction, stage-score prediction and best-debater prediction — measure agreement with professional adjudication at the match, stage and speaker levels.
Retained from 182 source matches after filtering incomplete or unresolved scoring records.
One scheduled stage × one evaluated side, each with three original judge scores (1–10).
Single-side contributions extracted from interactive stages; linked to parent-stage assessments.
148 original panels plus 20 appeal panels; every panel is three independent judges.
Motion, format and the ordered transcript; three judge decisions consolidated from impression, stage-based and decisive votes; the panel outcome; nine best-debater votes; recorded commentary.
Scheduled segments with a procedural type. A speech stage yields one scored side; questioning, cross-examination, head-to-head and free debate yield two, each with its own three ratings.
One continuous contribution from one side inside an interactive stage. Turns keep their order and parent stage but carry no independent quality score.
| Quantity | Count |
|---|---|
| Source / excluded matches | 182 / 34 |
| Retained matches | 148 |
| 4v4 without head-to-head | 71 |
| 4v4 with head-to-head | 45 |
| 2v2 | 32 |
| Stage–side instances | 2,690 |
| Turns in interactive stages | 20,542 |
| Original panel adjudications | 148 |
| Appeal panel adjudications | 20 |
| Total panel adjudications | 168 |
| Statistic | Value |
|---|---|
| Unanimous panels | 82 / 148 |
| Split panels | 66 / 148 |
| Pairwise decision agreement | 70.3% |
| Squared deviation from panel mean (stage scores) | 0.759 |
| Score-band agreement (all / exactly two / none) | 52.8 / 44.3 / 2.8% |
| ICC(1,3): stage–side scores | 0.523 |
| ICC(1,3): paired affirmative − negative differences | 0.630 |
| Appeal reversals | 7 / 20 (35%) |
Zero-shot, temperature 0 where supported, structured outputs. Dashed outlines are references. Full tables, metric definitions, structural and human references are on the benchmark page.
CCDD v1.0: full/ (148 match records + task files), multi_panel/ (20 appealed matches, both panels), cross_format/ (4v4 and 2v2 subsets). About 2.5 GB of JSON/JSONL.
The dataset is available at anonymous.4open.science/r/CCDD. The six largest exchange-level files are stored as parts under 100 MB; the README explains how to concatenate them.
@misc{yang2026ccdd,
title = {Chinese Competitive Debate: A Dataset and
Benchmark with Professional Adjudication},
author = {Yang, Zongrui and Li, Haoyuan and Wang, Zhongsheng and Zeng, Zhirui and Han, Pengqian and Zhou, Yi and Wang, Yuting and Liu, Jiamou},
year = {2026},
eprint = {2609.21637},
archivePrefix = {arXiv},
primaryClass = {cs.CL},
url = {https://arxiv.org/abs/2609.21637}
}We thank all friends in the debating community who offered advice, feedback and help with data processing for this benchmark.
We thank Mr. Xi Rui (席瑞), Mr. Wan Huaming (万华明), Ms. Wu Xinning (仵心凝) and other senior figures for their insight and ideas; and Beiming Debate Club (北冥辩论俱乐部), Adventurers' Tavern Debate Club (冒险者酒馆辩论俱乐部), the New Zealand Chinese Debating Association (新西兰华语辩论协会) and other organisations for their support and advice throughout data review, processing, tournament organisation and evaluation design.
Above all, we thank every expert judge who took part. Your long-accumulated debating practice and adjudication experience, and the care you brought to judging each match, form the most important professional foundation of this dataset and benchmark, and its most valuable asset.