born in 2003. Master candidate. His main research interests include natural language processing and natural language interface to databases
born in 1997. PhD. His main research interests include natural language processing and semantic parsing
born in 1972. PhD, professor. His main research interests include natural language processing, question answering systems, and information retrieval
Traditional Text-to-SQL tasks typically require large scale annotated data for model training, which incurs significant time and labor costs. Consequently, data scarcity remains a critical bottleneck, particularly in domain specific applications. While data augmentation based on large language model (LLM) has emerged as a promising solution to this issue, most existing methods heavily rely on the distribution of original datasets and often generate synthetic data that lack reliability and interpretability. Addressing these challenges, we propose SCoT-SQL, a novel chain-of-thought guided data synthesis framework. This method effectively integrates natural language instructions with symbolic knowledge, specifically detailed database schema and table content, to guide LLM, thereby significantly reducing semantic errors during the generation process. To guarantee the high quality of synthetic data, SCoT-SQL incorporates a rigorous filtering mechanism that leverages both model self consistency voting and verification based on execution. Additionally, the framework employs a self feedback mechanism driven by chain-of-thought reasoning to calibrate synthetic data. This process not only rectifies logical inconsistencies in SQL queries but also generates explicit step by step reasoning trajectories, enhancing the interpretability of the dataset. Comprehensive experiments on the KaggleDBQA and ScienceBenchmark datasets demonstrate the efficacy of the proposed method. SCoT-SQL achieves execution accuracy improvements of 6.5% and 3% respectively, significantly outperforming previous state of the art data synthesis baselines and proving its effectiveness in low resource and complex scenarios.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |