DBStorm: Generating Various Effective Workloads for Testing Isolation Levels
This program is tentative and subject to change.
Isolation level (IL) acts as a correctness contract between applications and database management systems (DBMSs). Problematic IL implementations would cause incorrect transaction execution results and erroneous database states. However, existing testing methods could not efficiently generate various effective workloads for testing ILs. The core challenges come from the requirements of (a) black-box testing (trigger the IL code of a closed source DBMS), (b) effective testing (evade redundant and ineffective testing), and (c) anomaly-sensitive testing (test various ILs in a distinguishable way). For black-box testing, we investigate the IL implementations of 15 popular DBMSs and discover that they follow a generic framework that utilizes conflict graphs to manage all conflicts of a workload, and performs a verification policy to prevent non-serializable anomalies. For effective testing, we propose a lightweight data state mirroring approach, which helps generate SQL operations that precisely access its expected records and participate the formation of specific conflict graphs. We also propose an efficient history-independent approach to continuously generate dissimilar conflict graphs. It guarantees the graph generation overhead is irrelevant to the scale of historical graphs. For anomaly-sensitive testing, we propose an implantation-based approach to orchestrate conflict record accesses and inject them into different transactions according to the anomaly definition. Our approach outperforms existing approaches in testing effectiveness, efficiency, and coverage. Practically, we have successfully found 30 bugs in popular DBMSs.
This program is tentative and subject to change.
Thu 19 SepDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
13:30 - 14:50 | |||
13:30 20mTalk | Testing Gremlin-Based Graph Database Systems via Query Disassembling Technical Papers Yingying Zheng Institute of Software Chinese Academy of Sciences, Wensheng Dou Institute of Software Chinese Academy of Sciences, Lei Tang Institute of Software Chinese Academy of Sciences, Ziyu Cui Institute of Software Chinese Academy of Sciences, Yu Gao Institute of Software, Chinese Academy of Sciences, China, Jiansen Song Institute of Software Chinese Academy of Sciences, Liang Xu , Jiaxin Zhu Institute of Software at Chinese Academy of Sciences, China, Wei Wang , Jun Wei Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences; University of Chinese Academy of Sciences Chongqing School, Hua Zhong Institute of Software Chinese Academy of Sciences, Tao Huang Institute of Software Chinese Academy of Sciences | ||
13:50 20mTalk | SQLess: Dialect-Agnostic SQL Query Simplification Technical Papers Li Lin School of Informatics, Xiamen University, Zongyin Hao School of Informatics, Xiamen University, Chengpeng Wang The Hong Kong University of Science and Technology, Zhuangda Wang School of Informatics, Xiamen University, Rongxin Wu School of Informatics, Xiamen University, Gang Fan n, n | ||
14:10 20mTalk | Testing Graph Database Systems with Graph-State Persistence Oracle Technical Papers Shuang Liu Renmin University of China, Junhao Lan Tianjin University, China, Xiaoning Du Monash University, Australia, Jiyuan Li Tianjin University, China, Wei Lu Renmin University of China, China, Jiajun Jiang Tianjin University, Xiaoyong Du Renmin University of China | ||
14:30 20mTalk | DBStorm: Generating Various Effective Workloads for Testing Isolation Levels Technical Papers Keqiang Li East China Normal University, Siyang Weng East China Normal University, Lyu Ni East China Normal University, Chengcheng Yang East China Normal University, Rong Zhang East China Normal University, Xuan Zhou East China Normal University, Aoying Zhou East China Normal University |