Segment-based Test Case Prioritization: a Multi-objective Approach
This program is tentative and subject to change.
Regression testing of software is a crucial but time-consuming task, especially in the context of UI testing where multiple microservices must be validated simultaneously. Test case prioritization (TCP) is a cost-efficient solution to address this by scheduling test cases in an execution order that maximizes an objective function, generally aimed at increasing the fault detection rate. While several techniques have been proposed for TCP, most rely on source code information which is usually not available for UI testing. In this paper, we introduce a multi-objective optimization approach to prioritize UI test cases, using evolutionary search algorithms and four coverage criteria focusing on web page elements as objectives for the optimization problem. Our method, which does not require source code information, is evaluated using two evolutionary algorithms (AGE-MOEA and NSGA-II) and compared with other TCP methods on a self-collected dataset of 11 test suites. The results show that our approach significantly outperforms other methods in terms of Average Percentage of Faults Detected (APFD) and APFD with Cost (APFDc), achieving the highest scores of 87.8% and 79.2%, respectively. We also introduce a new dataset and demonstrate the significant improvement our approach offers over existing methods through empirical experiments. The paper’s contributions include the application of web page segmentation in UI TCP for the first time, the construction of a new dataset for UI test case prioritization, and empirical comparisons that demonstrate the improvement of the proposed method.
This program is tentative and subject to change.
Fri 20 SepDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
13:30 - 14:50 | |||
13:30 20mTalk | Segment-based Test Case Prioritization: a Multi-objective Approach Technical Papers Hieu Huynh Katalon LLC., Nhu Pham University of Science, VNU-HCM; Katalon LLC., Vu Nguyen University of Science, VNU-HCM; Katalon LLC., Tien N. Nguyen University of Texas at Dallas | ||
13:50 20mTalk | Beyond Pairwise Testing: Advancing 3-wise Combinatorial Interaction Testing for Highly Configurable Systems Technical Papers Chuan Luo Beihang University, Shuangyu Lyu Beihang University, Qiyuan Zhao National University of Singapore, Wei Wu L3S Research Center, Leibniz University Hannover, Germany, Hongyu Zhang Chongqing University, Chunming Hu Beihang University | ||
14:10 20mTalk | Synthesis-based Enhancement for GUI Test Case Migration Technical Papers Yakun Zhang Peking University, Qihao Zhu Peking University, Jiwei Yan Institute of Software at Chinese Academy of Sciences, China, Chen Liu Clarkson University, Wenjie Zhang Peking University, Yifan Zhao Peking University, Dan Hao Peking University, Lu Zhang Peking University | ||
14:30 20mTalk | Revisiting Test-Case Prioritization on Long-Running Test Suites Technical Papers Runxiang Cheng University of Illinois at Urbana-Champaign, Shuai Wang University of Illinois at Urbana-Champaign, Reyhaneh Jabbarvand University of Illinois at Urbana-Champaign, Darko Marinov University of Illinois at Urbana-Champaign |