ISSTA 2024
Mon 16 - Fri 20 September 2024 Vienna, Austria
co-located with ISSTA/ECOOP 2024
Fri 20 Sep 2024 15:30 - 15:50 at EI 9 Hlawka - Builds and Testing Chair(s): Zeyu Sun

Multi-agent systems (MASs) have achieved remarkable success in multi-robot control, intelligent transportation, and multiplayer games, etc.

Thorough testing for MAS is urgently needed to ensure its robustness in the face of constantly changing and unexpected scenarios.

Existing methods mainly focus on single-agent system testing and cannot be directly applied to MAS testing due to the complexity of MAS.

To our best knowledge, there are fewer studies on MAS testing.

While several studies have focused on adversarial attacks on MASs, they primarily target failure detection from an attack perspective, i.e., discovering failure scenarios, while ignoring the diversity of scenarios.

In this paper, to highlight a typical balance between exploration (diversifying behaviors) and exploitation (detecting failures), we propose an advanced testing framework for MAS called {\tool} with diversity-guided exploration and adaptive critical state exploitation.

It incorporates both individual diversity and team diversity, and designs an adaptive perturbation mechanism to perturb the action at the critical states, so as to trigger more and more diverse failure scenarios of the system.

We evaluate MASTest on two popular MAS simulation environments: Coop Navi and StarCraft II.

Results show that the average distance of the resulting failure scenarios is increased by 29.55%-103.57% and 74.07%-370.00% on two environments compared to the baselines. Also, the failure patterns found by MASTest are improved by 71.44%-300.00% and 50%-500.00% on two experimental environments compared to the baselines.

Fri 20 Sep

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

15:30 - 16:30
Builds and TestingTechnical Papers at EI 9 Hlawka
Chair(s): Zeyu Sun Institute of Software at Chinese Academy of Sciences
15:30
20m
Talk
Enhancing Multi-agent System Testing with Diversity-Guided Exploration and Adaptive Critical State Exploitation
Technical Papers
Xuyan Ma Institute of Software at Chinese Academy of Sciences, Yawen Wang Institute of Software at Chinese Academy of Sciences, Junjie Wang Institute of Software at Chinese Academy of Sciences, Xiaofei Xie Singapore Management University, Boyu Wu Institute of Software at Chinese Academy of Sciences, Shoubin Li Institute of Software at Chinese Academy of Sciences, Fanjiang Xu Institute of Software at Chinese Academy of Sciences, Qing Wang Institute of Software at Chinese Academy of Sciences
DOI
15:50
20m
Talk
Commit Artifact Preserving Build Prediction
Technical Papers
Guoqing Wang Peking University, Zeyu Sun Institute of Software at Chinese Academy of Sciences, Yizhou Chen Peking University, Yifan Zhao Peking University, Qingyuan Liang Peking University, Dan Hao Peking University
DOI
16:10
20m
Talk
Detecting Build Dependency Errors in Incremental Builds
Technical Papers
Jun Lyu Nanjing University, Shanshan Li Nanjing University, He Zhang Nanjing University, Yang Zhang Nanjing University, Guoping Rong Nanjing University, Manuel Rigger National University of Singapore
DOI

Information for Participants
Fri 20 Sep 2024 15:30 - 16:30 at EI 9 Hlawka - Builds and Testing Chair(s): Zeyu Sun
Info for room EI 9 Hlawka:

Map: https://tuw-maps.tuwien.ac.at/?q=CAEG17

Room tech: https://raumkatalog.tiss.tuwien.ac.at/room/13939