LIRAT: Layout and Image Recognition Driving Automated Mobile Testing of Cross-Platform
Tue 12 Nov 2019 12:00 - 12:10 at Hillcrest - Mobile 1 Chair(s): Marouane Kessentini
The fragmentation issue spreads over multiple mobile platforms such as Android, iOS, mobile web and even WeChat, which hinders test scripts from running across platforms. To reduce the cost of adapting scripts for various platforms, some existing tools apply conventional computer vision techniques to replay the same script on multiple platforms automatically. However, because these solutions can hardly identify dynamic or similar widgets, it becomes difficult for engineers to apply them in practice. In this paper, we present an image-driven tool, namely LIRAT, to record and replay test scripts cross platforms, solving the problem of test script cross-platform replay for the first time. LIRAT records screenshots and layouts of the widgets, and leverages image understanding techniques to locate them in the replay process. Based on accurate widget localization, LIRAT supports replaying test scripts across devices and platforms. We employed LIRAT to replay 25 scripts from 5 application across 8 Android devices and 2 iOS devices. The results show that LIRAT can replay 88% scripts on Android platforms and 60% on iOS platforms.
LIRAT: Layout and Image Recognition Driving Automated Mobile Testing of Cross-Platform (LIRAT.pdf) | 8.99MiB |
Tue 12 NovDisplayed time zone: Tijuana, Baja California change
10:00 - 10:40 | |||
10:00 40mDemonstration | Pangolin: An SFL-based Toolset for Feature Localization Demonstrations Bruno Miguel Sotto-Mayor de Castro Machado IST, University of Lisbon, Alexandre Perez Palo Alto Research Center, Rui Abreu Instituto Superior Técnico, U. Lisboa & INESC-ID | ||
10:00 40mDemonstration | A Quantitative Analysis Framework for Recurrent Neural Network Demonstrations Xiaoning Du Nanyang Technological University, Xiaofei Xie Nanyang Technological University, Yi Li Nanyang Technological University, Lei Ma Kyushu University, Yang Liu Nanyang Technological University, Singapore, Jianjun Zhao Kyushu University | ||
10:00 40mDemonstration | Ares: Inferring Error Specifications through Static Analysis Demonstrations Li Chi Tsinghua University, Zuxing Gu School of Software, Tsinghua University, Min Zhou Tsinghua University, Ming Gu Tsinghua University, Hongyu Zhang The University of Newcastle | ||
10:00 40mDemonstration | SiMPOSE - Configurable N-Way Program Merging Strategies for Superimposition-based Analysis of Variant-Rich Software Demonstrations Dennis Reuling Software Engineering Group, University of Siegen, Udo Kelter Software Engineering Group, University of Siegen, Sebastian Ruland TU Darmstadt, Real-time Systems Lab, Malte Lochau TU Darmstadt Pre-print Media Attached File Attached | ||
10:00 40mDemonstration | VeriAbs : Verification by Abstraction and Test Generation Demonstrations Mohammad Afzal Tata Cosultancy Services, A Asia Tata Cosultancy Services, Avriti Chauhan Tata Cosultancy Services, Bharti Chimdyalwar Tata Consultancy Services, Priyanka Darke Tata Consultancy Services, Advaita Datar Tata Consultancy Services Ltd, Shrawan Kumar Tata Cosultancy Services, R Venkatesh Tata Research Development and Design Centre | ||
10:00 40mDemonstration | DeepHunter: A Coverage-Guided Fuzzer for Deep Neural Networks Demonstrations Xiaofei Xie Nanyang Technological University, Hongxu Chen Nanyang Technological University, Yi Li Nanyang Technological University, Lei Ma Kyushu University, Yang Liu Nanyang Technological University, Singapore, Jianjun Zhao Kyushu University | ||
10:00 40mDemonstration | SPrinter: A Static Checker for Finding Smart Pointer Errors in C++ Programs Demonstrations Xutong Ma Institute of Software, Chinese Academy of Sciences, Jiwei Yan Institute of Software, Chinese Academy of Sciences, Yaqi Li Institute of Software, Chinese Academy of Sciences, Jun Yan Institute of Software, Chinese Academy of Sciences, Jian Zhang Institute of Software, Chinese Academy of Sciences | ||
10:00 40mDemonstration | LIRAT: Layout and Image Recognition Driving Automated Mobile Testing of Cross-Platform Demonstrations Shengcheng Yu Nanjing University, China, Chunrong Fang Nanjing University, Yang Feng University of California, Irvine, Wenyuan Zhao Nanjing University, Zhenyu Chen Nanjing University File Attached | ||
10:00 40mDemonstration | FogWorkflowSim: An Automated Simulation Toolkit for Workflow Performance Evaluation in Fog Computing Demonstrations Xiao Liu School of Information Technology, Deakin University, Lingmin Fan School of Computer Science and Technology, Anhui University, Jia Xu School of Computer Science and Technology, Anhui University, Xuejun Li School of Computer Science and Technology, Anhui University, Lina Gong School of Computer Science and Technology, Anhui University, John Grundy Monash University, Yun Yang Swinburne University of Technology | ||
10:00 40mDemonstration | SGUARD: A Feature-based Clustering Tool for Effective Spreadsheet Defect Detection Demonstrations Da Li State Key Lab. for Novel Software Tech. and Dept. of Comp. Sci. and Tech., Nanjing University, Nanjing, China, Huiyan Wang State Key Lab. for Novel Software Tech. and Dept. of Comp. Sci. and Tech., Nanjing University, Nanjing, China, Chang Xu Nanjing University, Ruiqing Zhang Search Tech. Center Asia, Microsoft, Suzhou, China, Shing-Chi Cheung Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Xiaoxing Ma State Key Lab. for Novel Software Tech. and Dept. of Comp. Sci. and Tech., Nanjing University | ||
10:00 40mDemonstration | FPChecker: Detecting Floating-Point Exceptions in GPU Applications Demonstrations Ignacio Laguna Lawrence Livermore National Laboratory | ||
10:00 40mDemonstration | PMExec: An Execution Engine of Partial UML-RT Models Demonstrations Mojtaba Bagherzadeh Queen's University, Karim Jahed Queen's University, Nafiseh Kahani Queen's University, Juergen Dingel Queen's University, Kingston, Ontario Pre-print |
10:40 - 12:20 | Mobile 1Demonstrations / Research Papers / Journal First Presentations at Hillcrest Chair(s): Marouane Kessentini University of Michigan | ||
10:40 20mTalk | Test Transfer Across Mobile Apps Through Semantic Mapping Research Papers Jun-Wei Lin University of California, Irvine, Reyhaneh Jabbarvand University of California, Irvine, Sam Malek University of California, Irvine | ||
11:00 20mTalk | Test Migration Between Mobile Apps with Similar Functionality Research Papers | ||
11:20 20mTalk | DaPanda: Detecting Aggressive Push Notification in Android Apps Research Papers Tianming Liu Beijing University of Posts and Telecommunications, China, Haoyu Wang Beijing University of Posts and Telecommunications, China, Li Li Monash University, Australia, Guangdong Bai Griffith University, Yao Guo Peking University, Guoai Xu Beijing University of Posts and Telecommunications | ||
11:40 20mTalk | Automatic, highly accurate app permission recommendation Journal First Presentations Zhongxin Liu Zhejiang University, Xin Xia Monash University, David Lo Singapore Management University, John Grundy Monash University Link to publication | ||
12:00 10mDemonstration | LIRAT: Layout and Image Recognition Driving Automated Mobile Testing of Cross-Platform Demonstrations Shengcheng Yu Nanjing University, China, Chunrong Fang Nanjing University, Yang Feng University of California, Irvine, Wenyuan Zhao Nanjing University, Zhenyu Chen Nanjing University File Attached | ||
12:10 10mDemonstration | Humanoid: A Deep Learning-based Approach to Automated Black-box Android App Testing Demonstrations Yuanchun Li Peking University, Ziyue Yang Peking University, Yao Guo Peking University, Xiangqun Chen Peking University |