Quickstrom: Property-based acceptance testing with LTL specificationsvirtual
Sat 18 Jun 2022 04:30 - 04:50 at Toucan - Testing & Synthesis
We present Quickstrom, a property-based testing system for acceptance testing of interactive applications. Using Quickstrom, programmers can specify the behaviour of web applications as properties in our testing-oriented dialect of Linear Temporal Logic (LTL) called QuickLTL, and then automatically test their application against the given specification with hundreds of automatically generated interactions. QuickLTL extends existing finite variants of LTL for the testing use-case, determining likely outcomes from partial traces whose minimum length is itself determined by the LTL formula. This temporal logic is embedded in our specification language, Specstrom, which is designed to be approachable to web programmers, expressive for writing specifications, and easy to analyse. Because Quickstrom tests only user-facing behaviour, it is agnostic to the implementation language of the system under test. We therefore formally specify and test many implementations of the popular TodoMVC benchmark, used for evaluation and comparison across various web frontend frameworks and languages. Our tests uncovered bugs in over one third of the available implementations.
Fri 17 JunDisplayed time zone: Pacific Time (US & Canada) change
15:30 - 16:50 | |||
15:30 20mTalk | Interpreter-guided Differential JIT Compiler Unit Testingvirtual PLDI Guillermo Polito Univ. Lille, CNRS, Inria, Centrale Lille, UMR 9189 CRIStAL, Pharo Consortium, Stéphane Ducasse Inria, Pablo Tesone Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189 CRIStAL, Pharo Consortium DOI | ||
15:50 20mTalk | Landmarks and Regions: A Robust Approach to Data Extractionvirtual PLDI Suresh Parthasarathy Microsoft Research, Lincy Pattanaik Microsoft Research, Anirudh Khatry Microsoft Research, Arun Iyer Microsoft Research, Arjun Radhakrishna Microsoft, Sriram Rajamani Microsoft Research, Mohammad Raza Microsoft DOI | ||
16:10 20mTalk | Odin: On-Demand Instrumentation with On-the-Fly Recompilationvirtual PLDI Mingzhe Wang Tsinghua University, Jie Liang Tsinghua University, Chijin Zhou Tsinghua University, Zhiyong Wu Tsinghua University, Xinyi Xu Tsinghua University, Yu Jiang Tsinghua University DOI | ||
16:30 20mTalk | Quickstrom: Property-based acceptance testing with LTL specificationsvirtual PLDI DOI |
Sat 18 JunDisplayed time zone: Pacific Time (US & Canada) change
03:30 - 04:50 | |||
03:30 20mTalk | Interpreter-guided Differential JIT Compiler Unit Testingvirtual PLDI Guillermo Polito Univ. Lille, CNRS, Inria, Centrale Lille, UMR 9189 CRIStAL, Pharo Consortium, Stéphane Ducasse Inria, Pablo Tesone Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189 CRIStAL, Pharo Consortium DOI | ||
03:50 20mTalk | Landmarks and Regions: A Robust Approach to Data Extractionvirtual PLDI Suresh Parthasarathy Microsoft Research, Lincy Pattanaik Microsoft Research, Anirudh Khatry Microsoft Research, Arun Iyer Microsoft Research, Arjun Radhakrishna Microsoft, Sriram Rajamani Microsoft Research, Mohammad Raza Microsoft DOI | ||
04:10 20mTalk | Odin: On-Demand Instrumentation with On-the-Fly Recompilationvirtual PLDI Mingzhe Wang Tsinghua University, Jie Liang Tsinghua University, Chijin Zhou Tsinghua University, Zhiyong Wu Tsinghua University, Xinyi Xu Tsinghua University, Yu Jiang Tsinghua University DOI | ||
04:30 20mTalk | Quickstrom: Property-based acceptance testing with LTL specificationsvirtual PLDI DOI |