16 Sep

TESTBEDS is a Workshop co-located with ASE 2014 - 29th IEEE/ACM International Conference on Automated Software Engineering (ASE 2014)

Sample image

We are combining our workshop this year with WISE . Please see the program below to see which papers/talks will be in the TESTBEDS session at WISE.

Workshop Overview & Goals

Computers and embedded devices are playing an increasingly important role for end-users, researchers, and businesses. Many classes of event-driven software (EDS) applications have become commonplace. Examples of EDS include graphical user interfaces (GUIs), web applications, mobile applications, network protocols, embedded software, web services and device drivers. An EDS system takes internal/external events (e.g., commands, messages) as input (e.g., from users, other applications), changes its state, and sometimes outputs an event sequence. An EDS program is typically implemented as a collection of event handlers designed to respond to individual events. The emerging popularity of EDS means that ensuring quality through testing is becoming increasingly important for EDS; its correctness may affect the quality of the entire system in which the EDS operates. One way to test an EDS is to execute each event individually and observe its outcome, thereby testing each event handler in isolation. However, the execution outcome of an event handler may depend on its internal state, the state of other entities (objects, event handlers) and/or the external environment. Its execution may lead to a change in its own state or that of other entities. Moreover, the outcome of an event's execution may vary based on the sequence of preceding events seen thus far. Consequently, in EDS testing each event needs to be tested in different states and this makes testing difficult. EDS testing usually involves generating and executing sequences of events, and checking the correctness of the EDS after each event. Test coverage may not only be evaluated in terms of code, but also in terms of model coverage and event-space coverage of the EDS. Regression testing not only requires test selection, but also repairing obsolete test cases. And new paradigms, such as those found in mobile device message passing are emerging. The complexity of testing such systems also makes benchmarking and comparing with other researchers difficult. This workshop aims to bring together researchers from both Academia and Industry with the aim of sharing ideas and presenting research on the state-of-the art in automated testing and benchmarking techniques for event driven systems.

Workshop Program

We will be combining with the WISE workshop: ( see http://www.idt.mdh.se/WISE2014). The TESTBEDS session will be in the afternoon.

The papers/presentations schedule will be:

Important Dates

Workshop papers submission July 7th, 2014 , 23:59 (anywhere in world)

Workshop papers notification July 25, 2014

Workshop papers camera-ready July 30, 2014


We solicit papers novel papers related to testing (functional, non-functional, security) for EDS, or on the topic of benchmarking. Papers should be of one of the following types:

Each paper in the first three categories (full, position and demo) will be reviewed by at least three referees. Papers should be submitted as PDF files in standard ACM two-column conference format (Latex, Word). Industrial presentations are submitted in the form of a 2-page overview and 2 sample presentation slides as pdf files. They will be evaluated by at least two members of the Program Committee for relevance and soundness. Papers accepted for the workshop will appear in the ACM digital library, providing a lasting archived record of the workshop proceedings. Papers will be submitted through EasyChair . Submissions are open.


Ana C. R. Paiva, Faculty of Engineering of the University of Porto, Portugal
Myra B. Cohen, University of Nebraska - Lincoln, USA

Program Committee