The IEEE International Contest on Software Testing

The 2024 Spring IEEE International Contest on Software Testing


Software plays an integral part in our everyday lives because of its near-ubiquitous influence in our increasingly technological society. It has significant impacts on the improvement of efficiency, reliability, security, and safety of many service-oriented and mission-critical systems.

These goals, however, cannot be well accomplished if the software is not properly tested. Many lessons aim to provide students with the fundamental knowledge and techniques of software testing. However, they often ignore industry practices and can hardly offer real-world testing experience to students. To address this problem and to promote advanced software testing theory, techniques, and tools, the Technical Committee on System and Software Assurance of IEEE Reliability Society, the Dallas Chapter of IEEE Reliability Society, in collaboration with the Computer Science Department at the University of Texas at Dallas, as well as other sponsors such as Mooctest Inc. have organized multiple IEEE International Contests on Software Testing at different venues in recent years.

The upcoming contest will be held on March 30 (Saturday) in hybrid mode, both in-person in ECSS 2.102 (TI auditorium) at the UT Dallas campus and online.

This contest aims to bring real-world testing and tool-using experience to the participants and provide them with excellent opportunities to overcome industry testing challenges with their learned testing techniques.

News & Announcements


2024-02-01
Tutorial and practice test available online
2024-02-01
Registration open

Tutorial & Practice


All the contestants should watch the video and complete a practice test at http://www.mooctest.net/ to get familiar with the Mooctest platform before participating in the contest.

☞ Click here to watch the tutorial on Youtube.

Registration


Although the contest is free of charge, all the contestants are required to complete their registrations at the contest registration site by March 29.

Certificates and Cash Prizes


Each contestant will receive a certificate for attending this contest.

Winners will also receive cash prizes, and more details will be announced.


Contest Guidelines


  • All contestants must use their computers with the required software installed (see Running Environment). The contest has two parts:
    • The first part is a JUnit tutorial and practice test. It will be available from February 1 to March 29. Each contestant can complete this part by himself/herself. The objective is to help contestants understand the contest format and the basics of the JUnit testing framework. Each contestant needs to have basic knowledge of Java programming.
    • The second part is the contest on March 30, 2024, between 9:30 am - 12:30 pm, CDT. The contest is individual-based. Each contestant will design test cases with specific input values based on the given source code to test multiple Java programs. The quality of the generated test cases will be measured by the code coverage and mutation score achieved.

Running Environment


Win 10 or MacOS with Java 8 and Eclipse installed and Maven set up.
Here are the Java and Maven installation guides.
Eclipse with MoocTest Plugin: Windows 64 bit and Mac (Please download the correct version of Eclipse with the MoocTest plugin for your language and operating system).
Please also watch the tutorial video for more details.

For Mac OS, add mvn to /usr/local/bin/mvn or /usr/bin/env
and run the Eclipse Alia executable file to open the Eclipse.
In addition, you can download the MoocTest Eclipse Plugin and Eclipse separately and add/install the Plugin yourself.

Contest Venue


This contest will be held in ECSS 2.102 (TI auditorium) at the UT Dallas campus.
Online contestants will join via Zoom (Meeting ID: 895 5673 7619, Passcode: 185255).