The IEEE International Contest on Software Testing

The 2024 Spring IEEE International Contest on Software Testing


Software plays an integral part in our everyday lives because of its near-ubiquitous influence in our increasingly technological society. It has significant impacts on the improvement of efficiency, reliability, security, and safety of many service-oriented and mission-critical systems.

These goals, however, cannot be well accomplished if the software is not properly tested. Many lessons aim to provide students with the fundamental knowledge and techniques of software testing. However, they often ignore industry practices and can hardly offer real-world testing experience to students. To address this problem and to promote advanced software testing theory, techniques, and tools, the Technical Committee on System and Software Assurance of IEEE Reliability Society, the Dallas Chapter of IEEE Reliability Society, in collaboration with the Computer Science Department at the University of Texas at Dallas, as well as other sponsors such as Mooctest Inc. have organized multiple IEEE International Contests on Software Testing at different venues in recent years.

The upcoming contest will be held on March 30 (Saturday) in hybrid mode, both in-person in ECSS 2.102 (TI auditorium) at the UT Dallas campus and online.

This contest aims to bring real-world testing and tool-using experience to the participants and provide them with excellent opportunities to overcome industry testing challenges with their learned testing techniques.

News & Announcements

  • 2024-02-01
    Tutorial and practice test available online
  • 2024-02-01
    Registration open

Articles posted on Computer Sciecne website at UTD

  • UT Dallas CS and IEEE Reliability Society Organize IEEE Software Testing Contest [local] [CS site]
  • UT Dallas CS Hosts 2023 Spring IEEE International Contest on Software Testing [local] [CS site]
  • UT Dallas CS and IEEE Reliability Society Host The 2nd Annual Contest on Software Testing [local] [CS site]
  • UT DALLAS CS HOSTS SUCCESSFUL 2022 IEEE INTERNATIONAL CONTEST ON SOFTWARE TESTING [local] [CS site]

Articles posted on the IEEE Reliability Society website

  • 2023 Spring International Contest on Software Testing (Vol. 69, No. 1, March 2023) [local] [RS site]
  • 2022 Spring International Contest on Software Testing (Vol. 68, No. 2, June 2022) [local] [RS site]
  • 2021 International Contest on Software Testing (Vol. 67, No. 1, June 2021) [local] [RS site]
  • 2020 Software Testing Contest at UT Dallas (Vol. 66, No. 1, June 2020) [local] [RS site]
  • Software Testing Contest at QRS 2019 (Vol. 65, No. 3, October 2019) [local] [RS site]
  • Software Testing Contest in Brazil (Vol. 65, No. 3, October 2019) [local] [RS site]
  • Software Testing Contest at the University of Texas at Dallas (Vol. 65, No. 1, March 2019) [local] [RS site]
  • The 2018 Chinese National Student Contest on Software Testing at Nanjing University (Vol. 64, No. 3, November 2018) [local] [RS site]
  • Software Testing Contest in Brazil (Vol. 64, No. 3, November 2018) [local] [RS site]
  • A Very Successful Software Testing Contest at the University of Texas at Dallas(Vol. 64, No. 1, February 2018) [local] [RS site]
  • Software Testing Contest in Nanjing, China (Vol. 63, No. 3, November 2017) [local] [RS site]
  • Software Testing Contest at UT-Dallas (Vol. 63, No. 2, May 2017) [local] [RS site]

Tutorial & Practice


All the contestants should watch the video and complete a practice test at http://www.mooctest.net/ to get familiar with the Mooctest platform before participating in the contest.

☞ Click here to watch the tutorial on Youtube.

Registration


Although the contest is free of charge, all the contestants are required to complete their registrations at the contest registration site by March 29.

Certificates and Cash Prizes


Each contestant will receive a certificate for attending this contest.

Winners will also receive cash prizes as stated below.

Rank Name + Prize
1st Place Logan Dane ($300 USD Prize)
2nd Place Fnu Khaja Airaj Uddin Najaf ($200 USD Prize)
3rd Place Venkata Satya Vyshnavi Ryali ($100 USD Prize)
4th Place Nikhilesh Gorrepati ($100 USD Prize)
5th Place Yashvi Chandreshkumar Modi ($100 USD Prize)
6th Place Matthew Allen Haskell ($75 USD Prize)
7th Place Sumanth Chalavadi ($75 USD Prize)
8th Place Nishchal Devkota ($75 USD Prize)
9th Place Nithin Sai Muthuluri ($50 USD Prize)
10th Place Bhargav Kirtikumar Patel ($50 USD Prize)
11th Place Dharmila Chowdary Andra ($50 USD Prize)

Contest Guidelines


  • All contestants must use their computers with the required software installed (see Running Environment). The contest has two parts:
    • The first part is a JUnit tutorial and practice test. It will be available from February 1 to March 29. Each contestant can complete this part by himself/herself. The objective is to help contestants understand the contest format and the basics of the JUnit testing framework. Each contestant needs to have basic knowledge of Java programming.
    • The second part is the contest on March 30, 2024, between 9:30 am - 12:30 pm, CDT. The contest is individual-based. Each contestant will design test cases with specific input values based on the given source code to test multiple Java programs. The quality of the generated test cases will be measured by the code coverage and mutation score achieved.

Running Environment


Win 10 or MacOS with Java 8 and Eclipse installed and Maven set up.
Here are the Java and Maven installation guides.
Eclipse with MoocTest Plugin: Windows 64 bit and Mac (Please download the correct version of Eclipse with the MoocTest plugin for your language and operating system).
Please also watch the tutorial video for more details.

For Mac OS, add mvn to /usr/local/bin/mvn or /usr/bin/env
and run the Eclipse Alia executable file to open the Eclipse.
In addition, you can download the MoocTest Eclipse Plugin and Eclipse separately and add/install the Plugin yourself.

Contest Venue


This contest will be held in ECSS 2.102 (TI auditorium) at the UT Dallas campus.
Online contestants will join via Zoom (Meeting ID: 895 5673 7619, Passcode: 185255).