The IEEE International Software Testing Contest at the 10th Brazilian Conference on Software: Theory and Practice (CBSOFT)

Over the past decades, we have built software to improve our efficiency, reliability, and safety in production, business, daily life, etc. These goals, however, cannot be accomplished if the software is not properly tested. Some universities provide classes to teach students the fundamental knowledge and techniques of software testing. These classes often ignore industry practices and can hardly offer real-world testing experiences to students. To address this, we partner with industry sponsors and host a software testing contest along with an appropriate tutorial. Through the contest and tutorial, we bring real-world testing and tool experience to the participants and provide excellent opportunities for them to practice their learned testing techniques to overcome industry testing challenges.

To promote advanced software testing theory, techniques, and tools, IEEE Reliability Society, in collaboration with the 10th Brazilian Conference on Software: Theory and Practice as well as other sponsors, will host an IEEE International Software Testing Contest at CBFSOFT on September 23 in Salvador, Bahia, Brazil.


  • All interested contestants must send an email to Mr. Linghuan Hu before September 22, 2019 (CDT).
  • The subject of the email should be “2019 CBSOFT Software Testing Contest -- Contestant”.
  • The content should include the first name, last name, and affiliation.

Register Now

Format & Evaluation

All applications have to be submitted before the end of September 22, 2019 (CDT). All contestants must bring their own laptops. The contest has two parts:

  • The first part is a 2-hour tutorial (10:00 - 12:00). During this tutorial, we will help contestants properly configure their laptops, and explain how to use platform. Each contestant is required to have basic knowledge about Java programming and JUnit.
  • The second part is the contest (14:00 - 17:00) where contestants are required to design test cases based on the given specifications to test some Java programs.

The ranking of all the contestants is based on the quality of test cases they generate, which is measured in terms of the branch coverage, and the mutation score achieved. If test cases from multiple contestants achieve the same coverage, contestants with fewer test cases have a higher ranking than those with more test cases.

Running Environment

All contestants must bring their own laptops with Chrome browser installed. We will help contestants configure their laptops during the Tutorial session.

Tutorial & Practice Guide

You can find a tutorial of JUnit and two sample subject programs for practice by following the instructions posted at:


The first place receives a cash prize of $300 USD, followed by the 2nd for $200 USD, and five 3rd places each for $100 USD. Every contestant will receive a certificate of completion from the IEEE Reliability Society and the CBSOFT conference.

Contest Venue

The IEEE Inernational Software Testing Contest at CBSOFT will be held at the Mercure Salvador Rio Vermelho Hotel, Salvador, Bahia, Brazil.

R. da Fonte do Boi, 215 - Rio Vermelho, Salvador - BA, 41940-360, Brazil
(GPS Coordinates: -13.015347,-38.48514)