Link Search Menu Expand Document

Jacoco: Java Code Coverage

Jacoco (Java Code Coverage) is a tool for measing code coverage in Java.

Here are some additional articles:

How to read the test coverage reports

First, read about test coverage in general to understand line vs branch coverage: https://ucsb-cs156.github.io/topics/testing_coverage/

  • If any line of code is red, that means it is not tested at all—it is being missed by line coverage
  • If a line of code is yellow, it means there are multiple ways to execute the line.
    • it may have an if/else, or a boolean expression involving && or ||, and thus there are multiple paths through the code (multiple branches).
    • Yellow means it is being missed by branch coverage; some branches are covered, and others are not.
    • Think about the multiple paths through the code and be sure your tests cover all of them.

Getting Test Coverage Reports from GitHub Actions

When Jacoco fails on CI/CD, i.e. on GitHub Actions, it can be difficult to determine what went wrong from the logs. Instead, you can download what are called artifacts. Here’s how:

  • In this example, I added a bit of stupid code to one of the controllers, code that has no test coverage. (Note that this code serves no useful purpose other than to illustrate some code that isn’t covered by tests.) Here’s the code I added for which I added no tests:
          if (psId == 9999) {
            throw new Exception("test for code coverage");
          }
    
  • Let’s see what happened when I submitted this to CI/CD (i.e. did a pull request and GitHub Actions ran jacoco). Sure enough, it failed, as we can see from the red X in this screen shot image
  • We then go into the PR in more detail to see which part of the GitHub Actions failed, and we see that Jacoco was one of the parts that failed, as seen in this screen shot: image
  • Now what? The log is too long. But if we follow the steps shown in this animation, we can click “Summary”, then “Artifacts”. This downloads a zip file which, when uncompressed, contains the files for the Jacoco report. If we open index.html in a web browser, we can read the report and see exactly which lines are not covered by tests:

    download-artifacts