Release Validation Testing In Fedora QA

What is Release validation Testing

The release validation testing is a process which takes place before the official Fedora release.Before the Final (GA) release , we have Alpha and Beta pre-releases and at each of these milestones , nightly(s) and composes are released which are tested to ensure that the release meets a few criteria. Release Validation test is one way you can help Fedora get better and this post will talk about how you can start off from scratch.

Setting up your system for testing: You can start off by grabbing the image of the Fedora compose you want to test from here (in my case , I will demo with Fedora-KDE-Live-x86_64-24-20160424.n.0 ) Once downloaded you need to create a VM or you can also test it as primary OS of your system by since there bugs , it advised to start off with a VM. Default configuration of 20GB hard drive and 1024MB memory should be enough to execute the test cases.

For reporting back the results into the test matrix

You can choose to do it in two ways, either you can go ahead and edit the wiki directly or you can execute the following :

  1. dnf install python-wikitcms   
  2. dnf install relval   
Finding the testcases and posting results

Now that you are all set, let's find a test case and let me walk you through the process. The test cases can be found here ( note that I'm writing this for Fedora 24, hence I am using the F24 test cases) . I will take up a basic test case of "installation" category, run it and post my results.

results

To run the testcase , we can go ahead with relval size-check --username (FAS username) . After execution will be as follows and results will automatically be posted in the result matrix.

results

Results of my test can be found in the wiki page matrix.

results

That's how we can go ahead and perform Release Validation Tests.