First Steps

To understand the TestResults.io Test Automation Workflow better, it is suggested that you use the Playground project and play around with the different entities in that specific place. Once you understand the dependencies you can easily delete the Playground project and start testing. This shouldn't take you longer than 15 minutes. The steps in this tutorial are also available as a guided tour which can be started in the portal from the help (?) menu with Start Tutorial.

To start with this tutorial, please select from your project list, you should see a screen similar to this

Starting from here, we will follow three simple steps to create our execution environments, create a test case and finally a test set to execute this test case.

Step 1 – Execution Environment (7 minutes)

An execution environment always consist of a Subject Under Test, your software, and a Test Environment, the system your software should be tested on. In the simplest case your Subject Under Test is a web page which is tested on a pre-installed browser.

Setup your Subject Under Test

• Click on in the top navigation menu, this brings you to the "Software and Environments" screen

• Click on , this opens the "Add a new Software Version to be tested" dialog

• Enter the following details: Identifier: 1.0 Name: TestResults.io Installation Type: Webpage URL: https://demo.testresults.io

• Click on to register this software version

Setup your Test Environment

• Click on to open the "Add predfined Test Environment" dialog

• Select Windows 10 - Firefox in the Name drop down. Leave the Installed SW drop down at No preinstalled Software Version

• Click on to register this test environment

Compare your result

If everything worked out for you, your screen should look like this

Step 2 — Test Case (5 minutes)

A test case always links directly to exactly one test plan. A test plan can have multiple revision.

As we need a test plan document for this step, please download the prepared test plan before you continue and memorize the place you stored it.

Upload your Test Case

• Click on in the top navigation menu, this brings you to the "Test Cases" screen

• Click on , this opens the "New Test Case" dialog

• Enter the following details Identifier: TRIO-TC-1.0 Name: Test TestResults.io login Description: This test case will test that the login to TestResults.io's demo web page works

• Click on to register the new test case

• On the automatically opened "Test Case Details" screen you can click the upload icon () for the "Test Case Plan Document". Select the Example Test Plan you have downloaded at the beginning of this step.

• Click on to indicate that you started working on the automation for this test case.

Compare your result

If everything worked out for you, your screen should look like this

Step 3 – Test Set (3 minutes)

To execute a test case it needs to be included in at least one test set.

Create your Test Set

• Click on on the "Test Case Details" screen, this opens the "Include in Test Sets" dialog.

• Click on , this will allow you to enter the name of a new test set. Use the following information: Name: First

• Click on the button to add the new test set

• Click on to add the current test case to the new test set

Compare your result

If everything worked out for you, your screen should look like this

Conclusion

In the last 15 minutes you have create a dedicated test environment, uploaded a test case plan and added it to a test set for the first time. Congratulations, good job!

To make this more interesting, TestResults.io includes a special mode. If you followed the instruction step-by-step, you should now be able to execute the uploaded test case and see the results as if it would be executed as a real test. As an unguided exercise: Open your test set (hint: click on "First"), select test environment and your software version and press execute. Sit back, relax and see the results, as they come in.

If you want to have the full walk-through you should continue with the part where you actually learn how to automate a test case with the designer. Click here to continue.