TestResults.io
  • What is TestResults.io
  • System Architecture
  • Regulated Markets
    • Health Care Industry
    • Financial Services Industry
  • What's new?
    • Update Instruction
      • Update of the Designer extension in Visual Studio
      • Update the Execution Engine
      • Update the Base- and Environment Models
    • Migration to new project file
  • Designer
    • Overview
    • First Steps
    • Installation
    • TestResults.io solution
    • The development environment
      • Tool Window Overview
        • Test Environments
          • Steps to configure a SUT VM
          • How to access files on the system under test
        • Remote Viewer
          • Control Mode
          • Capture Mode
          • Screen Editor
          • Capture Single Image
        • Screen Explorer
        • Test Case Designer
        • Image Explorer
        • API Testing
        • TestResults.io options
          • Engines
          • Servers
    • Test Cases
      • Adding Test Cases
      • Test Case structure
      • Simple Test Case (Example)
      • Executing your Test Case
      • Generating Test Containers
      • Publishing Test Cases
      • Execution Variables
    • Software Models
      • Adding SW Models
      • Referencing the Model in the Test Case
      • Generating Test Containers
      • Publishing SW Models
      • Screens and Screen Elements
        • Tables
        • Visual Sense
        • Custom Screen Elements
    • Installers
      • Adding Installers
      • Generating Test Containers
      • Publishing Installers
    • Automation Framework Reference
      • Attributes
      • Enumerations
      • Filters
        • IImageFilter Interface
        • Select
        • Resize
      • GlobalEngineParameters
      • ImageDetectionParameters
      • ImageReference
      • Interfaces
        • ITester Interface
          • ITester Methods
          • ITester Properties
        • ITestee Interface
          • ITestee Methods
        • IConnections Interface
          • IConnections Methods
          • IConnections Properties
        • IDebug Interface
        • IEngineResult
        • IHelpers Interface
        • IImageHelper Interface
          • IImageHelper Methods
        • IKeyboard Interface
          • IKeyboard Methods
        • IMouse Interface
          • IMouse Methods
          • IMouse Properties
        • IReport Interface
          • IReport Methods
        • ISUTConnection Interface
      • OcrEngineParameters
        • Best practise
        • IronOcrEngineParameters
        • LEADOcrEngineParameters
        • OcrEngineRelatedCharacters
        • OcrPreprocessingParameters
      • ResultRectangle
      • SutNotReadyException
      • TestStepAbortedException
    • FAQ
      • Two-factor authentication (2FA) and One Time Passwords (OTP)
      • Receive and verify Emails
      • Using Excel as test data source
      • Verify PDF Content
  • Portal
    • Overview
    • First Steps
    • User's Guide
      • Login
      • Projects
      • Dashboard
      • Test Cases
      • Software & Environments
      • Test Sets
      • Job Queue
      • Management
      • Notifications Summary
    • Automation Engineer's Guide
      • Test Automation Workflow
      • Automating a test case
      • Enabling Software & Environments
    • REST API Reference
      • Authentication
      • Projects
      • Test Sets
      • Test Cases
      • Test Plans
      • Test Reports
      • Files
      • Software
      • Environments
      • Untitled
      • Executions
      • Favorites
      • Statistics
      • User Management
      • Customer Management
      • Notifications
      • Configurations
      • Invoicing
  • Models
    • Overview
    • Base Model
      • BaseScreen
        • BaseScreen Properties
        • BaseScreen Methods
      • OnScreenElement
        • OnScreenElement Methods
        • OnScreenElement Properties
      • Primitives
        • Button
          • Button Methods
          • Button Properties
        • Checkbox
          • Checkbox Methods
        • ContextMenu
          • ContextMenu Methods
          • ContextMenu Properties
        • Dropdown
          • Dropdown Methods
          • Dropdown Properties
        • DropdownMenu
          • DropdownMenu Methods
          • DropdownMenu Properties
        • GenericScroller
          • GenericScroller Methods
          • GenericScroller Properties
        • HorizontalScroller
        • IconButton
          • IconButton Properties
        • Label
        • LabelWithButton
          • LabelWithButton Properties
        • LabelWithCheckbox
          • LabelWithCheckbox Properties
        • LabelWithValue
          • LabelWithValue Methods
          • LabelWithValue Properties
        • PwTextBox
          • PwTextBox Methods
        • TextBox
          • TextBox Methods
          • TextBox Properties
        • Tables and lists
          • Column
            • Column Methods
            • Column Properties
          • ItemList
            • ItemList Methods
            • ItemList Properties
          • Row
            • Row Methods
            • Row Properties
          • TableBase
            • TableBase Methods
            • TableBase Properties
        • LabelWithElementBase
          • LabelWithElementBase Properties
      • Enumerations
      • Extensions
        • EngineResultExtensions Methods
        • EnumExtensions Methods
        • ReportExtensions Methods
        • StringExtensions Methods
        • TesterConnectionExtensions Methods
        • TesterDebugExtensions Methods
        • TesterHelperExtensions Methods
        • TesterMouseExtensions Methods
        • TesterOnScreenElementExtensions
        • TesterSelectExtensions Methods
      • Helper Classes
        • BaseModelHelpers
          • BaseModelHelpers Methods
          • BaseModelHelpers Properties
        • Attributes for Designer
        • ListHelpers
      • Exceptions
        • ElementNotFoundException
        • InteractionFailedException
        • ScreenNotFoundException
      • Interfaces
        • IAppBasics Interface
          • IAppBasics Methods
          • IAppBasics Properties
        • IBrowser
        • ICommandLineWindow
        • IScroller Interface
          • IScroller Methods
          • IScroller Properties
        • ISutLocale Interface
          • ISutLocale Methods
          • ISutLocale Properties
        • ISystemHelpers
        • ISystemInteractions
        • IWindow
    • Environment Model
      • Windows
        • Screens
          • CmdWindow
            • CmdWindow Methods
            • CmdWindow Properties
          • FileDialog
            • FileDialog Methods
            • FileDialog Properties
          • FileExplorer
            • FileExplorer Properties
          • RunWindow
            • RunWindow Methods
            • RunWindow Properties
          • Window
            • Window Methods
            • Window Properties
        • SutLocale
          • SutLocale Methods
          • SutLocale Properties
        • SystemHelpers
          • SystemHelpers Methods
          • SystemHelpers Properties
        • SystemInteractions
        • WebBrowser
          • Browser
            • Browser Methods
            • Browser Properties
          • BrowserScroller
            • BrowserScroller Methods
            • BrowserScroller Properties
          • AuthenticationDialog
            • AuthenticationDialog Methods
            • AuthenticationDialog Properties
          • DownloadDialog
            • DownloadDialog Methods
            • DownloadDialog Properties
        • EnvironmentModel Enumerations
        • Interfaces
          • IWebAppBasics
            • IWebAppBasics Property
Powered by GitBook
On this page
  • Step 1 – Execution Environment (7 minutes)
  • Setup your Subject Under Test
  • Setup your Test Environment
  • Compare your result
  • Step 2 — Test Case (5 minutes)
  • Upload your Test Case
  • Compare your result
  • Step 3 – Test Set (3 minutes)
  • Create your Test Set
  • Compare your result
  • Conclusion

Was this helpful?

  1. Portal

First Steps

A short, 15 minutes guide to your first test case in TestResults.io

PreviousOverviewNextUser's Guide

Last updated 4 years ago

Was this helpful?

To understand the TestResults.io better, it is suggested that you use the Playground project and play around with the different entities in that specific place. Once you understand the dependencies you can easily delete the Playground project and start testing. This shouldn't take you longer than 15 minutes. The steps in this tutorial are also available as a guided tour which can be started in the portal from the help (?) menu with Start Tutorial.

To start with this tutorial, please select from your project list, you should see a screen similar to this

Starting from here, we will follow three simple steps to create our execution environments, create a test case and finally a test set to execute this test case.

Step 1 – Execution Environment (7 minutes)

An execution environment always consist of a Subject Under Test, your software, and a Test Environment, the system your software should be tested on. In the simplest case your Subject Under Test is a web page which is tested on a pre-installed browser.

Setup your Subject Under Test

  • Enter the following details: Identifier: 1.0 Name: TestResults.io Installation Type: Webpage URL: https://demo.testresults.io

Setup your Test Environment

  • Select Windows 10 - Firefox in the Name drop down. Leave the Installed SW drop down at No preinstalled Software Version

Compare your result

If everything worked out for you, your screen should look like this

Step 2 — Test Case (5 minutes)

A test case always links directly to exactly one test plan. A test plan can have multiple revision.

As we need a test plan document for this step, please download the prepared test plan before you continue and memorize the place you stored it.

Upload your Test Case

  • Enter the following details Identifier: TRIO-TC-1.0 Name: Test TestResults.io login Description: This test case will test that the login to TestResults.io's demo web page works

Compare your result

If everything worked out for you, your screen should look like this

Step 3 – Test Set (3 minutes)

To execute a test case it needs to be included in at least one test set.

Create your Test Set

Compare your result

If everything worked out for you, your screen should look like this

Conclusion

In the last 15 minutes you have create a dedicated test environment, uploaded a test case plan and added it to a test set for the first time. Congratulations, good job!

To make this more interesting, TestResults.io includes a special mode. If you followed the instruction step-by-step, you should now be able to execute the uploaded test case and see the results as if it would be executed as a real test. As an unguided exercise: Open your test set (hint: click on "First"), select test environment and your software version and press execute. Sit back, relax and see the results, as they come in.

Click on in the top navigation menu, this brings you to the "Software and Environments" screen

Click on , this opens the "Add a new Software Version to be tested" dialog

Click on to register this software version

Click on to open the "Add predfined Test Environment" dialog

Click on to register this test environment

Click on in the top navigation menu, this brings you to the "Test Cases" screen

Click on , this opens the "New Test Case" dialog

Click on to register the new test case

On the automatically opened "Test Case Details" screen you can click the upload icon () for the "Test Case Plan Document". Select the Example Test Plan you have downloaded at the beginning of this step.

Click on to indicate that you started working on the automation for this test case.

Click on on the "Test Case Details" screen, this opens the "Include in Test Sets" dialog.

Click on , this will allow you to enter the name of a new test set. Use the following information: Name: First

Click on the button to add the new test set

Click on to add the current test case to the new test set

If you want to have the full walk-through you should continue with the part where you actually learn how to automate a test case with the designer. Click to continue.

here
Test Automation Workflow
289B
test-plan-example.txt
Example Test Plan (text-only)