TestResults.io
  • What is TestResults.io
  • System Architecture
  • Regulated Markets
    • Health Care Industry
    • Financial Services Industry
  • What's new?
    • Update Instruction
      • Update of the Designer extension in Visual Studio
      • Update the Execution Engine
      • Update the Base- and Environment Models
    • Migration to new project file
  • Designer
    • Overview
    • First Steps
    • Installation
    • TestResults.io solution
    • The development environment
      • Tool Window Overview
        • Test Environments
          • Steps to configure a SUT VM
          • How to access files on the system under test
        • Remote Viewer
          • Control Mode
          • Capture Mode
          • Screen Editor
          • Capture Single Image
        • Screen Explorer
        • Test Case Designer
        • Image Explorer
        • API Testing
        • TestResults.io options
          • Engines
          • Servers
    • Test Cases
      • Adding Test Cases
      • Test Case structure
      • Simple Test Case (Example)
      • Executing your Test Case
      • Generating Test Containers
      • Publishing Test Cases
      • Execution Variables
    • Software Models
      • Adding SW Models
      • Referencing the Model in the Test Case
      • Generating Test Containers
      • Publishing SW Models
      • Screens and Screen Elements
        • Tables
        • Visual Sense
        • Custom Screen Elements
    • Installers
      • Adding Installers
      • Generating Test Containers
      • Publishing Installers
    • Automation Framework Reference
      • Attributes
      • Enumerations
      • Filters
        • IImageFilter Interface
        • Select
        • Resize
      • GlobalEngineParameters
      • ImageDetectionParameters
      • ImageReference
      • Interfaces
        • ITester Interface
          • ITester Methods
          • ITester Properties
        • ITestee Interface
          • ITestee Methods
        • IConnections Interface
          • IConnections Methods
          • IConnections Properties
        • IDebug Interface
        • IEngineResult
        • IHelpers Interface
        • IImageHelper Interface
          • IImageHelper Methods
        • IKeyboard Interface
          • IKeyboard Methods
        • IMouse Interface
          • IMouse Methods
          • IMouse Properties
        • IReport Interface
          • IReport Methods
        • ISUTConnection Interface
      • OcrEngineParameters
        • Best practise
        • IronOcrEngineParameters
        • LEADOcrEngineParameters
        • OcrEngineRelatedCharacters
        • OcrPreprocessingParameters
      • ResultRectangle
      • SutNotReadyException
      • TestStepAbortedException
    • FAQ
      • Two-factor authentication (2FA) and One Time Passwords (OTP)
      • Receive and verify Emails
      • Using Excel as test data source
      • Verify PDF Content
  • Portal
    • Overview
    • First Steps
    • User's Guide
      • Login
      • Projects
      • Dashboard
      • Test Cases
      • Software & Environments
      • Test Sets
      • Job Queue
      • Management
      • Notifications Summary
    • Automation Engineer's Guide
      • Test Automation Workflow
      • Automating a test case
      • Enabling Software & Environments
    • REST API Reference
      • Authentication
      • Projects
      • Test Sets
      • Test Cases
      • Test Plans
      • Test Reports
      • Files
      • Software
      • Environments
      • Untitled
      • Executions
      • Favorites
      • Statistics
      • User Management
      • Customer Management
      • Notifications
      • Configurations
      • Invoicing
  • Models
    • Overview
    • Base Model
      • BaseScreen
        • BaseScreen Properties
        • BaseScreen Methods
      • OnScreenElement
        • OnScreenElement Methods
        • OnScreenElement Properties
      • Primitives
        • Button
          • Button Methods
          • Button Properties
        • Checkbox
          • Checkbox Methods
        • ContextMenu
          • ContextMenu Methods
          • ContextMenu Properties
        • Dropdown
          • Dropdown Methods
          • Dropdown Properties
        • DropdownMenu
          • DropdownMenu Methods
          • DropdownMenu Properties
        • GenericScroller
          • GenericScroller Methods
          • GenericScroller Properties
        • HorizontalScroller
        • IconButton
          • IconButton Properties
        • Label
        • LabelWithButton
          • LabelWithButton Properties
        • LabelWithCheckbox
          • LabelWithCheckbox Properties
        • LabelWithValue
          • LabelWithValue Methods
          • LabelWithValue Properties
        • PwTextBox
          • PwTextBox Methods
        • TextBox
          • TextBox Methods
          • TextBox Properties
        • Tables and lists
          • Column
            • Column Methods
            • Column Properties
          • ItemList
            • ItemList Methods
            • ItemList Properties
          • Row
            • Row Methods
            • Row Properties
          • TableBase
            • TableBase Methods
            • TableBase Properties
        • LabelWithElementBase
          • LabelWithElementBase Properties
      • Enumerations
      • Extensions
        • EngineResultExtensions Methods
        • EnumExtensions Methods
        • ReportExtensions Methods
        • StringExtensions Methods
        • TesterConnectionExtensions Methods
        • TesterDebugExtensions Methods
        • TesterHelperExtensions Methods
        • TesterMouseExtensions Methods
        • TesterOnScreenElementExtensions
        • TesterSelectExtensions Methods
      • Helper Classes
        • BaseModelHelpers
          • BaseModelHelpers Methods
          • BaseModelHelpers Properties
        • Attributes for Designer
        • ListHelpers
      • Exceptions
        • ElementNotFoundException
        • InteractionFailedException
        • ScreenNotFoundException
      • Interfaces
        • IAppBasics Interface
          • IAppBasics Methods
          • IAppBasics Properties
        • IBrowser
        • ICommandLineWindow
        • IScroller Interface
          • IScroller Methods
          • IScroller Properties
        • ISutLocale Interface
          • ISutLocale Methods
          • ISutLocale Properties
        • ISystemHelpers
        • ISystemInteractions
        • IWindow
    • Environment Model
      • Windows
        • Screens
          • CmdWindow
            • CmdWindow Methods
            • CmdWindow Properties
          • FileDialog
            • FileDialog Methods
            • FileDialog Properties
          • FileExplorer
            • FileExplorer Properties
          • RunWindow
            • RunWindow Methods
            • RunWindow Properties
          • Window
            • Window Methods
            • Window Properties
        • SutLocale
          • SutLocale Methods
          • SutLocale Properties
        • SystemHelpers
          • SystemHelpers Methods
          • SystemHelpers Properties
        • SystemInteractions
        • WebBrowser
          • Browser
            • Browser Methods
            • Browser Properties
          • BrowserScroller
            • BrowserScroller Methods
            • BrowserScroller Properties
          • AuthenticationDialog
            • AuthenticationDialog Methods
            • AuthenticationDialog Properties
          • DownloadDialog
            • DownloadDialog Methods
            • DownloadDialog Properties
        • EnvironmentModel Enumerations
        • Interfaces
          • IWebAppBasics
            • IWebAppBasics Property
Powered by GitBook
On this page
  • Software
  • Test Environments
  • Predefined
  • Custom

Was this helpful?

  1. Portal
  2. User's Guide

Software & Environments

Provides information on how to mange the Subject Under Test/Software and test environments repository.

PreviousTest CasesNextTest Sets

Last updated 6 years ago

Was this helpful?

TestResults.io provides you a place to store all your software versions as well as all test environments you want to test your software on.

Software

For you to be able to test a software version, the software needs to be made available to the TestResults.io platform. This is done by clicking on the "NEW SW VERSION" button, which opens the "Add a new Software Version" dialog.

The add Software Version allows you to specify an identifier, usually the version number, a name and if the Version is based on a previously uploaded software version. If it is not based on a previously uploaded software version, you can select "SW has major UI changes". This gives the TestResults.io platform the information that test plans written against previous versions cannot be executed against this version until an automation engineer look at them.

In addition you can select the installation type. Based on the selected type you might have additional setting fields available. The following types are available:

Type

Description

Additional Fields

Webpage

Your software is not an on-premise installation but is an online accessible services, e.g. Gmail, Outlook Web, etc.

URL: The url field allows you the defined the url that should be opened in the browser before the test case gets executed.

Requires Installation

Your software is on-premise and needs to be installed in the test environment.

Software Executable: Your installer, adb, etc. file

Installation Instruction: A free format file that describes how to install the software in the test environment.

Included in Test Environment

Your software is on-premise and pre-installed in the test environment.

n/a

After you have provided the required information you can register the new software version with a click on the "ADD SOFTWARE VERSION" button.

For every registered software version the software and environments screen gives you a Pass Rate. This rate gives you an overview of the amount of passed tests out of all executed tests against this sw version.

Test Environments

Your software needs a place to run in. These places are managed in the test environments. TestResults.io provides you two versions of environments: Predefined and Custom.

Predefined

As implied by the name, you can select a test environment like Windows (multiple Versions), Ubuntu, etc. from a growing list of pre-defined test environments.

You just need to select your target test environment in the name drop down and click on the "ADD TEST ENVIRONMENT" button to add this environment to the list of test environments available to you.

Custom

In addition, if the connection to your test environment requires a login, you need to provide the username in the login field and the corresponding password in the password field.

Besides these general settings you can choose between different hosting types. Based on the selected type you might have additional setting fields available.

Type

Description

Additional Fields

TestResults.io cloud

Your test environment will be hosted in an automatically generated virtual machine in the Microsoft Azure Cloud.

ResultProbe Connections

Your test environments are within your test labs and are connected to TestResults.io via a ResultsProbe.

n/a

3rd Party Device Clouds

Your test environments are provided by a 3rd party device cloud provider like SauceLabs, BitBar, etc.

Cloud Login: Defines the login used to connect to the hosting cloud Cloud Password: Defines the password used to connect to the hosting cloud Device Capabilities: Defines the Appium based capabilities required for this test environment

After you have provided the required information you can register the new software version with a click on the "ADD TEST ENVIRONMENT" button.

In case you test a software that comes with any of these predefined environments you can select a software version from the installed sw drop down. Please see the section to find out how to provide a software that can selected from the installed sw dropdown.

For any custom environment, you have to define the name. In case you test a software that comes with your environment you can select a software version from the installed sw drop down. Please see the section to find out how to provide a software that can selected from the installed sw dropdown.

Image File: A VHD file with Microsoft Azure.

software
software
compatible
Add a new Software Version dialog
Add predefined Test Environment dialog
Add custom Test Environment dialog