Validation Testing

The Validation Testing Framework

Validation testing is done by running a test script that creates and configures transports, devices, profiles, profile implementations and application components, and then runs the configured tests.

Validation tests are implemented as test agents in the validation test framework that is part of the device kit. The device kit provides a wizard that lets you create the projects for a new validation test. To run a validation test, a test manager servlet lets you select and run a test script, and review the test results.

Since the primary goal is to test profile implementations and adapters for physical devices, the framework supports manually assisted testing. As part of the test a tester can be prompted to assert certain conditions or perform certain actions.

The major components of the Validation Testing Framework are the Test Agents, the Test Controller and the Test Manager. A Test Agent provides one or more testcases. The Test Controller manages the execution of tests provided by Test Agents. The Test Manager provides a user interface to select and execute a test script specifying configuration and test actions, and to view test progress and results.

Getting Started with Validation Testing

A validation test is realized by implementing a Test Agent with TestSuite and one or more TestCases. A test script must be implemented with actions for configuring a system and for running one or more test sequentially or in parallel. Tests can be configured for running as standard Java application, or as service, managed service, or managed service factory in an OSGi runtime environment. To assist with the creation of a new Test Agent the Device Kit provides a wizard to create the projects for a new Test Agent, with skeleton code for a TestSuite and a single TestCase. The following instructions explain how to create and run a new Test Agent.

Profile Validation Testing

For each Profile that is defined in the Device Kit a Profile Validation Test is provided that allows the implementation of the profile for a specific device to be tested for conformance to the profile. For the specific devices that are supported by the Device Kit sample launch configurations and test scripts are provided for executing the Profile Validation Tests that the device implements. The Profile Validation Testing documentation describes these tests in more detail.

Validation Testing Framework Prerequisites

As provided, the example launch configurations support running validation tests on Equinox or a standard JRE from the Eclipse workbench. The prerequisites for running the Validation Testing Framework on a target runtime are described separately.