Automated Validation

Basic validation concept is to check whether the device / firmware / software is working according to requirements. For any environment that evolves, that is constantly upgraded and expanded it is reasonable to check all provided features after any hardware or code changes.

Assuming that the subject of a validation has a lot of features, the process may be long-lasting and doing it manually may be unreasonable. To spare a significant amount of time and make an effort productive it is a good idea to automate the whole process.

Our hardware and RobotFramework infrastructure is capable to support many of recently used boards to confirm their features. If You consider constant changes of revision of the confirm their features. If You consider constant changes of revision of the confirm their features. If You consider constant changes of revision of the subject it is suggested to take a regression test suite. With regression testing, we can confirm, that a recent version of the hardware and/or embedded firmware has not adversely affected existing features.

Regression testing is
required whenever:

hardware schematics have been changed
embedded firmware code has been modified
new features have been implemented
there is a change in the embedded firmware framework version (for example coreboot version)
there is a change in the specification that embedded firmware relies upon on (for example UEFI, ACPI, SMBIOS)

Key features

Fully automated, fast and accurate validation
Rigorous dependency analysis (requirements vs. test-cases)
Full (over 100 tests) or partial (on clients demand) testing package
RobotFramework.org infrastructure
Detailed HTML logs and spreadsheet reports attached
Bug management support
Time comparison summaries*
Optional CI integration
Affordable pricing

*available only with time-based regression service

Service options

Client is obligated to choose the type of regression testing:

Full

Custom

and the period of time for validation:

One-time

Time-based

receiving a customized validation package.

QA technologies

Technologies that are supported by Regression Testing Solutions can be part of the validation package requested by the client:

Installation validation
- Linux based systems (Debian, Ubuntu, Voyage)
- BSD based systems (pfSense, OPNsense)
OS performance validation
Embedded Firmware validation (coreboot, UEFI/edk2, U-Boot, Zephyr, mbedOS, BIOS, bare metal)
Hypervisors validation (Bareflank, Xen, Intel ACRN)
Preboot Execution Environment (PXE) over network validation
Hardware compatibility testing (storages, modems, security modules)