Automated Validation

Basic validation concept is to check whether the device / firmware / software is working according to requirements. For any environment that evolves, that is constantly upgraded and expanded it is reasonable to check all provided features after any hardware or code changes.

Assuming that the subject of a validation has a lot of features, the process may be long-lasting and doing it manually may be unreasonable. To spare a significant amount of time and make an effort productive it is a good idea to automate the whole process.

Our hardware and RobotFramework infrastructure is capable to support many of recently used boards to confirm their features. If You consider constant changes of revision of the subject it is suggested to take a regression test suite. With regression testing, we can confirm, that a recent version of the hardware and/or embedded firmware has not adversely affected existing features.

Regression testing
is required whenever:

  • hardware schematics have been changed
  • embedded firmware code has been modified
  • new features have been implemented
  • there is a change in the embedded firmware framework version (for example coreboot version)
  • there is a change in the specification that embedded firmware relies upon on (for example UEFI, ACPI, SMBIOS)

Key features

  • Fully automated, fast and accurate validation
  • Rigorous dependency analysis (requirements vs. test-cases)
  • Full (over 100 tests) or partial (on clients demand) testing package
  • RobotFramework.org infrastructure
  • Detailed HTML logs and spreadsheet reports attached
  • Bug management support
  • Time comparison summaries*
  • Optional CI integration
  • Affordable pricing

*available only with time-based regression service

Service options

Client is obligated to choose the type of regression testing:

Full
Custom

and the period of time for validation:

One-time
Time-based

receiving a customized validation package.

QA technologies

Technologies that are supported by Regression Testing Solutions can be part of the validation package requested by the client:

  • Installation validation
    • Linux based systems (Debian, Ubuntu, Voyage)
    • BSD based systems (pfSense, OPNsense)
  • OS performance validation
  • Embedded Firmware validation (coreboot, UEFI/edk2, U-Boot, Zephyr, mbedOS, BIOS, bare metal)
  • Hypervisors validation (Bareflank, Xen, Intel ACRN)
  • Preboot Execution Environment (PXE) over network validation
  • Hardware compatibility testing (storages, modems, security modules)

Bug management

All malfunctions and bugs are precisely described and linked in the service selected by the client. We are experienced in:

  • GitLab
  • GitHub
  • Atlassian/JIRA Software

Although, any new tracking tool is welcome and will surely become familiar in no time.

NOTE: If there will be a request for the help with bugs elimination (mainly in the embedded firmware area) we can also provide such support.

Contact Us

Feel free to ask if you have any questions.

Back to Top