LePhan Publishing

V&V Test Architecture

The V&V Automation framework separates the desktop test application, test logic, communication protocol, embedded firmware, hardware interface, and reporting functions into distinct layers. This structure allows the framework to be adapted to different embedded products and verification requirements.

System Architecture

Verification begins in the PC application, where the operator selects and executes test cases. Test commands are sent to the embedded device, results are returned to the PC, and the automation software evaluates the results against predefined acceptance criteria.

WPF V&V Test Application

Temperature   |   Battery   |   Accelerometer   |   All V&V Tests

Operator Interface • Test Status • Results

Test Automation Layer

Test Cases • Test Criteria • Test Runners

PASS / FAIL Evaluation • Session Management

Communication Layer

Serial Service

Command / Response Protocol

Embedded Firmware

Command Handler • Test Runner

Test Cases • Test Results

Simulation

Firmware-generated test inputs can be used during software development before physical test hardware is available.

Hardware-in-the-Loop

The same automated test structure can be connected to physical sensors, control boards, and device hardware for HIL verification.

PC Test Application

The desktop application controls test execution and provides the primary operator interface. Each verification area uses the same general automation pattern.

Test Case Configuration

Test definitions include expected values, tolerances, test identifiers, names, and enabled or disabled state. Criteria can be maintained outside the application.

Test Runners

Dedicated test runners manage command transmission, response handling, timeout detection, result decoding, and test evaluation.

Single and Suite Execution

Individual test cases can be executed for development and troubleshooting, while complete suites can be run automatically for verification and regression testing.

All V&V Tests

A higher-level workflow executes multiple test suites sequentially and produces an overall session result.

PC-to-Embedded Communication

The PC application communicates with the embedded control board through a defined command-and-response interface. The protocol separates test execution from the user interface and allows the same automation approach to be reused with additional tests.

Serial Communication

A serial service manages communication between the desktop application and the embedded device.

Defined Packet Protocol

Test commands and results are transferred using structured packets containing command identifiers, payload data, and packet validation information.

Request / Confirmation Model

The PC sends a test request and the embedded firmware returns a corresponding confirmation containing the measured test result.

Error Handling

The automation layer can detect timeout conditions, invalid responses, and mismatched test responses before producing the final test result.

Embedded Firmware Test Support

The embedded firmware contains dedicated V&V support that receives test requests, executes the selected test condition, and returns measured or simulated results to the PC application.

Command Handler

Decodes incoming V&V commands and routes each request to the appropriate embedded test implementation.

Embedded Test Runner

Executes the requested test and prepares the associated result data for transmission back to the PC.

Simulation Mode

Known input conditions can be simulated in firmware, allowing the PC test framework and protocol to be tested before the final hardware setup is complete.

HIL Mode

Hardware-in-the-Loop operation allows automated tests to use physical sensors and actual device signals while retaining the same PC-side test workflow.

Automated Result Flow

Each test follows the same high-level sequence from execution through automated reporting.

Test Execution
Measured Result
Acceptance Criteria
PASS / FAIL
Session Result
Report Generation
Test Evidence
Engineering Review

Test Evidence and Reporting

Test execution results are stored by session and can be automatically exported into multiple formats for engineering review, traceability, and further analysis.

PDF

Human-readable verification report.

Excel

Structured results for review and analysis.

JSON

Machine-readable test and session data.

Logs

Communication and execution history for troubleshooting.

Reusable and Expandable

Temperature, Battery, and Accelerometer tests are used in the current demonstration, but they are examples of the test architecture rather than fixed limitations of the framework.

Additional sensors, device functions, communication interfaces, acceptance criteria, and reporting requirements can be added while maintaining the same overall automation structure.

Add New Test Suites

New verification areas can follow the existing test-case, test-runner, result, and reporting pattern.

Adapt to Different Products

Device-specific commands and hardware interfaces can be changed while retaining the overall PC automation framework.