Test + Evaluate
6S: Scenarios Database, Statistic Structured Space for Smart Sampling
Provider: VEDECOM, France
Contact: [email protected]
Description
VEDECOM has developed and validated across multiple use cases a scenario sampling tool for ADAS testing, designed to reduce the testing budget while providing statistically rigorous performance guarantees. The tool enables the inference of the true accident rate of the ADAS from a limited number of test scenarios, ensuring a controlled uncertainty level and relying on real-world driving data observations.
Key Features
- Structured critical scenario selection ensuring full behavioral coverage with controlled sample size.
- Reduces test volume, accelerates execution, and quantifies residual risk based on test outcomes.
- Statistical guarantee through absence of accidents on the critical sample, with improved precision over random sampling.
- Guides validation planning for ADAS.
How does this solution cover this SAF block?
- Efficiently covers the full behavioral space by selecting one critical scenario per zone, ensuring complete and representative coverage with minimal test effort.
- Provides statistical guarantees of safety through accident-free validation on critical samples, with precise quantification of residual risk.
- Accelerates validation by optimizing sample size, integrating concrete scenario data and statistically inferenced ones.
- Offers a rigorous operational framework for planning, executing, and justifying ADAS and autonomous system validation campaigns.
AVL SCENIUS™
Provider: AVL List GmbH, Austria
Contact: [email protected]
Description
The AVL SCENIUS™ is a comprehensive, end-to-end solution designed to meet the complex demands of ADAS/AD test management and safety validation. It supports the entire validation process — from managing requirements, defining and organizing tests to allocating them across diverse environments, coordinating execution, and enabling thorough result evaluation through a seamless, automated workflow.
Key Features
- Automated Testing: Significantly reduce manual effort, allowing for more efficient testing processes and quicker turnaround times through a smart variety of reliable testing approaches.
- Regulatory Compliance: Stay ahead of the curve with built-in compliance checks that ensure your system meets the latest safety standards and regulations.
- Enhanced Traceability: Track requirements, tests, and results across the entire development lifecycle, ensuring nothing falls through the cracks.
- Virtual Assessment: Leverage advanced features to conduct virtual assessments, proving safety and credibility in a controlled environment.
- Real-time Analytics: Gain insights that help you make informed decisions and quickly identify and address issues.
- Comprehensive Reporting: Generate detailed dashboards and reports on test results, helping you demonstrate system reliability and safety to stakeholders.
- Seamless Integration: Painless integration with various CI/CD – CI/CT pipelines and interfaces, reducing complexity and ensuring smooth workflows.
How does this solution cover this SAF block?
- Scenario Designer with full ASAM OpenX compatibility
- Scenario Data Manager
- Validation Project Manager
- Test Definition Manager
- Test Execution Manager
- Test Analyzer
- Reporting and Dashboarding
- Safety Assessment
- Requirement Manager
- ODD Manager
- Rich REST API to integrate in workflow and tools
Applus IDIADA Homologation CAV
Provider: Applus+ IDIADA, Spain
Contact: [email protected]
Description
Homologation of ADS and ADAS functions is becoming more demanding as its features are becoming more complex. The assessment of its safety is based in the NATM (New Assessment Tool Methodology) which is aligned with the SAF. With 15+ years of experience in vehicle type approval, IDIADA’s CAV Homologation department offers industry-leading consultancy and homologation services that bridge regulatory requirements with innovative technologies, supporting manufacturers globally.
Key Features
- Comprehensive ODD and OEDR analysis using proprietary methodologies
- Classification of nominal, critical and failure scenarios for virtual, track and real-world testing
- Rigorous evaluation of testing reports with traceability to regulatory requirements
- Expert audit of Safety concept and Safety Management Systems (SMS)
- Comprehensive and flexible framework for real-world testing
How does this solution cover this SAF block?
- Test evaluate and coverage: We derive testing scenarios from the ODD and OEDR analyses defined in the input phase. These scenarios are used to verify and evaluate the functional operation of the ADS executed in physical track testing and/or through simulation tool assessment.
- Safety case: From both consultancy or homologation services we can help to build a safety case or to assess the safety case of the manufacturer—verifying its safety concept in an audit procedure and from the evidence of previous blocks.
- Decide: The compliance with the requirements and pass/fail criteria established in UNECE and EC regulation will determine the final decision.
Neural Surrogate Models
Provider: University of Trento, Italy
Contact: [email protected]
Description
Service to construct neural surrogate models of system performance across a logical scenario with quantified confidence.
Key Features
- Synthetic models of systems tracking system evolution
- Ex-post quantification of KPIs for different risks in different regions of the logical scenario
- Identification of failure modes
- Fast, low computational burden permits the derivation of prudent speed recommendations against unexpected events during system operation
How does this solution cover this SAF block?
- It serves as a surrogate model for “Execute” and “Test Evaluate,” providing predictions with quantified confidence.
- Create efficient summary models that synthesize a system’s performance across a logical scenario with bounded confidence.
- Analyze the system ex-post, quantifying risks and failure modes for different types of events.
- Derive prudent speed functions to prevent those risks.
- Query on new concrete scenarios not initially used, returning answers with quantified confidence/uncertainty, reducing the need for repeated testing.
IDIADA Report Analysis Services
Provider: Applus+ IDIADA, Spain
Contact: [email protected], [email protected]
Description
Applus+ IDIADA provides comprehensive report analysis services for simulated & physical platforms, performance evaluation, and detailed technical assessment for automotive engineering projects.
Key Features
- Seamless analysis across simulation, performance, and experimental platforms
- Detailed documentation with rigorous engineering insights and data interpretation
- In-depth evaluation of vehicle systems, performance metrics, and engineering parameters using state-of-the-art diagnostic tools
How does this solution cover this SAF block?
- Analyzes results from both simulated and physical tests, ensuring consistency and completeness across environments.
- Applies use-case specific criteria and baseline comparisons to determine test pass/fail outcomes.
- Uses advanced diagnostics and performance metrics to evaluate system behavior against expected results.
- Enables scenario refinement based on detailed technical findings and coverage gaps.