Connected and Automated Vehicles
Guidelines for the Evaluation and Reporting of Automated Vehicle Trials
- Publication no: AP-G102-23
- ISBN: 978-1-922994-05-9
- Published: 27 July 2023
- Edition: 1.0
- PDF (free) Download
These guidelines set out the key stages associated with evaluation and reporting of automated vehicle trials including:
- Scoping and planning: understanding the objectives and purpose of the trial and the associated evaluation, along with developing a plan to reach the evaluation objectives.
- Conducting: undertaking the plan, with necessary adjustments, to gather and analyse findings.
- Reporting and dissemination: reporting on the key findings from the evaluation and disseminating the report broadly.
The guidelines focus specifically on the evaluation and reporting of trials and not the undertaking of the trials themselves. The Guidelines for Trials of Automated Vehicles in Australia 20203 issued by the National Transport Commission and Austroads, and individual state and territory guidelines provide guidance on undertaking a trial.
- Summary
- Achieving consistency
- Improving quality and maximising value
- Key stages of evaluation and reporting
- 1. Introduction
- 1.1 Purpose
- 1.1.1 Why Develop Guidelines for Evaluation and Reporting?
- 1.2 Scope
- 1.3 Structure
- 1.1 Purpose
- 2. Context
- 2.1 Balancing Competing Needs
- 2.2 Need
- 2.3 Minimum Level of Evaluation and Reporting
- 2.4 NTC and Austroads Guidelines for Trials of AVs
- 2.5 How Reporting Associated with the Guidelines Fits in with Other Reporting
- 2.6 AV and Other Advanced Vehicle Technologies
- 2.7 Version Control of the Guidelines (Dated Versions)
- 2.8 Austroads’ Role
- 2.9 Users of the Guidelines
- 2.10 Are the Guidelines Mandatory?
- 2.11 Supporting Material
- 2.12 Dealing with Commercially Sensitive Data and Information, Intellectual Property and Private Information
- 3. Guidelines
- 3.1 Evaluation and Reporting Stages
- 3.2 Application of the Guidelines
- 3.3 Scoping and Planning
- 3.3.1 Define the Learnings and Outcomes Desired from the Trial
- 3.3.2 Develop Clear and Agreed Trial Objectives
- Alignment with desired government outcomes
- Applicable evaluation and reporting for the trial stages and life cycle
- 3.3.3 Determine the KPIs to Measure and Evaluate the Trial
- 3.3.4 Assess Required Data and Plan Data Collection Method
- 3.3.5 Development of a Knowledge Sharing Plan
- 3.3.6 Prioritising and Planning for the Evaluation and Reporting
- 3.3.7 Obtaining Agreement on the Evaluation and Reporting Undertaken
- 3.4 Conducting
- 3.4.1 Collect the Data
- 3.4.2 Collect Lessons Learned
- 3.4.3 Analyse the Data Against the KPIs
- 3.5 Reporting and Dissemination
- 3.5.1 Metadata Categorisation
- 3.5.2 Prepare Report: Suggested Structure
- 3.5.3 Approve Report
- 3.5.4 Disseminate Report
- References
- Appendix A Example KPIs
- Appendix B Example Report Template
- B.1 Cover Page: Trial Identifiers
- B.1.1 Trial Name
- B.1.2 Leading Organisation or Coordinator
- B.1.3 Contact Details
- B.1.4 Jurisdiction
- B.1.5 Trial Categorisation
- B.2 Section 1: Trial Objectives and Purpose
- B.2.1 Trial Objective
- B.2.2 Trial Purpose
- B.3 Section 2: Trial Details
- B.3.1 Timing and Duration
- B.3.2 Budget (optional)
- B.3.3 Links to Website (optional)
- B.3.4 Description of the Trialled Technology
- B.3.5 Maturity of the Technology being Trialled
- B.3.6 Future Evolutions
- B.3.7 Operational Design Domain
- B.3.8 Location
- B.3.9 Operational Conditions and Environment
- B.3.10 Uniqueness of the Trial
- B.3.11 Trial Stakeholders (optional)
- B.3.12 Capabilities/Item Tested but Unable to be Resolved (optional)
- B.4 Section 3: KPIs and Results
- B.4.1 KPIs
- B.4.2 Key Results
- B.5 Section 4: Discussion of Findings
- B.6 Section 5: Opportunities
- B.1 Cover Page: Trial Identifiers
Related publications
WEB-R753-26
AP-R753-26
Latest Connected and Automated Vehicles News