A.6. Verification and Conformance

82. Each profile should identify authoritative measures to determine verification and conformance with agreed quality assurance, Key Performance Indicators (KPIs), and Quality of Service standards such that actors are satisfied they achieve adequate performance. All performance requirements must be quantifiable and measurable; each requirement must include a performance (what), a metric (how measured), and a criterion (minimum acceptable value).

83. Stakeholders are invited to provide feedback to improve a profile's verification and conformance criteria.

84. Verification and Conformance is considered in terms of the following five aspects:

  1. Approach to Validating Service Interoperability Points

  2. Relevant Maturity Level Criteria

  3. Key Performance Indicators (KPIs)

  4. Experimentation

  5. Demonstration

A.6.1. Approach to Validating Service Interoperability Points

85. Each profile should describe the validation approach used to demonstrate the supporting service interoperability points. The intention of this section is to describe a high-level approach or methodology by which stakeholders may validate interoperability across the SIOP(s).

A.6.2. Relevant Maturity Level Criteria

86. Each profile should describe the Maturity criteria applicable to the profile. The intention of this section is to describe how this profile supports the achievement of improved interoperability.

A.6.3. Key Performance Indicators (KPIs)

87. Each profile should describe the associated Key Performance Indicators (KPIs) to establish a baseline set of critical core capability components required to achieve the enhanced interoperability supported by this profile. The intention of this section is to assist all stakeholders and authorities to focus on the most critical performance-related items throughout the capability development process.

Table A.3. Key Performance Indicators (KPIs)[1]
Key Performance Indicators (KPI) Description
KPI #1: Single (named) Architecture  
KPI #2: Shared Situational Awareness  
KPI #3: Enhanced C2  
KPI #4: Information Assurance  
KPI #5: Interoperability  
KPI #6: Quality of Service  
KPI #7: TBD  

[1] 'notional' KPIs shown in the table are for illustrative purposes only.


A.6.4. Experimentation

88. Each profile should document experimentation venues and schedules that will be used to determine conformance. The intention of this section is to describe how experimentation will be used to validate conformance.

A.6.5. Demonstration

89. Each profile should document demonstration venues and schedules that demonstrate conformance. The intention of this section is to describe how demonstration will be used to validate conformance.