Criteria used to determine a quality indicator
To assess the quality of indicators the Indicator Assurance Service asks for information and evidence to be submitted in the IAS application form. Questions include:
- why the indicator is needed
- the persons who will use or benefit from the use of the indicator
- the methodology to be used in constructing the indicator
- the data sources in relation to the methodology applied
- how the quality indicator is to be published
Once an application has been received it is then subject to rigorous examination against specific quality criteria and supporting considerations set out in the assurance process methodology.
The high level criteria used during the Indicator Assurance Process are:
- Clarity: Is it clear what the indicator will measure?
- Rationale: What are the reasons and evidence for measuring this?
- Data: Are the data in the measure fit (enough) to support the purpose?
- Construction: Will the methods used support the stated purpose? Is it clear what methods are used and how they have been tested and/or justified?
- Interpretation: Is the presentation of the indicator suitable and are all potential users able to interpret the values?
- Risks and Usefulness: Are any limitation, risks or perverse incentives associated with the indicator explicitly stated? Can the indicator be used for quality improvements?