Abstract
The present research addressed gaps in our current understanding of validity and quality of measurement provided by patient
reported experience measures. We established the psychometric properties of a freely available experience of service questionnaire
(ESQ), based on responses from 7,067 families of patients across 41 UK providers of child and adolescent mental health services,
using the two-level latent trait modeling. Responses to the ESQ were subject to strong ‘halo’ effects, which were thought
to represent the overall positive or negative affect towards one’s treatment. Two strongly related constructs measured by
the ESQ were interpreted as specific aspects of global satisfaction, namely satisfaction with care, and with environment.
The Care construct was sensitive to differences between less satisfied patients, facilitating individual and service-level
problem evaluation. The effects of nesting within service providers were strong, with parental reports being the most reliable
source of data for the between-provider comparisons. We provide a scoring protocol for converting the hand-scored ESQ to the
model-based population-referenced scores with supplied standard errors, which can be used for benchmarking services as well
as individual evaluations.
reported experience measures. We established the psychometric properties of a freely available experience of service questionnaire
(ESQ), based on responses from 7,067 families of patients across 41 UK providers of child and adolescent mental health services,
using the two-level latent trait modeling. Responses to the ESQ were subject to strong ‘halo’ effects, which were thought
to represent the overall positive or negative affect towards one’s treatment. Two strongly related constructs measured by
the ESQ were interpreted as specific aspects of global satisfaction, namely satisfaction with care, and with environment.
The Care construct was sensitive to differences between less satisfied patients, facilitating individual and service-level
problem evaluation. The effects of nesting within service providers were strong, with parental reports being the most reliable
source of data for the between-provider comparisons. We provide a scoring protocol for converting the hand-scored ESQ to the
model-based population-referenced scores with supplied standard errors, which can be used for benchmarking services as well
as individual evaluations.
- Content Type Journal Article
- Category Original Article
- Pages 1-13
- DOI 10.1007/s10488-012-0433-9
- Authors
- Anna Brown, Department of Psychiatry, University of Cambridge, Cambridge, UK
- Tamsin Ford, Peninsula Medical School, University of Exeter, Exeter, UK
- Jessica Deighton, CAMHS EBPU, University College London and the Anna Freud Centre, London, UK
- Miranda Wolpert, CAMHS EBPU, University College London and the Anna Freud Centre, London, UK
- Journal Administration and Policy in Mental Health and Mental Health Services Research
- Online ISSN 1573-3289
- Print ISSN 0894-587X