We are sometimes asked whether changes in Star readings actually reflect the changes that occur during service provision. We have three responses to this: the first two are based on the practices we have in place for the development of new Stars and for training and implementation of the Star. The third is to present the research evidence that the Star readings can be applied accurately and that readings correlate with other measures in the expected way.
- Star Development
- New versions of the Star are created alongside managers and practitioners to ensure the Journey of Change captures key changes occurring for those using services.
- Pilot data is statistically analysed to check that the scales are sensitive enough to detect change.
- Service users and practitioners provide end-of-pilot feedback about the extent to which the Star captures the changes made.
- Training and Implementation
- For the Star to accurately reflect change, practitioners should be well-trained with ongoing support to continue using it well. This is why training is mandatory, we provide free CPD for licensed trainers and encourage refresher training, regular supervision, and auditing.
- Research Evidence
- Convergent validity: Star readings have been shown to correlate with other validated measures in our own, as well as in external peer-reviewed research.
- Predictive validity: Star readings, and change in Star readings, predict hard outcomes such as securing accommodation, employment, and school absenteeism
- Inter-rater reliability: different practitioners are able to consistently assign Star readings
We are keen to conduct further analyses of the relationship between Star readings and other measures, so please get in touch if you have linked data and are interested in us exploring it.
To read our three page briefing providing a more detailed version of the above, please download it here (PDF).