5 Tips for using Star Data in your Reports and Evaluations

April is here and you may be thinking about putting together project evaluations or preparing your Trustee Annual Report and considering how you demonstrate the impact of your services.

Now is an ideal time to think about using your Outcomes Stars data. Even if you haven’t been using Outcomes Stars for long and don’t have lots of review Stars, read on… you can still use Star data to evidence the need for your service.

In this article we have gathered some tips and ideas to help you use Star data in your annual reports.

Use Star Charts to bring case studies alive

You probably have lots of stories of amazing personal change achieved by people you support, and already include individual case studies in your annual reporting. You can illustrate this by adding a Star Chart showing someone’s first and last/latest Star readings.

This is a great way to show the changes that have been made. Along with the narrative in your case study, a Star Chart will help you tell the story of how the support provided facilitated progress on the Journey of Change in relevant outcome areas.

TOP TIP

If you don’t use Star Online why not use a photo of your hand-plotted Star Chart image?​

Paula's Star
A Star Chart showing someone’s first and last/latest Star readings

Taking a snapshot view

Snapshot reports look at Outcomes Stars completed across a cohort of people at a particular point in their support. A great way of using a Snapshot report is to look at everyones’ first Stars to see how the readings are distributed across the Journey of Change in each outcome area (by working out the percentage of people with readings at each Stage, in each outcome area). This will give you a profile of the needs people have when they first start support.

TOP TIP

Use this information to illustrate why you deliver the kind of interventions that you do – this can show that your service is evidence led and is focusing resources where they are needed most.

A snapshot report

Example of how an organisation may use a Snapshot (SS) report:

We use the Wellbeing Star™ to help us identify people’s needs when they start the three-month social prescribing programme. Over 60% of our programme participants are either not yet thinking about or finding out about how they could improve their lifestyle, so our programme focuses on one to one and small group work to help people open up about their lifestyle and consider the impact this might have on their existing health conditions.

Illustrating the distance travelled

Outcomes Stars are designed to show the progress made by the people you support, and it is really satisfying to be able to collate Star readings to show this progress across a service or organisation. If enough people have completed two or more Stars, readings can be collated for a service or organisation to capture distance travelled and demonstrate the percentage of people that have moved forward, maintained or dropped back over the course of a year.

How much progress are people making in each outcome area?
A distance travelled (DT) report

In your report narrative, you might want discuss progress made across all outcome areas around the Star or you might prefer to focus your narrative on a few areas that your service targets through your interventions, by selecting a few headline figures from the data in the report.

Example of adding narrative to a Distance Travelled (DT) report:

As evidenced by our use of the Well-being Star™, which we complete with participants on our social prescribing programme, 80% of participants made positive change in the area Money, following our successful collaboration with our local CAB debt and benefits service – this is a big improvement from the previous year, where Money was the area in which we saw significant need (people were at the lowest two stages of the Journey of Change scale) and we saw the least positive change.

TOP TIP

Explain what your distance-travelled data is showing you, the learnings that have been taken from this and include plans for service delivery going forward based on the findings.

Don’t be afraid to report on people dropping back, maintaining or acknowledging change that isn’t as strong as you would like. Some areas do take longer to make positive change or depend on resources that aren’t available or are out of the control of your service. Reporting on this will show to stakeholders that you understand the data you are getting from Outcomes Stars and that you use it to reflect on your provision and the wider context you work in.

For example:

Although we continue to see less positive change in the outcome area Where you live on the Wellbeing Star™, this is an area where it is often difficult to achieve results within the 3-month programme e.g. referrals to the Council’s aids and adaptation team for an assessment typically take about 10 weeks.

TOP TIP

When using Outcomes Stars to evidence your impact, use the correct title of the Star you use and use the ™ to show you are using a recognised evidence-based Outcomes measurement tool.

Further support

Triangle is here to support you to make the most from your Star data. If you need any support or have any questions, get in touch with your main point of contact at Triangle.

We run regular webinars to help you get the most from your Star data and use the Star Online report dashboards. You can book a slot and find out more information about our webinars below.

Share your practice with Triangle

We would love to see examples of where you have used your Outcomes Stars data to evidence your impact or where you have learnt something interesting – please get in touch to share your experience of using Star data.

Evidence that the Star accurately reflects change occurring during service provision

We are sometimes asked whether changes in Star readings actually reflect the changes that occur during service provision. We have three responses to this: the first two are based on the practices we have in place for the development of new Stars and for training and implementation of the Star. The third is to present the research evidence that the Star readings can be applied accurately and that readings correlate with other measures in the expected way.

  1. Star Development
    • New versions of the Star are created alongside managers and practitioners to ensure the Journey of Change captures key changes occurring for those using services.
    • Pilot data is statistically analysed to check that the scales are sensitive enough to detect change.
    • Service users and practitioners provide end-of-pilot feedback about the extent to which the Star captures the changes made.
  2. Training and Implementation
    • For the Star to accurately reflect change, practitioners should be well-trained with ongoing support to continue using it well. This is why training is mandatory, we provide free CPD for licensed trainers and encourage refresher training, regular supervision, and auditing.
  3. Research Evidence
    • Convergent validity: Star readings have been shown to correlate with other validated measures in our own, as well as in external peer-reviewed research.
    • Predictive validity: Star readings, and change in Star readings, predict hard outcomes such as securing accommodation, employment, and school absenteeism
    • Inter-rater reliability: different practitioners are able to consistently assign Star readings

We are keen to conduct further analyses of the relationship between Star readings and other measures, so please get in touch if you have linked data and are interested in us exploring it.

To read our three page briefing providing a more detailed version of the above, please download it here (PDF).

Triangle reflects on attending the Scotland that cares – Scottish Parliamentary Reception event – 7th March 2023

I’m Jim Borland, the Implementation Lead for Triangle in Scotland and it was my privilege to attend the recent Scottish Parliamentary Reception event hosted by Oxfam, promoting a new campaign ‘A Scotland that cares’.

The campaign is focused on why making a commitment to valuing and investing in care within the National Performance Framework is so vital to drive progress towards a Scotland that cares. The campaign has been launched to coincide with the first review of the National Outcomes framework in five years. It sets out the argument that to build a fairer and more resilient country, the Scottish government must set a National Outcome for Scotland to fully value and invest in all forms of care and all those who provide it. Too many carers face deep personal and financial costs, including poverty. With the cost-of-living crisis deepening pressures on those who rely on or provide care are increasing. Only once this standard exists, can we then all work together to create positive change for society.

A New National Outcome on Care

The campaign has created a blueprint for a new National Outcome on Care, but it requires public support and the political will to change the current situation and work towards improving the situation for those who experience and provide care across Scotland.

The event was organised by Oxfam Scotland and sponsored by Karen Adam, MSP for Banffshire and Buchan Coast. There were approximately 60 attendees’ from interested agencies, including staff from some of the 55 organisations that currently support the campaign. These included Carers Scotland, Carers Trust, One Parent Families Scotland and Scottish Care, as well as a variety of MSPs from constituencies across Scotland. I am proud to say that Triangle is also one of the supporting organisations.

Support the campaign

Jamie Livingston, the head of Oxfam Scotland opened the event describing his lived experience of caring for his sister who died after battling cancer.  He highlighted the practical issues facing those requiring care and those providing it, but also the issues for the carers once their caring role ends. He talked about his sister’s determination to be active in improving the situation.  Highlighting her efforts of contacting, all the political leaders in Scotland to raise awareness of the lack of support for all those needing and providing care. He has taken his sisters positive action through to this campaign. Whilst many current Scottish political parties already support future change, there is an opportunity for everyone, especially those who experience care and those who provide it to add their voice to the call by taking action via the campaign website: https://ascotlandthatcares.org.

Karen Adam MSP, then highlighted her own lived experience of being a carer, outlining the need for financial support and appropriate resources being made available to help individuals being cared for or fulfilling the very difficult carer’s role itself. She highlighted the need for the carers voice to be heard, valued and rewarded for the work that they do.

Jamie Livingston provided background information on the campaign, which started in 2021 during the Covid-19 pandemic. At the time, it was clear those being cared for, and their carers were excluded from many aspects of the pandemic recovery plans. This was highlighted by the fact care and carers are invisible in all 11 Scottish National Performance framework outcome indicators.  

Together with several partner agencies, the drive to change started with the intention to ensure a permanence to investment in the caring role.  Together with the development and publication of policy via a new National Outcome on Care. Working in conjunction with the University of the West of Scotland (UWS) the partnership developed a blueprint for a new National Outcome. It is hoped to be the basis for potential care indicators specifically linked to carers and the caring role in Scotland. Jamie also highlighted the upcoming consultation phase of the Scottish Government’s review of National Standards and urged individuals and organisations alike to be involved in this consultation and support change to the National Outcomes.

Seven new national indicators have been identified to measure progress:

  • The quality of life of carers, care workers and those experiencing care;
  • The quality of care for all;
  • The financial wellbeing of carers, care workers and those experiencing care;
  • The voice and influence of carers, care workers and those experiencing care;
  • Access to education and training;
  • The adequacy of funding for care;
  • The job quality of social care and childcare workers

Oxfam Scotland: “We want Scotland to fully value and invest in those experiencing care and all those providing it because… Scotland’s one million unpaid carers are the bedrock of health and social care, without whom the care system would collapse. Despite saving Scotland £10.9 billion each year, too often they experience poverty, loss of employment and ill health simply because they care. This must change!”

Satwat Rahman, CEO of One Parent Families Scotland, outlined the importance of this work, and why her organisation has been involved since its inception. Introducing four panel speakers, all with similar negative lived experience of the current support available. These experiences included:

  • The view that the carers’ role is predominately valued and seen as a priority only by family members, peers and caring services. General opinion was that there was little, or no value put on this role by external services, including education, employment, and financial services.
  • There was an expectation from external agencies that carers should ‘know what to do’, without any support.
  • Very limited support available for young carers, especially in the areas of education and finance – thus the carer’s own life and dreams have to be put on hold and suffer whilst they fulfil their caring role.
  • An overly complicated benefits system, which was off-putting to a lot of carers.
  • A lack of resources for those requiring care, or respite for the carers themselves. Demonstrating the need for infrastructure improvements in care provision as one size doesn’t fit all.

Consequently, the need for recognition around the importance of the carers role was emphasised.  Increased and appropriate funding for carers and carers services is needed, to assist carers to provide support and ensure the person requiring care is treated appropriately and with dignity.

Karen Hedge, deputy CEO of Scottish Care concluded the presentations highlighting the view that carers were seen as ‘Cinderella’ within Social Care services, and much more is required to support these individuals. She further emphasised the need for proper policy and legislation which in turn would require achievements to be measured to ensure compliance. Only then would Scotland be able to demonstrate we are a nation that cares.

I found all the personal stories and experiences very moving, particularly from the four panel members sharing their ‘lived’ experience.

As an organisation, Triangle is not directly involved in supporting individuals. We develop Outcomes Star’s for organisations who provide support to individuals in a wide range of social provision settings, including carers. The Carers Star was developed in partnership with the Social Enterprise in East Lothian (SEEL), The Carers Trust and funding from the Scottish Government. It provides a robust framework to assist practitioners work together with carers to help optimise the quality of their lives and assist them in their caring role.

We often discuss the importance of enabling and empowering people by being person-centred and strengths-based and this Star will assist in identifying a carers strengths and challenges to identify support needs to improve the carers situation. However, as highlighted by most of the speakers, the current apathy towards the carer’s role and lack of resources and finance available to support this role directly impacts what is achievable by a person or supporting organisation.

The culture around current care services in Scotland requires change if Scotland is to demonstrate that it values and invests in all individuals experiencing or providing care.

The event gave me plenty to think about and I am personally committed along with my colleagues within Triangle to support this campaign and I would urge anyone reading this post to add their voice to the campaign.

Support the campaign

Please visit the campaign website: https://ascotlandthatcares.org and sign up to the campaign to create change for this vital cohort of our society. Everyone will need to be cared for at some point in their life: as a child, in later life, or due to additional support needs. If you receive care or are a carer yourself, please let our political leaders know why valuing and investing in care matters to you.

Further information

If you would like further information about the Carers Star, please email us at info@triangleconsulting.co.uk

Stay updated

You can subscribe to our newsletter to receive updates directly to your inbox, so there is no need to keep checking for new blogs.

The Outcomes Star: helping make trauma informed philosophy practice

Over the past decade, there has been increasing recognition of both:

  • the high prevalence of complex trauma, adverse childhood events and the different ways in which trauma presents and
  • how important it is to ensure that services are delivered in ways that do not risk people becoming re-traumatised, in relation to how workers engage with them and the topics discussed.

Given the potential of the COVID-19 context and measures to cause, exacerbate and reactivate trauma, it has been argued that –

  “never before has trauma-informed care been so important to promote the health and well-being of all and to protect our marginalised populations at greatest risk”
(Collin-Vézina, Brend & Beeman, 2020)

Trustworthiness, transparency; collaboration and empowerment are key principles of trauma-informed care, which can guide service delivery policies and practices (SAMSHA, 2014). However, there can be barriers to putting these into practice.  Tools that offer a clear framework for translation of the principles of trauma informed care into practice can benefit many organisations and help them overcome these barriers.

The Outcomes Star tools have many features that directly support trauma informed working, including:

Relationship-based – The collaborative process of practitioners and clients completing the Outcomes Star helps to build a trusting and positive relationship, giving service users greater control and voice and within which important connections in the person’s life are discussed.

Empowering – The Journey of Change is sensitive to small but important steps and progress. Visually showing change can be empowering and motivating for both practitioners and clients.

Focuses on the present not someone’s history – completing the Star is a conversation about someone’s life, how things are for them and what they are doing now, rather than bringing up past histories or traumatic experiences.

Strengths based not deficit-based; they use positive language focusing on the process of change and the support and actions needed, not on the severity of problems.

Holistic – the whole person and all relevant life circumstances are recognised. Plotting where someone is on the Star chart provides a clear representation of where support is needed and where things are going well, highlighting the interaction between different areas of someone’s life.

As well as the tools themselves, training and guidance around the Outcomes Star emphasises flexibility in responding to a client’s window of tolerance and preferences – for example, about when and how to introduce and discuss the different outcome areas. There is also guidance about identifying appropriate action plans in a trauma-informed way that is sensitive to the client’s capacity to drive things forward themselves.

Triangle is committed to continuous learning and improvement of the Outcomes Stars and how they are used. Staff have received training and advice from experts on trauma informed care and we are currently reviewing some of our older, widely used Stars using a trauma-informed lens.

*****

For more information, please see our guide on ;How to use the Outcomes Stars with trauma informed approaches’ or get in touch on info@triangleconsulting.co.uk or +44(0) 207 272 8765.

Year in review: Shining brightly in uncertain times

Joy MacKeith, one of Triangle’s directors and co-founders, and co-author of the Outcomes Stars, explores her year in review, and shares her thoughts on the impact and successes of 2019, including the new Star Online and new Stars.

It’s week one back in the office after my new year’s break. My inbox is surprisingly full and the office is already buzzing with activity. Not everyone has taken two weeks off it seems. Before taking a deep breath and diving into the patiently waiting emails I allow myself the luxury of a moment to reflect on a very busy 2019 and anticipate what 2020 has in store.

Star Online 2 is unveiled

For me 2019 will always be the year that we built our new, improved software system and 2020 will be the year that the one thousand organisations working with the Star Online started to use it. The initial feedback from those who helped us test it in development has been amazing. I know many of our clients will be particularly excited about the reporting capability, with new visuals, new customisation and new time period reporting options. Other new features will make it much easier to manage implementation and data quality.  The fact that we now have a state-of-the-art platform for further developments is also very exciting. An off-line app is high on the list of new features we have planned. The new system is now live for new clients.  A massive thanks goes to Sarah Owen, our team member, who has led the project and QES our software development partners.

Making an impact

I will also remember 2019 as the year we conducted our strategic review. Thirteen years since the publication of the first Star it was time to look at how well the suite of tools had stood the test of time and how Triangle and the Star need to develop to stay at the cutting edge of practice. As part of the review we carried out a summer survey of our clients to find out what difference the Star makes. I know that people love the Star, so I was expecting broadly positive findings, but the level of appreciation and impact took me by surprise. Here are a few highlights:

  • 87% of Star users report that their keywork is more effective
    as a result of using the Star
  • 81% said that Star data
    reports enabled them to monitor and report on their outcomes more effectively
  • 95% say that the Star supports good conversations and collaboration between
    staff and service users
  • 92% say that helps service users to get an
    overview of their situation
  • 93% say that the Star supports
    person-centered, strengths-based working
  • 92% say that the Star
    is motivating for staff and
    service users because it makes change visible.

There were so many stand-out findings that it is hard not to keep adding more, but you get the idea. Of course there are always things that can be improved, but it was heartening to hear that many of the developments people were asking for focused around the Star Online so it was wonderful to know that in just a few months those needs would be met.

Not only do the findings underline the positive way that the Star helps workers take an enabling, strengths-based approach, but they are also a powerful affirmation of Triangle’s decision to invest heavily in implementation support through our client services team, our trainers and our regionally based implementation leads.

Research shows that better results are obtained from good implementation of a poor tool than from poor implementation of a good one. We aim to provide both an excellent tool and excellent implementation support. It is so affirming to see that this powerful combination is really making a difference. 

The strategic review concluded that the Star
is a tool whose time has now come because of the increasing recognition of the
importance of person-centred, outcomes focused collaborative working. Although
it is well known in some sectors and regions, it is still largely unknown in
many others so the potential for further impact is substantial. A key theme for
2020 and beyond will therefore be doing more to communicate what the Star is,
the way that it can transform service delivery and the wealth of research
behind it.

An organisation with a mission

As well as fact finding, our strategic review also involved some deep reflection and soul searching on Triangle’s role in the current service delivery climate. We are painfully aware that the service delivery landscape has changed since 2006 when the first version of the Star was published. Assumptions that if someone is motivated to change then the services will be there to support them no longer hold. Many services are now much lighter touch and can find it challenging to make the time for an in-depth conversation about needs and plans. This has resulted in requests for ‘lighter touch’ or self-completion Stars.

Should the Star stick to its original formulation
as a comprehensive and reflective tool or adapt to new realities? There are no
easy answers, but we have re-affirmed and sharpened our mission as an organisation
that is committed to both advocating for an enabling approach to service
delivery and helping service providers make this a reality in practice.

We now begin a new strand of work to shape the
debate around what matters in service delivery through research, blogs,
conference presentations and making links with the many others advocating for
this kind of approach.

Drawing together the evidence base

The Outcomes Star was born out of practice
rather than research and quickly took root because many organisations were
hungry for a tool that would evidence the effectiveness of their work without
getting in the way. When they discovered that the Star positively helped them
achieve their outcomes, there was no stopping it. 

As a result, the formal research evidence for the Star lagged behind its use. 2019 was the year that changed and we were finally able to draw together a decade of work on validation to publish psychometric factsheets on nearly all versions (we are still collecting the data on very recently published Stars). 2020 will see the publication of a paper in a peer-reviewed journal setting out the psychometric properties of the Family Star Plus, the most widely used of the suite of Stars. This is an incredibly important landmark for us in establishing the Outcomes Star as a different kind of tool that straddles the aims of both promoting and evidencing change.

Hello and goodbye

Closer to home, 2019 has been an important year of hellos and goodbyes. Hello to our first Managing Director, Graham Randles, who joined us from the New Economics Foundation consultancy service, and goodbye to Paul Muir, our Operations Director who pioneered our work on implementation support and much else besides. Hello to Tamara Hamilton who will be covering Sarah Owen’s maternity leave this year and goodbye to Susan Goodbrand who covered Emily Lamont’s maternity leave. Goodbye also to Roxanne Timmis who has moved on to an exciting new role with Think Ahead, a charity that supports graduates into mental health social work. Best of all, we have said hello to four new babies including Ziya Nisi born on 28th December to Giorgia, one of the staff at Unique Outcomes, our Australian implementation partner.

And finally

Triangle also gave birth to five new Stars in 2019 in a year of unprecedented Star development activity. We now have a Star for preparing for the end of life. Together with our Parent and Baby Star this means the Stars really can take you from cradle to grave.  2020 sees the publication of our new 3-5 year plan, a project to build on interest in the Star in the USA, the full implementation of our new software system and much more besides. 

It is incredible to see how something that started as an approach for one organisation in one sector has evolved and flourished over so many sectors and countries around the world. As we approach a very uncertain new decade, it gives me hope that when people collaborate to address specific issues with commitment, persistence, flexibility and creativity, we really can make a difference.

Graphic introducing the Planning Star - linking to the Planning Star webpage
Image introducting the Preparation Star - linking to the Preparation Star webpage
Image introducing the Pathway Star with a graphic linking to a blog on how the Pathway Star is a person-centered tool
Graphic introducing the Recovery Star Fourth Edition, linking to a blog post on the new Star
Image linking to a blog post introducing the new My Mind Star for use with organisations supporting young people's mental health and well-being

If you have any questions about our new Stars, or would like any information on the new Star Online, or anything else, please contact us on info@triangleconsulting.co.uk or +44 (0) 207 272 8765.