Our User Survey is incredibly important to us as an organisation. Systems are constantly evolving and developing, and the Upshot system is no different. We use the feedback from our users, those who use and work on the system day-in-day-out to help shape our product roadmap, improve our communication, tweak our guides, support and training offering and meet changing and growing demands. 

Over the last few years, we have published the results in full to allow users, or those interested in using Upshot, to query our survey responses for themselves and to open up our data for a complete picture. 

As part of our commitment to transparent impact reporting, we have developed our 2024 public and interactive survey dashboard. On this dashboard, you can query results across our userbase. Data can be queried from specific sectors and feedback can be explored based on the day-to-day roles of our users.  

We have also produced a detailed FAQ document to address questions and challenges that were posed to us in our survey.

We analyse and look at our data year-on-year, comparing each year against previous years to monitor, evaluate and learn from our developments we are making to the System and our offering as a CIC.

This year we have noticed a few shifts and changes in our results:  

• The biggest positive shift in our user survey results is around “Upshot keeps me updated of new developments”. This had a +8% increase this year. We were very pleased to see this as over the last 12 months we have more regularly updated our “What’s New?” tab on the system to ramp up communication on new features, and we have also increased the volume of communication we sent to users (but hopefully we haven’t gone overboard! None of us enjoy bombardments of emails).

• We have also seen a sizable improvement in the feedback around our user guides. Over the last 12 months we have continued to produce guides that can be found in our guide section. The one change this year is adding in additional guidance that is not necessarily solely around how to use certain features of the Upshot System but ideas and guidance on features and aspects of the system that can be used in different delivery settings – i.e. guidance on capturing data in a 1:1 setting or recording data in a school setting.

• Reporting on data collected on Upshot continues to be an aspect and element of Upshot that the greatest number of users require additional training and support on. To address this we have recently launched free open training sessions, a number of which will focus solely on reporting on Upshot. We have also developed a number of excel-based reporting templates to help organisations with slightly more complicated reporting needs. These can be found within our guide section. We hope additional reporting training and a growing number of reporting resources will also help increase confidence working with data.

• Finally, this year we also noticed a small drop in the number of users stating that “Upshot is easy to use” – this was ~1%. To address this slight drop there is a focus within this year’s roadmap to introduce a series of features to make the system that bit easier to use for users.  

You can query and view the 2024 User Satisfaction Survey results below...