A review of LSV Sport in 2018 identified challenges and solutions and set a series of recommendations from the participating membership, including the overarching goal of ‘better before bigger’.
One of the five key recommendations from the report was ‘Improving evaluation: A focus on better analysis and evidence for decision making, with a greater emphasis on feedback, while providing more timely and relevant information for stakeholders.’
The subsequent evaluation project includes the development and implementation of a Sport M&E plan for 2018/19 focussed on the summer beach lifesaving competition.
Aquatic Sport (Sport) plays a vital role in keeping active members fit and active while enhancing their lifesaving skills, known as ‘active training’. Each year in Victoria, thousands of members compete in lifesaving events. In addition, Sport participation engages hundreds of volunteer officials and coaches across the beach, pool and IRB disciplines. Initiated by the LSV Board, an internal review of Sport was conducted by the department from October 2017 to July 2018. Extensive feedback was obtained from the review including: 156 informal interviews at carnivals and events; 54 formal interviews and 18 written responses received. One of the five key recommendations from the report was ‘Improving evaluation: A focus on better analysis and evidence for decision making, with a greater emphasis on feedback, while providing more timely and relevant information for stakeholders.’ A key challenge identified in the review was a lack of clear goals and objectives for Sport in Victoria (LSV, 2018). Subsequently, the Aquatic Sport Executive identified that the solution to this challenge was to develop a strategic plan underpinned by an evaluation plan, commissioned to LSV Risk & Research.
The overall project aim is to determine, develop and implement a Sport monitoring and evaluation (M&E) plan for 2018/19. Given the focus on ‘Better before bigger’, the 2018/19 plan focussed on the summer beach lifesaving competition. Future M&E plans will expand to IRB and pool disciplines, however these are out of scope of the current project.
Specific project objectives are to
- Design a Sport M&E plan relating to summer beach events.
- Implement the Sport M&E plan relating to summer beach (beach and surf) lifesaving events, including:
– Data collection, and coordination of data collection.
– Analysing data, interpreting findings, and establishing potential measurable KPIs for subsequent evaluations.
– Preparing a report for dissemination.
Specific objectives within the Sport M&E plan for the 2018/19 summer season are to determine:
- The level of participation in Sport.
- The level of satisfaction with Sport as an indicator of retention.
- The overall experience with Sport including potential barriers and enablers to participation.
- Address participation in key areas including:
– Setting targets to improve the representation of coaches by gender and club.
– Setting targets to improve the representation of officials by age.
– Addressing lower participation rates from Under 14 onwards.
– Using average participation across carnivals as the key indicator of participation rather than the total.
- Methods to review communication to and between athletes, officials and coaches should be assessed, with particular focus on event scheduling, cancellation, and location, explaining how decisions are made and the timeframes around the decision-making process. It is noted that Team App would assist in this area.
- Improve members’ experience at carnivals. Key areas of focus are carnival locations, event scheduling and timing of carnivals.
- Set KPIs for 2019/20 season beach events:
– Overall satisfaction with LSV Sport to increase from 7.2 to 8 out of 10.
– Satisfaction with carnivals to increase from 7.1 to 8 out of 10.
– Satisfaction with LSV’s communication of information about carnivals to increase from 7.4 to 8 out of 10.
– Reduce the number of negative comments via the Feedback App by 10%.
- Conduct further research:
– Improve data capture and analysis to improve accuracy and usability of data reporting, particularly in relation to participation rates.
– Identify the reasons why more current members and more clubs do not participate in Sport.
– Establish benchmarks (baseline measures) for other areas of Sport.