The Intervention Journey A Roadmap to Effective Digital Safety Measures 2025

To ensure the effectiveness of digital safety interventions, continuous monitoring needs to be established. This ongoing oversight can include automated tools that detect and flag potential safety issues, as well as regular audits to evaluate the intervention’s effectiveness and identify areas for improvement. By maintaining a vigilant watch over how interventions operate in practice, organizations can ensure that their safety measures remain effective and relevant in a rapidly evolving digital landscape. While automated tools can be used alongside other measures to determine the effectiveness and repercussions of an intervention, the user and their feedback are key. An essential component of continuous monitoring is the establishment of clear and accessible channels for user feedback. User feedback enables organizations to identify and address specific issues while offering valuable insights into how safety interventions are perceived and experienced across diverse user communities. It serves as a source of both quantitative and qualitative data. By actively listening to users and incorporating their feedback into the development process, companies can refine their interventions to better meet the needs and expectations of their user base. Organizations should seek feedback from non-governmental organizations (NGOs) or civil society organizations working with those with lived experiences, as they can provide valuable insights that users may generally lack. Within this step, defining key metrics is fundamental to evaluating the success of digital safety interventions. Metrics could include the number of incidents reported, response times, user satisfaction and awareness of safety features, and overall harm reduction. Measuring digital safety is a complex task, complicated by the constant evolution of technologies, the challenge of developing metrics that are both adaptable and consistent, and the need to balance privacy concerns with the demand for transparency. A previous coalition paper, Making a Difference: How to Measure Digital Safety Effectively, categorizes digital safety metrics into three groups:4 –Impact: metrics that illuminate the impacts on individuals and provide insights into characteristics and patterns of lived experiences –Risk: metrics that enable the detection and mitigation of potential harms –Process: metrics that cover the approach, implementation and outcomes of systems relating to digital safety The transparency of an organization’s digital safety, maintained through regular reporting on safety interventions, is a major pillar of the review and feedback of interventions. Transparency reports allow organizations to share information about the actions they are taking to protect users, the effectiveness of those measures and the challenges they face. By openly communicating about their safety efforts, companies can build trust with their users and stakeholders, demonstrating accountability and a genuine commitment to creating a safer digital environment. These reports also provide an opportunity to showcase progress, celebrate successes and highlight areas where further work is needed, promoting a culture of continuous improvement and collaboration in digital safety efforts. Although listed as the final step in the intervention journey, measurement and review should be integrated into every stage of the process. 1.4 Feedback, measurement and transparency Feedback, measurement and transparency BOX 4 Key considerations –Are the feedback mechanisms accessible and easy to use for all affected parties? –How transparent is the organization being with users and stakeholders about the goals, processes and outcomes of the intervention? –What information can the organization publicly share to demonstrate commitment to digital safety while maintaining user privacy and mitigating bad actors circumventing safety measures? –How is the organization collecting feedback from users, partners and stakeholders regarding the digital safety intervention? –Is the organization adequately reporting on both successes and areas needing improvement in the intervention’s impact? –How will the feedback inform future iterations of the digital safety intervention? Although listed as the final step in the intervention journey, measurement and review should be integrated into every stage of the process. The Intervention Journey: A Roadmap to Effective Digital Safety Measures 11