Evaluation of complex interventions to prevent psychosocial risk: an interdisciplinary method

Objectives
This project dealt with evaluation of complex interventions on Psychosocial Risks (PSR) and Musculo Skeletal Disorders (MSD) targeting primary prevention and organizational level. In this context, the project aimed:
- to perform a relevant theoretical framework,
- to design recommendations, methods and tools for field practices.
Methods
A multidisciplinary working group (psychology, sociology, ergonomics, economics, epidemiology, management and education sciences) carried out:
- The state of art on evaluation of PSR and MSD interventions;
- The comparison of the evaluation theoretical models available in human and biological sciences;
- The literature review on existing multidisciplinary models of evaluation;
- The report on evaluation perception of 50 practitioners (ergonomists, private and institutional advisors, occupational health physicians, etc.);
- The design of a new method on evaluation based on theoretical issues and practitioners’ perception.
Results
For each academic discipline, evaluation was considered according to ontology, epistemology, causation, method, tools, etc. Convergence and divergence between the disciplines were detected. Realistic evaluation was retained as integrative model of existing intervention models. In parallel, practitioners’ interviews on strategic and practical concerns allowed to adjust the evaluation method.
The proposed method defined 4 different domains of evaluation, among those one on all potential effects of organizational interventions (listed in 6 headings and 39 sub headings) and another on assessment of causality between intervention and effects. This evaluation method was tested in 2015, by 27 out of 50 practitioners in 32 interventions intended overall to prevent PSR and/or MSD but also to reduce physical load or to promote quality of life, etc. An 800-item form was filled out by testers in order to evaluate the new method in substance and in form. Mixed analyses of questionnaire allowed sharpening this evaluation method and particularly the 39-item forementioned list.
Conclusion
A book on theoretical aspects and a brochure for practitioners, updated by the experiment results are in the pipeline. Edition of both documents in 2016 should contribute to promote complete and adequate evaluation, in order to improve field practices on PSR and MSD interventions. This evaluation methodology could concern all complex interventions which intend to change work organization.