Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: a randomised controlled trial
Objectives Robust research of complex interventions designed to promote mental well-being in later life is required to inform service development. An essential component is ensuring that such interventions are delivered as intended. We present a detailed description of the design and implementation...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2021-04-01
|
| Series: | BMJ Open |
| Online Access: | https://bmjopen.bmj.com/content/11/4/e043478.full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846161031961772032 |
|---|---|
| author | Gail Mountain Kirsty Sprange Claire Craig |
| author_facet | Gail Mountain Kirsty Sprange Claire Craig |
| author_sort | Gail Mountain |
| collection | DOAJ |
| description | Objectives Robust research of complex interventions designed to promote mental well-being in later life is required to inform service development. An essential component is ensuring that such interventions are delivered as intended. We present a detailed description of the design and implementation of a fidelity assessment within a trial of one such intervention (Lifestyle Matters). The findings help to explain the trial results and also inform the design of embedded fidelity assessments within future evaluations of complex interventions.Design We conducted a mixed-method fidelity assessment embedded as part of a multicentre pragmatic randomised controlled trial. A conceptual fidelity framework was developed from the Behaviour Change Consortium framework. From this the fidelity assessment was designed. The resulting instrument assessed the following parameters: intervention design, training, supervision; and delivery, receipt and enactment of the intervention.Intervention The Lifestyle Matters intervention was designed to assist older people to improve and sustain mental well-being through participation in meaningful activity. The aim is to enable participants to engage in both new and neglected activities through a mix of facilitated group meetings and individual sessions.Results The fidelity assessment demonstrated that the intervention was delivered as per protocol for the group component and was tailored to meet individual needs. There was substantial inter-rater agreement for training; and group member performance 0.72; and moderate agreement for facilitator performance 0.55. It was not possible to determine whether small declines seen in facilitator performance were due to facilitator drift or moderating factors such as group dynamics or participant characteristics.Conclusions The assessment methods adequately measured criteria identified as being significant indicators of fidelity. Adherence during training, delivery and supervision was good. The subjective nature of identification and rating observed behaviours was the main challenge. Future research should explore alternative methods of assessing fidelity in trials of complex interventions.Trial registration number ISRCTN67209155. |
| format | Article |
| id | doaj-art-7de9344d8b994bf2b032b1e0e333d675 |
| institution | Kabale University |
| issn | 2044-6055 |
| language | English |
| publishDate | 2021-04-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Open |
| spelling | doaj-art-7de9344d8b994bf2b032b1e0e333d6752024-11-21T11:55:08ZengBMJ Publishing GroupBMJ Open2044-60552021-04-0111410.1136/bmjopen-2020-043478Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: a randomised controlled trialGail Mountain0Kirsty Sprange1Claire Craig2professor of applied dementia studiesassistant professor of clinical trialsLab4Living, Sheffield Hallam University, Sheffield, South Yorkshire, UKObjectives Robust research of complex interventions designed to promote mental well-being in later life is required to inform service development. An essential component is ensuring that such interventions are delivered as intended. We present a detailed description of the design and implementation of a fidelity assessment within a trial of one such intervention (Lifestyle Matters). The findings help to explain the trial results and also inform the design of embedded fidelity assessments within future evaluations of complex interventions.Design We conducted a mixed-method fidelity assessment embedded as part of a multicentre pragmatic randomised controlled trial. A conceptual fidelity framework was developed from the Behaviour Change Consortium framework. From this the fidelity assessment was designed. The resulting instrument assessed the following parameters: intervention design, training, supervision; and delivery, receipt and enactment of the intervention.Intervention The Lifestyle Matters intervention was designed to assist older people to improve and sustain mental well-being through participation in meaningful activity. The aim is to enable participants to engage in both new and neglected activities through a mix of facilitated group meetings and individual sessions.Results The fidelity assessment demonstrated that the intervention was delivered as per protocol for the group component and was tailored to meet individual needs. There was substantial inter-rater agreement for training; and group member performance 0.72; and moderate agreement for facilitator performance 0.55. It was not possible to determine whether small declines seen in facilitator performance were due to facilitator drift or moderating factors such as group dynamics or participant characteristics.Conclusions The assessment methods adequately measured criteria identified as being significant indicators of fidelity. Adherence during training, delivery and supervision was good. The subjective nature of identification and rating observed behaviours was the main challenge. Future research should explore alternative methods of assessing fidelity in trials of complex interventions.Trial registration number ISRCTN67209155.https://bmjopen.bmj.com/content/11/4/e043478.full |
| spellingShingle | Gail Mountain Kirsty Sprange Claire Craig Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: a randomised controlled trial BMJ Open |
| title | Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: a randomised controlled trial |
| title_full | Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: a randomised controlled trial |
| title_fullStr | Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: a randomised controlled trial |
| title_full_unstemmed | Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: a randomised controlled trial |
| title_short | Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: a randomised controlled trial |
| title_sort | evaluation of intervention fidelity of a complex psychosocial intervention lifestyle matters a randomised controlled trial |
| url | https://bmjopen.bmj.com/content/11/4/e043478.full |
| work_keys_str_mv | AT gailmountain evaluationofinterventionfidelityofacomplexpsychosocialinterventionlifestylemattersarandomisedcontrolledtrial AT kirstysprange evaluationofinterventionfidelityofacomplexpsychosocialinterventionlifestylemattersarandomisedcontrolledtrial AT clairecraig evaluationofinterventionfidelityofacomplexpsychosocialinterventionlifestylemattersarandomisedcontrolledtrial |