Assessing the concurrent validity, inter-rater reliability and test-retest reliability of the Australian Treatment Outcomes Profile (ATOP) in alcohol and opioid treatment populations.
Addiction. 2020 Nov 17;:
Authors: Deacon RM, Mammen K, Bruno R, Mills L, Dunlop A, Holmes J, Jefferies M, Hall M, Shakeshaft A, Farrell M, Graham R, Lintzeris N
BACKGROUND AND AIMS: The Australian Treatment Outcomes Profile (ATOP) is a brief instrument measuring recent substance use, risk profile, and general health and wellbeing among clients attending Alcohol and other Drug (AoD) treatment services. This study evaluates the ATOP for concurrent validity, inter-rater and test-retest reliability among alcohol and opioid treatment groups.
DESIGN: For concurrent validity and inter-rater reliability, participants completed an ATOP with a clinician, and an ATOP plus standardised questionnaires (Time Line-Follow Back, Opiate Treatment Index, Kessler-10, 12 item Short Form Survey, WHO Quality of Life-BREF, Personal Wellbeing Index) with a researcher within 3 days. For test-retest reliability, participants completed two ATOPs with a researcher within a 3-day interval.
SETTING: Outpatient AoD treatment centres in Australia.
PARTICIPANTS: For testing concurrent validity and inter-rater reliability, 278 participants were recruited by advertisements in waiting rooms or clinician invitation over 2016-2018. A further 94 participants were recruited to examine test-retest reliability MEASUREMENTS: Statistical tests used for concurrent validity and test-retest reliability were Pearson’s and Spearman rank order correlations for continuous variables, and Cohen’s κ for nominal variables. Inter-rater reliability was assessed using Krippendorf’s α.
FINDINGS: Most Australian Treatment Outcomes Profile items returned excellent or moderate validity and reliability. For the main substances used – alcohol, cannabis, and benzodiazepines – concurrent validity, interrater reliability and test retest reliability all reached excellent or good agreement (0.72-0.98). Psychological health, physical health and quality of life showed fair to strong agreement with their comparator scales (0.47-0.85).
CONCLUSIONS: The Australian Treatment Outcomes Profile is a validated and reliable instrument for assessing recent substance use and clinical risk, health and welfare among alcohol and opioid clients in Alcohol and other Drug treatment settings. Its ability to reliably measure complex constructs, such as psychological and physical health, against longer scales makes it suitable for integration into routine clinical care, enabling regular monitoring of patient outcomes and safety parameters.
PMID: 33201546 [PubMed – as supplied by publisher]
Source: ncbi 2