Evaluating the agreement between different substance use recall periods in multiple HIV cohorts

This study aims to evaluate the agreement in substance use on both binary and ordinal scales between 3-month and 6-month recall periods with samples from different communities, demographic backgrounds, and HIV status. We administered the Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) to 799 participants from three different North American cohorts focused on substance use and HIV. We conducted a within-person agreement analysis by calculating the agreement levels and Kappa statistic between data collected using the 3-month recall ASSIST and 6-month custom substance use surveys as well as different terminology for each substance in multiple cohorts. For all drugs studied, the agreement on the binary use or ordinal frequency of use metrics showed a high agreement level between 80.4% and 97.9% and an adequate adjusted kappa value between 0.61 and 0.96, suggesting substantial agreement. According to the agreement criteria we proposed, substance use data collected using different recall periods and with variation in drug names can be harmonized across cohorts. This study is the first to evaluate the feasibility of data harmonization of substance use by demonstrating high level of agreement between different recall periods in different cohorts. The results can inform data harmonization efforts in consortia where data are collected from cohorts using different questions and recall periods.