Precision and Recall of Search Strategies for Identifying Studies on Work-Related Psychosocial Risk Factors in PubMed

Purpose This study aims to report on the effectiveness of various search strategies and keywords to find studies on work-related psychosocial risk factors (PRF) in the PubMed bibliographic database. Methods We first selected by hand-searching 191articles published on PRF and indexed in PubMed. We extracted 30 relevant MeSH terms and 38 additional textwords. We then searched PubMed combining these 68 keywords and 27 general keywords on work-related factors. Among the 2953 articles published in January 2020, we identified 446 articles concerning exposure to PRF, which were gathered in a Gold Standard database. We then computed the Recall, Precision, and Number Needed to Read of each keyword or combination of keywords. Results Overall, 189 search-words alone or in combination were tested. The highest Recall with a single MeSH term or textword was 43% and 35%, respectively. Subsequently, we developed two different search strings, one optimizing Recall while keeping Precision acceptable (Recall 98.2%, Precision 5.9%, NNR 16.9) and one optimizing Precision while keeping Recall acceptable (Recall 73.1%, Precision 25.5%, NNR 9.7). Conclusions No single MeSH term is available to identify relevant studies on PRF in PubMed. Locating these types of studies requires the use of various MeSH and non-MeSH terms in combination to obtain a satisfactory Recall. Nevertheless, enhancing the Recall of search strategies may lead to lower Precision, and higher NNR, although with a non-linear trend. This factor must be taken into consideration when searching PubMed.