COVID-19 coronavirus research has overall low methodological quality thus far: case in point for chloroquine/hydroxychloroquine

Prior epidemics of high-mortality human coronaviruses, such as the acute respiratory syndrome coronavirus (SARS-CoV or SARS-1) in 2003, have driven the characterization of compounds that could be possibly active against the currently emerging novel coronavirus SARS-CoV-2 (COVID-19). Presently, no approved treatment or prophylaxis is available for COVID-19. We comment on the existing COVID-19 research methodologies in general and the published reporting. Given the media attention and claims of effectiveness, we chose chloroquine and hydroxychloroquine, in combination with azithromycin, as an area of COVID-19 research to examine. MEDLINE and EMBASE electronic databases were searched from 2019 to present (April 3rd, 2020) using a mix of keywords such as COVID-19 and chloroquine and hydroxychloroquine. We also searched the largest clinical medicine preprint repository, medRxiv.org. We found 6 studies, 3 randomized control trials and 3 observational studies, focusing on chloroquine and hydroxychloroquine (with azithromycin). We critically appraised the evidence. We found that the COVID-19 research methodology is very poor in the area of chloroquine/hydroxychloroquine research. In screening the literature, we observed the same across COVID-19 research in relation to potential treatments. The reporting is very poor and sparse, and patient-important outcomes needed to discern decision-making priorities are not reported. We do understand the barriers to perform rigorous research in health care settings overwhelmed by a novel deadly disease. However, this emergency pandemic situation does not transform flawed methods and data into credible results. The adequately powered, comparative, and robust clinical research that is needed for optimal evidence-informed decision-making remains absent in COVID-19.