Do you get what you pay for? Preventing insufficient effort responding in MTurk and student samples

Previous research has developed multiple indices to detect instances of insufficient effort responding (IER; Huang et al., 2015, 0.1037/a0038510). Although these techniques are largely successful, conflation between effort and insufficient effort leads to unnecessary data removal, thus warranting investigation into IER prevention strategies such as warning statements. For example, Brühlmann et al. (2020, 10.1016/j.metip.2020.100022) reported that close to 60% of participants were flagged for IER on at least one IER detection index. The current study used positive, negative, and no warning statements in two samples (MTurk and university participant pool) to examine their impact on two types of IER. Results do not support the use of warning statements to reduce IER covertly, overtly, or overall. Although slightly more university participants were flagged for IER for two of five IER indices, the remaining three indices did not differ between samples. This finding represents an important contribution to survey research literature by directly comparing samples on a variety of IER indices. Implications for survey research necessitate the examination of additional prevention strategies and sample differences in IER.