Accounting for Complex Sample Designs in Analyses of the Survey of Consumer Finances

We examined the effects of using bootstrap weights to account for the complex sample design in analyses of Survey of Consumer Finances (SCF) datasets. No article published in this journal that has used the SCF has mentioned the issue of complex sample designs. We compared results obtained without weights and with application of population and bootstrap weights in a logistic regression, and found no substantial differences between the unweighted and the weighted analyses. We also compared results for an ordinary least squares regression, and found few differences between unweighted and weighted models. Unweighted regressions produced more conservative significance tests than the counterpart, and some econometricians have suggested that unweighted analyses are better for hypothesis testing. If estimation of the magnitudes of effects is important, weighted regression may be better because it produces consistent estimators. Researchers should be cautious in drawing conclusions when weighted and unweighted effects are substantially different.