A sequential mixed-mode experiment in the U.S. National Monitoring the Future study

Megan E. Patrick, Mick P. Couper, Virginia B. Laetz, John E. Schulenberg, Patrick M. O'Malley, Lloyd D. Johnston, Richard A. Miech

    Research output: Contribution to journalArticlepeer-review

    14 Scopus citations


    The national Monitoring the Future (MTF) study examines substance use among adolescents and adults in the United States and has used paper questionnaires since it began in 1975. The current experiment tested three conditions as compared to the standard MTF follow-up protocol (i.e., MTF Control) for the first MTF follow-up survey at ages 19/20 years (i.e., one or two years after high school graduation). The MTF Control group included participants who completed in-school baseline surveys in the 12th grade in 2012-2013 and who were selected to participate in the first follow-up survey in 2014 (n=2,451). A supplementary sample of participants who completed the 12th grade baseline survey in 2012 or 2013 but were not selected to participate in the main MTF follow-up (n=4,950) were recruited and randomly assigned to one of three experimental conditions: (1) Mail Push, (2) Web Push, (3) Web Push+E-mail. Results indicated that the overall response rate was lower in Condition 2 compared to MTF Control and to Condition 1; there were no differences between Condition 3 and other conditions. Web response was highest in Condition 3; among web responders, smartphone response was also highest in Condition 3. Subgroup differences also emerged such that, for example, compared to white participants, Hispanics had greater odds of web (versus paper) response and blacks had greater odds of smartphone (versus computer or tablet) response. Item nonresponse was lowest in the Web Push conditions (compared to MTF Control) and on the web survey (compared to paper). Compared to MTF Control, Condition 3 respondents reported higher rates of alcohol use in the past 30 days. The total cost was lowest for Condition 3. Overall, the Condition 3 Web Push+E-mail design is promising. Future research is needed to continue to examine the implications of web and mobile response in large, national surveys.

    Original languageEnglish (US)
    Pages (from-to)72-97
    Number of pages26
    JournalJournal of Survey Statistics and Methodology
    Issue number1
    StatePublished - Mar 1 2018

    Bibliographical note

    Funding Information:
    This work was supported by the National Institute on Drug Abuse grants R01DA001411 and R01DA016575 to L. Johnston. The content here is solely the responsibility of the authors and does not necessarily represent the official views of the sponsors. *Address correspondence to Megan E. Patrick, 426 Thompson St., P.O. Box 1248, Institute for Social Research, University of Michigan, Ann Arbor, MI 48106-1248, USA, E-mail: meganpat@umich.edu.

    Publisher Copyright:
    © The Author 2017. Published by Oxford University Press on behalf of the American Association for Public Opinion Research. All rights reserved.


    Dive into the research topics of 'A sequential mixed-mode experiment in the U.S. National Monitoring the Future study'. Together they form a unique fingerprint.

    Cite this