Affiliations
AffiliationsItem in Clipboard
The Use of Multimode Data Collection in Random Digit Dialing Cell Phone Surveys for Young Adults: Feasibility StudyDaniel Alexander Gundersen et al. J Med Internet Res. 2021.
. 2021 Dec 20;23(12):e31545. doi: 10.2196/31545. AffiliationsItem in Clipboard
AbstractBackground: Young adults' early adoption of new cell phone technologies have created challenges to survey recruitment but offer opportunities to combine random digit dialing (RDD) sampling with web mode data collection. The National Young Adult Health Survey was designed to test the feasibility of this methodology.
Objective: In this study, we compared response rates across the telephone mode and web mode, assessed sample representativeness, examined design effects (DEFFs), and compared cigarette smoking prevalence to a gold standard national survey.
Methods: We conducted a survey experiment where the sampling frame was randomized to single-mode telephone interviews, telephone-to-web sequential mixed mode, and single-mode web survey. A total of 831 respondents aged 18 to 34 years were recruited via RDD at baseline. A soft launch was conducted prior to main launch. We compared the web mode to the telephone modes (ie, single-mode and mixed mode) at wave 1 based on the American Association for Public Opinion Research response rate 3 for screening and extended surveys. Base-weighted demographic distributions were compared to the American Community Survey. The sample was calibrated to the US Census Bureau's American Community Survey to calculate DEFFs and to compare cigarette smoking prevalence to the National Health Interview Survey. Prevalence estimates are estimated with sampling weights and are presented with unweighted sample sizes. Consistency of estimates was judged by 95% CI.
Results: The American Association for Public Opinion Research response rate 3 was higher in the telephone mode than in the web mode (24% and 30% vs 6.1% and 12.5%, for soft launch and main launch, respectively), which was reflected in response rate 3 for screening and extended surveys. During the soft launch, the extended survey and eligibility rate were low for respondents pushed to the web mode. To boost productivity and survey completes for the web condition, the main launch used cell phone numbers from the sampling frame where the sample vendor matched the number to auxiliary data, which suggested that the number likely belonged to an adult in the target age range. This increased the eligibility rate, but the screener response rate was lower. Compared to population distribution from the US Census Bureau, the telephone mode overrepresented men (57.1% [unweighted n=412] vs 50.9%) and those enrolled in college (40.3% [unweighted n=269] vs 23.8%); it also underrepresented those with a Bachelor of Arts or Science (34.4% [unweighted n=239] vs 55%). The web mode overrepresented White, non-Latinos (70.7% [unweighted n=90] vs 54.4%) and those with some college education (30.4% [unweighted n=40] vs 7.6%); it also underrepresented Latinos (13.6% [unweighted n=20] vs 20.7%) and those with a high school or General Education Development diploma (15.3% [unweighted n=20] vs 29.3%). The DEFF measure was 1.28 (subpopulation range 0.96-1.93). The National Young Adult Health Survey cigarette smoking prevalence was consistent with the National Health Interview Survey overall (15%, CI 12.4%-18% [unweighted 149/831] vs 13.5%, CI 12.3%-14.7% [unweighted 823/5552]), with notable deviation among 18- to 24-year-olds (15.6%, CI 11.3%-22.2% [unweighted 51/337] vs 8.7%, CI 7.1%-10.6% [unweighted 167/1647]), and those with education levels lower than Bachelor of Arts or Science (24%, CI 19.3%-29.4% [unweighted 123/524] vs 17.1%, CI 15.6%-18.7% [unweighted 690/3493]).
Conclusions: RDD sampling for a web survey is not feasible for young adults due to its low response rate. However, combining this methodology with RDD telephone surveys may have a great potential for including media and collecting autophotographic data in population surveys.
Keywords: data capture; feasibility; mixed mode surveys; random digit dialing; recruitment; research methods; smoking; survey; survey methodology; web mode; web survey.
©Daniel Alexander Gundersen, Jonathan Wivagg, William J Young, Ting Yan, Cristine D Delnevo. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 20.12.2021.
Conflict of interest statementConflicts of Interest: None declared.
FiguresFigure 1
NYAHS sampling and original data…
Figure 1
NYAHS sampling and original data collection design. CATI: computer-assisted telephone interview; NYAHS: National…
Figure 1NYAHS sampling and original data collection design. CATI: computer-assisted telephone interview; NYAHS: National Young Adult Health Survey; RDD: random digit dialing.
Figure 2
Cigarette smoking prevalence, NYAHS vs…
Figure 2
Cigarette smoking prevalence, NYAHS vs NHIS. BA: Bachelor of Arts; BS: Bachelor of…
Figure 2Cigarette smoking prevalence, NYAHS vs NHIS. BA: Bachelor of Arts; BS: Bachelor of Science; NHIS: National Health Interview Survey (2018); NYAHS: National Young Adult Health Survey (2018).
Similar articlesSoullier N, Legleye S, Richard JB. Soullier N, et al. BMC Med Res Methodol. 2022 Apr 3;22(1):94. doi: 10.1186/s12874-022-01573-1. BMC Med Res Methodol. 2022. PMID: 35369861 Free PMC article.
L'Engle K, Sefa E, Adimazoya EA, Yartey E, Lenzi R, Tarpo C, Heward-Mills NL, Lew K, Ampeh Y. L'Engle K, et al. PLoS One. 2018 Jan 19;13(1):e0190902. doi: 10.1371/journal.pone.0190902. eCollection 2018. PLoS One. 2018. PMID: 29351349 Free PMC article.
Barr ML, van Ritten JJ, Steel DG, Thackway SV. Barr ML, et al. BMC Med Res Methodol. 2012 Nov 22;12:177. doi: 10.1186/1471-2288-12-177. BMC Med Res Methodol. 2012. PMID: 23173849 Free PMC article.
ZuWallack R, Jans M, Brassell T, Bailly K, Dayton J, Martinez P, Patterson D, Greenfield TK, Karriker-Jaffe KJ. ZuWallack R, et al. J Surv Stat Methodol. 2022 Nov 2;11(5):1089-1109. doi: 10.1093/jssam/smac028. eCollection 2023 Nov. J Surv Stat Methodol. 2022. PMID: 38028817 Free PMC article. Review.
Gibson DG, Pereira A, Farrenkopf BA, Labrique AB, Pariyo GW, Hyder AA. Gibson DG, et al. J Med Internet Res. 2017 May 5;19(5):e139. doi: 10.2196/jmir.7428. J Med Internet Res. 2017. PMID: 28476725 Free PMC article. Review.
Mercincavage M, Chen C, Trenholm I, Gonsalves NJ, Young WJ, Bover Manderski MT, Patel MS, O'Connor MK, Gundersen D, Delnevo CD, Steinberg MB. Mercincavage M, et al. Prev Med Rep. 2024 Jul 22;45:102834. doi: 10.1016/j.pmedr.2024.102834. eCollection 2024 Sep. Prev Med Rep. 2024. PMID: 39156724 Free PMC article.
Paytubi S, Benavente Y, Montoliu A, Binefa G, Brotons M, Ibáñez R, Ochoa C, Peremiquel-Trillas P, Serrano B, Travier N, Alemany L, Costas L. Paytubi S, et al. BMJ. 2022 Dec 21;379:e072561. doi: 10.1136/bmj-2022-072561. BMJ. 2022. PMID: 36543351 Free PMC article.
Yan T, Wivagg J, Young WJ, Delnevo CD, Gundersen DA. Yan T, et al. Surv Res Methods. 2023 Dec 22;17(4):509-517. doi: 10.18148/srm/2023.v17i4.8128. Surv Res Methods. 2023. PMID: 38895588 Free PMC article.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.3