Consistency of data collected through online life history calendars
The collection of longitudinal data is crucial in some domains such as life course studies. However, prospective studies are considerably costly, and thus retrospective data are an appealing alternative. A life history calendar is a tool specifically conceived to collect retrospective data. However, although it is designed to enhance the recall process of the respondents, the accuracy of the data collected through this approach remains unknown, particularly when data is collected online. In this study, we conducted a secondary analysis of data collected from n = 5,181 respondents through an online survey regarding their sexual health. Because we inquired about the occurrence of certain events twice during the survey, once using a life calendar and once through a traditional questionnaire, we were able to perform three types of consistency checks: (1) reporting of single events, (2) age when the events occurred and (3) correct timing between two events. The main results indicated that it is generally more difficult to remember the exact age of occurrence of an event than the event itself, that the report of related events is generally coherent, and that women are generally more accurate in their answers than men. Based on our results, it is therefore possible to identify a subset of persons whose answers are more consistent throughout the survey. This study also shows that data obtained through an online life history calendar can be of a quality similar to that obtained through a traditional online questionnaire.
-
Barrense-Dias, Y., Akre, C., Berchtold, A., Leeners, B., Morselli, D. and Suris, J.-C. (2018) Sexual Health and Behavior of Young People in Switzerland (No. 291; Raisons de Santé). Institut universitaire de médecine sociale et préventive. https://www.iumsp.ch/Publications/pdf/rds291_fr.pdf
-
Belli, R.F. (1998) The structure of autobiographical memory and the event history calendar: potential improvements in the quality of retrospective reports in surveys, Memory, 6(4): 383–406. doi: 10.1080/741942610
-
Belli, R.F., Lee, E.H., Stafford, F.P. and Chou, C.H. (2004) Calendar and Question-list survey methods: association between interviewer behaviors and data quality, Journal of Official Statistics, 20(2): 185–218.
-
Belli, R.F., Shay, W.L. and Stafford, F.P. (2001) Event history calendars and question list surveys: a direct comparison of interviewing methods, Public Opinion Quarterly, 65(1): 45–74. doi: 10.1086/320037
-
Belli, R.F., Smith, L.M., Andreski, P.M. and Agrawal, S. (2007) Methodological comparisons between CATI event history calendar and standardized conventional questionnaire instruments, Public Opinion Quarterly, 71(4): 603–22. doi: 10.1093/poq/nfm045
-
Bergman, L.R., Eklund, G. and Magnusson, D. (1991) Studying individual development: problems and methods, in D. Magnusson, L.R. Bergman, G. Rudinger and B. Torestad (eds) Problems and Methods in Longitudinal Research: Stability and Change, Cambridge: Cambridge University Press, pp 1–27.
-
Bilgen, I. and Belli, R.F. (2010) Comparison of verbal behaviors between calendar and standardized conventional questionnaires, Journal of Official Statistics, 26(3): 481–505.
-
Bradburn, N.M., Rips, L.J. and Shevell, S.K. (1987) Answering autobiographical questions: the impact of memory and inference on surveys, Science, 236(4798): 157–61. doi: 10.1126/science.3563494
-
Brüderl, J., Castiglioni, L., Ludwig, V., Pforr, K. and Schmiedeberg, C. (2017) Collecting event history data with a panel survey: combining an electronic event history calendar and dependent interviewing, Methods, Data, Analyses, 11(1): 45–66.
-
Callegaro, M., Yu, M., Cheng, F.W., Hjermstad, E., Liao, D. and Belli, R.F. (2005) Comparison of computerized event history calendar and question-list interviewing methods: a two-year hospitalization history study, in 2004 Proceedings of the American Statistical Association, 59th Annual Conference of the American Association for Public Opinion Research, Alexandria, VA: American Statistical Association, pp 4746–53.
-
Caspi, A., Moffitt, T.E., Thornton, A., Freedman, D., Amell, J.W., Harrington, H., Smeijers, J. and Silva, P.A. (1996) The life history calendar: a research and clinical assessment method for collecting retrospective Event-history data, International Journal of Methods in Psychiatric Research, 6(2): 101–14. doi: 10.1002/(SICI)1234-988X(199607)6:2<101::AID-MPR156>3.3.CO;2-E
-
Conway, M.A. (1996) Autobiographical knowledge and autobiographical memories, in D.C. Rubin (ed) Remembering our Past: Studies in Autobiographical Memory, Cambridge: Cambridge University Press, pp 67–93.
-
Dijkstra, W., Smit, J.H. and Ongena, Y.P. (2009) An evaluation study of the event history calendar, in R.F. Belli, F.P. Stafford and D.F. Alwin (eds) Calendar and Time Diary Methods in Life Course Research, Thousand Oaks, CA: Sage, pp 257–75.
-
Engel, L.S., Keifer, M.C. and Zahm, S.H. (2001) Comparison of a traditional questionnaire with an icon/calendar-based questionnaire to assess occupational history, American Journal of Industrial Medicine, 40(5): 502–11. doi: 10.1002/ajim.1118
-
Freedman, D., Thornton, A., Camburn, D., Alwin, D. and Young-DeMarco, L. (1988) The life history calendar: a technique for collecting retrospective data, Sociological Methodology, 18: 37–68. doi: 10.2307/271044
-
Glasner, T., van der Vaart, W. and Dijkstra, W. (2015) Calendar instruments in retrospective web surveys, Field Methods, 27(3): 265–83. doi: 10.1177/1525822X14554882
-
Groves, R.M. (2006) Nonresponse rates and nonresponse bias in household surveys, Public Opinion Quarterly, 70(5): 646–75. doi: 10.1093/poq/nfl033
-
Herz, R.S. and Schooler, J.W. (2002) A naturalistic study of autobiographical memories evoked by olfactory and visual cues: testing the Proustian hypothesis, The American Journal of Psychology, 115(1): 21–32. doi: 10.2307/1423672
-
Janssen, S.M.J., Chessa, A.G. and Murre, J.M.J. (2006) Memory for time: how people date events, Memory & Cognition, 34(1): 138–47.
-
Johnson, E.O. and Schultz, L. (2005) Forward telescoping bias in reported age of onset: an example from cigarette smoking, International Journal of Methods in Psychiatric Research, 14(3): 119–29. doi: 10.1002/mpr.2
-
Kazemian, L. and Farrington, D.P. (2005) Comparing the validity of prospective, retrospective, and official onset for different offending categories, Journal of Quantitative Criminology, 21(2): 127–47. doi: 10.1007/s10940-005-2489-0
-
Loftus, E.F. and Marburger, W. (1983) Since the eruption of Mt. St. Helens, has anyone beaten you up? Improving the accuracy of retrospective reports with landmarkevents, Memory & Cognition, 11(2): 114–20.
-
Luke, N., Clark, S. and Zulu, E.M. (2011) The relationship history calendar: improving the scope and quality of data on youth sexual behavior, Demography, 48(3): 1151–76. doi: 10.1007/s13524-011-0051-2
-
Mathiowetz, N. and Duncan, G. (1988) Out of work, out of mind: response errors in retrospective reports of unemployment, Journal of Business & Economic Statistics, 6(2): 221–9.
-
McHugh, R.K., Votaw, V.R., Sugarman, D.E. and Greenfield, S.F. (2018) Sex and gender differences in substance use disorders, Clinical Psychology Review, Dec;66: 12–23. doi: 10.1016/j.cpr.2017.10.012
-
Morselli, D., Le Goff, J.M. and Gauthier, J.-A. (2019) Self-administered event history calendars: a possibility for surveys?, Contemporary Social Science, 14(3-4): 423-446, doi: 10.1080/21582041.2017.1418528
-
Morselli, D., Berchtold, A., Suris, J.-C. and Berchtold, A. (2016) On-line life history calendar and sensitive topics: A pilot study, Computers in Human Behavior, 58: 141–149. https://doi.org/10.1016/j.chb.2015.12.068
-
Neter, J. and Waksberg, J. (1964) A study of response errors in expenditures data from household interviews, Journal of the American Statistical Association, 59(305): 18–55. doi: 10.1080/01621459.1964.10480699
-
Petersen, J.L. and Hyde, J.S. (2010) A meta-analytic review of research on gender differences in sexuality, 1993–2007, Psychological Bulletin, 136(1): 21–38,. doi: 10.1037/a0017504
-
R Core Team (2018) R: A Language and Environment for Statistical Computing [online], Vienna: R Foundation for Statistical Computing, https://www.r-project.org/.
-
Reuben, A., Moffitt, T.E., Caspi, A., Belsky, D.W., Harrington, H., Schroeder, F., Hogan, S., Ramrakha, S., Poulton, R. and Danese, A. (2016) Lest we forget: comparing retrospective and prospective assessments of adverse childhood experiences in the prediction of adult health, Journal of Child Psychology and Psychiatry, 57(10): 1103–12. doi: 10.1111/jcpp.12621
-
RStudio Team (2016) RStudio: Integrated Development Environment for R [online], Boston, MA: RStudio, https://www.rstudio.com/.
-
Schatz, E., Knight, L., Belli, R.F. and Mojola, S.A. (2020) Assessing the feasibility of a life history calendar to measure HIV risk and health in older South Africans, PLOS ONE, 15(1):1–15 art e0226024, https://doi.org/10.1371/journal.pone.0226024. doi: 10.1371/journal.pone.0226024
-
Schlinkmann, K.M., Bakuli, A. and Mikolajczyk, R. (2017) Incidence and comparison of retrospective and prospective data on respiratory and gastrointestinal infections in German households, BMC Infectious Diseases, 17(1):1–8 art 336, https://doi.org/10.1186/s12879-017-2434-5. doi: 10.1186/s12879-017-2434-5
-
Shum, M.S. (1998) The role of temporal landmarks in autobiographical memory processes, Psychological Bulletin, 124(3): 423–42. doi: 10.1037/0033-2909.124.3.423
-
Thompson, C.P., Skowronski, J.J. and Lee, D.J. (1988) Telescoping in dating naturally occurring events, Memory & Cognition, 16(5): 461–8.
-
Voorpostel, M. (2010) Attrition patterns in the Swiss Household Panel by demographic characteristics and social involvement, Swiss Journal of Sociology, 36(2): 359–77.
-
Watson, N. and Wooden, M. (2009) Identifying factors affecting longitudinal survey response, in P. Lynn (ed) Methodology of Longitudinal Surveys [online], Chichester: John Wiley, pp 157–81, https://doi.org/10.1002/9780470743874.ch10.
-
Wieczorek, L.L., Tata, C.S., Penke, L. and Gerlach, T.M. (2020) Online implementation of an event history calendar with formr: a tutorial, Personal Relationships, 27(1): 176–208. doi: 10.1111/pere.12305
-
Yoshihama, M., Gillespie, B., Hammock, A.C., Belli, R.F. and Tolman, R.M. (2005) Does the life history calendar method facilitate the recall of intimate partner violence? Comparison of two methods of data collection, Social Work Research, 29(3): 151–63. doi: 10.1093/swr/29.3.151
| May 2022 onwards | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 1491 | 1486 | 33 |
| Full Text Views | 46 | 45 | 0 |
| PDF Downloads | 49 | 48 | 0 |
We are a leading social science publisher
committed to making a difference.
Bristol University Press and
Policy Press
bristoluniversitypress.co.uk