TY  - RPRT
T1  - Effects of a Government-Academic Partnership: Has the NSF-Census Bureau Research Network Helped Secure the Future of the Federal Statistical System?
Y1  - 2017
A1  - Weinberg, Daniel
A1  - Abowd, John M.
A1  - Belli, Robert F.
A1  - Cressie, Noel
A1  - Folch, David C.
A1  - Holan, Scott H.
A1  - Levenstein, Margaret C.
A1  - Olson, Kristen M.
A1  - Reiter, Jerome P.
A1  - Shapiro, Matthew D.
A1  - Smyth, Jolene
A1  - Soh, Leen-Kiat
A1  - Spencer, Bruce
A1  - Spielman, Seth E.
A1  - Vilhuber, Lars
A1  - Wikle, Christopher
AB  - <p>Effects of a Government-Academic Partnership: Has the NSF-Census Bureau Research Network Helped Secure the Future of the Federal Statistical System? Weinberg, Daniel; Abowd, John M.; Belli, Robert F.; Cressie, Noel; Folch, David C.; Holan, Scott H.; Levenstein, Margaret C.; Olson, Kristen M.; Reiter, Jerome P.; Shapiro, Matthew D.; Smyth, Jolene; Soh, Leen-Kiat; Spencer, Bruce; Spielman, Seth E.; Vilhuber, Lars; Wikle, Christopher The National Science Foundation-Census Bureau Research Network (NCRN) was established in 2011 to create interdisciplinary research nodes on methodological questions of interest and significance to the broader research community and to the Federal Statistical System (FSS), particularly the Census Bureau. The activities to date have covered both fundamental and applied statistical research and have focused at least in part on the training of current and future generations of researchers in skills of relevance to surveys and alternative measurement of economic units, households, and persons. This paper discusses some of the key research findings of the eight nodes, organized into six topics: (1) Improving census and survey data collection methods; (2) Using alternative sources of data; (3) Protecting privacy and confidentiality by improving disclosure avoidance; (4) Using spatial and spatio-temporal statistical modeling to improve estimates; (5) Assessing data cost and quality tradeoffs; and (6) Combining information from multiple sources. It also reports on collaborations across nodes and with federal agencies, new software developed, and educational activities and outcomes. The paper concludes with an evaluation of the ability of the FSS to apply the NCRN’s research outcomes and suggests some next steps, as well as the implications of this research-network model for future federal government renewal initiatives. This paper began as a May 8, 2015 presentation to the National Academies of Science’s Committee on National Statistics by two of the principal investigators of the National Science Foundation-Census Bureau Research Network (NCRN) – John Abowd and the late Steve Fienberg (Carnegie Mellon University). The authors acknowledge the contributions of the other principal investigators of the NCRN who are not co-authors of the paper (William Block, William Eddy, Alan Karr, Charles Manski, Nicholas Nagle, and Rebecca Nugent), the co- principal investigators, and the comments of Patrick Cantwell, Constance Citro, Adam Eck, Brian Harris-Kojetin, and Eloise Parker. We note with sorrow the deaths of Stephen Fienberg and Allan McCutcheon, two of the original NCRN principal investigators. The principal investigators also wish to acknowledge Cheryl Eavey’s sterling grant administration on behalf of the NSF. The conclusions reached in this paper are not the responsibility of the National Science Foundation (NSF), the Census Bureau, or any of the institutions to which the authors belong</p>
PB  - NCRN Coordinating Office
UR  - http://hdl.handle.net/1813/52650
ER  - 

TY  - ABST
T1  - Data management and analytic use of paradata: SIPP-EHC audit trails
Y1  - 2016
A1  - Lee, Jinyoung
A1  - Seloske, Ben
A1  - Córdova Cazar, Ana Lucía
A1  - Eck, Adam
A1  - Kirchner, Antje
A1  - Belli, Robert F.
ER  - 

TY  - RPRT
T1  - NCRN Meeting Spring 2016: The ATUS and SIPP-EHC: Recent Developments
Y1  - 2016
A1  - Belli, Robert F.
AB  - NCRN Meeting Spring 2016: The ATUS and SIPP-EHC: Recent Developments Belli, Robert F. One of the main objectives of the NCRN award to the University of Nebraska node is to investigate data quality associated with timeline interviewing as conducted with the American Time Use Survey (ATUS) time diary and the Survey of Income and Program Participation event history calendar (SIPP-EHC). Specifically, our efforts are focused on the relationships between interviewing dynamics as extracted from analyses of paradata with measures of data quality. With the ATUS, our recent efforts have revealed that respondents differ in how they handle difficulty with remembering activities, with some overcoming these difficulties and others succumbing to them. With the SIPP-EHC, we are still in the initial stages of extracting variables from the paradata that are associated with interviewing dynamics. Our work has also involved the development of a CATI time diary in which we are able to analyze audio streams to capture interviewing dynamics. I will conclude this talk by discussing challenges that have yet to be overcome with our work, and our vision of moving forward with the eventual development of self-administered timeline instruments that will be respondent-friendly due to the assistance of intelligent-agent driven virtual interviewers. Presented at the NCRN Meeting Spring 2016 in Washington DC on May 9-10, 2016; see http://www.ncrn.info/event/ncrn-spring-2016-meeting
PB  - University of Nebraska
UR  - http://hdl.handle.net/1813/43893
ER  - 

TY  - JOUR
T1  - Using Data Mining to Predict the Occurrence of Respondent Retrieval Strategies in Calendar Interviewing: The Quality of Retrospective Reports
JF  - Journal of Official Statistics
Y1  - 2016
A1  - Belli, Robert F.
A1  - Miller, L. Dee
A1  - Baghal, Tarek Al
A1  - Soh, Leen-Kiat
AB  - Determining which verbal behaviors of interviewers and respondents are dependent on one another is a complex problem that can be facilitated via data-mining approaches. Data are derived from the interviews of 153 respondents of the Panel Study of Income Dynamics (PSID) who were interviewed about their life-course histories. Behavioral sequences of interviewer-respondent interactions that were most predictive of respondents spontaneously using parallel, timing, duration, and sequential retrieval strategies in their generation of answers were examined. We also examined which behavioral sequences were predictive of retrospective reporting data quality as shown by correspondence between calendar responses with responses collected in prior waves of the PSID. The verbal behaviors of immediately preceding interviewer and respondent turns of speech were assessed in terms of their co-occurrence with each respondent retrieval strategy. Interviewers’ use of parallel probes is associated with poorer data quality, whereas interviewers’ use of timing and duration probes, especially in tandem, is associated with better data quality. Respondents’ use of timing and duration strategies is also associated with better data quality and both strategies are facilitated by interviewer timing probes. Data mining alongside regression techniques is valuable to examine which interviewer-respondent interactions will benefit data quality.
VL  - 32
IS  - 3
ER  - 

TY  - JOUR
T1  - Parallel Associations and the Structure of Autobiographical Knowledge
JF  - Journal of Applied Research in Memory and Cognition
Y1  - 6
A1  - Belli, Robert F.
A1  - Al Baghal, Tarek
KW  - Autobiographical knowledge
KW  - Autobiographical memory
KW  - Autobiographical periods
KW  - Episodic memory
KW  - Retrospective reports
AB  - The self-memory system (SMS) model of autobiographical knowledge conceives that memories are structured thematically, organized both hierarchically and temporally. This model has been challenged on several fronts, including the absence of parallel linkages across pathways. Calendar survey interviewing shows the frequent and varied use of parallel associations in autobiographical recall. Parallel associations in these data are commonplace, and are driven more by respondents’ generative retrieval than by interviewers’ probing. Parallel associations represent a number of autobiographical knowledge themes that are interrelated across life domains. The content of parallel associations is nearly evenly split between general and transitional events, supporting the importance of transitions in autographical memory. Associations in respondents’ memories (both parallel and sequential), demonstrate complex interactions with interviewer verbal behaviors during generative retrieval. In addition to discussing the implications of these results to the SMS model, implications are also drawn for transition theory and the basic-systems model.
VL  - 5
SN  - 2211-3681
UR  - http://www.sciencedirect.com/science/article/pii/S2211368116300183
IS  - 2
ER  - 

TY  - CHAP
T1  - Calendar and time diary methods: The tools to assess well-being in the 21st century
T2  - Handbook of research methods in health and social sciences
Y1  - 0
A1  - Córdova Cazar, Ana Lucía
A1  - Belli, Robert F.
ED  - Liamputtong, P
JF  - Handbook of research methods in health and social sciences
PB  - Springer
ER  - 

TY  - ABST
T1  - Does relation of retrieval pathways to data quality differ by self or proxy response status?
Y1  - 0
A1  - Lee, Jinyoung
A1  - Belli, Robert F.
ER  - 

TY  - ABST
T1  - Evaluating Data quality in Time Diary Surveys Using Paradata
Y1  - 0
A1  - Córdova Cazar, Ana Lucía
A1  - Belli, Robert F.
ER  - 

TY  - ABST
T1  - An evaluation study of the use of paradata to enhance data quality in the American Time Use Survey (ATUS)
Y1  - 0
A1  - Córdova Cazar, Ana Lucía
A1  - Belli, Robert F.
ER  - 

TY  - ABST
T1  - Memory Gaps in the American Time Use Survey. Are Respondents Forgetful or is There More to it?
Y1  - 0
A1  - Kirchner, Antje
A1  - Belli, Robert F.
A1  - Deal, Caitlin E.
A1  - Córdova-Cazar, Ana Lucia
ER  - 

TY  - ABST
T1  - Using audit trails to evaluate an event history calendar survey instrument
Y1  - 0
A1  - Lee, Jinyoung
A1  - Seloske, Ben
A1  - Belli, Robert F.
ER  - 

TY  - ABST
T1  - Working with the SIPP-EHC audit trails:  Parallel and sequential retrieval
Y1  - 0
A1  - Lee, Jinyoung
A1  - Seloske, Ben
A1  - Córdova Cazar, Ana Lucía
A1  - Eck, Adam
A1  - Belli, Robert F.
ER  -