Skip to Main Content
 
  
The National Academies of Sciences, Engineering and Medicine
Committee on National Statistics
Division of Behavioral and Social Sciences and Education
 Consensus Study 
Transparency and Reproducibility of Federal Statistics for the National Center for Science and Engineering Statistics
    
 
Project Description 

An ad hoc panel will study issues of documentation and archiving of statistical data products for the National Science Foundation's National Center for Science and Engineering Statistics (NCSES). The desired objective is to enable NCSES to enhance the transparency and reproducibility of the agency's statistics and facilitate improvement of the statistical program workflow processes of the agency and its contractors. The panel will consider such issues as:

(1) What documentation and archiving guidance, standards, and tools currently exist to assist NCSES to facilitate transparency and reproducibility? Which ones are most useful and feasible to implement? For censuses and sample surveys? For administrative records? For statistics that may be based on combinations of these and other data sources?
(2) In what ways can the costs of transparency for NCSES and its data users be minimized and the benefits maximized?
(3) How can NCSES obtain value from saving and using the history of statistical program workflow processes to facilitate validation and to guide improvement over time in various processes, such as editing and imputation?
(4) What are best practices to foster transparency internal to NCSES through more comprehensive documentation and archiving of methods and data?
(5) What are best practices to foster transparency external to NCSES while maintaining an appropriate degree of disclosure control for confidential microdata?
(6) What requirements for documentation and archiving standards and tools should NCSES include in contracts with data collectors, such as the U.S. Census Bureau and private survey firms?
(7) What are feasible implementation steps toward better documentation and archiving for NCSES in the next 2-3 years? What should be the goals for a longer term R&D effort in this area?
(8) How can NCSES work with other federal statistical agencies to facilitate adoption of documentation and archiving standards and tools in common?

Meetings of the Committee

Meeting 1 | May 21, 2019
Keck Center, Room 100 
500 5th Street NW
Washington, DC 20001
Agenda
Presentations


Meeting 2 | September 9, 2019
Keck Center, Room 100
500 5th Street NW
Washington, DC 20001
Agenda
Presentations


Meeting 3 | November 5, 2019

Keck Center, Room 208
500 5th Street NW
Washington, DC 20001
Presentations


 

Staff Information
 

Michael Cohen, Senior Program Officer 
Michael Siri, Associate Program Officer
Jillian Kaufman, Senior Program Assistant 
 


Sponsors
 
National Science Foundation
National Center for Science and Engineering Statistics 

 

Committee Members
 
Daniel Kasprzyk, Chair
Philip Ashlock
David Barraclough
Christopher Chapman
Daniel W. Gillman
Linda A. Jacobsen
H. V. Jagadish
Frauke Kreuter
Margaret Levenstein
Peter V. Miller
Audris Mockus
Sarah M. Nusser
Eric Rancourt
William L. Scherlis
Lars Vilhuber


See committee bios



   Contact

For more information, please contact:

Jillian Kaufman 
JKaufman@nas.edu

Mailing Address
Keck Center W1116
500 Fifth Street, NW
Washington, DC 20001


 
 
 
 
 
 
 
 




 


 



CNSTAT Home About CNSTAT CNSTAT Members CNSTAT Staff CNSTAT Mission Other Sites of Interest News and Events Upcoming Events CNSTAT News Public Seminars and Symposia Our Work Approaches to Estimating the Prevalence of Human Trafficking in the US Challenges and New Approaches for Protecting Privacy in Federal Statistical Programs Contingent Work and Alternate Work Arrangements Developing Indicators of Educational Equity Transparency and Reproducibility of Federal Statistics for the National Center for Science and Engineering Statistics Using Models to Estimate Hog Production Workshop on Improving the American Community Survey Workshop on Social Science Modeling for Big Data in the World of Machine Learning Principles and Practices for a Federal Statistical Agency People, Projects, and Publications 2018-2019 Presentations from Meetings and Workshops Publications CNSTAT Reports Principles and Practices (P&P) Work With Us Our Study Process Study Process Brochure Getting to Know the Committee Process Overview for Sponsors Guide for Study Sponsors