Skip to Main Content
 
  
The National Academies of Sciences, Engineering and Medicine
Committee on National Statistics
Division of Behavioral and Social Sciences and Education

Workshop on Transparency and Reproducibility in Federal Statistics

 

• AGENDA •
Workshop on Transparency and Reproducibility in Federal Statistics
June 21–22, 2017

The Keck Center of the National Academies
500 5th Street NW, Washington, DC 20001



Wednesday, June 21—Room 201


9:00 – 9:10 am (light breakfast available at 8:30am)
Introduction from the Sponsor
Amy Friedlander, National Science Foundation

9:10 – 9:45 am
Views of Transparency from the American Association for Public Opinion Research (AAPOR) and the U.S. Office of Management and Budget (OMB)
Chair: Graham Kalton, Westat and Steering Committee member
Speakers:
AAPOR Transparency Initiative: Peter Miller, U.S. Census Bureau
Relevant OMB Directives: Brian Harris-Kojetin, Committee on National Statistics

9:45 – 11:00 am
Benefits and Costs of Transparency: Views from Agencies
What are the Benefits? What are the Costs? What Does the Future Look Like in Terms of Threats by Private Competitors?
Chair: Susan Offutt, U.S. Government Accountability Office, retired, and Steering Committee member
Speakers:
Jennifer Madans, National Center for Health Statistics
Sally Thompson, Bureau of Economic Analysis
John Eltinge, U.S. Census Bureau

11:00 – 11:15 am Break

11:15 am – 12:15 pm
International View of Benefits and Costs, and Approaches Used for Transparency
Chair: William F. Eddy, Carnegie Mellon University and Steering Committee chair
Speakers:
Sarah Henry, United Kingdom Office for National Statistics
Peter Brodie, United Kingdom Office for National Statistics


12:15 – 1:15 pm Working Lunch, in Third Floor Cafeteria--to continue morning discussions

1:15 – 2:15 pm
International View of Benefits and Costs, and Approaches Used for Transparency (continued)
Chair: William F. Eddy, Carnegie Mellon University and Steering Committee chair
Speaker:
Eric Rancourt, Statistics Canada

2:15 – 3:00 pm
Case Studies: What Occurs Now Regarding Transparency?
Chair: Susan Offutt, U.S. Government Accountability Office, retired, and Steering Committee member
Speakers:
Small Area Income and Poverty Estimates (SAIPE): Wesley Basel, U.S. Census Bureau
Longitudinal Employer–Household Dynamics (LEHD): Robert Sienkiewicz, U.S. Census Bureau

3:00 – 4:30 pm
What Does Transparency (and Reproducibility) Mean Operationally?
Chair: Audris Mockus, University of Tennessee and Steering Committee member

Internal to an Agency—Reproducibility and Technology Transfer; Input Data Sources (Survey Data, Administrative Records Data, Other Sources); Documentation of Methods
Speaker:
John Eltinge, U.S. Census Bureau and Steering Committee member

External to an Agency—Building Trust; Benefits from Crowdsourcing; Input Data Sources; Documentation of Methods
Speakers:
Ruth Ann Killion, U.S. Census Bureau
Audris Mockus, University of Tennessee and Steering Committee member

4:30 – 4:50 pm Break

4:50 – 5:10 pm
Making Confidential Data Part of Reproducible Research
Lars Vilhuber, Cornell University

5:10 – 5:30 pm
What Does Reproducibility Mean for Federal Statistics? An Academic’s Perspective
H.V. Jagadish, University of Michigan

5:30 pm Adjourn for Dinner


Thursday, June 22—Room 201

9:00 – 9:30 am (light breakfast available at 8:30am)
Summary of Where We Are So Far
Chair: Graham Kalton, Westat and Steering Committee member
Speaker:
John Abowd, U.S. Census Bureau

9:30 – 11:20 am
Improving Transparency of Statistical Data with Standards for Metadata and Work Processes
Chair: William F. Eddy, Carnegie Mellon University and Steering Committee chair
Speakers:
Automating the Capture of Data Transformation Metadata: H.V. Jagadish, University of Michigan
Data Documentation Initiative (DDI): Daniel Gillman, Bureau of Labor Statistics
Statistical Data and Metadata Exchange (SDMX): David Barraclough, Organisation for Economic Co-operation and Development
Generic Statistical Information Model (GSIM): Michaela Denk, International Monetary Fund
Generic Statistical Business Process Model (GSBPM): Juan Muñoz, National Institute of Statistics and Geography (INEGI; Mexico)

11:20 am – 12:30 pm
Building Trust—Summarizing the Workshop
Benefits Due to Crowd Sourcing; Need for Governance; What Tools Look Most Promising; Outreach to the Public and to Analysts; Demands of Transparency; What is Feasible and What May Not Be?
Discussion Panelists:
John M. Abowd, U.S. Census Bureau
Hermann Habermann, Committee on National Statistics
Thomas A. Louis, Johns Hopkins University
William F. Eddy, Carnegie Mellon University and Steering Committee chair

12:30 – 1:30 pm Working Lunch, in Third Floor Cafeteria--to continue morning discussions

1:30 pm Adjournment


Workshop Invitees:

John M. Abowd, U.S. Census Bureau
David Barraclough, Organisation for Economic Co-operation and Development
Wesley Basel, U.S. Census Bureau
Pete Brodie, United Kingdom Office for National Statistics
Connie Citro, Committee on National Statistics
Michael Cohen, Committee on National Statistics
Michaela Denk, International Monetary Fund
William F. Eddy, Carnegie Mellon University
John Eltinge, U.S. Census Bureau
Amy Friedlander, National Science Foundation
Lucia Foster, U.S. Census Bureau
John Gawalt, National Center for Science and Engineering Statistics, National Science Foundation
Matt Graham, U.S. Census Bureau
Daniel Gillman, Bureau of Labor Statistics
Hermann Habermann, Committee on National Statistics
Brian Harris-Kojetin, Committee on National Statistics
Sarah Henry, United Kingdom Office for National Statistics
H.V. Jagadish, University of Michigan
Ron Jarmin, U.S. Census Bureau
Graham Kalton, Westat
Ruth Ann Killion, U.S. Census Bureau
Nancy Kingsbury, U.S. Government Accountability Office
Patricia Knezek, National Science Foundation
Carl Lagoze, University of Michigan
Margaret Levenstein, Inter-university Consortium for Political and Social Research
Thomas A. Louis, Johns Hopkins University
Jennifer Madans, National Center for Health Statistics
Erika McEntarfer, U.S. Census Bureau
Peter Miller, U.S. Census Bureau
Audris Mockus, University of Tennessee
Juan Muñoz, National Institute of Statistics and Geography (INEGI; Mexico)
Susan Offutt, U.S. Government Accountability Office (retired)
Eric Rancourt, Statistics Canada
Danielle Sandler, U.S. Census Bureau
Robert Sienkiewicz, U.S. Census Bureau
Michael Siri, Committee on National Statistics
Miron Straf, Social and Decision Analytics Laboratory, Virginia Tech
Victoria Stodden, University of Illinois at Urbana-Champaign
Sally Thompson, Bureau of Economic Analysis
Lars Vilhuber, Cornell University



Home BOHSI Home Home BOSE Home C-CAB Home BECS Home BCYF Home TAC Home Home BOTA Home CPOP Home CNSTAT Home CLAJ Home BBCSS Home About BOSE BOSE Mission BOSE Members BOSE Staff Our Sponsors Visiting our Buildings About BBCSS BBCSS History BBCSS Members BBCSS Staff Our Sponsors About CPOP CPOP Mission CPOP Members CPOP Staff About TAC TAC History TAC Members TAC Associates by State TAC Staff About CNSTAT CNSTAT Members CNSTAT Staff CNSTAT Mission Other Sites of Interest TEstTAc2 About BOTA BOTA Mission BOTA Members BOTA Staff Visiting Our Buildings About CLAJ CLAJ Mission CLAJ Members CLAJ Staff Other Sites of Interest About BECS BECS in Brief BECS Brochure BECS Statement of Task BECS Members BECS Staff About BCYF BCYF History BCYF Graphic Illustration BCYF Members BCYF Staff About BOHSI BOHSI History BOHSI Members BOHSI Staff Our Sponsors