Federal government statistics provide critical information to the country and serve a key role in a democracy. For decades, sample surveys with instruments carefully designed for particular data needs have been one of the primary methods for collecting data for federal statistics. However, the costs of conducting such surveys have been increasing while response rates have been declining, and many surveys are not able to fulfill growing demands for more timely information and for more detailed information at state and local levels.

Innovations in Federal Statistics examines the opportunities and risks of using government administrative and private sector data sources to foster a paradigm shift in federal statistical programs that would combine diverse data sources in a secure manner to enhance federal statistics. This first publication of a two-part series discusses the challenges faced by the federal statistical system and the foundational elements needed for a new paradigm.

Contents

• The National Academies of SCIENCES • ENGINEERING • MEDICINE
• PANEL ON IMPROVING FEDERAL STATISTICS FOR POLICY AND SOCIAL SCIENCE RESEARCH USING MULTIPLE DATA SOURCES AND STATE-OF-THE-ART ESTIMATION METHODS
• COMMITTEE ON NATIONAL STATISTICS
• Acknowledgments
• Executive Summary
• 1. Introduction
  • FEDERAL STATISTICS AND EVIDENCE-BASED POLICY MAKING
  • PANEL CHARGE AND ACTIVITIES
  • OVERVIEW OF THE REPORT
• 2. Current Challenges and Opportunities in Federal Statistics
  • THE U.S. FEDERAL STATISTICAL SYSTEM
  • THE IMPORTANCE OF FEDERAL STATISTICS
  • THE SAMPLE SURVEY PARADIGM
  • THREATS TO THE SURVEY PARADIGM
  • INCREASING DEMANDS FOR MORE DETAILED AND MORE TIMELY INFORMATION
• 3. Using Government Administrative and Other Data for Federal Statistics
  • BENEFITS
  • USE OF ADMINISTRATIVE RECORDS BY OTHER NATIONAL STATISTICAL OFFICES
  • ACCESS TO AND USE OF ADMINISTRATIVE DATA BY FEDERAL STATISTICAL AGENCIES
  • STATE AND LOCAL GOVERNMENT ADMINISTRATIVE DATA FOR FEDERAL STATISTICS
  • CHALLENGES IN USING ADMINISTRATIVE DATA FOR FEDERAL STATISTICS
  • OTHER GOVERNMENT DATA SOURCES
  • COMBINING SURVEY AND ADMINISTRATIVE DATA SOURCES
• 4. Using Private-Sector Data for Federal Statistics
  • DIMENSIONS OF NEW DATA SOURCES
  • USING PRIVATE-SECTOR DATA SOURCES FOR STATISTICS
  • CHALLENGES TO USING PRIVATE-SECTOR DATA SOURCES FOR FEDERAL STATISTICS
• 5. Protecting Privacy and Confidentiality While Providing Access to Data for Research Use
  • TENSION BETWEEN PRIVATE LIVES AND PUBLIC POLICIES
  • RISKS OF ACCESS
  • LEGAL FOUNDATION FOR PRIVACY AND CONFIDENTIALITY
  • APPROACHES TO PROTECTING PRIVACY
• 6. Advancing the Paradigm of Combining Data Sources
  • USING ADMINISTRATIVE RECORDS AND OTHER SOURCES OF DATA FOR FEDERAL STATISTICS
  • DATA ACCESS AND DATA SHARING
  • PROTECTING PRIVACY
  • ASSESSING DATA QUALITY AND FITNESS FOR USE
• References
• APPENDIXES
  • Appendix A. Workshop Agendas
  • Appendix B. Biographical Sketches of Panel Members and Staff
• COMMITTEE ON NATIONAL STATISTICS

Suggested citation:

National Academies of Sciences, Engineering, and Medicine. (2017). Innovations in Federal Statistics: Combining Data Sources While Protecting Privacy. Washington, DC: The National Academies Press. doi: 10.17226/24652.