Science and Technology Policy: Reports

Ensuring the Integrity, Accessibility, and Stewardship of Research Data in the Digital Age (prepublication)
As digital technologies are expanding the power and reach of research, they are also raising complex issues. These include complications in ensuring the validity of research data; standards that do not keep pace with the high rate of innovation; restrictions on data sharing that reduce the ability of researchers to verify results and build on previous research; and huge increases in the amount of data being generated, creating severe challenges in preserving that data for long-term use.

Ensuring the Integrity, Accessibility, and Stewardship of Research Data in the Digital Age examines the consequences of the changes affecting research data with respect to three issues - integrity, accessibility, and stewardship-and finds a need for a new approach to the design and the management of research projects. The report recommends that all researchers receive appropriate training in the management of research data, and calls on researchers to make all research data, methods, and other information underlying results publicly accessible in a timely manner. The book also sees the stewardship of research data as a critical long-term task for the research enterprise and its stakeholders. Individual researchers, research institutions, research sponsors, professional societies, and journals involved in scientific, engineering, and medical research will find this book an essential guide to the principles affecting research data in the digital age. 

On Being a Scientist: Third Edition (2009)
On Being a Scientist was designed to supplement the informal lessons in ethics provided by research supervisors and mentors. The book describes the ethical foundations of scientific practices and some of the personal and professional issues that researchers encounter in their work. It applies to all forms of research--whether in academic, industrial, or governmental settings-and to all scientific disciplines.

This third edition of On Being a Scientist reflects developments since the publication of the original edition in 1989 and a second edition in 1995. A continuing feature of this edition is the inclusion of a number of hypothetical scenarios offering guidance in thinking about and discussing these scenarios.  

Evaluation of the Reference Manual on Scientific Evidence: Letter Report (2009)
At the request of the Federal Judicial Center, the Committee on Science, Technology, and Law is developing the third edition of the federal judges' Reference Manual on Scientific Evidence. This brief report describes the results of an assessment done to collect user comments on the first and second editions of the Reference manual, as well as suggestions for the third edition. These comments and suggestions on format, audience, and content will be used to guide the development of the third edition.

Evaluating Research Efficiency in the U.S. Environmental Protection Agency (2008)
A new report from the National Research Council recommends changes in how the federal government evaluates the efficiency of research at EPA and other agencies. Assessing efficiency should be considered only one part of gauging a program's quality, relevance, and effectiveness. The efficiency of research processes and that of investments should be evaluated using different approaches.  Investment efficiency should examine whether an agency's R&D portfolio, including the budget, is relevant, of high quality, matches the agency's strategic plan.  These evaluations require panels of experts.  In contrast, process efficiency should focus on "inputs" (the people, funds, and facilities dedicated to research) and "outputs" (the services, grants, publications, monitoring, and new techniques produced by research), as well as their timelines and should be evaluated using quantitative measures.  The committee recommends that the efficiency of EPA's research programs be evaluated according to the same standards used at other agencies. To ensure this, OMB should train and oversee its budget examiners so that the PART questionnaire is implemented consistently and equitably across agencies.
Committee on Science, Engineering, and Public Policy (COSEPUP)

  Innovation Policies for the 21st Century: Report of a Symposium (2007)
To mark the opening of a study of Comparative Innovation Policy: Best Practice for the 21st Century the Board on Science, Technology, and Economic Policy (STEP) convened a symposium providing an overview of areas to be examined in the study and topics requiring further policy attention. The event highlighted the policies and programs of leading nations and provided valuable insights into some of the common challenges of growing and supporting high-technology industry and the commercialization of public investments in R&D. This report contains a summary of the symposium proceedings and an introduction analyzing the issues and placing them in a broader policy context.
Board on Science, Technology and Economic Policy (STEP)  

Advanced Research Instrumentation and Facilities (2006)
In recent years, the instrumentation needs of the nation’s research communities have changed and expanded. The need for particular instruments has become broader, crossing scientific and engineering disciplines. The growth of interdisciplinary research that focuses on problems defined outside the boundaries of individual disciplines demands more instrumentation. Instruments that were once of interest only to specialists are now required by a wide array of scientists to solve critical research problems. The need for entirely new types of instruments—such as distributed networks, cybertools, and sensor arrays—is increasing. Researchers are increasingly dependent on advanced instruments that require highly specialized knowledge and training for their proper operation and use.

The National Academies Committee on Science, Engineering, and Public Policy Committee on Advanced Research Instrumentation was asked to describe the current programs and policies of the major federal research agencies for advanced research instrumentation, the current status of advanced mid-sized research instrumentation on university campuses, and the challenges faced by each. The committee was then asked to evaluate the utility of existing federal programs and to determine the need for and, if applicable, the potential components of an interagency program for advanced research instrumentation. Committee on Science, Engineering, and Public Policy (COSEPUP)

  Strategies for Preservation of and Open Access to Scientific Data in China: Summary of a Workshop (2006)
Preservation of and open access to digital scientific resources are essential to global research, yet the challenges in storing and maintaining access to these collections are substantial. China faces major hurdles in this regard. A workshop held in June 2004 in Beijing convened scientific information managers, digital archiving experts, national science policy and funding officials, and representatives of development organizations to explore the scientific and technical, legal and policy, institutional and economic, and management aspects of creating sustainable and accessible archives of digital health and environmental data in China.
Board on International Scientific Organizations (BISO)  

Science and Technology in the National Interest: Ensuring the Best Presidential and Federal Advisory Committee Science and Technology Appointments (2005)
In 2004, an ad hoc committee was charged with preparing this third report examining the most senior S&T appointments to federal government positions and updating the accompanying list of the most urgent S&T presidential appointments. Sufficient changes have occurred since the National Academies 2000 report on presidential appointments—including the 2001 terrorist attacks, the anthrax deaths, the reorganization of homeland-security activities in the federal government, new developments in S&T, and concerns about the politicization of S&T decision making and advice—to warrant this new edition. In contrast with previous reports on the subject, this one covers not only presidential appointments to top S&T leadership positions but also the appointment of scientists, engineers, and health professionals to serve on federal advisory committees that focus on science-based policy or on the review of research proposals. The committee recognizes that other areas of federal responsibility are as important as S&T, but S&T appointments are the only ones within its purview.
Committee on Science, Engineering, and Public Policy (COSEPUP)  

Electronic Scientific, Technical, and Medical Journal Publishing and Its Implications: Proceedings of a Symposium (2004)
This report is the proceedings of a 2003 symposium on "Electronic Scientific, Technical, and Medical Journal Publishing and Its Implications," which brought together experts in STM publishing, both producers and users of these publications, to: (1) identify the recent technical changes in publishing, and other factors, that influence the decisions of journal publishers to produce journals electronically; (2) identify the needs of the scientific, engineering, and medical community as users of journals, whether electronic or printed; (3) discuss the responses of not-for-profit and commercial STM publishers and of other stakeholders in the STM community to the opportunities and challenges posed by the shift to electronic publishing; and (4) examine the spectrum of proposals that has been put forth to respond to the needs of users as the publishing industry shifts to electronic information production and dissemination.
Board on International Scientific Organizations (BISO)  

Electronic Scientific, Technical, and Medical Journal Publishing and Its Implications: Report of a Symposium (2004)
The Symposium on Electronic Scientific, Technical, and Medical (STM) Journals and Its Implications addressed five key areas. The first two—costs of publication and publication business models and revenue—focused on the STM publishing enterprise as it exists today and, in particular, how it has evolved since the advent of electronic publishing. This was followed by a review of copyright and licensing issues of concern to the authors and to universities. The final two sessions looked toward the future, specifically, at what publishing may be in the future and what constitutes a publication in the digital environment.
Board on International Scientific Organizations (BISO)  

Science and Technology in U.S. Foreign Assistance: Interim Report to the Administrator, U.S. Agency for International Development (2004)
This report provides the preliminary views on the critical role of science and technology (S&T) in development assistance by a committee that was established in accordance with a cooperative agreement between the U.S. Agency for International Development (USAID) and the NRC. The initial views of the committee were made available to the administrator or USAID to aid the administrator in making decisions concerning near-term steps that can be taken to strengthen the S&T capabilities of USAID and to integrate S&T more effectively into programs that are supported by USAID.
Development, Security, and Cooperation (DSC)

    Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation (2004)
In 1995, the National Science Foundation (NSF) created a special account to fund large (several tens of millions of dollars) research facilities. Over the years, these facilities have come to represent an increasingly prominent part of the nation’s R&D portfolio. Recently concern has intensified about the way NSF is selecting projects for this account. In 2003, six U.S. Senators including the chair and ranking member of the Senate Subcommittee on VA, HUD, and Independent Agencies Appropriations expressed these concerns in a letter to the NRC asking it to “review the current prioritization process and report to us on how it can be improved.” This report presents a series of recommendations on how NSF can improve its priority setting process for large research facilities. While noting that NSF has improved this process, the report states that further strengthening is needed if NSF is to meet future demands for such projects.
Committee on Science, Engineering, and Public Policy (COSEPUP)  

Ensuring the Quality of Data Disseminated by the Federal Government:Workshop Report (2003)
The National Academies Science, Technology, and Law Program convened three workshops focusing on specific aspects of OMB's "Guidelines for Ensuring and Maximizing the Quality, Objectivity, Utility, and Integrity of Information Disseminated by Federal Agencies." The workshops were intended to assist the agencies in developing their agency-specific implementation guidelines. This workshop report details the approaches agencies are considering using to implement the guidelines.
Committee on Science, Technology, and Law (STL)  

Access to Research Data in the 21st Century: An Ongoing Dialogue Among Interested Parties, Report of a Workshop (2002)
In the years since the Shelby Amendment, scientists, industry, and policy makers have struggled over how the public’s new right of access should be applied to scientific data. There is loose agreement that research data should be accessible, but wide disagreement over the “depth” to which the public has such a right. The National Academies’ Science, Technology, and Law Program held a workshop to explore the mounting tensions in the federal regulatory process between the need to provide access to research data and the need to protect the integrity of the research process. The workshop provided a picture of the debate arising from passage of the Shelby Amendment and the resulting OMB revisions of Circular A-110. This report is a summary of the workshop.
Committee on Science, Technology, and Law (STL)  

Defining the Mandate of Proteomics in the Post-Genomics Era: Workshop Report (2002)
Research in proteomics is the next logical step after genomics in understanding life processes at the molecular level. In the largest sense proteomics encompasses knowledge of the structure, function and expression of all proteins in the biochemical or biological contexts of all organisms. Since that is an impossible goal to achieve, at least in our lifetimes, it is appropriate to set more realistic, achievable goals for the field. Up to now, primarily for reasons of feasibility, scientists have tended to concentrate on accumulating information about the nature of proteins and their absolute and relative levels of expression in cells (the primary tools for this have been 2D gel electrophoresis and mass spectrometry). Although these data have been useful and will continue to be so, the information inherent in the broader definition of proteomics must also be obtained if the true promise of the growing field is to be realized. Acquiring this knowledge is the challenge for researchers in proteomics and the means to support these endeavors need to be provided. An attempt has been made to present the major issues confronting the field of proteomics and two clear messages come through in this report. The first is that the mandate of proteomics is and should be much broader than is frequently recognized. The second is that proteomics is much more complicated than sequencing genomes. This will require new technologies but it is highly likely that many of these will be developed. Looking back 10 to 20 years from now, the question is: Will we have done the job wisely or wastefully?  Board on International Scientific Organizations (BISO)