Creating useful integrated data sets to inform public policy

The costs of traditional primary data collection have risen dramatically over the past decade. For example, the cost of the decennial census of population and housing, conducted by the U.S. Census Bureau, has risen from ;This research used two exploratory case studies to examine the creation of integrated data sets among three government agencies, the Internal Revenue Service (IRS), the U.S. Census Bureau (Census), and the Centers for Medicare and Medicaid Services (CMS). It identified the policy issues raised by the creation of such data pools and examined how these issues are approached in a decentralized governmental statistical system, such as that found in the United States. The creation of new, combined data sets and the related policy issues were examined through five dimensions, legal, technical, organizational, perceptual, and human.;The case studies addressed the following research questions related to the sharing of administrative records between U.S. Federal agencies: (1) What is the life cycle flow of administrative records data on individuals and businesses between IRS, CMS, and the Census Bureau? (2) What are the significant issues that have arisen as a result of sharing administrative records related to the need to protect privacy and confidentiality? (3) What insights and potential solutions can be learned from the experience of those who have worked within the federal statistical system that would help address the significant data-sharing issues that have been identified?;The study found that each agency involved in sharing administrative records is governed by a different set of statutes and regulations that only partially overlap. This patchwork of laws and regulations greatly slows down the initiation of record sharing projects. Participants at the agencies believe that privacy safeguards are adequate and effective. Participants at the agencies expend significant effort to assure that data are protected as required by law and by interagency agreements. Each agency has its own distinct internal processes for approving and tracking record sharing projects. There are no mature government-wide shared processes or criteria for reviewing or approving projects involving multiple agencies. The current processes are slow and burdensome and discourage initiation of new projects.