STAR METRICS
STAR METRICS(Science and Technology for America's Reinvestment: Measuring the EffecT of Research on Innovation, Competitiveness and Science) was a partnership (STAR METRICS Consortium) betweenUnited Statesfederal science agencies andresearch institutionsto document thereturn on investment,research impact,and social outcomes of federally fundedresearch and development.The federal consortium comprised theWhite House Office of Science and Technology Policy(OSTP), theNational Institutes of Health(NIH), theNational Science Foundation,(NSF), theUS Department of Agriculture,(USDA), and theUS Environmental Protection Agency,(EPA). NIH was the host agency for the consortium, which was governed by an Executive Committee and an advisory interagency working group.
It was announced by OSTP on 28 May 2010 in a press release titled "STAR METRICS: New Way to Measure the Impact of Federally Funded Research".[1]
Pilot
[edit]A pilot was undertaken by the following seven institutions in a Federal Demonstration Partnership:[2]
- University of Texas at Austin
- University of Delaware
- George Mason University
- California Institute of Technology
- University of Alabama
- University of Massachusetts, Dartmouth
History
[edit]The imperative for the launch of STAR METRICS was the passing of theAmerican Recovery and Reinvestment Act of 2009(ARRA), which included astimulus packagefor research and development because it was widely believed that investments in science and research would stimulate economic growth. Part of the bill required recipients to report quarterly onjob creation.[3][4][5][6]The ARRA reporting requirements are distinct from STAR METRICS. The latter was established to provide evidence that investment in research had a positive effect on the economy, because there is little thoroughly conclusive evidence that this is actually the case - even though it is a generally accepted assumption.[4]
In 2010 STAR METRICS was given a five-year commitment from agencies, and NIH and NSF committed $1 million (~$1.36 million in 2023) combined.[7][8]Other federal funders that have joined are theUnited States Department of Energy,Environmental Protection Agency,andDepartment of Agriculture.Research institutions voluntarily join the consortium. Subsequent funding from federal agencies continued until 2022.
The formal governance was put in place in January 2012, with NIH hosting the project.[8]
The goal of the program was set to develop measures for the impact of federal investments on science, society, the workforce and the economy. To this end, a database was set up of all federally funded researchers and cleaned to ensure no confusions of people with the same or similar names etc. were made. This database was then used to match with other accessible databases such as public records of patents, institutional financial records, payroll data, as well as more traditional scientific output indicators such asscientific citations.[4][9]
Outcomes
[edit]An attraction of STAR METRICS project was that it would scrape data from existing reports, databases, and the internet for the information it needed, much like theLattes Platformin Brazil.[7][10]
STAR METRICS quickly started tracking job creation from ARRA and non-ARRA research grants at 70 universities, and subsequently moved on to tracking other outcomes of investment in research.[5]
STAR METRICS also developed Federal RePORTER, a database that consolidated information from several extant databases--eRA databases, Medline, and PubMed Central -- using linkages among these disparate data sources. This centralized database allowed for research into science funding across federal agencies and linkages to subsequent downstream impacts and outcomes. The database was discontinued on March 1, 2022, but served as the inspiration for other efforts to track and link federal science investments to outcomes, such as the University of Michigan's Institute for Research On Innovation and Science (IRIS) program. The following agencies contributed data to Federal RePORTER:
- DOD (Department of Defense)
- Center for Neuroscience and Regenerative Medicine (CNRM)
- Congressionally Directed Medical Research Programs (CDMRP)
- Combat Care Casualty Research Program (CCCRP)
- Defense and Veterans Brain Injury Center (DVBIC)
- ED (Department of Education)
- Institute of Education Sciences (IES)
- Environmental Protection Agency (EPA)
- HHS (Department of Health and Human Services)
- Administration for Children and Families (ACF)
- Agency for Healthcare Research and Quality (AHRQ)
- Centers for Disease Control and Prevention (CDC)
- Food and Drug Administration (FDA)
- National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR)
- National Institutes of Health (NIH)
- National Aeronautics and Space Administration (NASA)
- National Science Foundation (NSF)
- USDA (United States Department of Agriculture)
- Agriculture Research Service (ARS)
- Forest Service (FS)
- National Institute of Food and Agriculture (NIFA)
- U.S. Department of Veterans Affairs (VA)
See also
[edit]References
[edit]- ^STAR METRICS: New Way to Measure the Impact of Federally Funded Research,White House Office of Science and Technology Policy
- ^FDP, STAR METRICS page
- ^Julia Lane (25 March 2010). "Let's make science metrics more scientific".Nature.464(7288): 488–489.Bibcode:2010Natur.464..488L.doi:10.1038/464488a.hdl:10419/43597.PMID20336116.S2CID9563303.
- ^abcColin Macilwain (9 June 2010)."Science economics: What science is really worth".Nature.465(7299): 682–684.doi:10.1038/465682a.PMID20535177.
- ^abColin Macilwain (28 September 2011)."A multi-billion dollar injection: Stimulus—response".Nature.477(7366): 524–525.Bibcode:2011Natur.477..524M.doi:10.1038/477524a.PMID21956310.
- ^Halevi, Gali (March 2012)."Scientific Evaluation and Metrics – an Interview with Julia Lane".Research Trends(27).
- ^abDavid Kramer (August 2010)."Initiative aims to quantify the paybacks from basic research".Physics Today.63(8): 20.Bibcode:2010PhT....63h..20K.doi:10.1063/1.3480067.
- ^ab"Open Government at HHS".26 January 2015.
- ^Julia Lane, Stefano Bertuzzi (11 February 2011). "Measuring the Results of Science Investments".Science.331(6018): 678–680.Bibcode:2011Sci...331..678L.doi:10.1126/science.1201865.PMID21310987.S2CID206531958.
- ^"EU looks to US model for measuring R&D impact".EurActiv. 16 April 2010.
External links
[edit]- Official website
- Amstat News Letter
- Working group,Federal Demonstration Partnership
- Original website