How NASA is redesigning the science of peer review

NASA Science Mission Directorate Dual-Anonymous Peer Review Virtual Town Hall · 20:23 · Video: NASA Science · Watch at the source

In short: To ensure the most rigorous and unbiased science, NASA is shifting how it evaluates research proposals. By moving toward a dual-anonymous system, the agency aims to strip away the influence of prestige and reputation, focusing purely on the merit of the ideas being submitted.

On March 3, 2020, the NASA Science Mission Directorate (SMD) hosted a virtual town hall to introduce the implementation of dual-anonymous peer review. This process is designed to minimize bias during the proposal evaluation phase. In a dual-anonymous system, both the researchers submitting the proposal and the experts reviewing it remain anonymous to one another. This prevents reviewers from being influenced by a laboratory's size, a researcher's previous accolades, or institutional affiliations. This initiative specifically addresses the motivations for moving away from traditional review structures. It seeks to eliminate hidden biases that might favor established names over novel concepts.

The transition involves specific logistical shifts for the scientific community. NASA provided guidance on how to prepare anonymized proposals and detailed the mechanics of the review process itself. The goal is to create a level playing field where the quality of the science is the primary metric for success. This shift is part of a broader effort to modernize how NASA manages its science missions and competition models, including the rollout of Competition Model 2.0 (CM 2.0). The agency also scheduled specific sessions for the A.32 ICESat2 project to discuss these changes. These meetings occurred on June 15 and September 12 to help the community adapt.

Transparency and community engagement are central to these changes. NASA has utilized virtual town halls and webinars to gather feedback from academia, the media, and the public. These forums allow the community to vote on questions and participate in the dialogue regarding how new policies, such as those affecting astromaterials curation and sample allocation, impact the scientific return of space exploration. The Chief Scientist for Astromaterials Curation also hosts webinars to discuss the bi-annual Astromaterials Newsletter. This publication serves as the primary way to announce new sample opportunities to the scientific community.

Opens the Intellect+ feed with this card first. Swipe up for the next one.

Sources

To cite this card, link to https://intellectplus.co.uk/app/space-nasa-science-mission-directorate-dual-anonymous-peer-review-.

How we source, check and correct cards: Editorial standards.

General information, not professional advice. Spotted an error? Flag the card or see corrections and complaints.

Intellect Plus is a visual educational discovery platform for exploring fascinating facts and ideas. Brain Food, Not Brain Rot. What is Intellect Plus?

Related

Finding something worth knowing…