Skip to main content
 
Finding Our Future: A Research Agenda for the Research Enterprise



Chapter 4. Responding to the Challenges: An Integrative Research Agenda

Alternative strategies and new technologies to support the review and selection of research proposals

Traditionally, technology has played a role in supporting the review process. The potential of technology to go beyond its primary role as a document delivery mechanism in the review process is great, but relatively unexplored. This research could start by mapping the various proposal review models in use. The research could Identify and document these different review processes and draw out and make explicit the underlying assumptions and values for each. The results could inform the development of new strategies, new support technologies, and improve our understanding of the factors that influence success. Research is needed to meet the challenges of characterizing proposals effectively, of characterizing the skills of potential reviewers, and of using this information to quickly match reviewers to proposals. This should be studied from multiple perspectives such as knowledge sharing and natural language processing. Such a study might also identify cultural differences across communities of reviewers with respect to what constitutes a good review, a good review process, and evidence of fairness. Research could also explore how different technologies, different presentations of information, and different structures might work at various points in the process.

Whether an organization uses a peer review process, or depends more on program officer expertise, program officers are central players in the review and selection of research proposals. They depend heavily on proposal-based information and expert knowledge to move a review process forward. Research that focuses on their role and on the information flow and human interaction it requires might generate new understanding of the nature of that work, its interpersonal and organizational dynamics, and how these influence technology requirements, business processes, and overall performance.

The specific nature of the workflow, collaboration, and knowledge sharing could be identified through this analysis and used to inform the development of relevant technologies. The role of emerging technologies such as peer-to-peer networks, for example, could be examined in the context of the review process. Applications of emerging collaboration technologies could be examined, with the results informing both current and future technology development.