Background

Existing evaluations of biomedical research have relied on quantitative metrics such as the number of publications in academic journals and citation indices. The field of genomics has also been dominated by a focus on quantitative outcomes, with significant research funding invested alongside rapid advancements in analytical technologies. In this context, research on the ethical, legal, and social implications (ELSI) of human genomic information, aimed at preventing its misuse and protecting personal privacy, has gained prominence. Governments and academic foundations have significantly increased funding for ELSI research to prevent the misuse of genomic technologies and foster social consensus. However, there is currently no clear standard for evaluating the specific changes that this research has brought about in national policies, corporate governance, or clinical practices in hospitals. The gap between academic impact and societal impact makes it difficult to demonstrate the actual usefulness of genomic ELSI research, which has long been a challenge for the academic community. The pathways through which research results are institutionalized are complex and gradual, making it difficult to fully capture their unique value through simple publication citation counts.

Key Findings

In this commentary, the authors propose an interconnected four-step framework to overcome the limitations of existing evaluation systems and objectively assess the value of genomic ELSI research. The first step is to clarify stakeholders and the scope of impact. This involves clearly defining the direct and indirect stakeholders affected by the research results, such as healthcare settings where genomic information is used, industries providing genetic testing services, and policymakers designing regulations. The second step is to develop multidimensional impact assessment indicators. This involves moving beyond academic citation indices to identify a variety of social indicators, such as the number of legal consultations, the frequency of inclusion in policy development processes, and the use of educational materials by patient advocacy groups. The third step is to track and visualize the impact pathway. This involves tracing and structuring the causal relationships of how ELSI research is translated into actual institutional decision-making through intermediate steps. The final step is feedback and governance integration. This involves establishing a system to incorporate the analyzed evaluation results into subsequent research plans or public funding allocation decisions, creating a cyclical structure that continuously enhances the practical utility of the research. This evaluation system differs from existing approaches by emphasizing qualitative analysis and quantitative tracking, integrating them to transparently reveal the social trajectory of individual research.

Significance and Prospects

The new evaluation framework can serve as a stepping stone to improve the efficiency of research funding allocation and enhance the credibility of bioethics policies. Research foundations can use this framework to select and strategically support research projects that contribute to solving social problems. Policymakers can also obtain clear evidence of which research materials to refer to when developing guidelines for the use of genomic information. However, there are several challenges to be addressed in order to implement this multidimensional evaluation in practice. Social impact often emerges gradually over several years after the completion of academic research, so the establishment of infrastructure for long-term follow-up studies is essential. Furthermore, given the involvement of qualitative evaluation, a sophisticated consensus-building process involving a multidisciplinary group of experts is required to ensure the fairness of the evaluation.