Machine Learning to Assess Trends and Alignment of Funded Research Output

Time: Wednesday 22-Jul-2020 14:00 (This is a past event.)

Discussion Moderator:

Artifacts
slides: please to see content

Motivation / Abstract
Research and development activities are regarded as one of the most influencing factors of the future of a country. Large investments in research can yield a tremendous outcome in terms of a country’s overall wealth and strength. However, public financial resources of countries are often limited which calls for a wise and targeted investment. Scientific publications are considered as one of the main outputs of research investment. Although the general trend of scientific publications is increasing, a detailed analysis is required to monitor the research trends and assess whether they are in line with the top research priorities of the country. 

Such focused monitoring can shed light on scientific activities evolution as well as the formation of new research areas, thus helping governments to adjust priorities, if required. But monitoring the output of the funded research manually is not only very expensive and difficult, it is also subjective. Using structural topic models, in this paper we evaluated the trends in academic research performed by federally funded Canadian researchers during the time-frame of 2000–2018, covering more than 140,000 research publications. The proposed approach makes it possible to objectively and systematically monitor research projects, or any other set of documents related to research activities such as funding proposals, at large-scale. Our results confirm the accordance between the performed federally funded research projects and the top research priorities of Canada.
Questions Discussed
- Using Structural Topic Modelling to extract high level research topics out of scientific publications
- Nuances of extracting topics and generating labels for clusters in a semi-automated way
- Implications of this work on automated research tracking for the purposes of research & development policy making
Key Takeaways
- Research evaluation is a subjective process currently because of the peer-review nature of it
- Advanced techniques could help us to better quantify research activities and measure their impact
- Research projects are constantly evolving that calls for a continuous monitoring to not only check their evolution but assess their alignment with the federal priorities and economic growth objectives
Stream Categories:
 Science of Science