Summary report - Evaluation of TRIUMF

TRIUMF is a particle accelerator laboratory conducting research in nuclear and particle physics, nuclear medicine as well as materials and accelerator science. These research areas require large-scale, expensive facilities for experimentation. As such, TRIUMF maintains unique scientific infrastructure which is accessed by members of the Canadian and international scientific communities. In addition, TRIUMF collaborates on international projects, which allows Canadian researchers access to international facilities.

TRIUMF receives operational funding from the federal government through a contribution agreement with the National Research Council (NRC). Therefore the NRC conducts an evaluation of TRIUMF every 5 years in compliance with requirements of the Financial Administration Act (Sec 42.1) and as per the NRC's approved Departmental Evaluation Plan.

The evaluation focused on the 5-year period of 2013-14 to 2017-18. Because the NRC's contribution is only one source of funding and there are no distinct outcomes associated solely with it, the evaluation considers the full slate of TRIUMF activities and outcomes. The evaluation's data collection approach incorporated both qualitative and quantitative methods including:

• a review of documents
• a review of administrative and performance data
• interviews with TRIUMF staff, clients, partners and other key stakeholders
• a survey of TRIUMF users
• an international peer review

A bibliometric analysis (commissioned by TRIUMF) and an economic and social impact assessment (commissioned by the NRC) were also completed by external consultants with the objective of informing the evaluation. Another important line of evidence for the evaluation is the international peer review. The International Peer Review Committee (IPRC) was made up of 7 individuals; 6 with expertise in each of TRIUMF's main research areas and one with expertise on commercialization. The IPRC assessed the scientific impact of TRIUMF and provided insight on the facility's strategic plan for 2020-2025.

• TRIUMF serves the needs of a growing Canadian subatomic research community. The growth of this community increases the demand for facilities provided by TRIUMF. As a result, TRIUMF facilities are oversubscribed, limiting access.
• University researchers and students need the large scale facilities at TRIUMF because these are not available within their own institutions. The IPRC noted that TRIUMF enables Canadian universities to participate in the global research community at a much higher level than would be possible without a facility such as TRIUMF.
• Research needs could not be met in Canada in the absence of TRIUMF because it provides specialized infrastructure for research in nuclear physics, nuclear astrophysics and particle physics as well as other capabilities that not available elsewhere in Canada.
• TRIUMF aligns with federal government priorities in the area of science, technology and innovation. Alignment is demonstrated through iterations of the federal science and technology strategy as well as Budget 2017 and Budget 2018. TRIUMF also supports the NRC in its core responsibilities of advancing scientific and technological knowledge and growing innovative businesses.
• The NRC is well positioned to provide oversight to TRIUMF given its expertise in managing a large science laboratory; no other federal organization is more appropriately positioned to provide the oversight role.

  TRIUMF has made important contributions to science and has generated social and economic benefits for Canada.

• Through its outreach work and collaborative projects, as well as by providing researchers with the required facilities in which to conduct their research, TRIUMF has contributed to Canada's positive international reputation in TRIUMF related fields.
• The IPRC found that there are world-class efforts from TRIUMF in all areas in which they perform research. Further, despite its relatively small size compared to other international labs, a bibliometric study shows that TRIUMF is competitive in terms of publication output and impact.
• TRIUMF has played a role in international collaborations that have resulted in significant discoveries. TRIUMF's participation in such important projects is in part due to the infrastructure and the unique capabilities they offer. In addition, in its role as a facilitator, TRIUMF has been instrumental in connecting Canadian researchers to the world.
• TRIUMF prioritizes training of highly qualified personnel (HQP) and provides numerous training opportunities. Students affiliated with TRIUMF also benefit from the extensive facilities available at the laboratory which are not available elsewhere in Canada.
• TRIUMF not only develops HQP, but the existence of TRIUMF makes Canada an attractive place for them to remain following their training. Overall, the positive reputation in subatomic physics has made Canada an attractive place for researchers to work.
• TRIUMF has generated economic and social benefits for Canada as a result of its regular activities and through TRIUMF Innovations. The IPRC noted concentration of commercialization activities in the life sciences and that 95% of royalty revenue was tied to one partnership and therefore recommended diversification to reduce risks. The IPRC also noted potential to expand outreach activities beyond British Columbia to increase reach and support from other provinces.

  TRIUMF is committed to efficient and economic operations.

• During the evaluation period, TRIUMF made many changes to improve efficiencies including putting in place a chief operating officer and a project management office. TRIUMF is also undergoing a significant exercise to transform its governance structure and many other changes throughout the organization are planned. The IPRC noted the need for communication about the changes to all staff and careful monitoring of the impact of these changes.
• TRIUMF has managed resources soundly. TRIUMF has secured increased funding from the NRC for work on the ARIEL project. While still representing a small portion of their total income, TRIUMF also saw an increase in revenue, which provides the facility with the capacity to support projects and initiatives not easily funded through public sources.
• TRIUMF has proposed a strategic plan for years 2020-2025 based on 3 key dimensions: science and technology, people and skills, and innovation and collaboration. The IPRC noted that the plan is aggressive but achievable at the requested budget and that it positions TRIUMF to produce ground-breaking results.
• Canada's current approach to funding creates challenges for TRIUMF as it does for other facilities. For TRIUMF, the uncoordinated funding approaches and cycles makes project planning and execution difficult, often because projects go beyond the timeframe of the funding. The issues associated with Canada's funding approach are widely recognized and steps toward improvement may come, in part from the federal government's implementation of the 2017 Science Review recommendations.