Caroline Paunov
Martin Borowiecki
Caroline Paunov
Martin Borowiecki
Good governance of public research policy can boost the effectiveness of public investment in research. This chapter describes the governance of public research policy across 35 OECD member countries and its evolution over 2005-17. It sheds light on different research-policy contexts that explain why a “one-size-fits-all” approach is inappropriate. The chapter successively addresses four core governance dimensions with important implications for research sector performance. It first discusses the objectives of national STI strategies for higher education institutes (HEIs) and public research institutes (PRIs), which are increasingly expected to contribute to raising national R&D intensity and to address societal challenges. It then describes the variety of organisations allocating funding and evaluating performance. The section that follows discusses the growing autonomy of HEIs and PRIs and the use of associated policy tools, such as performance contracts. The last of the four core governance dimensions relates to the modes of stakeholder involvement in policy decision-making. The chapter concludes with a review of potential future developments.
The statistical data for Israel are supplied by and under the responsibility of the relevant Israeli authorities. The use of such data by the OECD is without prejudice to the status of the Golan Heights, East Jerusalem and Israeli settlements in the West Bank under the terms of international law.
The contributions to innovation of research conducted by higher education institutions (HEIs) and public research institutions (PRIs) are well recognised, as is the need for public support for such research. In the emerging globalised knowledge economy, where the best innovations are key success factors, research is more important than ever. Yet many countries struggle to increase public budgets for research. Consequently, countries deploy a battery of policy instruments to orient investments in public research. Each national policy mix is shaped by the mechanisms and institutional arrangements governing policy action on publicly funded research in HEIs and PRIs. More effective policy governance arrangements can enhance the effectiveness of research funding. For instance, involving all stakeholders in policy design can help identify better policies to overcome obstacles hindering public research activities.
This chapter describes the governance of public research policy across 35 OECD member countries and its evolution over 2005-17. It sheds light on different research-policy contexts that explain why a “one-size-fits-all” policy approach is inappropriate. It outlines institutional choices countries are in a position to change.
More specifically, the chapter addresses four core dimensions that shape the policy mix regarding HEIs and PRIs and provides findings (Figure 9.1), with important implications for the research sector’s performance (e.g. Aghion et al., 2010; Breznitz, 2007).
This chapter identifies a number of common characteristics and trends across these dimensions of the governance of public research policy (Table 9.1) using the results of an OECD survey on the governance of research policy conducted after a three-year process of in-depth data collection and validation1 (Borowiecki and Paunov, 2018).
The chapter is structured as follows: The first section discusses the objectives of national STI strategies for HEIs and PRIs. This is followed by a description of the institutions allocating funding and evaluating performance. The third section discusses the autonomy of HEIs and PRIs, followed by a section devoted to an overview of stakeholder involvement in policy decision-making. The final section concludes with a review of potential future developments.
Public research features prominently in national STI plans or strategies, which are in place in 33 (i.e. 94%) of the 35 OECD countries surveyed. They outline national priorities for research and innovation, and define the expected contributions of HEIs, PRIs, industry and civil-society actors (e.g. non-governmental organisations [NGOs] and foundations). Policy demands across OECD countries include finding solutions to societal challenges (e.g. demographic change and sustainable growth); developing key technologies (e.g. digital technologies) for competitiveness; and increasing national research and development (R&D) intensity. Countries’ STI strategies differ in terms of the national priorities they set (i.e. societal challenges, research fields and/or industries), the targets they define (i.e. R&D intensity) and how they monitor progress in reaching these targets.
Dimension |
Common characteristics of how public research is organised across OECD countries |
|
---|---|---|
HEIs and PRIs in national science, technology, and innovation (STI) strategies |
|
|
Institutions allocating funding and evaluating performance of HEIs and PRIs |
|
|
Autonomy of HEIs and PRIs |
|
|
Stakeholders’ involvement in policy-making |
|
Looking at the data collected by the OECD governance of research policy survey, three main observations can be made. First, most strategies (i.e. in 31 of 33 countries, plus the Brussels-Capital Region, the Flemish Region and the Walloon Region in Belgium) identify specific scientific research areas, technologies and economic fields, e.g. energy and energy technologies; health and life sciences; information and communication technologies; and nanotechnology and advanced materials. A growing number of strategies place digital-transformation objectives at the core of their strategic orientations, as discussed in Chapter 3.
Second, STI strategies also define the expected contributions of HEIs and PRIs to overcoming socio-economic challenges. In 30 (i.e. 91%) of the 33 countries surveyed, and in the Brussels-Capital Region, the Flemish Region and the Walloon Region, STI strategies address major societal challenges, including demographic change, health, environment, smart transport and cities. The STI strategies of 25 (i.e. 76%) of 33 countries, the Brussels-Capital Region and the Walloon Region stress the need for research and innovation to develop a sustainable economy. The strategies of 13 (40%) of 33 countries emphasise the importance of STI in addressing demographic change. Finally, the STI strategies of 15 (45%) of 33 countries, as well as the Flemish Region and the Walloon Region, also encourage investment in STI to improve transport systems.
Third, most national STI strategies include quantifiable benchmarks for policy outcomes (Figure 9.2).
The national STI strategies of 23 (70%) of 33 countries, and the Brussels-Capital Region, the Flemish Region and the Walloon Region have a national R&D intensity target. The data also shows that 11 (or 33%) of national STI strategies and the STI strategies of Brussels-Capital Region and the Walloon Region have targets HEIs and PRIs at the core of policy attention. These targets include raising funding for doctoral students (7 of 33 strategies, plus the Brussels-Capital Region), and increasing job placements for researchers and PhDs in industry (5 out of 33 strategies, plus the Brussels-Capital Region). Japan’s Fifth Science and Technology Basic Plan for 2016-20 features targets for increasing the number of tenure positions for young academic researchers and raising the share of female researchers among newly hired university personnel. It also sets quantitative benchmarks for knowledge transfer between universities and industry. These include increasing private funding for university research, the amount of collaborative research funds received from industry and the number of licence agreements on university patents.
Project-based funding – i.e. funding mostly allocated by agencies to a research group or researcher to perform a specific item of research and/or innovation – is an important tool to incentivise HEIs and PRIs to contribute to national STI objectives. Together with institutional block funding, it accounts for the bulk of funding for public HEIs and PRIs, complemented (to a lesser degree) by funding from industry and other segments of the private sector. The governance setting, notably which institution provides such funds, also contributes to raising the effectiveness of project-based funding.
The evidence shows that in 31 (i.e. 89%) of 35 OECD countries, national agencies decide on project-based funding allocations for HEIs. In most countries (30 countries out of 35, plus Wallonia and Flanders, for HEIs; 25 out of 34 countries, plus Wallonia and Flanders, for PRIs), ministries provide institutional block funding. The main roles of these agencies is to fund research and innovation projects; among other responsibilities, they also provide expert advice on related policy.
The institutional landscape for project-based funding is a dynamic one. Between 2005 and 2016, 10 OECD countries created new project-funding institutions. They include the French National Research Agency (ANR), created in 2006; the Innovation Fund Denmark, created in 2014; and the State Research Agency (AEI) in Spain, created in 2015.
Several countries use multiple agencies to allocate project-based funding. In 12 of 31 OECD countries, a single agency provides project-based funding, compared to 2 or more specialised agencies in the remaining 19 countries (Figure 9.3).
Agencies specialising in research fields usually exist where such research has very special features (e.g. health and medical research) and are an important research base in the country. In Australia, for instance, the National Health and Medical Research Council manages funds for health and medical research, whereas the Australian Research Council handles competitive calls for all other research fields. Canada has several such specialised agencies, including the National Research Council, the Natural Sciences and Engineering Research Council; the Canadian Institutes of Health Research; and the Social Sciences and Humanities Research Council of Canada.
In several countries featuring multiple agencies, research and innovation tasks are separate, reflecting the divided responsibilities across different ministries. In Austria, the Austrian Science Fund (FWF) is responsible for basic research, whereas the Austrian Research Promotion Agency (FFG) and the CDG-Christian Doppler Research Association fund applied research. This reflects the ministerial division of responsibilities, whereby the Federal Ministry of Science, Research and Economy is responsible for research, and the Federal Ministry for Transport, Innovation and Technology is in charge of innovation.
In countries with federal structures, education, research and innovation tasks are shared between the national level and the federal state or subnational level. In Germany, the federal states oversee education policy (including teaching at HEIs), whereas nationwide PRIs and the national German Research Fund (among other national and regional players) provide financing for research and innovation. In addition, a variety of competitive funding tools for project-based research funding of HEI and PRI have been implemented. In Belgium, five regional funding agencies provide project-based research funding.
Over 2007‑17, some countries reduced the number of funding agencies to simplify funding applications (creating a “one-stop-shop”), reduce funding fragmentation and increase efficiency. Denmark, for instance, created the Innovation Fund Denmark in 2014 by merging the Danish Council for Strategic Research, the Danish National Advanced Technology Foundation and the Danish Council for Technology and Innovation. The merger’s objective was to simplify grant applications for researchers and businesses. Estonia created the Estonian Research Council in 2012 by consolidating the functions of three agencies to reduce fragmentation in public research funding.
Specialised agencies in charge of evaluating and monitoring the performance of HEIs and PRIs are in place in 19 (56%) of 34 countries, in Wallonia in Belgium, and in Massachusetts in the United States. The agencies’ objective is to conduct high-quality, independent evaluations, to inform policy on funding programmes for HEIs and PRIs. The High Council for the Evaluation of Research and Higher Education (HCERES) in France is one such agency. In Ireland, the Higher Education Authority (HEA) is responsible for system governance and institutional block funding for HEIs, whereas the Quality and Qualifications Ireland (QQI) oversees quality assurance. Both the HEA and QQI conduct quality and strategic evaluations of HEIs and PRIs, based on criteria set by the government. In the Netherlands, the Higher Education and Research Review Committee is an independent committee that evaluates the attainment of performance targets set in performance contracts. Evaluation and monitoring is performed by ministries in 11 (32%) of 34 countries; and by HEI\PRIs in the Netherlands and Spain. In Belgium and the United States, regions/federal states are in charge of evaluations of HEIs and PRIs.2
Examples of recently established agencies and independent committees for evaluation and monitoring include the Agency for Assessment and Accreditation of Higher Education (A3ES) in Portugal (2007); the Higher Education and Research Review Committee in the Netherlands (2012); and the National Agency for Evaluation of Universities and Research Institutes (ANVUR) in Italy (2010).
The move towards stronger performance evaluation has also increased the importance of performance contracts and performance-based funding instruments. Performance contracts are set up between national ministries/agencies and individual HEIs; they define goals and link them to block funding of HEIs. Performance contracts are in place in 13 (37%) of 35 OECD countries and several regions/federal states (e.g. Scotland in the United Kingdom; and Baden Württemberg, Brandenburg and North Rhine-Westphalia, among other federal states in Germany). Nine countries introduced performance contracts during the past decade (Figure 9.4).
Performance contracts vary across countries in several respects, including the shares of HEI budgets they cover. Among the nine countries and four regions/federal states for which such information is currently available, the shares subject to performance contracts vary from 1% in Denmark and 7% in Latvia and the Netherlands, to 94-96% in Austria and 100% in Finland and Korea. At the regional/federal level, performance contracts affect 50% of institutional funding of HEIs in Scotland, for instance. In the German federal states for which information is available, performance contracts apply to 2% of HEIs institutional funding in Brandenburg and 23% of block funding of HEIs in North Rhine-Westphalia.
Other differences in performance contracts relate to their targets. Targets are used to monitor the performance of HEIs and assess whether they have met their objectives. As expected, education and research targets are the main criteria, used in the 12 countries and 2 regions (Scotland and North Rhine-Westphalia) with performance contracts in place and for which target-related information is available; 10 of these countries and 2 regions (Scotland and North Rhine-Westphalia) focus on the role of HEIs in supporting innovation performance; 5 countries and Scotland address socio-economic challenges and include targets to support the local economy. Differences also exist in how targets are defined. Some countries use qualitative indicators, while others rely more on quantitative indicators. Table 9.2 describes the cases of Austria, Finland and Scotland.
Country |
Targets |
Process |
---|---|---|
Austria |
Qualitative and quantitative criteria used in performance contracts set education, research and innovation targets for universities. Education indicators include the number of students who complete full credits per academic year, the number of graduates and the quality of teaching. Research indicators pay specific attention to the generation of basic research, as well as young academics’ career paths. Innovation-outcome indicators vary across institutions. The University of Vienna, for instance, commits to increasing the number of patents and providing courses on technology transfer (University of Vienna, 2015). |
Each of the 22 Austrian institutions signs a specific performance agreement for a period of 3 years, based on institutional development plans. The National Development Plan for Higher Education, formulated by the Federal Ministry of Science, Research and Economics for a period of six years, sets national objectives that inform the universities’ development plans. These goals include increasing the number of students in different disciplines, increasing the number of graduates, and improving student-staff ratios. The University Act (2002) also fixes a set of issues to be addressed in institutional plans, such as strategic goals, co-operation with other universities and knowledge transfers. |
Finland |
Quantitative indicators for education include:
Research indicators include:
Several indicators focus on the degree of internationalisation, including:
Other education-and-science policy indicators include strategic development efforts, field-specific funding and contributions to “national duties” (e.g. teacher-training schools). A different formula applies to universities of applied science, with criteria focusing on education (79%), R&D (15%) and strategic development (6%). |
A funding formula serves as a basis for each university to negotiate its performance agreement with the Ministry of Education and Culture (MEC) at the beginning of every four-year term. Each performance agreement contains specific institutional targets. Universities participate in the monitoring and evaluation process. The evaluation process also involves on-site visits by MEC staff. Performance reviews are conducted jointly by representatives from the MEC and individual institutions. To enable the MEC to monitor performance, HEIs provide information to a central statistical database maintained by the Ministry. An assessment of the performance of HEIs is published every year. |
Scotland |
Qualitative and quantitative criteria used in performance contracts include:
|
Outcome agreements are made between the Scottish Funding Council and individual HEIs, and run for three years. These agreements also set annual targets for institutional priority areas. In 2014-15, four main priority areas were selected: equality (opportunity); innovation; graduate employability and enterprise; and sustainable institutions. Universities have defined quantitative indicators to help monitor their performance. |
Source: De Boer, H. et al. (2015), “Performance-based funding and performance agreements in fourteen higher education systems, http://doc.utwente.nl/93619/7/jongbloed%20ea%20performance-based-funding-and-performance-agreements-in-fourteen-higher-education-systems.pdf.
Performance contracts are only one measure introduced over the past decade. Among other reforms, 9 (27%) of 33 countries introduced performance indicators in the formula for allocating university block grants.
Several countries have also strengthened their programmes for research excellence. In 2005, Germany established the “Excellence Initiative”, a competition among German research universities for top-up funds from the Federal Government to make German universities more competitive internationally. In 2007, three “excellence universities” were selected, based on criteria of research excellence. Each university received USD 26 million (US dollars) (EUR 21 million [euros]) annually. Another 18 universities received funding to establish international graduate schools and “excellence clusters”, i.e. research hubs bringing together different research groups from within and across universities in the region. The competition’s second round in 2012 expanded funding to 11 elite universities. In 2018, the Initiative for Excellence was renamed the “Excellence Strategy”, providing support only for created excellence clusters and the selected excellence universities.
Institutional autonomy is an important, much-discussed issue in the governance of public research. Institutional autonomy allows HEIs and PRIs to decide for themselves how best to meet the objectives set in national STI strategies and to select the most relevant funding criteria for their specific contexts. This can be useful, for example, when considering the commercialisation of public research, since their opportunities to collaborate with industry differ according to the type of research conducted, the relations with industry, their local economic context, etc.
Reforms implemented over the past decades have increased the autonomy of HEIs. In many OECD countries, HEIs can take their own decisions regarding industry relations, budget allocation, recruitment and promoting researchers (Figure 9.5). In 29 (85%) of 34 OECD countries, HEIs are free to create legal entities, such as technology offices and spinoffs, and decide on the conditions for collaborating with industry. In many cases, autonomy is the outcome of the reforms implemented over 2005-17. In France, for instance, HEIs have been free to establish their own for-profit entities and joint R&D ventures with industry since 2011 (Freedom and Responsibilities for Universities Act 2011). In Portugal, Law 62/2007 of 10 September 2007 on Higher Education Institutes (RJIES) granted some HEIs more autonomy.
HEIs do not have full autonomy, however, to decide salaries, which also depend on the funding sources and institutional conditions. HEIs can decide on the salaries of their academic staff in 12 (34%) of 35 OECD countries. In some countries (e.g. Denmark and France), national laws regulate salary bands for academic personnel; in other countries (e.g. Austria and the Netherlands), collective bargaining agreements are in place.
When it comes to internal budget allocation decisions, public HEIs in 23 (68%) of 34 OECD countries can decide on the share of institutional block funding to allocate to teaching, research and innovation activities. PRIs in 23 (79%) of 29 countries providing this information can freely decide their budget allocations.
The final structural dimension strongly shaping governance is how HEIs and PRIs themselves, as well as civil society (including citizens, labour unions, NGOs and foundations) and industry, participate in decision-making on research policy.
The first important way for stakeholders to shape research and innovation policy is to participate in research and innovation councils (particularly those with strong policy mandates), which are in place in 31 of 35 OECD countries. Councils are permanent public bodies outside of ministries and agencies, which are mandated to engage in one or several of the following activities: provide policy advice (28 of the 31 countries, i.e. 90%); develop strategic priorities (23 countries, 74%); evaluate policy reforms (15 countries, 48%); co-ordinate within both government and non-public stakeholders (15 countries, 48%); and allocate research and innovation budgets (7 countries, 23%).
Stakeholders outside of government are often represented in research and innovation councils. Civil society (including members of labour unions and NGOs) is active in 15 (48%) of the existing 31 councils. Private-sector representatives – often large firms, but also some small and medium-sized enterprises (SMEs) – are present in 26 councils (84%). Foreign experts participate in 6 (19%) of the 31 OECD countries with councils, i.e. Austria, France, Germany, Greece, Switzerland and the United Kingdom. Foreign experts come mostly from academia; a few (e.g. in Austria and the United Kingdom) come from industry or the public sector (Figure 9.6).
A second way for stakeholders from civil society and industry to shape the policy decisions of HEIs (particularly those with substantial autonomy) is to sit on their governing boards or councils. In most OECD countries, the university governance structure include a board (also known as a senate). The university board is the main decision-making body and is responsible for setting priorities. Stakeholder representation is important, in that it helps HEIs understand and answer public demands on their teaching and research activities.
University boards in 28 (82%) of 34 countries have outside stakeholder representation (Figure 9.7). In 25 (90%) of these 28 countries, the boards include private-sector representatives – mostly from large firms, but sometimes from SMEs. University boards in 23 (68%) of 34 countries include representatives from civil society – i.e. citizens, NGOs and foundations. In 21 (62%) of the 34 countries, the boards include representatives from both the private sector and civil society. In 10 (29%) of these countries, foreign experts sit on university boards. In 4 (12%) of these 34 countries, only the private sector is represented (Figure 9.7).
In some countries, external stakeholder representation on university boards is fairly new. In Portugal, for instance, university reforms introduced stakeholder representation on the governing boards of HEIs in 2007. In France, the Law on Higher Education and Research introduced the representation of business and local actors in the governing bodies of HEIs and PRIs in 2013.
Online public consultations are a new policy instrument, devised to include civil society more fully in policy formulation (see Chapter 10 on technology governance). Online platforms were used to develop national STI plans in Australia (National Research Infrastructure Roadmap 2016); Canada (Innovation and Skills Plan 2017); France (National Research Strategy 2015); Japan (Fifth Science and Technology Basic Plan 2016-20); Mexico (National Development Plan 2013-18); and the Netherlands (Dutch National Research Agenda, 2016). In 2016, the UK Department for Business, Energy and Industrial Strategy issued an online consultation to prepare for the National Innovation Strategy. In 2017, Finland introduced an online consultation to develop the national Vision for Higher Education and Research 2030, along with a roadmap.
Other more traditional, yet still important stakeholder-investment methods include working groups, roundtables and calls for inputs. Like online consultations, these temporary methods allow broader consultation and sectoral targeting. For example, the Scientific and Technological Research Council of Turkey (TÜBITAK) conducted an open-ended survey to identify priorities in the biomedical technology sector, gathering over 1 200 ideas from 300 researchers and experts. Technology roadmaps and policy programmes were developed based on these inputs (OECD, 2016a). New and established mechanisms were used jointly to engage stakeholders in the development of a ‘Made-in-Canada’ Athena SWAN programme. It will be aimed at supporting the careers of under-represented groups, including women, Indigenous peoples, members of visible minorities, and persons with disabilities, across all disciplines in higher education and research. Similarly, the Estonian Ministry of Education and Research formed a strategy preparation committee, convening over 200 specialists from research, business (including entrepreneurs) and government, to help prepare the Estonian Research and Development and Innovation Strategy 2014-20, “Knowledge-based Estonia”. These exercises are flexible instruments that engage stakeholders in policy making, complementing the more permanent consultations already in place.
This chapter described some of the characteristics of public research policy across OECD member countries and recent trends in its organisation. The evidence shows OECD countries use formal instruments to evaluate the performance and contributions of HEIs and PRIs to achieving national STI priorities. Specialised agencies in charge of evaluating and monitoring the performance of HEIs and PRIs are an important component, together with strong stakeholder involvement in the policy process governing the publicly funded research conducted in these institutions. Reforms implemented over the past decades have increased the autonomy of HEIs and PRIs, allowing them to take their own decisions regarding industry relations, budget allocation and recruitment, and promotions.
Based on the trends evidenced by the data, the following four factors are expected to shape the future organisation of public research policy:
National STI strategies will increasingly solicit the contributions of HEIs and PRIs to achieve a wider set of socio-economic objectives, including technology development (e.g. digital technologies) and the societal priorities described in the Sustainable Development Goals. National STI strategies are also likely to go beyond traditional R&D intensity targets, with new objectives placing HEIs and PRIs at the core of policy attention. These will include raising funding for doctoral students, and securing job placements in industry for researchers and PhDs.
With increased pressure on public budgets and demands to account for spending, OECD countries will likely further invest in and consolidate the evaluation and monitoring structures for HEIs and PRIs. Specialised agencies are already in place in many OECD countries. New forms of evaluation, exploiting big-data analysis and digital platforms, will play an important role in these efforts (see discussion in Chapter 12).
Efforts to expand and enhance multi-stakeholder consultations will greatly contribute to organising public research policy and identifying societal needs. National research and innovation councils, which provide platforms for engaging with civil society and industry, are already part of the standard national policy toolkit. University outreach already takes the form of stakeholder engagement in university boards, and linkages between HEIs and PRIs and wider society will grow stronger. Online consultations soliciting input from the population at large will likely expand further. The use of big-data and semantic-analysis tools will also increase, making it possible to process unstructured stakeholder inputs.3
HEIs and PRIs will become more autonomous. This will afford them more opportunities to decide how they can best meet the objectives of national STI strategies, likely resulting in a diversification of approaches. More autonomy also means that the contributions of HEIs and PRIs to national STI strategies will increasingly depend on the amounts and modalities of the public funding contracts established between them and their government.
Aghion, P. et al. (2010), “The governance and performance of universities: Evidence from Europe and the US”, Economic Policy, Vol. 25, pp. 7‑59, Oxford University Press, Oxford, http://www.jstor.org/stable/40603192.
Borowiecki, M. and C. Paunov (2018), “How is research policy across the OECD organised? Insights from a new policy database”, OECD Science, Technology and Industry Working Papers, No. 2018/55, OECD Publishing, Paris, https://doi.org/10.1787/235c9806-en.
Breznitz, D. (2007), Innovation and the State, Yale University Press, New Haven, CT.
De Boer, H. et al. (2015), “Performance-based Funding and Performance Agreements in Fourteen Higher Education Systems”, Centre for Higher Education Policy Studies, No. C15HdB014I, Enschede, Netherlands, http://doc.utwente.nl/93619/7/jongbloed%20ea%20performance-based-funding-and-performance-agreements-in-fourteen-higher-education-systems.pdf (accessed on 18 October 2016).
Estermann, T., T. Nokkala and M. Steinel (2015), “University Autonomy in Europe II – The Scorecard”, European University Association, Brussels, https://eua.eu/resources/publications/401:university-autonomy-in-europe-ii-the-scorecard.html (accessed on 19 September 2016).
University of Vienna (2015), Performance agreement of the University of Vienna (Leistungsvereinbarung 2016–2018), website (German), https://www.univie.ac.at/mtbl02/02_pdf/20151222.pdf (accessed 22 November 2016).
← 1. The resulting database is publicly available at https://stip.oecd.org/resgov.
← 2. There are regional agencies in place in Wallonia (Belgium), and in Massachusetts and California (United States), while there is a regional Ministry in charge of evaluations of HEIs and PRIs in Flanders (Belgium).
← 3. For a discussion of the potential of semantic analysis for innovation policy analysis, see: www.innovationpolicyplatform.org/semantics.