Global Affairs Canada’s architecture for results of international assistance

Challenge

To inform strategic decision making, enable better Managing for Results (MfR) at the programme/portfolio and corporate levels, and report on the results of its efforts better, Global Affairs Canada (GAC) needed to find a way to address some of the following issues:

• lack of alignment among corporate, programme/portfolio and project level outcomes and indicators

• challenges with rolling up results information and indicator data (from about 1 500 projects), including multiple corporate-level expected outcomes and indicators

• multiple corporate-level expected outcomes and indicators, making it challenging for staff to ensure effective alignment and roll-up of results information and indicator data

• lack of a comprehensive methodology that guides staff on how results and indicators align at the planning stage and how results information can be rolled up for evidence-based assessment, decision making and reporting at the programme/portfolio and corporate levels.

Approach

GAC developed an Architecture for Results of International Assistance (ARIA) approach and methodology. It developed guidance, tools and training material to help staff implement this approach, which includes three guiding principles:

• Distinguish policies from results frameworks. Results frameworks may need to change as we learn and adapt. Because policies are approved at high levels, they do not allow for this flexibility.

• Use a manageable number of corporate expected outcomes and indicators.

• Strengthen MfR at the programme/portfolio level to enable better strategic and operational planning, implementation and assessment than project management alone provides.

Outcomes at the programme/portfolio and project levels are more specific than at the corporate level in terms of “who experiences change”, “what change is experienced” and “where change takes place”. A horizontal nesting model is used to guide staff on the alignment of outcomes among the different levels.

Figure 1. The horizontal results nesting model: expected outcomes

Source: Global Affairs Canada.

A typology differentiates two types of indicators:

Commonly used indicators are standard indicators (e.g. Sustainable Development Goal indicators) identified for sectors or a theme in corporate-level results frameworks for use at the programme/portfolio and project level.

Consolidated indicators combine project-level indicators with others from the same “family” to form one broader indicator that allows for aggregation at the programme/portfolio and corporate levels. Consolidated indicators created by GAC are identified in corporate-level results frameworks for use at the programme/portfolio level. Family member indicators are used at the project level.

A classification of indicators distinguishes Complementary Performance Indicators (CPIs), which can be extracted from project to programme/portfolio level, and Key Performance Indicators (KPIs), which are aggregated from the project to the programme/portfolio level and then to the corporate level.

Results

The ARIA approach has allowed for better alignment at the corporate and portfolio levels among different results frameworks developed at different times, through different processes and responding to different requirements. This has helped to mitigate the number of indicators being used across these different frameworks and to provide clarity on how to align to these various frameworks at the operational level.

Eight Action Area Results Frameworks (AARF) have been developed to operationalise the priorities of Canada’s Feminist International Assistance Policy (FIAP) and its Action Area (AA) Policies into expected outcomes. In turn, the expected ultimate outcomes of these AARFs align to GAC’s broader Departmental Results Framework.

GAC has also deployed the approach to a number of its operations where the expected outcomes of country or thematic portfolios align horizontally to the expected outcomes of the AARFs, and thus to the priorities and path to action of the FIAP and AA Policies.

The horizontal nesting model has allowed programmes to tailor outcomes to varying programming contexts, while still aligning to relevant corporate-level outcomes and broad policy objectives.

The results frameworks share indicators where relevant, helping to mitigate the number of corporate indicators. Data collection on the FIAP KPIs is ongoing for the third year.