Vademecum 2127 en Compressed
Vademecum 2127 en Compressed
Vademecum 2127 en Compressed
Regional and
Urban Policy 1
EUROPEAN COMMISSION
Directorate-General for Regional and Urban Policy
Directorate F - Better implementation, Closure and Programme Implementation III
Unit F1 — Better Implementation and Closure
European Commission
B-1049 Brussels
Economic Appraisal Vademecum
FOREWORD
Elisa Ferreira
Commissioner for
Cohesion and Reforms
3
Economic Appraisal Vademecum
CONTRIBUTORS
This Economic Appraisal Vademecum (EAV) was prepared by DG REGIO with the support of JASPERS experts involved in project
economic appraisal. The EAV team included:
Project management and supervision DG REGIO - Unit F1 Better Implementation and Closure:
Sabine Vandermotten (Deputy Head of Unit)
Camelia Mihaela Kovács (Administrator)
Witold Willak (Deputy Head of Unit, 02 Coordination of Programmes)
The authors are grateful to colleagues who reviewed earlier drafts of the document, including: Julien Bollati from the European
Climate, Innovation and Networks Executive Agency (CINEA); Anna–Leena Asikainen, José Doramas Jorge Calderon, Christian
Milhan, Andre Oosterman, Christian Schempp and Isidoro Tapia from the European Investment Bank.
The authors bene昀椀ted from the advice of Prof. Massimo Florio (University of Milan) who acted as external academic advisor for
the Part I – General Principles. No errors or omissions should be attributed to him.
4
Economic Appraisal Vademecum
ACRONYMS
B/C bene昀椀t/cost
CF conversion factor
EA economic appraisal
SE stakeholder engagement
TABLE OF CONTENTS
Part I - General Principles
INTRODUCTION 8
2. COST–BENEFIT ANALYSIS 20
2.1 Introduction 20
2.2 Simpli昀椀ed cost–bene昀椀t analysis 20
2.3 Parameters 20
2.4 Topics not (fully) addressed in the 2014 CBA guide 21
2.5 Updates and developments 22
BIBLIOGRAPHY 31
ANNEX V. Transport 54
BIBLIOGRAPHY 91
6
Economic Appraisal Vademecum
Economic Appraisal
Vademecum 2021-2027
Part I - General Principles
7
Economic Appraisal Vademecum
INTRODUCTION
Background
The common provisions regulation for the 2014–2020 programming period included an obligation for major projects to undertake
a cost–bene昀椀t analysis (CBA) in line with the methodology described in legislation (Commission Implementing Regulation (EU)
No 207/2015) (1), supported by the European Commission Guide to Cost–Bene昀椀t Analysis of Investment Projects published in
2014 (2) – hereinafter referred to as the 2014 CBA guide.
The methodology and the 2014 CBA guide strengthened several aspects of the concrete application of CBA in project preparation,
notably in relation to economic analysis. The Joint Assistance to Support Projects in European Regions (JASPERS) initiative, which
supported the European Commission in the development of the last two editions of the European Commission CBA guide, was
strategically positioned to ensure quality standards across projects with proven bene昀椀ts in terms of both consistency of approach
and optimisation of public spending across sectors. The requirement for CBA has contributed signi昀椀cantly to ensuring good value
for money and has encouraged rigour in the project selection process.
Through the application of CBA to major projects in the 2014–2020 programming period, EU Member States gained a lot of
experience in using CBA as a tool to support decision-making on EU-funded investments. In many Member States, the use of
CBA in project appraisal extended beyond major projects, con昀椀rming the growing appreciation of the bene昀椀ts of carrying out
economic appraisal (EA) to ensure an optimal allocation of available funding. On the other hand, the conduct of CBA in certain
sectors and certain projects appeared overly complex and time-consuming, implying that simpler methods that o昀昀er similar
explanatory value are required. Building on the experience gained, a more 昀氀exible, yet rigorous, analytical framework for project
EA is proposed for the 2021–2027 programming period, for voluntary use. This framework re昀氀ects the principle of delegation of
approval to the national authorities to better take into account speci昀椀c and national project contexts.
In the context of the European Green Deal and Europe’s commitments to 昀椀ghting climate change, it is more important than ever
to use a methodology that o昀昀ers a wider perspective than looking only at 昀椀nancial cash 昀氀ows between stakeholders of European
projects and policies, including quantifying and monetising the e昀昀ects on those stakeholders that are indirectly a昀昀ected by those
policies.
EU and national recovery plans that have been developed to mitigate the economic recession triggered by the COVID-19 crisis
provide Member States with funding and 昀椀nancing opportunities for investments in several sectors. Public grants and loans will
be used in combination with regulatory measures and public 昀椀scal interventions to promote the recovery from the crisis in the
long term, including addressing the infrastructure backlogs observed in the EU. In this context, it will be important to secure the
sound selection and prioritisation of projects – based on, among other criteria, the results of EA.
In recognition of the above, and considering the exclusive responsibility of national authorities to assess and approve cohesion
policy projects in the 2021–2027 programming period, the Directorate-General for Regional and Urban Policy has launched, with
the support of JASPERS, the preparation of this Economic Appraisal Vademecum (EAV), for possible wider voluntary use across
EU funding sources in the 2021–2027 programming period. This EAV is based on established good practices at both EU and
national levels and it is consistent with the approach to EA followed by the European Investment Bank and other international
昀椀nancing institutions.
The EAV aims to provide methodological insights and tools to use EA methods in support of the early screening of investments
and for the assessment of projects for which a more detailed CBA might not be necessary.
To complement the EAV, the Directorate-General for Regional and Urban Policy developed a spreadsheet template with the
objective of standardising how to structure the cash 昀氀ows underpinning EA. The use of a standardised template is considered
useful, as it provides project promoters with some practical guidance on the format of the content of a CBA or other EA tool. At
the same time, this template helps evaluators to assess project proposals faster. This template is a tool that is complementary
to both the 2014 CBA guide and the EAV (3).
In this document, EA is de昀椀ned as the process aimed at assessing if a project will contribute to overall social welfare and to
economic growth. It takes into account bene昀椀ts and costs to society and gauges the value that the project generates for all
stakeholders, to determine if society will gain from the investment.
The EAV intends to ensure that appraisal is ‘昀椀t for purpose’ and provides the necessary information for decision-makers at various
decision points throughout the project cycle, while reducing the administrative burden not only for bene昀椀ciaries but also for those
bodies involved in the management of EU funds.
1
See: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32015R0207&from=EN
2
See: https://ec.europa.eu/regional_policy/sources/docgener/studies/pdf/cba_guide.pdf
3
The spreadsheet template was prepared by Dr. Linas Jasiukevičius under a consulting assignment led by the European Commission and also bene昀椀tted from advice of experts from JASPERS and from Julien Bollati
of CINEA.
8
Economic Appraisal Vademecum
For the 2021–2027 programming period and the cohesion policy funds, the use of CBA is not a legal requirement, and the 2014
CBA guide is not a legally binding document. It is recommended, however, to keep following its provisions to assess the economic
viability of large infrastructure investments. Starting from this basis, the EAV does not replace the 2014 CBA guide, but instead
complements it in the following ways:
- it introduces the principles of proportionality and 昀氀exibility to EA, in particular for projects on a small scale or simple
projects for which developing a fully 昀氀edged CBA might be unnecessarily burdensome or costly;
- it facilitates the practical application of the EA methodologies through the identi昀椀cation of established good practices;
- it covers additional sectors deemed to be relevant in the multiannual 昀椀nancial framework (MFF) for 2021–2027.
CBA remains the recommended appraisal tool, but other tools are suggested in speci昀椀c circumstances based on sector, project
type and scale.
The EAV is not prescriptive and should not be understood as an enforcement tool of EU legislation. Member States can draw
on the information presented to set up a framework for both project appraisal and selection that is in line with international
good practices. In particular, they can use it to better de昀椀ne their methods and criteria to approve investments in a context of
transparency and accountability of public expenditure.
As EA tools can be used across di昀昀erent EU/national policy sectors and institutions, the EAV is not linked exclusively to the
cohesion policy and is a resource that can be used across di昀昀erent funds in the 2021–2027 昀椀nancial perspective.
Finally, it is worth underlining that the EAV covers economic (and to some extent 昀椀nancial) appraisal only. Other important
aspects of project appraisal (e.g. demand; technical, environmental, legal and procurement aspects; and risk assessments) are
not discussed in this document. This is not to say that these aspects should not be assessed, but they would be better dealt
with within a project preparation guide than within a guide for EA. Where relevant, the EAV makes reference to existing guidance
documents and methodologies that help in dealing with these aspects in a sound manner.
Structure
The EAV is structured in two parts.
- Chapter 1 discusses why it is important to carry out an EA and how this should be proportional to the project’s type
and 昀氀exible enough to account for the speci昀椀cities of the project’s context. A simpli昀椀ed approach for the screening
of investment options is presented in this chapter.
- Chapter 2 illustrates CBA as the recommended EA voluntary tool. It complements the guidance provided in Chapter 2
of the 2014 CBA guide with additional/updated information, clearly stating when this represents a development or
a further speci昀椀cation compared with that guide. The text promotes a more 昀氀exible approach to setting some of the
parameters relevant for CBA than the requirements of the 2014–2020 programming period.
- Chapter 3 presents the guiding principles, key features and scope of application of alternative EA tools such as
least-cost analysis (LCA), cost-e昀昀ectiveness analysis (CEA) and multi-criteria analysis (MCA). This chapter updates
and expands upon Annex IX of the 2014 CBA guide.
- Appendix I provides a non-exhaustive overview of existing CBA national guidance.
- Finally, a bibliography of relevant references is provided.
Overall, Part I provides the general analytical framework for using EA during the 2021–2027 MFF.
- Annexes I to VII set out good practices in EA in the following sectors to complement the corresponding chapters of the
2014 CBA guide: research and innovation, renewable energy, energy e昀케ciency, municipal waste management, transport,
broadband, and water and wastewater. The focus is on topics in which the state of the art (in terms of data sets or guidance)
has developed since the 2014 CBA guide or conclusions have been drawn from the lessons learned in 2014–2020.
- Annexes VIII to X present methodologies for EA in sectors that were not covered in the 2014 CBA guide but are considered
relevant in the 2021–2027 MFF, namely healthcare, ICT and urban development.
These annexes are structured as follows: an introduction presenting the policy context, a discussion of what EA tool to use and
what simpli昀椀cations to apply at the di昀昀erent stages of the project cycle, and guidance on the key aspects featuring EA for the
relevant projects in the sector.
These annexes align with and further develop the general principles illustrated in Part I.
Even though they have some obvious connections and synergies, these annexes are intended as relatively independent sectoral
good practice guidance (‘living documents’) that can be updated over the course of the MFF once additional sources of information
or empirical data become available. Also, new sectors might be added at a later stage.
9
Economic Appraisal Vademecum
The policy framework for the cohesion policy outlines 昀椀ve main objectives in 2021–2027:
1. a more competitive and smarter Europe, by promoting innovative and smart economic transformation and regional ICT
connectivity;
2. a greener, low-carbon transition towards a net-zero carbon economy and resilient Europe, by promoting a clean and fair
energy transition, green and blue investment, the circular economy, climate change mitigation and adaptation, risk prevention
and management, and sustainable urban mobility;
4. a more social and inclusive Europe implementing the European Pillar of Social Rights;
5. a Europe closer to citizens, by fostering the sustainable and integrated development of all types of territories and local
initiatives.
The Just Transition Fund shall support the speci昀椀c objective of enabling regions and people to address the social, employment,
economic, and environmental impacts of the transition towards the Union’s 2030 targets for energy and climate and a climate-
neutral economy of the Union by 2050, based on the Paris Agreement.
According to the common provisions regulation (CPR) (4) approved in June 2021, there are no legal requirements for ‘major
projects’ with EU ex ante approval, nor does the regulation explicitly mention the need to perform a CBA (5).
However, the CPR calls for managing authorities to ensure proper value for money for the selection of operations to be 昀椀nanced,
with a major shift of responsibilities from the EU to Member States. The rationale for such a shift is based on the acknowledgement
that, over the years, best practices in the 昀椀eld of project preparation and EA were systematically promoted and developed at the
national level in line with EU requirements. At the same time, the CPR aims to foster the promotion of national quality standards
and practices.
At the national level, establishing and enforcing a methodology and related criteria for the selection of operations falls within the
responsibilities of managing authorities and of monitoring committees (6). The results of EA can be used as, among other things,
selection criteria to verify that projects are good value for money (i.e. to verify the maximisation of the ratio between resources
used and expected achievements).
Table 1 at the end of this section provides an overview of the main simpli昀椀cations introduced in the approach to EA for cohesion
policy-funded investments in the 2021–2027 programming period, compared with 2014–2020.
EA in general and CBA in particular are becoming increasingly relevant in other investment contexts beyond the cohesion policy.
CBA remains a requirement for most projects applying to the Connecting Europe Facility (CEF). According to the regulation
laying down the next CEF long-term budget (2021–2027) (7), CBA is among the criteria for the eligibility and awarding of grants
for cross-border projects in the 昀椀eld of renewable energy. For other sectors such as transport and energy transmission, CBA
requirements are speci昀椀ed in the work programmes and calls for proposals. Information included in CBAs will be assessed in the
framework of the selection process for Projects of Common Interest (PCIs). The European Climate, Infrastructure and Environment
Executive Agency has designed and made available to its bene昀椀ciaries a spreadsheet template to present the CBA results in the
submission of project proposals in the 昀椀eld of transport (CEF-T). In addition, a dedicated section of the spreadsheet template that
is complementary to this EAV and provides unit values of bene昀椀ts and costs at the country level is being considered for smaller
projects applying to the CEF transport call for proposals for 2021–2027. In the 昀椀eld of energy (CEF-E), it is recommended that
the CBA methodology drawn up by the European Network of Transmission System Operators for Electricity (ENTSO-E) (8) and
forGas (ENTSO-G) (9) is followed.
4
Regulation (EU) 2021/1060 of the European Parliament and of the Council of 24 June 2021 laying down common provisions on the European Regional Development Fund, the European Social Fund Plus, the
Cohesion Fund, the Just Transition Fund and the European Maritime, Fisheries and Aquaculture Fund and 昀椀nancial rules for those and for the Asylum, Migration and Integration Fund, the Internal Security Fund and
the Instrument for Financial Support for Border Management and Visa Policy.
5
According to Article 100 of Regulation (EU) No 1303/2013, a major project is an investment operation comprising “a series of works, activities or services intended in itself to accomplish an indivisible task of a
precise economic or technical nature which has clearly identi昀椀ed goals and for which the total eligible cost exceeds EUR 50 000 000 […]”.
6
In some Member States, methodologies are also centrally adopted at the coordinating body level, to be applied consistently by the various managing authorities.
7
Regulation (EU) 2021/1153 of the European Parliament and of the Council of 7 July 2021 establishing the Connecting Europe Facility and repealing Regulations (EU) No 1316/2013 and (EU) No 283/2014. (http://
data.europa.eu/eli/reg/2021/1153/oj).
8
ENTSO-E (2020), 3rd ENTSO-E guideline for cost bene昀椀t analysis of grid development projects, draft version, 28 January 2020 (https://eepublicdownloads.blob.core.windows.net/public-cdn-container/tyndp-
documents/2020-01-28_3rd_CBA_Guidleine_Draft.pdf). Final draft pending European Commission approval.
9
ENTSOG (2019), 2nd ENTSOG methodology for cost-bene昀椀t analysis of gas infrastructure projects 2018 (https://www.entsog.eu/sites/default/昀椀les/2019-03/1.%20ADAPTED_2nd%20CBA%20Methodology_
Main%20document_EC%20APPROVED.pdf).
10
Economic Appraisal Vademecum
The InvestEU regulation (10) introduces climate, environmental and social sustainability of investments as crucial elements in
the decision-making process when approving the use of the EU guarantee. These sustainability aspects should be veri昀椀ed for
the 昀椀nancing of investment operations under all windows of the InvestEU Fund, in particular in the area of infrastructure, also
taking into consideration the principle of proportionality. Operations with a signi昀椀cant climate, environmental or social impact
must be subject to a sustainability proo昀椀ng assessment following the methodology developed in the InvestEU sustainability
proo昀椀ng guidance (11). The assessment, quanti昀椀cation and, where feasible, monetisation of environmental and climate change
impacts (costs and bene昀椀ts) delivered by the project 昀椀t into the more comprehensive EA that is usually carried out by InvestEU
implementing partners as part of their due diligence process. The results of EA should be reported to the InvestEU Investment
Committee and taken into account, among other elements, when deciding on granting the EU guarantee. For those implementing
partners that do not (yet) have an established approach or procedure, this EAV (together with the 2014 CBA guide and the other
EU and national manuals mentioned in this section 1.1 and in Annex I) can provide a useful reference framework.
The Recovery and Resilience Facility will make EUR 672.5 billion in loans and grants available to support reforms and
investments undertaken by Member States by 2026. The aim is to mitigate the economic and social impact of the coronavirus
pandemic and make European economies and societies more sustainable, more resilient and better prepared for the challenges
and opportunities of the green and digital transitions. The Commission guidance to Member States on recovery and resilience
plans (12) speci昀椀es the following.
When preparing their plans, Member States should consider an investment as an expenditure on an activity, project, or
other action within the scope of the Proposal that is expected to bring bene昀椀cial results to society, the economy and/or
the environment. The Proposal aims at promoting measures that, if taken now, would bring about a structural change
and have a lasting impact on economic and social resilience, sustainability and long-term competitiveness (green and
digital transitions), and employment.
A simpli昀椀ed EA (as discussed later in this document) can be adopted in this context to assess the overall impacts of the
investments included in the recovery plans 昀椀nanced by the facility, while at the same respecting the need for timely decision-
making.
CBA will also remain a requirement in the framework of the preparatory phase of European Strategy Forum on Research
Infrastructures projects (the priority roadmap for research infrastructures in the EU). A Guidebook for socio-economic impact
assessment of research infrastructures was recently published by the Research Infrastructure Impact Assessment Pathways (RI-
PATHS) project funded by Horizon 2020 (13).
In terms of international 昀椀nancing institutions, the European Investment Bank (EIB) conducts an EA of projects considered
for 昀椀nancing. The EIB uses CBA as the default methodology to estimate a project’s economic rate of return (ERR) that accounts
for broader project bene昀椀ts and costs to society, including environmental externalities. It also applies CEA and, more recently,
MCA, taking into account the evolving circumstances of each sector. The results of the EA are entered into the overall evaluation
framework of projects applying for a loan from the EIB (additionality and impact measurement framework). The economic
appraisal of investment projects at the EIB (EIB, 2013a) presents the methodologies that the EIB uses to assess the economic
viability of projects. The EIB is currently updating this manual (14).
The European Bank for Reconstruction and Development (EBRD) undertakes an economic assessment of projects with high
greenhouse gas (GHG) emissions (15). When applying the economic assessment, a CBA is conducted, unless a CEA is deemed more
appropriate in some speci昀椀c circumstances, as described in the Methodology for the economic assessment of EBRD projects with
high greenhouse gas emissions (2019) (16).
The use of CBA has also gained much ground for the appraisal of investment projects at the national level, as re昀氀ected in
several manuals that were published for di昀昀erent sectors. Appendix I provides a non-exhaustive overview of existing CBA national
guidance. Some examples include the following: for France, Quinet et al. (2013); for Sweden, ASEK (2016) and Kriström and Bonta
Bergman (2014); for Poland, the experience of the Centre for EU Transport Projects (CUPT; Archutowska et al., 2014); and for the
United Kingdom, the Green Book (last update in 2018; UK Treasury, 2018).
CBA is also used to appraise relatively small investments in smaller economies. For example, in Lithuania, CBA is required for
investment projects larger than EUR 300 000. In Malta, the requirement for CBA becomes mandatory for any project proposal
with a total project cost of over EUR 5 million.
10
Regulation (EU) 2021/523 of the European Parliament and of the Council of 24 March 2021 establishing the InvestEU Programme and amending Regulation (EU) 2015/1017 (http://data.europa.eu/eli/reg/2021/523/
oj).
11
European Commission (2021), Technical guidance on sustainability proo昀椀ng for the InvestEU Fund, C(2021) 2632 昀椀nal, European Commission, Brussels (https://europa.eu/investeu/investeu-fund/about-investeu-
fund_en).
12
European Commission (2021), Commission sta昀昀 working document guidance to Member States recovery and resilience plans, SWD(2021) 12 昀椀nal, European Commission, Brussels (https://ec.europa.eu/info/sites/
default/昀椀les/document_travail_service_part1_v2_en.pdf).
13
For more information, see the RI-PATHS website (www.ri-paths.eu).
14
EIB (2013a), Economic appraisal of investment projects at the EIB (https://www.eib.org/attachments/thematic/economic_appraisal_of_investment_projects_en.pdf).
15
That is, projects where the proceeds increase emissions by 25 000 tonnes of carbon dioxide equivalent (CO2e) per year relative to a baseline or increase emissions by 100 000 tonnes of CO2e per year in absolute
terms.
16
EBRD (2019), Methodology for the economic assessment of EBRD projects with high greenhouse gas emissions (https://www.ebrd.com/news/publications/institutional-documents/methodology-for-the-economic-
assessment-of-ebrd-projects-with-high-greenhouse-gasemissions.html).
11
Economic Appraisal Vademecum
Since 2007, JASPERS (17) has been supporting the development of national CBA guidelines in several EU Member States, as
well as providing extensive capacity building on the subject, also at the EU level (18). Based on these activities over the last two
programming periods, the practice of using EA tools for decision-making on EU co-昀椀nanced projects has become well established
across the Member States and is likely to continue in 2021–2027.
Table 1. Approaches to EA for cohesion policy-funded investments – differences between 2014–2020 and
2021–2027
17
JASPERS is a major joint technical assistance initiative of the European Commission and the European Investment Bank that provides advisory and capacity-building support to all EU Member States and pre-
accession countries for the preparation of projects to be co-昀椀nanced by EU structural and cohesion funds, by the instrument for pre-accession assistance and by the Connecting Europe Facility. JASPERS helps
bene昀椀ciary countries to absorb EU funds intended to achieve greater cohesion in Europe through sound programmes and projects, which are planned, prepared, procured and run to the highest technical, social and
environmental standards possible. For further information, visit the JASPERS website (http://jaspers.eib.org/).
18
For more information about the EU level, see in particular the cycle of joint JASPERS / Directorate-General for Regional and Urban Policy CBA forum meetings implemented between 2015 and 2019
(www.jaspersnetwork.org)
12
Economic Appraisal Vademecum
In accordance with Article 61 of Regulation According to Article 73(c) of the CPR, the managing
No 1303/2013, Annex V to Regulation authority need to ‘ensure that selected operations
No 1303/2013 and Section III of Regulation present the best relationship between the amount of
EU support
No 480/2014, the outcomes of the 昀椀nancial support, the activities undertaken and the achievement
intensity
analysis in the CBA are used to calculate the of objectives’. This implies, amongst other, that
funding gap rate and, in turn, the intensity/level self-昀椀nancing and/or the bankability potential of an
of EU support (unless State aid rules prevail) operation should be taken into account where relevant
According to Annex III to Regulation No Member States are free to establish and use their own
Social 2015/207, a social discount rate of 5 % will be country-speci昀椀c social discount rate (see Section 2.3);
discount rate used for major projects in cohesion countries 3 % can be used in the absence of a national
and 3 % for the other Member States approach
- providing useful information to decision-makers at key decision milestones throughout the project development cycle;
- prioritising or ranking projects to meet a set of intended objectives with constrained resources;
- scoping out and shortlisting both strategic and technical options in the early programming and project development phase;
- enhancing transparency and accountability in project selection by using a consistent method that allows assumptions to be
tested.
13
Economic Appraisal Vademecum
For EA to inform decision-making, it should be supported by robust and objectively veri昀椀able evidence and should consider a
range of options to achieve a well-de昀椀ned objective or range of objectives. This will lower the risk that the analysis is used as a
mere compliance tool that justi昀椀es a decision already taken.
The EA can be used in a variety of situations during the di昀昀erent stages of the project life cycle. During project preparation, it is
used to identify and develop, in an iterative manner, the best project option to pursue the intended objectives and, ultimately, to
decide whether to proceed or not with a speci昀椀c investment. During implementation, it can be useful as a reference to check the
actual rolling out of the investment against the intended objectives and targets for monitoring purposes. Ex post, it can be used
to guide evaluations and extract lessons learned for future projects, in particular on the causes of possible deviations from the
ex ante estimations and on the main drivers underlying the project’s economic performance. In other words, EA should be seen
as an iterative process throughout the whole life of a project.
EA is particularly important at the early planning stage, when a range of alternatives are being considered, to inform decision-
makers on whether an investment is worthwhile (see Box 1 for good practices in option analysis).
Based on an analysis of a sample of around 250 major projects in 2014–2020, JASPERS has identi昀椀ed the most frequent
shortcomings of option analyses and formulated good practice examples.
Figure 1 and the text below describe, concisely, the role of EA in the development of a project proposal.
14
Economic Appraisal Vademecum
Preliminary screening/
• Definition of investment options
option analysis
• Simplified EA:
- Include all financial costs and benefits (economic costs only when relevant)
- Based on rough cost estimates and preliminary demand outputs
Large projects
Small projects
Detailed business • Fully fledged EA:
case - Further analysis (option selection)
Source: Authors.
The project objectives should be de昀椀ned with an explicit link to the needs identi昀椀ed and, if possible, should be quanti昀椀ed through
indicators and targets. A clear de昀椀nition of the objectives is necessary to identify the intended e昀昀ects of the project, which will
be further evaluated in the EA, and to verify the relevance of the project vis-à-vis the needs identi昀椀ed.
This process is instrumental in further identifying potential investment options and their expected bene昀椀ts and risks and in
providing the 昀椀rst high-level cost estimates.
Step 2 – preliminary screening / option analysis: simpli昀椀ed economic appraisal (all projects)
At the preliminary stage, the EA of an investment would typically assess a broad set of options with high-level or indicative costs
and e昀昀ects/bene昀椀ts. In this regard, the EA can be regarded as ‘simpli昀椀ed’.
A simpli昀椀ed EA implies focusing on 昀椀rst estimates from demand analysis of the outputs (goods/services) rendered by the project
(19) and rough estimates of the investment and operating costs.
Rough cost estimates are generally understood as being based on unit prices obtained from limited (regional) market surveys (i.e.
quotations from di昀昀erent suppliers) or from similar projects in the same (best if regional) context. It should be ensured, however,
that cost estimates are all-inclusive (i.e. that no important cost component is missing, e.g. asset replacement or decommissioning
costs). Overhead costs for planning and supervision, as well as contingencies, may be excluded, but then this should be applied to
all assessed options. If included, overheads should be calculated similarly for all options (e.g. as a percentage of net investment
cost).
The major outcome of the preliminary screening / option analysis is the identi昀椀cation of a technically feasible option (or a
shortlist of feasible options) that is in line with relevant strategies, policies and legislative requirements.
When the project is small – or when it is ‘simple’ because similar projects have already been carried out many times and
benchmarks of typical economic performance are available – a preliminary, simpli昀椀ed, EA is generally su昀케cient to be able to
select from the list of feasible alternatives a single preferred option that will be subject to evaluation for 昀椀nancing (20). Based
on the results of this analysis, project evaluators should have enough information to take the decision with a good degree of
con昀椀dence (see step 4).
It is the responsibility of Member States to de昀椀ne at the national level what the 昀椀nancial threshold is that quali昀椀es a project as
small.
19
This may not apply to all sectors/cases. For example, large transport infrastructures usually require the use of complex demand models that are already available at the option selection stage.
20
Or, if only one investment option is considered, to assess its economic viability and propose it for EU co-昀椀nancing.
15
Economic Appraisal Vademecum
Step 3 – detailed business case: fully 昀氀edged economic appraisal (large/strategic projects only)
When the project is large and/or strategic (or when the initial results of the EA are not conclusive), the EA must be updated and
detailed at subsequent stages of development of the proposal, as more information becomes available.
In other words, as the project proposal is developed further and its estimated impacts are re昀椀ned, project promoters are normally
expected to develop a more detailed EA as part of their business case. This could include:
- more accurate cost estimates resulting from additional detailed engineering work, more de昀椀nitive project speci昀椀cation and
design, better information about conditions of planning approval or more detailed project scoping;
- more re昀椀ned e昀昀ect/bene昀椀t estimates from detailed market or service demand studies and a clearer de昀椀nition of target
bene昀椀ciaries and other stakeholders;
- if CBA is used, a conversion of 昀椀nancial costs into the economic costs based on shadow prices;
- the inclusion of externalities (if not already quanti昀椀ed during the simpli昀椀ed EA).
A detailed business case is often used to assess, in depth, the merit of one project option, selected using the methodology
described in step 2. However, in less frequent cases, more options can also be developed in parallel at this stage.
Appraisals are often iterated a number of times before the project proposal is accepted in its 昀椀nal format and moved to
implementation (or a decision not to proceed to implementation is taken, as may be the case). In particular, it will usually be
important to review the impact of risks, uncertainties and inherent biases as project preparation proceeds.
This information helps to provide a reasonable understanding of whether, in the light of possible changing circumstances, the
proposed project is likely to continue to achieve net social bene昀椀t.
In addition, the results of the EA can be also used by a decision-making body to rank and prioritise competing projects in the
context of budgetary constraints.
It is worth noting, however, that the results of the EA would not be the only factor taken into account when taking an investment
decision (or when ranking and prioritising projects). Other aspects such as strategic relevance (national, regional, territorial or
sustainable urban development perspectives), technical feasibility, a昀昀ordability, environmental sustainability, climate resilience,
legal compatibility, managerial capacity, etc., are also equally important (21).
Depending on the type and sector of the investment, a range of EA methodologies could be considered.
CBA is the preferred approach for assessing public investment projects, as it o昀昀ers a robust, objective and evidence-based
analytical framework for project evaluation. In the EU, it has been and it continues to be widely used across di昀昀erent policy
sectors and institutions as the main EA tool to identify welfare-maximising projects, subject to the resource constraints.
Conducting a CBA could be, however, a resource-intensive process and should be proportionate to the size, importance and/or
risk pro昀椀le of the investment. Depending on the project’s scale, nature and/or data availability, a comprehensive CBA may not
always be recommended or even possible. In such cases, Least-Cost Analysis (LCA) or Cost-E昀昀ectiveness Analysis (CEA) could be
adopted as an alternative. A Multi-Criteria Analysis (MCA) could also be used as an alternative, even though it is more often used
as a complement to the other tools.
- decision-makers have previously agreed on a speci昀椀c objective and wish to compare only those options that aim to meet the
same objective (e.g. the compliance-driven (22) projects in the environment sectors);
- there is only one project outcome (or the outcomes and the possible associated externalities are considered equivalent)
across options. For example when the project focuses merely on the choice of technology or is not a self-standing unit of
analysis, but a component within a larger investment that has already been subjected to CBA (e.g. an upgrade of information
technology systems) and performing another CBA would not provide any explanatory value.
In these cases, the project appraisal focuses on whether the project constitutes the cheapest (LCA) or the most cost-e昀케cient
(CEA) alternative to supply a given good or service and to achieve the intended objective.
These aspects should always be properly assessed from the perspective of their informative value and legitimacy in the given circumstances; in case of doubts, quanti昀椀ed methods should take precedence over
21
MCA is typically used as an appraisal tool for structuring the option analysis during project preparation. MCA can be used to
screen strategic options at the preliminary stage of the project cycle. Once the strategic option is identi昀椀ed, a comparison of the
speci昀椀c technical solutions can be carried out by means of a CBA or CEA/LCA. As discussed later in this document (Section 3.2),
the MCA approach is also used in the context of investment programmes with multiple objectives, as a tool to show the relevance
of project investments to overall strategic aims and policy objectives.
To sum up, the suitability of the tools for certain projects depends on the extent to which:
- the project produces multiple outputs (the greater the number of outputs, the more appropriate the application of CBA);
- these outputs can be measured and monetised (the easier an output is to monetise, the more feasible the use of CBA);
- the appraisal concerns a programme or an investment plan that includes several projects (this type of appraisal requires a
clear relationship with existing polices, and MCA is suitable in this case).
Chapters 2 and 3 (as well as the annexes in Part II of the EAV) give more precise indications about the scope of application of
the CBA (while remaining a voluntary option) and other tools.
Table 2 provides a framework for the potential use of EA tools across sectors/areas. The table is for guidance only and is not
exhaustive, as other investment areas may be deemed to be relevant in future EU policies. The choice of EA method depends
ultimately on speci昀椀c circumstances and the data availability of each project.
17
Economic Appraisal Vademecum
Project type
Area Investment area
Small projects Large/strategic projects
Water and wastewater infrastructure
LCA/CEA CBA
(e昀케ciency driven) (23)
Water and
Water and wastewater infrastructure
wastewater LCA/CEA LCA/CEA
(exclusively compliance driven)
Flood prevention Simpli昀椀ed CBA CBA
Transport infrastructure (all modes) (Simpli昀椀ed) CBA CBA
Transport infrastructure: compliance-driven
Transport CEA/MCA CEA/MCA
project (all modes)
New technology in transport CEA/MCA CBA/CEA/MCA
23
NB: Projects that have a mix of e昀케ciency- and compliance-driven elements (in practice this is usual) should follow this line.
24
Revenues are determined by the forecasts of the quantity of goods/services provided and their price, in the form of fees, tari昀昀s or charges to users. The underlying concept de昀椀ning a revenue is that ‘it is a
payment against a service’. In turn, payments received from upper level institutions/authorities to cover operational de昀椀cits and to ensure operations’ sustainability are to be considered as subsidies and therefore
not included in the calculation of the return on investment.
18
Economic Appraisal Vademecum
The building blocks of 昀椀nancial appraisal have many elements in common with EA, in particular project costs. In
addition, when CBA is used as an EA tool, the assessment of the project’s 昀椀nancial pro昀椀tability (return on investment) outlines
the cash 昀氀ows that underpin the calculation of the socioeconomic costs and bene昀椀ts.
However, economic and 昀椀nancial appraisals di昀昀er in the scope, the basis for valuation of the costs and bene昀椀ts (e.g. 昀椀nancial
appraisal does not consider non-cash 昀氀ow items such as externalities) and the discount rate used (see Box 2).
The 昀椀nancial net present value on investment and the 昀椀nancial rate of return on investment are two indicators used to measure
the project’s pro昀椀tability. When the former is positive and the latter is larger than the discount rate, the project is 昀椀nancially
viable.
In general, a project that is not 昀椀nancially viable needs a redesign or additional sources of funding such as grants and subsidies.
By contrast, a 昀椀nancially pro昀椀table project should preferably be supported with other forms of 昀椀nancing (e.g. loans).
As regards sustainability of operations, a project is 昀椀nancially sustainable if the cumulated cash 昀氀ow (i.e. cash in hand at the end
of the year) is positive (or nil) for all of the years considered for operations.
For the methodology on how to carry out the analysis of 昀椀nancial pro昀椀tability within the CBA, see Section 2.7 of the 2014 CBA
guide.
A commonly used approach consists of estimating the actual cost of capital in a given industry/sector. Following this approach, the FDR
is intended as an indicator of (minimum) expected pro昀椀tability of a business and it can be estimated based on the weighted average
capital cost (WACC) approach. The use of WACC as the FDR is considered appropriate because it integrates a risk premium into the
expected return for new investments in a given sector. That is, the WACC is taken as a reference for comparison with the return an investor
would have if it invested in that business. As general rule, the WACC values to be used should be those o昀케cially set at the national level by
the regulating authority for those (sub)sectors where this is available. In other cases (e.g. partial sector coverage and unregulated sectors),
alternative rates can be proposed by other planning authorities on the basis of a robust justi昀椀cation and a clear methodology. When the
nature of the investment is so speci昀椀c that it can be considered a ‘self-standing sector’ with regard to the context in which it operates,
company-speci昀椀c WACCs can be proposed directly by project promoters.
Another approach consists of estimating the opportunity cost of capital for an economy as a whole. In this case, the FDR can be
proxied by the latest long-term interest rates of national government bonds (or by the long-term returns of an international portfolio of
investments).
In the context of EU co-昀椀nanced projects, both approaches are acceptable. The WACC is more frequently used in private investments, and
the opportunity cost of capital in the public ones. Member States can assess their own country-speci昀椀c FDR(s), provided that adherence to
State aid rules is respected. It is Member States’ responsibility to provide clear indications of what FDR applies to their bene昀椀ciaries in order
to ensure a consistent application to all sectors and projects concerned.
19
Economic Appraisal Vademecum
1 2. COST-BENEFIT ANALYSIS
2.
2.1 Introduction
CBA is an analytical tool used to assess the economic advantages or disadvantages of an investment decision by quantifying the
welfare changes attributable to its implementation. It aims to quantify all bene昀椀ts and costs for society in monetary terms. These
include economic, social and environmental impacts. It was a compulsory tool in the 2014–2020 programming period for major
projects 昀椀nanced by the European Regional Development Fund or the Cohesion Fund and is a voluntary tool in the 2021–2027
programming period with the necessary contextual adjustments.
Chapter 2 of the 2014 CBA guide discusses in detail the CBA general analytical framework, its working rules and operational
steps. The EAV focuses, therefore, only on the new or speci昀椀ed provisions compared with what is stated in the 2014 CBA guide.
This concerns the following:
As discussed in Section 1.2, at the preliminary stage the EA can be regarded as ‘simpli昀椀ed’, as it is based on rough, indicative
estimates of costs and bene昀椀ts.
If CBA is adopted as the EA method, a typical simpli昀椀cation at this stage consists of the use of 昀椀nancial costs (based on market
prices) instead of economic costs (based on shadow prices). As the calculation of economic costs can be resource intensive, the
conversion of market prices is not always necessary in a simpli昀椀ed CBA (25).
In addition, when the project options are expected to have similar externalities, in terms of both typology and volume, their
inclusion in the analysis can be skipped and replaced by a descriptive, qualitative assessment (26).
2.3 Parameters
Reference period
The number of years for which cost and bene昀椀t forecasts are provided corresponds to the project’s reference period.
The CPR for 2021–2027 no longer includes binding reference periods per sector, as was the case in the past regulation (see
Annex I of Commission Delegated Regulation (EU) No 480/2014)(27).
The reference period should correspond to the project’s economic life to allow its likely long-term impacts to unfold. In other
words, CBA projections must be long enough to capture all signi昀椀cant costs and bene昀椀ts of the project. The project’s economic life
is de昀椀ned as the expected time during which the project remains useful (i.e. capable of providing goods/services) to the promoter.
The economic life of an asset could be di昀昀erent from its actual physical life. For example, a technology product can be in optimal
physical condition but not anymore economically useful to the promoter as it became obsolete.
When a project includes assets with di昀昀erent economic lives, a good practice is to set the reference period as the value-weighted
average lifetime of these assets. This, however, should generally be restricted to a reasonable time limit of future forecastability
of the net future economic cash 昀氀ows, usually no longer than 50 years.
The reference period should include the years of both investment and operations (and decommissioning, when relevant).
Since the choice of the reference period a昀昀ects the EA results (usually, the longer the reference period, the higher the economic
performance), the project evaluators should check that the assumptions made on the project’s economically useful life are
realistic and justi昀椀ed. In this regard, it might be helpful to refer to standard benchmarks that are nationally or internationally
accepted, and di昀昀erentiated by sector. The sector annexes in Part II of the EAV provide some useful indications in this regard.
25
However, when prede昀椀ned conversion factors per cost item are made available in national guidelines, the conversion process is smooth and can already be adopted in a simpli昀椀ed CBA. Or, if VAT on construction
cost is already known at the preliminary stage, it can be easily simply dropped o昀昀 in the simpli昀椀ed CBA.
26
However, when unit values are made available in the economic literature, as this is the case particularly for the transport sector, the valuation of externalities can be already integrated in a simpli昀椀ed CBA.
27
Commission Delegated Regulation (EU) No 480/2014 of 3 March 2014 supplementing Regulation (EU) No 1303/2013 of the European Parliament and of the Council laying down common provisions on the
European Regional Development Fund, the European Social Fund, the Cohesion Fund, the European Agricultural Fund for Rural Development and the European Maritime and Fisheries Fund and laying down
general provisions on the European Regional Development Fund, the European Social Fund, the Cohesion Fund and the European Maritime and Fisheries Fund (https://eur-lex.europa.eu/legal-content/EN/TXT/
PDF/?uri=CELEX:02014R0480-20150511&from=EN).
20
Economic Appraisal Vademecum
The SDR re昀氀ects the long-term opportunity cost of resources for society as a whole. The SDR is used in EA to recognise that
consumers have an intertemporal preference to consume goods and services from the use of resources that are scarce and often
competing. In other words, the resources allocated to one project have other potential uses, which are forgone.
Di昀昀erent approaches have been proposed in the literature to estimate the SDR. The approach recommended here is the social
rate of time preference (SRTP) (28).
The Member States can assess their own country-speci昀椀c SDRs following the formula presented in Annex II of the 2014 CBA
guide (29) and taking into account the following recommendations.
- Issues related to systemic risk and optimism bias should be re昀氀ected not in the SDR but in the risk
assessment. Systemic risks lead to a reduction in the value of the expected bene昀椀ts if these bene昀椀ts are positively
correlated with a macroeconomic scenario. Rather than adjusting the discount rate, systemic risks can be handled in the
EA by accounting them directly into the net bene昀椀ts’ streams and testing the robustness of the project’s performance
against changes in the main assumptions. This can be done by using base case values to be further tested in sensitivity
analysis. Additional project risks including option bias should be addressed in a (qualitative and/or quantitative) risk
assessment in line with Section 2.8 of the 2014 CBA guide.
- The SDR can decline over the reference period in projects with very long-term impacts. In the economic
literature, there is some empirical support for the view that constant discounting is inconsistent with consumers’
preferences. That is, in facing the decision between a smaller reward soon and a larger reward later, individuals would
apply a lower discount rate in the long term. Time-inconsistent preferences would therefore justify using an SDR that
declines over time. While the rationale for such an assumption is clear, the approach suggested here is that the SDR
remains stable over the reference period. In most cases, the bene昀椀ts and the costs arise during a limited number of
years. That is, the reference period is ‘short’ enough to justify the use of a single SDR and to calculate the economic net
present value (ENPV) with a negligible margin of error. Only projects with very long-term impacts (e.g. beyond 50 years),
involving intergenerational equity considerations, should adopt declining discount rates.
- The SDR should not vary across sectors based on policy considerations. Sector-speci昀椀c rates would imply that
one project or sector has a higher opportunity cost than another, which is not consistent with the social rate of time
preference-based approach.
In this regard, a forthcoming publication (Catalano et al., 2021) presents estimations of the SDR at the national level for a sample
of countries and can be a useful reference. Based on their calculations with updated data (including forecasts of economic growth
rates), the SDR would currently range from a maximum of 8.13 % for Estonia to 0.80 % for Italy (calculated following the SRTP
method), with an EU average of 3.6 % and a median value of 2.8 %.
As a matter of simpli昀椀cation, in the absence of national values, 3 % SDR can be taken as a reference point for EU-funded projects
in 2021–2027.
Finally, it is worth noting that the EA is usually carried out in constant (real) prices (i.e. with prices 昀椀xed at a base year). When the
analysis is carried out at constant prices, the SDR should be expressed in real terms.
- wider impacts achieved through the multiplier e昀昀ect (e.g. contributions to regional gross domestic product or unemployment
rates) should be excluded from the analysis because they are usually transformed, redistributed and/or capitalised forms of
the direct e昀昀ects already captured in the CBA;
- induced impacts on local economies should also be excluded because of possible displacement e昀昀ects; for example, an
increase of business activities in the project area can be matched by an equal decrease elsewhere (30);
- indirect impacts on complementary markets (e.g. cost savings achieved by the promoter’s suppliers, distributors, etc.) can be
included, when relevant and provided that they are not already captured in the shadow prices of the project’s inputs and/or
outputs.
Historical costs
The initial investment cost consists of capital expenditures (CAPEX) for all 昀椀xed and non-昀椀xed assets occurring during the
implementation period. In the case of historical costs (i.e. expenditure already incurred before the start of the analysis), the
approach recommended in the EAV is to include them in the analysis (i.e. they should not be considered sunk costs). Historical
costs should be capitalised (using an average in昀氀ation rate based on the consumer price index) and included in the 昀椀rst year of
the reference period.
28
This is de昀椀ned as the rate at which the consumers are willing to postpone a unit of current consumption in exchange for more future consumption.
29
SRTP = p + e × g, where p is the pure time preference, e is the elasticity of the marginal utility of consumption (i.e. the percentage change in individuals’ marginal utility corresponding to each percentage change
in consumption) and g is the expected growth rate of per capita consumption. As an example, evidence of the empirical estimation of the SDR for 20 European countries is presented in Florio (2014).
30
Unless boosting a given geographical area/region is itself an objective of the project. 21
Economic Appraisal Vademecum
The rationale is that, in the context of EU co-昀椀nanced projects, the main question is not ‘should the project be continued?’, as
this would matter in, for example, the case of purely private investments. Instead, the question is ‘do the expected net bene昀椀ts
justify an investment that is paid with EU taxpayers’ money?’. In this regard, to protect EU taxpayers’ interests, the analysis of a
project’s economic viability should focus on the whole investment cost (31).
In-kind contributions
In-kind contributions supplied during either implementation or operation periods should be included in the analysis at (at least)
their market value, even if they do not correspond to an actual 昀椀nancial cash 昀氀ow.
Di昀昀erent adaptation measures should be assessed to 昀椀nd the right measure or mix of measures or even to consider deferred
implementation timings (昀氀exible/adaptive measures) that can be implemented to reduce the risk to an acceptable level. The
selected measure(s) should then be integrated into the project design and/or its operation to enhance its climate resilience. Their
costs (either CAPEX or operating expenses (OPEX)) are entered as inputs (out昀氀ows) into the EA of the project.
The European Commission’s technical guidance on the climate proo昀椀ng of infrastructure in 2021–2027 provides detailed
guidance on how to carry out a climate risk assessment (32).
In practice, however, distortions in investment projects in Europe are not so substantial; therefore, for most elements, it can be
assumed that their shadow pricing corresponds to market prices.
Thus, when national parameters are not available, the default rule is that market prices equal shadow prices (i.e. CF = 1), with
the exception of the items illustrated in Table 3. Labour, land, utilities and commodities are those items most frequently a昀昀ected
by market distortions, which an analysis of their opportunity cost is always recommended for.
31
Some (marginal) exceptions may apply in the case of minor investment items that occurred in the very distant past, for instance feasibility studies that become outdated or the purchase of land that cannot be
recovered and therefore its opportunity cost is close to zero.
32
European Commission (2021), Technical guidance on the climate proo昀椀ng of infrastructure in the period 2021-2027, C(2021) 5430 昀椀nal, European Commission, Brussels (https://ec.europa.eu/clima/sites/default/
昀椀les/adaptation/what/docs/climate_proo昀椀ng_guidance_en.pdf).
22
Economic Appraisal Vademecum
Residual value
When the reference period is set equal to the project’s economic life the residual value is normally zero. However, in cases in
which, at the end of the reference period, some assets/components are still economically useful or there is a market for their
resale, a residual value bene昀椀t may be included in the last year of analysis.
As regards the estimation of the residual value, unlike in 2014–2020, the method of using the remaining cash 昀氀ow after the end
of the reference period is no longer suggested as the preferred option. This is because of the current recommendation to set the
reference period equal to the total economically useful life of the project (the two approaches are mutually exclusive, as they
generate the same result).
The recommended approach is therefore to calculate the remaining value of the assets/components based on a standard
accounting depreciation formula (book value).
In the case of projects with a very long economically useful life, however, it might not be convenient to show forecasts for their
entire economic life (e.g. if this exceeds 50 years). In this case, the reference period can be shortened for the convenience of
presentation and the residual value can be added and estimated as the (discounted) remaining cash 昀氀ow of costs and bene昀椀ts.
In line with the EC technical guidance on the climate proo昀椀ng of infrastructure in 2021–2027 (34), it is recommend to use as
shadow cost of carbon the values recently established by the EIB as the best available evidence on the cost of meeting
the temperature goal of the Paris agreement (i.e. the 1.5 ⁰C target) (35) (Table 4).
Year EUR / t CO2e Year EUR / t CO2e Year EUR / t CO2e Year EUR / t CO2e
2020 80 2030 250 2040 525 2050 800
2021 97 2031 278 2041 552
Project ranking
The project’s overall socioeconomic performance is measured by the following indicators:
- ENPV – this is the di昀昀erence between discounted total social bene昀椀t and social cost, valued at shadow prices, and is
expressed in monetary values;
- ERR – this is the SDR producing a zero value of the ENPV and is expressed in percentage points;
- bene昀椀t/cost (B/C) ratio – this is the ratio between discounted economic bene昀椀ts and costs.
The project is economically viable when the ENPV is positive, the ERR is larger than the SDR and the B/C ratio is greater than 1.
33
In case of projects that o昀昀set emissions through the purchase of emission permits, including cap and trade (such as the European Emission Trading System), care should be paid to avoid any double counting.
For example, increase of emissions can be o昀昀set by purchasing emission permits, which result in net zero emissions. In other words, CBA has to discriminate between situations where there are o昀昀sets and where
there are not.
34
See footnote 30.
35
In 2020, the EIB was engaged in a review of the latest evidence on the cost of carbon, in particular drawing from modelling results that formed the basis of the Intergovernmental Panel on Climate Change Special
Report on Global Warming of 1.5 ⁰C. In the light of the Paris Agreement, the review of the EIB’s carbon pricing approach focused on the full cost of the marginal measure required to drive the economy to meet the
1.5 ⁰C global temperature target (abatement cost approach; see https://www.eib.org/en/publications/the-eib-group-climate-bank-roadmap).
23
Economic Appraisal Vademecum
As illustrated in Annex XI of the 2014 CBA guide, each indicator has its own particular merit, pros and cons. In this respect, the
choice of economic indicator to be used for selecting options (or when ranking alternative projects) depends on the circumstances.
When comparing options within a single investment proposal, usually the better performing option has both a larger ENPV and a
larger ERR than the option performing less well. There might be, however, some (infrequent) cases in which, owing to the di昀昀erent
scales of the options, one has a larger ENPV but a smaller ERR than the other. In such a case, it is suggested that the ERR is used
because it would (usually) allow the promoter to save resources that could be reused for additional investments (36).
In ranking alternative projects from a group, if there is a constraint on the number of projects that can be 昀椀nanced, then the ENPV
should be used as the default indicator. By contrast, in the more frequent case of projects competing under budget constraints,
the ENPV becomes less relevant (because it is biased towards more expensive projects) and the ERR is the preferred option,
provided that it can be calculated for all projects.
Owing to its limitations, it is not recommended to use the B/C ratio to rank options/projects (37).
Stakeholder engagement
Stakeholder engagement (SE) is the process of identifying and incorporating stakeholder concerns, needs and values in
the decision-making process. The overall goal is to achieve a transparent decision-making process with greater input from
stakeholders and their support on the decisions that will be taken. To secure successful project implementation and
operations, stakeholders should be involved during the process of project preparation following a participatory
approach. The advantages of SE include an increase in the reliability and legitimacy of the public administration, an increase
in the sense of social responsibility among local communities related to the project, an increase in social equity and a decrease
in barriers.
As discussed in Section 2.8.10 of the 2014 CBA guide, stakeholder identi昀椀cation and an analysis of the distributional e昀昀ects of the
project are useful complements to the results of the CBA, helping to meet the objective of putting into practice a clear decision-
making process with a strong involvement of stakeholders to support the project decision. In operational terms, a matrix can be
developed, linking each project impact with the sectors and the stakeholders a昀昀ected by such impacts.
While traditional CBA does not explicitly consider SE in its computation, there are some recent developments in this 昀椀eld
attempting to monetise the costs and bene昀椀ts of SE (e.g. the cost of engaging stakeholders (events, negotiations, etc.) and the
bene昀椀ts of their participation) (38).
36
The option with the larger ERR, usually, has a smaller investment cost than the option with the larger ENPV.
37
As discussed in Annex XI of the 2014 CBA guide, the B/C ratio is sensitive to the classi昀椀cation of the project e昀昀ects as bene昀椀ts rather than costs. It is relatively common to have project e昀昀ects that can be treated
both as bene昀椀ts and as cost reductions and the converse. As the B/C ratio rewards projects with low costs, considering a positive e昀昀ect as a cost reduction rather than a bene昀椀t would result in only an arti昀椀cial
improvement of the indicator.
38
One of the 昀椀rst attempts proposed in the international literature related to the introduction of SE within CBA was that of Pagliara and Di Ruocco (2018). In this paper, the authors recomputed all of the costs and
bene昀椀ts of the Turin–Lyon high-speed rail project following an ex post approach. They demonstrated how the monetisation of the costs and bene昀椀ts of SE could provide a way forward in project evaluation.
24
Economic Appraisal Vademecum
2
3. OTHER ECONOMIC APPRAISAL TOOLS
OTHER ECONOMIC APPRAISAL TOOLS
CEA is used to compare two or more project options in relation to their e昀昀ectiveness and life-cycle costs in accomplishing a
single policy-speci昀椀c objective. By combining information on e昀昀ectiveness and costs, the project promoter can determine which
investment option provides the best e昀昀ect at the lowest cost (or, conversely, which option provides the highest e昀昀ect for a given
cost). In this respect, CEA can take the forms of cost minimisation or e昀昀ect maximisation.
Like CBA, CEA is a method used for the evaluation of a project’s e昀昀ects at the microeconomic level. CEA di昀昀ers from CBA because
it does not evaluate the bene昀椀ts in monetary terms. This is based on the assumption that all options considered are
technically and economically viable and deliver the same single typology output (or process the same single type
of input) even if in di昀昀erent intensities/volumes.
Table 5 reviews the di昀昀erences between CBA and CEA in terms of the inclusion and treatment of the main project’s cash 昀氀ow
items.
If the options achieve the same output with the same intensity/volume, they di昀昀er only in costs, and the CEA can be simpli昀椀ed to
an LCA, whereby options are compared based only on the present value of their life-cycle costs.
CEA usually aims to identify the possible alternatives for achieving a set goal and the related costs, and to choose the most
e昀昀ective option. That is, it allows us to choose which one among several alternatives is most cost-e昀昀ective, but it does not
tell us if an alternative is worthwhile in some absolute sense. In other words, unlike CBA, CEA cannot indicate if the preferred
option provides a net bene昀椀t to society. Therefore, it is always useful to compare the results of the analysis with established
benchmarks to verify that the chosen option meets the generally acceptable cost performance criteria.
When an option is both more e昀昀ective and less costly than the alternative, it is said to ‘dominate’ the alternative. In this situation,
there is no need to calculate cost-e昀昀ectiveness ratios, because the decision on the strategy to choose is obvious.
However, in most circumstances, the option under examination is simultaneously more (or less) costly and more (or less) e昀昀ective
than the alternative(s). In this situation, cost-e昀昀ectiveness ratios allow appraisers to rank the options, eliminate those
whose cost-e昀昀ectiveness ratio is higher than others and then identify the optimal option.
The ‘levelised cost’ concept is often used to assess the project’s cost-e昀昀ectiveness.
The levelised cost is a life-cycle cost indicator, commonly used to gauge long-run unit costs. It is calculated as the ratio of
the present value of the total (capital, operating, replacement and decommissioning, if relevant) costs over the entire project
reference period to the present value of the total amount of output produced over the same time horizon (39).
When the project does not generate revenue, and all options have the same economic lifetime, the levelised cost can be used
directly as a cost-e昀昀ectiveness ratio. This is the most common application of the CEA for EA.
On the other hand, when the project options are revenue generating, and when the reference period is not equal to the economic
lifetime of the asset, revenues and residual value must be calculated and included in the analysis.
39
This is the simplest and most commonly used de昀椀nition of levelised cost based on 昀椀nancial items (market prices). In some cases, in particular in the energy sector, it is possible to calculate levelised costs based
on economic items (shadow prices), which are also a factor in the margin cost of externalities.
25
Economic Appraisal Vademecum
CFi is the discounted sum of CAPEX + O&M (40) – revenue – residual value
Qi is the discounted changes in outputs (quantity).
Finally, this indicator can also easily be adapted to incorporate key economic externalities (e.g. carbon dioxide and air pollutant
emissions), when these di昀昀er substantially between the options appraised. When this indicator is negative, externalities can be
included as costs in the numerator of the formula (41).
The CEA methodology is often used in the economic evaluation of healthcare programmes, but it can also be used to assess
some education and environmental projects. For these examples, simple CEA ratios are used, such as the cost per student,
cost per unit of emission reduction, cost per unit of water, wastewater or waste treated, and so on.
CEA is less helpful when a money value can also be given to the bene昀椀ts, not just to the costs. In addition, CEA cannot be used
to compare projects or programmes with several di昀昀erent outcomes or objectives that are not directly comparable.
To sum up, CEA is a practical tool for project comparison when the following conditions apply:
- the project produces only one output that is homogeneous and easily measurable;
- the aim of the project is to achieve the output at minimal cost;
- costs can be completely assessed for each alternative (i.e. hidden costs are more or less irrelevant);
- there is a wide range of benchmarks to verify that the chosen technology meets the minimum cost performance requirements.
The MCA methodology can be useful at both programme and project levels.
At the project level, it is recommended to consider the MCA as a tool to complement CBA, CEA and/or LCA, for example to compare
project strategic options (see Section 1.3). This practice was already recommended and used during the 2014–2020 MFF for
the appraisal of major projects. The use of simple MCA as a tool for the analysis of options in project appraisal is described in
Annex IX of the 2014 CBA guide, as well as in Chapter 9 of The economic appraisal of investment projects at the EIB (EIB, 2013a),
and is not repeated here.
This section provides additional practical indications on how to perform an MCA at the programme level, where it is advisable to
use a policy-led MCA (PLMCA) (42).
A PLMCA could be used to assess multisectoral territorial programmes (e.g. regional transition and urban development
programmes) or to prioritise and select projects within a given policy area or projects that have multiple sites/objectives (e.g.
smart specialisation or integrated programmes dealing with climate change). At such programme levels, PLMCA can provide a
clear record of the decision-making process, which is particularly useful when projects need to be prioritised from a larger pool of
alternatives. PLMCA assigns scores based on a process that starts with the highest level objectives informed by existing policies,
and it illustrates the steps taken to reach the 昀椀nal decision. Annex X of Part II of the EAV provides an example of a PLMCA used
to assess an urban regeneration programme.
PLMCA aims to provide a sound basis for programme/investment plan evaluation by referencing an explicit set of objectives that
decision-makers have identi昀椀ed on the basis of existing policies (at local, regional, national, EU and other international levels).
Decision-makers establish both measurable criteria and proxy indicators to assess the extent to which the objectives are likely
to be met.
There are many ways to design a PLMCA exercise. However, a ‘typical’ approach (e.g. the one shown in Annex X of Part II of the
EAV) usually comprises some standardised steps:
- Problem structuring. This step de昀椀nes the context in which the programme takes place, the stakeholders’ standpoints that
are to be considered and the de昀椀nition of the overarching policy framework and associated objectives to enable decision-
making. These objectives should not be redundant, but could be competing (the achievement of one objective could partly
preclude the achievement of another). The decision-makers should assign a weighting to each objective in order to re昀氀ect its
relative importance. It is highly desirable that the de昀椀nition of the policy objectives is guided by reference to international,
national and local policy goals alongside secondary information sources. Within a given policy area (transport, environment,
urban development, etc.), typical objectives refer to institutional, social, territorial, environmental, technical, 昀椀nancial and
40
This includes replacement costs.
41
In this case, the CEA embraces some aspects typical of CBA (i.e. the monetary evaluation of externalities) and can be regarded as an ‘in between’ methodology or a simpli昀椀ed CBA. This approach applies in particular
to energy investments.
42
The PLMCA tool represents the output of a holistic and consistent approach to the appraisal of programmes by aligning programme objectives with policy and identifying qualitative and quantitative criteria/
indicators for measuring performance objectives.
26
Economic Appraisal Vademecum
economic dimensions.
- Model building. Once the policy framework and the set of objectives have been determined, a technique should be de昀椀ned
to aggregate information and to make an informed choice. This step focuses on de昀椀ning, for each objective, a number of
appraisal criteria or indicators. Appraisal criteria or indicators can be qualitative or quantitative and they can refer to the
priorities pursued by the di昀昀erent parties involved or to particular evaluation aspects. When relevant, minimum thresholds
can be set for some criteria for the programme to be accepted.
- Analysis of impact and programme performance. This step involves forecasting, for each of the objectives, the impact
produced by the programme. All of the decision-makers must decide by consensus the scores that determine the performance
in relation to each objective. It is important to note that application of the model is likely to include the consideration of both
quantitative and qualitative aspects of performance, including, where feasible, outputs from CBAs (43). This process requires
that the decision-makers review together how the programme delivers under each aspect represented by the columns in the
PLMCA model.
- Reporting results. Scores under each objective are then aggregated to give a total score for the proposal as a whole (all
dimensions considered). The results of the appraisal may either inform a decision directly or result in the need for further
iteration (e.g. to adjust problem de昀椀nition or the nature and weights applied to the objectives) and/or sensitivity testing.
To sum up, MCA is particularly suitable at the programme level to evaluate di昀昀erent investment con昀椀gurations/scenarios, which
may need to be supplemented with further economic analysis at the project level (CBA or CEA/LCA). Its key bene昀椀t is the appraisal
of territorial investment programmes including those with cross-cutting objectives, such as smart specialisation plans, to set the
framework for the individual investment projects. Such programmes pose a challenge if appraised using CBA/CEA methodologies
because they cut across sectors and involve many dimensions (economic, technological, territorial, etc.).
The main limitation of MCA arises when assigning weights and allocating scores because of the potential discretion/subjectivity.
Rules and good practices can be established to mitigate these shortcomings. For example, one good practice involves setting up
focus groups to bring together the project’s stakeholders in order to achieve a consensus on weightings and scores to be assigned
to the objectives (as well as the programme objectives themselves).
Annex X of Part II of the EAV lists risks and potential remedies in the context of MCA.
43
For example, the B/C ratio may be one criterion and a minimum value may be required. In this way, the CBA result is fully integrated into the MCA. Where CBA is not part of the MCA, capital and operating costs
are important criteria. Similarly, not only policy objectives but also technical feasibility and risk criteria are often set, which may also have minimum thresholds.
27
Economic Appraisal Vademecum
28
Economic Appraisal Vademecum
https://www.gov.ie/
en/organisation-
Ireland Transport All Common Appraisal Framework
information/800ea3-common-
appraisal-framework/
https://www.gov.ie/
2016 guidelines on a common appraisal framework en/organisation-
Ireland Transport All
for transport projects and programmes information/800ea3-common-
appraisal-framework/
https://www.invitalia.it/
chi-siamo/area-media/
Guida all’analisi costi-bene昀椀ci dei progetti notizie-e-comunicati-stampa/
Italy General
d’investimento fondi-europei-online-la-guida-
all-analisi-costi-bene昀椀ci-dei-
progetti-di-investimento
https://www.mit.gov.it/
Linee guida per la valutazione degli investimenti sites/default/昀椀les/media/
Italy Transport All in opera pubbliche nei settori di competenza del notizia/2017-07/Linee%20
Ministero delle Infrastrutture e dei Trasporti Guida%20Val%20OO%20
PP_01%2006%202017.pdf
https://www.mit.gov.it/
sites/default/昀椀les/media/
Tabelle di sintesi dell’analisi della mobilità urbana/
Italy Transport Urban documentazione/2018-10/
ACE/ACB
Appendice%20
all%27ADDENDUM.pdf
https://eufunds.gov.mt/en/
Operational%20Programmes/
Useful%20Links%20and%20
Guidance manual for cost bene昀椀t analysis (CBAs)
Malta General Downloads/Documents/
appraisal in Malta
Guidance%20Manual%20
for%20CBAs%20Appraisal_
May2013.pdf
https://www.pbl.nl/sites/default/
昀椀les/downloads/pbl-cpb-2015-
Netherlands General General Guidance for Cost-Bene昀椀t Analysis
general-guidance-for-cost-
bene昀椀t-analysis_01512.pdf
https://www.昀椀nance-ni.gov.uk/
Northern Northern Ireland guide to expenditure appraisal and topics/昀椀nance/northern-ireland-
General
Ireland evaluation (NIGEAE) guide-expenditure-appraisal-
and-evaluation-nigeae
Norway General Cost-Bene昀椀t Analysis https://www.regjeringen.no/
https://www.transport.nsw.gov.
au/projects/project-delivery-
Norway Transport Transport for NSW Cost-Bene昀椀t Analysis Guide requirements/evaluation-and-
assurance/transport-for-nsw-
cost-bene昀椀t
https://www.pois.gov.pl/
strony/o-programie/dokumenty/
Niebieska Księga Infrastruktura drogowa (Blue Book niebieskie-ksiegi-dla-projektow-
Poland Transport Road
Road Infrastructure) w-sektorze-transportu-
publicznego-infrastruktury-
drogowej-oraz-kolejowej
http://www.pois.gov.pl/
strony/o-programie/dokumenty/
Niebieska Księga Sektor kolejowy Infrastruktura niebieskie-ksiegi-dla-projektow-
Poland Transport Railways
kolejowa w-sektorze-transportu-
publicznego-infrastruktury-
drogowej-oraz-kolejowej/
http://www.pois.gov.pl/
strony/o-programie/dokumenty/
Niebieska Księga Sektor Transportu Publicznego w niebieskie-ksiegi-dla-projektow-
Poland Transport Public transport
miastach, aglomeracjach, regionach w-sektorze-transportu-
publicznego-infrastruktury-
drogowej-oraz-kolejowej/
29
Economic Appraisal Vademecum
https://www.
Guidelines on issues relating to the preparation of
funduszeeuropejskie.gov.pl/
investment projects, including revenue generating
Poland General media/5193/NOWE_Wytyczne_
projects and hybrid projects for the period 2014–
PGD_PH_2014_2020_
2020
podpisane.pdf
https://www.fonduri-structurale.
ro/stiri/18389/poim-
Metodologie de analiză cost-bene昀椀ciu pentru
Water and metodologie-de-analiza-cost-
Romania Environment investiţiile în infrastructura de apă și canalizare
wastewater bene昀椀ciu-pentru-investitiile-
昀椀nanțate din fonduri publice
in-infrastructura-de-apa-si-
canalizare
30
Economic Appraisal Vademecum
BIBLIOGRAPHY
Archutowska, J., Kiwiel, A., Giziński, D., Żbikowska, E., Witaszek, W. and Adamczuk, M. (2014), Best practices in cost-bene昀椀t analyses of transport
projects co-funded by the European Union, CUPT, Warsaw (https://www.cupt.gov.pl/images/zakladki/analiza_koszt%C3%B3w_i_korzysci/CBA_
CUPT_2014_ang.pdf).
ASEK (2016), Samhällsekonomiska principer och kalkylvärden för transportsektorn: ASEK 6.0, Tra昀椀kverket, Borlänge, Sweden.
Asian Development Bank (2017), Guidelines for the Economic Analysis of Projects, Asian Development Bank, Mandaluyong City, Philippines.
Beria, P., Maltese, I. and Mariotti, I. (2012), ‘Multicriteria versus cost bene昀椀t analysis: a comparative perspective in the assessment of sustainable
mobility’, European Transport Research Review, Vol. 4, pp. 137–152.
Boardmand, A. E., Greenberg, D. H, Vining, A. R. and Weimer, D. L. (2018), Cost-Bene昀椀t Analysis, Concept and Practice, 5th edition, Cambridge
University Press, Cambridge, UK.
Catalano, G. et al. (2021, forthcoming) The Social Cost of Capital – Recent estimates for selected countries, CSIL working paper.
De Rus, G. (2010), Introduction to Cost-Bene昀椀t Analysis – Looking for reasonable shortcuts, Edward Elgar Publishing.
Dodgson, J. S., Spackman, M., Pearman, A. and Phillips, L. D. (2009), Multi-criteria Analysis – A manual, Department for Communities and Local
Government, London.
EBRD (2019), Methodology for the economic assessment of EBRD projects with high greenhouse gas emissions, EBRD, London (https://www.
ebrd.com/news/publications/institutional-documents/methodology-for-the-economic-assessment-of-ebrd-projects-with-high-greenhouse-
gasemissions.html).
EIB (2013a), The economic appraisal of investment projects at the EIB (https://www.eib.org/attachments/thematic/economic_appraisal_of_
investment_projects_en.pdf).
EIB (2013b), Induced GHG Footprint – The carbon footprint of projects 昀椀nanced by the Bank. Methodologies for the assessment of project GHG
emissions and emission variations, version 10.
European Commission (2014), Guide to Cost-Bene昀椀t Analysis of Investment Projects – Economic appraisal tool for cohesion policy 2014–2020
(https://ec.europa.eu/regional_policy/sources/docgener/studies/pdf/cba_guide.pdf).
European Commission (2017), A social multi-criteria framework for ex-ante impact assessment operational issues, JRC technical reports,
Publications O昀케ce of the European Union, Luxembourg (https://publications.jrc.ec.europa.eu/repository/bitstream/JRC107899/jrc107899_
smce-ia-operational.pdf).
European Commission (2018), Cost Development of Low Carbon Energy Technologies, JRC technical reports, Publications O昀케ce of the European
Union, Luxembourg (https://publications.jrc.ec.europa.eu/repository/bitstream/JRC109894/cost_development_of_low_carbon_energy_
technologies_v2.2_昀椀nal_online.pdf).
European Commission (2019), The Costs of Not Implementing EU Environmental Law, Publications O昀케ce of the European Union,
Luxembourg (https://op.europa.eu/en/publication-detail/-/publication/2c05c9e6-59aa-11e9-a8ed-01aa75ed71a1/language-en/format-PDF/
source-115844964).
Florio, M. (2014), Applied Welfare Economics: Cost-bene昀椀t analysis of projects and policies, Routledge.
Griniece, E., Angelis, J., Reid, A., Vignetti, S., Catalano, J., Helman, A., Barberis Rami, M. and Kroll, H. (2020), Guidebook for Socio-Economic Impact
Assessment of Research Infrastructures, Zenodo.
Johansson, P.-O. and Kristrom, B. (2016), Cost-Bene昀椀t Analysis for Project Appraisal, Cambridge University Press, Cambridge, UK.
Kriström, B. and Bonta Bergman, M. (2014), Samhällsekonomiska analyser av miljöprojekt – en vägledning, Naturvårdsverket Rapport 6628.
Pagliara, F. and Di Ruocco, I. (2018), ‘How public participation could improve public decisions on rail investments?’, Regional Science Policy &
Practice, Vol. 10, pp. 383–403.
Quinet, É., Baumstark, L., et al. (2013), Cost Bene昀椀t Assessment of Public Investments – Summary and recommendations, Commissariat général
à la stratégie et à la prospective, Paris (https://www.strategie.gouv.fr/sites/strategie.gouv.fr/昀椀les/atoms/昀椀les/cgsp-calcul_socioeconomique_
english4.pdf).
UK Treasury (2018), The Green Book – Appraisal and evaluation in central government, HMSO, London, UK (https://assets.publishing.service.gov.
uk/government/uploads/system/uploads/attachment_data/昀椀le/685903/The_Green_Book.pdf).
World Bank (2005), Where to use cost e昀昀ectiveness techniques rather than cost bene昀椀t analysis, transport note No TRN-9, World Bank,
Washington DC (https://assets.publishing.service.gov.uk/media/57a08c6b40f0b652dd001300/C21-trn-9-EENote2.pdf).
31
Economic Appraisal Vademecum
Economic Appraisal
Vademecum 2021-2027
Part II - Sector Applications
33
Economic Appraisal Vademecum
ACRONYMS
34
Economic Appraisal Vademecum
I.1. Introduction
This chapter discusses the use of CBA for investments in Research and Innovation (R&I), a sector that is at the core
of the EU’s development policies and funding programmes in 2021–2027. The methodology presented was developed in
the 2014–2020 programming period for the ex ante analysis of investments in infrastructure and applied to numerous types of
projects, from science parks and innovative manufacturing facilities to university campuses. The focus was on basic and applied
research facilities, which have a broad range of bene昀椀ts that overlap with other types of infrastructure in the sector. This chapter
retains this focus and is, therefore, likely to be most applicable for strategic infrastructure projects in R&I, including those that
could be 昀椀nanced by the InvestEU fund. The methodology should also be relevant for research-funding programmes and other
non-infrastructural investments 昀椀nanced from Horizon Europe and other funding mechanisms.
The information provided is complementary to the methodology presented in the 2014 CBA guide, which was further developed
in the JASPERS sta昀昀 working paper Economic analysis of research infrastructure projects in the programming period 2014–2020
(JASPERS, 2017).
The economic appraisal of infrastructures and programmes engaging in research will, to varying extents, be subject
to a common problem: the impact of the research can be di昀케cult to predict, fully capture and monetise. While this
is particularly true of fundamental research, the unpredictability of the economic bene昀椀ts of R&I is inherent to the 昀椀eld. It is a
factor that any quantitative method that attempts to predict the economic impact of research is likely to encounter.
For this reason, a promoter may judge CBA to be an inappropriate mode of assessment for certain investments in ‘blue sky’
research, namely where the research outputs and the eventual bene昀椀ts realised by society are not immediately apparent. In
these instances, it may still be useful to quantify the outputs of the research where possible (e.g. the number of publications)
and describe their impact qualitatively instead of attempting to monetise the bene昀椀ts.
Promoters will need to carry out additional analyses to facilitate the CBA. As a minimum, bene昀椀ciaries should analyse
the demand for the infrastructure and its outputs, consider the alternative options for reaching the objectives of the investment
and model the future 昀椀nancial performance and sustainability of the infrastructure and bene昀椀ciary. Each of these analyses
provides information and inputs that are required to perform a CBA. The 2014 CBA guide outlines these steps in detail.
Table 1 provides a summary of the questions and information that project promoters and decision-making bodies should consider
when preparing or appraising the demand and options analyses.
Figure 1 illustrates at glance the common economic bene昀椀ts associated with the di昀昀erent types of infrastructure
discussed in this chapter. Table 2 below provides a description of bene昀椀ts, methods to calculate their value and potential sources
of data to perfrom a CBA. Additional bene昀椀ts should be considered depending on the objectives of the speci昀椀c project (2).
1
Con昀椀gurations of R&I infrastructure projects include aspects such as location, choice of technologies, operating model and size.
2
A full explanation of the methodologies can be found in JASPERS (2017). Readers should also consult Florio (2019).
35
Economic Appraisal Vademecum
Source: Authors.
36
Economic Appraisal Vademecum
Table 1. Information to be considered in the demand and option analyses, by infrastructure type
Demand - Has the need for investment - Are the sales forecasts justi昀椀ed - Do economic and demographic
analysis been demonstrated? Is there by market analysis? trends support the need for the
a gap analysis of equipment, investment?
infrastructure and sta昀昀? - Has the competition been
analysed? - Are tuition fees falling or rising
- Is the equipment requested justi昀椀ed nationally or being introduced?
and reasonable in view of the - How vulnerable is the project to
intended research results? regulatory changes? - What are the dropout and
repetition rates of the
- Is there demand/buy-in from - How will the innovation help institution?
researchers for the project? to retain or accelerate the
company’s market share? - What are the past and future
- Is there a market for research enrolment rates?
outputs? - Does the company have a track
record of introducing innovations - What is the ratio of graduates
- Is there demonstrated interest from into the market? to students enrolled?
industry for the infrastructure and
its outputs? - Is the whole value chain aligned - Is there evidence of demand for
(e.g. su昀케cient supply for skilled labour in the academic
- Is the project aligned with national production) with the o昀昀ering of disciplines concerned?
and/or regional strategies? the new good/service?
Option - Is the scale of the infrastructure - Is the choice of technology, - Is the scale of the infrastructure
analysis and equipment justi昀椀ed? suppliers, site, etc. sensible? justi昀椀ed?
- What impact will the investment - Should a new plant be built - What are the alternatives
have on regional development? or the existing one enlarged/ to the investment? Could
modernised? the bene昀椀ciary rent or share
- What are the alternatives to the facilities or make use of existing
investment? Could the bene昀椀ciary - Is the scale of the infrastructure facilities owned by another
rent or share facilities or make justi昀椀ed? institution?
use of existing facilities owned by
another institution?
37
Economic Appraisal Vademecum
Table 2. A summary of economic benefits, quantification methods, valuation calculations and data sources,
by infrastructure type
Infra-
Quanti昀椀ca- Value Potential data Considerations and
structure Description Bene昀椀t
tion method calculation sources lessons learned
type
RI, IM Develop- Bene昀椀t Market Market value of EIB (2013), The estimated
ment of new/ attributed to value as patent × num- European number of patents
improved patents granted proxy for ber of patents Commission and should be based
products and WTP granted World Intellectual on the track record
processes Property of the promoter
Organization or comparable
institutions. On
average, patents
represent a cost;
therefore, the
estimated market
value should be
conservative
RI ‘New knowl- Bene昀椀t to society Marginal (Average gross Bene昀椀ciary’s data The estimated
edge’ of new scienti昀椀c production annual salary number of
publications by costs (re- of scientist ÷ publications should
researchers who muneration average per- be based on the
are users of the of authors) centage of track record of
facility time researcher the promoter
spends on one or comparable
publication) × institutions, or
overall number averages for the
of publications discipline
by project per
year
38
Economic Appraisal Vademecum
RI, TE Human capital Bene昀椀t to Market Economic Market values for For the bene昀椀t to
formation society of an value as bene昀椀t in year the salaries of occur, there should
educated labour proxy for t = number MA, MSc and PhD be a bottleneck
force WTP of graduates graduates can in the supply of
in year t × be taken from courses so that, in
(present value the Organisation the absence of the
in year t of for Economic Co- project, students
incremental operation and do not receive it or
gross salary Development have to go abroad
÷ average statistics for the bearing relocation
number of speci昀椀c country costs
years of and compared
working career with statistics on
ahead of average salaries
graduates)
RI Social capital Bene昀椀t from Market (Average Bene昀椀ciary’s data
development the creation value as travel costs +
of networks proxy for average event
between WTP or conference
researchers fees paid by
and between participants)
researchers + (average
and private daily wage of
companies attendee ×
(through days at event)
conferences, × (average
networking number of
events, etc.) attendees)
× (number
of events or
conferences
organised
per year)
RI Reduction of Bene昀椀ts to the See See Annex VIII
health risks general public Annex VIII
of research
that leads to
a reduction in
health risks
RI Cultural Bene昀椀ts from Travel cost Approach
e昀昀ects for outreach method according
visitors activities to the or bene昀椀t to JASPERS
general public transfer working paper
(e.g. visitors, approach on cultural
tourists) projects
(JASPERS,
2011)
RI, IM, Climate Change in Incremental GHG savings in Commission
TE change carbon footprint change in CO2e × shadow notice on
bene昀椀ts (or (if reduction associated price of CO2e technical
costs) then bene昀椀t, if GHG guidance on the
increase then emissions climate proo昀椀ng
cost) valued per of infrastructure
tonne of in 2021–2027
CO2e (EC 2021)
39
Economic Appraisal Vademecum
RI, IM Learning-by- Economic Incremental Volume of Bene昀椀ciary’s data The bene昀椀t should
doing bene昀椀t bene昀椀t to shadow high-tech apply only when
昀椀rms supplying pro昀椀t procurement × the suppliers are
equipment sales multiplier local; otherwise,
for RDI × average the bene昀椀t is lost
infrastructure pro昀椀t margin
40
Economic Appraisal Vademecum
II.1. Introduction
The EU has set itself an objective to reach carbon neutrality by the middle of the century. According to the pathways to reach
‘net zero’ greenhouse gas (GHG) emissions by 2050 developed by the European Commission, the power sector will need to have
almost fully decarbonised by 2040. Similarly, although at a somewhat slower pace, the decarbonisation of the heating sector is
also required to reach net zero emissions by 2050.
In the medium term, the EU climate and energy framework had initially set a target of a 40 % reduction in GHG emissions
(compared with 1990 levels) by 2030; this includes a binding target of renewable energy sources (RESs) making up 32 % in EU
昀椀nal consumption by 2030.
Following a proposal from the European Commission, however, the European Council has recently endorsed a more ambitious
binding EU target of a net domestic reduction of at least 55 % in GHG emissions by 2030 (compared with 1990). Higher RES
penetration targets for 2030 will accordingly be required. The country-speci昀椀c targets and the measures put in place to achieve
them are presented in the national energy and climate plans of the Member States. The legal framework for the promotion of
RESs in the EU is set out by the ‘recast’ of the renewable energy directive (Directive (EU) 2018/2001).
Several instruments in the EU budget (e.g. the ‘greener, carbon free Europe’ policy objective of the European Structural and
Investment Funds, the Just Transition Fund and the Modernisation Fund) can support investments in renewable energy. In
addition, in the context of its ‘climate bank roadmap’ (EIB, 2020), the European Investment Bank (EIB) is planning to strengthen
its 昀椀nancial and advisory support for the decarbonisation of energy supply on the basis of the criteria set out in its energy lending
policy (EIB, 2019).
The objective of this chapter is to provide an overview of the EA of investments in renewable energy generation in the electricity
and heating sectors.
41
Economic Appraisal Vademecum
The levelised cost is a commonly used concept in energy economics, particularly when comparing alternative technologies.
This is calculated as the ratio between (i) the present value of the project costs over its life cycle and (ii) the present value
of the supplied power/heat over the same reference period. Assuming that, in the long run, all production factors (including
capital) are variable, the indicator can be used as a proxy for the long-run marginal cost of a given technology or a project. By
adding to the project costs the shadow cost of ‘externalities’, the levelised cost can also be estimated in socioeconomic terms.
Here we will assume, for example, that we want to estimate the LCOH generation from the installation and operation of
a new 20 thermal megawatt (MWt) biomass hot-water boiler in a district heating system with an initial investment cost
of EUR 9 million. Over the expected economic life (15 years of operations), the following costs, externalities (3) and heat
generation are estimated:
Net pre-
sent value 2021 2022 2023 2024 2025 2030 2035
at 5%
LCOH – biomass boiler (million EUR)
Investment cost 8.4 4.5 4.5
Fuel costs 25.6 — — 2.7 2.7 2.7 2.7 2.7
Other operating and
2.5 — — 0.3 0.3 0.3 0.3 0.3
maintenance costs
Total costs (without
36.5 4.5 4.5 3.0 3.0 3.0 3.0 3.0
externalities)
Shadow cost of CO2
— — — — — — — —
emissions
Shadow cost of airborne
4.6 — — 0.5 0.5 0.5 0.5 0.5
pollutants
Total socioeconomic cost 41.2 4.5 4.5 3.5 3.5 3.5 3.5 3.5
By dividing the net present value (NPV) of LCOH – biomass boiler (EUR/MWh)
the single cost components by the NPV of
the energy generated, the levelised cost 8
subcomponents can also be estimated. Capital cost
Fuel cost 24
Other operating and
2
maintenance costs
LCOH – 昀椀nancial 34
LCOH – economic 38
3
Direct CO2 emissions from the combustion of biomass are assumed to be zero if the fuel sourcing is done in compliance with the applicable sustainability criteria. Supply chain emissions (e.g. from biomass
preparation and transportation) are not considered in the example. In addition to the emissions of airborne pollutants (e.g. sulphur oxides, nitrogen oxides and particulate matter), costs for externalities related to the
security of supply of the required biomass could be considered if relevant to re昀氀ect, for example, availability or price volatility risks.
42
Economic Appraisal Vademecum
At the stage of a full feasibility analysis, a fully 昀氀edged CBA is normally carried out for the selected option.
For certain RES technologies that are innovative but have not yet been developed on a commercial basis (e.g. 昀氀oating wind farms
and concentrated solar power), however, a cost-e昀昀ectiveness/qualitative approach is usually more appropriate. As a matter of
fact, for these technologies, the economic bene昀椀ts estimated according to the methodology presented above would normally not
outweigh the related project costs, so the resulting economic rate of return (ERR) would fall short of the social discount rate. A
bene昀椀t related to the ‘learning curve’ of the speci昀椀c technology would in this case need to be assessed. This would hinge on the
analysis of the expected ‘learning rate’ (typically estimated as the expected percentage reduction in the unit investment cost at
each doubling of the installed capacity) and the forecast pace of deployment of the technology in terms of cumulated installed
capacity (see, for example, European Commission, 2018). A monetary valuation of the incremental learning e昀昀ect associated
with a speci昀椀c project is challenging and might require rather subjective assumptions. A very rough estimate could be based on
a share of future capital expenditures (CAPEX) reductions (inferred from the learning rate) proportional to the project capacity
in the overall installed capacity over the reference period. However, given the high uncertainty related to such an estimation, it
is advisable that the EA of innovative RES projects mainly relies on the estimation of the LCOE, complemented by a qualitative
assessment of the market potential of the technology.
On the bene昀椀ts side, the CBA of a project to increase the supply of electricity from RES essentially hinges on the determination of
an appropriate estimate of the economic value of the power generated by the project. The change in ‘social welfare’ associated
with the project can in principle be gauged by the reduction in social marginal generation costs (including externalities) triggered
by the investment (4). The price formed in the wholesale power market cannot typically be deemed to adequately re昀氀ect the
social value of the avoided costs, because of certain distortions (e.g. subsidies to RES generators or incomplete internalisation
of environmental externalities). A ‘shadow price’ should then be estimated for the economic value of power. For this purpose, a
relevant LCOE can be taken as a starting point (5), to be adjusted to include the following elements, whenever relevant to the
speci昀椀c technology and market situation assumed to de昀椀ne the economic value of electricity generation.
- A capital cost (CAPEX) component. Intuitively, the economic value of new generation capacity added to the system depends
on the level of scarcity on the market. The system adequacy – as gauged, for example, by the expected evolution of the
‘reserve margin’ (6) – can be taken into account to possibly adjust downwards the value of this component in case of
overcapacity (7).
- A fuel cost component (if relevant). This is calculated on the basis of the plant’s e昀케ciency and the cost of the delivered fuel
(‘border price’ plus transmission/distribution costs – net of taxation) (8).
- Other (昀椀xed and variable) operating and maintenance (O&M) costs component, not including fuel and CO2 / air pollutant
emissions, which are separately monetised. This typically includes, for example, personnel costs, insurance, maintenance, etc.
- The social cost of carbon. The shadow price to be used for the monetisation of the CO2 emissions component can be taken
from the values used by the EIB (see Section 2.5 of Part I of this Economic Appraisal Vademecum (EAV)). Attention should
be paid to excluding from other components of the LCOE the possible cost of European Union Emissions Trading System
allowances to avoid double counting.
- The socioeconomic value of emissions of airborne pollutants (e.g. NOx) as unit damage values (e.g. from the Needs project)
could be used (9). The values can be escalated over the reference period on the basis of the expected real gross domestic
4
This means focusing on the changes associated with the project in the area underneath the social (e.g. externalities-adjusted) supply curve. For large investments (relative to the power system), where the project
may also trigger an impact on power demand because of a price e昀昀ect, the willingness to pay for the incremental demand would also have to be considered – which is possibly relevant for small, isolated systems.
5
In the absence of speci昀椀c modelling allowing the identi昀椀cation of the mix of marginal generators displaced by the project and the related average time-weighted bene昀椀t, the following shortcut can be used: in a
hypothetical system where investment in power generation is optimised on the basis of the social (as opposite to market) generation costs, the (distortions-adjusted) levelised cost of a base-load generator that
operates at full technical availability would adequately re昀氀ect the socioeconomic long-run value of power (see, for example, Lamont, 2008).
6
The reserve margin is the ratio between the available generation capacity (with intermittent technologies such as wind and solar considered on a ‘de-rated’ basis) and the peak load to be covered, minus 1. The
availability of intermittent technologies such as wind and solar needs to be considered on a ‘de-rated’ basis, expressing an equivalent 昀椀rm (‘dispatchable’) capacity. Transmission constraints are ignored here. An
estimation of reserve margin can be found in adequacy studies or from energy consultancy companies.
7
A rule-of-thumb approach could, for example, be (i) to include the full CAPEX component for cases in which the medium-term forecast of the reserve margin is lower than 30 %, (ii) to assume that a reserve margin
above 50 % signals the presence of overcapacity and hence no CAPEX component is included in the shadow price, and (iii) for a reserve margin between 30 % and 50 %, to use a partial CAPEX component, declining
linearly from the full value to zero as the value within the interval increases (e.g. for a reserve margin of 40 %, only half of the CAPEX value would be considered).
8
European Network of Transmission System Operators for Electricity (ENTSO-E) and for Gas (ENTSOG) scenarios prepared for the 10-year network development plan exercises include assumptions on fuel price
developments that can, for example, be used. As regards gas transmission costs, where relevant, data from Eurostat can be used.
9
See the Needs project website for more information (http://www.needs-project.org/); in particular, see RS3a D 1.1, Report on the procedure and data to generate averaged/aggregated data.
43
Economic Appraisal Vademecum
- A security-of-supply cost related to the use of (imported) fuels. The EIB uses, for example, a value equal to EUR 10/MWhel
(megawatt-hours of electrical energy) for power generated from a gas-昀椀red combined-cycle gas turbine.
The sum of those components would provide a reasonable estimate of the base economic value of electricity produced by the
project.
However, if the technology assumed to de昀椀ne the economic value of electricity is 昀椀rm (‘dispatchable’) generation, when evaluating
the value of power from a project installing variable (i.e. intermittent, non-dispatchable) RES, such as wind and solar, two
downward adjustments would need to be made to account for the following aspects (11).
- ‘Pro昀椀ling’ costs. Power demand varies over the day (and seasons) and so does its value, given that a di昀昀erent mix
of generation sources, with di昀昀erent generation costs, is called on to produce power at di昀昀erent moments in time
(storage and demand-response are typically limited, and generation basically needs to meet demand in real time). So,
for example, generation at times of peak demand has a higher value than in the middle of the night, when demand is
low. Owing to the weather-dependent variability of generation of intermittent RES, RESs cannot extract value from the
entire pro昀椀le of power demand, as a baseload generator would. For this reason, a ‘pro昀椀ling’ (or utilisation) cost would
typically need to be deducted from the base value of the shadow price. This would depend on (i) the extent to which the
expected generation pro昀椀le of the speci昀椀c project under appraisal correlates with the relevant demand pro昀椀le and (ii)
the current and expected overall penetration of variable RES in the system – the higher the share of intermittency, the
higher the pro昀椀ling cost.
- ‘Balancing costs’. The uncertainty associated with the output variability may lead to mismatches between the scheduled
RES generation (e.g. at the time of closure of the day-ahead market) and the power actually fed to the grid. This would
lead to additional costs for the ‘balancing’ of demand and supply in the system.
In the estimation of the economic bene昀椀ts, the di昀昀erent components of the shadow price can be singled out for presentation
purposes (e.g. CO2 reduction bene昀椀t or security-of-supply bene昀椀t).
As regards the reference period over which the CBA is performed, an operational phase of 15 to 20 years (the latter for mature
RESs, such as onshore wind and solar photovoltaic systems) is typically appropriate to adequately re昀氀ect the economic life of the
project assets without the need to consider major replacement cost or residual value.
Heat generation
The CBA of RESs in heating can be based on a similar conceptual framework to that presented above for the case of power
generation. The reference period can usually be taken to be 15 years, but a longer time horizon can be used for projects related
to a district heating system, provided asset replacement costs are adequately taken into account.
As regards the economic investment and operating costs, the same considerations presented above for electricity projects apply.
For generation investments in the context of district heating, it is important to also take into account the costs associated with
heat distribution and the related losses.
As regards the bene昀椀ts, the economic (i.e. externalities-adjusted) LCOH (12) from the next best alternative to the RES heat
generated by the project can be used as a relevant shadow price.
The use of the LCOH can be particularly useful at the stage of option analysis, to compare di昀昀erent decarbonisation options,
for example for district heating systems. Similarly to electricity, two types of levelised cost can be estimated: 昀椀nancial and
socioeconomic. The 昀椀nancial levelised cost should be based on observed market prices and the related forecasts of future costs
and prices that are going to be borne by the owner(s) of the heat generation/distribution assets. The socioeconomic levelised cost
should be based on the 昀椀nancial levelised cost and complemented with the assessment of external costs that would be borne by
society at large (e.g. the damage value of airborne pollutants, GHG emissions and security-of-supply considerations for certain
fuels). For combined heat and power options, the value of power generation can be netted out from the heat generation cost,
where appropriate. Table 3 summarises the elements typically considered in the 昀椀nancial and economic LCOH.
10
In the Needs project, evidence was found that monetary values for health risks for future years increase with an intertemporal elasticity to GDP per capita growth of 0.7 to 1.0.
11
A description of the methodological approach can be found in Hirth (2013). There are several studies on the valuation of those ‘system costs’. An overview of the literature and value estimations is, for example,
available in OECD and Nuclear Energy Agency (2018) – see Section 3.3.
12
The LCOH can be considered a life-cycle average incremental cost or long-run marginal cost. This is calculated as the ratio of (i) the present value of all costs (CAPEX, operating expenses, fuel, etc.) associated
with a given technology over the appropriate reference period and (ii) the present value of the heat supplied by the related plant(s) over the same time horizon.
44
Economic Appraisal Vademecum
Options should primarily be ranked on the basis of the socioeconomic LCOH (the lower the better), particularly if public support
(e.g. EU 昀椀nancing) is foreseen. At the same time, it is important that the related 昀椀nancial cost can be deemed to be competitive
and a昀昀ordable. The 昀椀nancial LCOH can be considered as a rough approximation of a heat tari昀昀 regulated on a cost-plus basis (15).
13
This would, for example, be the case of imported fuels such as natural gas or possibly biomass. The consideration of this cost would (slightly) favour the use of locally sourced fuels over imported fuels, whose
availability and price volatility may be more problematic.
14
To be estimated on the basis of the methodology presented in the ‘Power generation’ section above.
15
Di昀昀erences could, for example, stem from (i) di昀昀erences between the ex ante cost estimates and the actual costs incurred for the di昀昀erent alternatives, (ii) di昀昀erences in average investment costs in the LCOH and
the related depreciation included over the same reference period in the heat tari昀昀s by the regulator, (iii) di昀昀erences between the return on capital embedded in the discount rate used in the LCOH and the allowed
pro昀椀t included in the regulated tari昀昀s, (iv) the fact that, if the investment is co-昀椀nanced by public grants (e.g. EU funds), the capital component in the related heat tari昀昀s is likely to be lower than in the 昀椀nancial
LCOH estimated ex ante, and (v) in the case of co-generation assets, di昀昀erences between the cost allocation method to transfer common heat and power costs to the heat tari昀昀 and the residual net LCOH after
deduction of power sales revenue.
45
Economic Appraisal Vademecum
In the case of buildings, as of 2021, all new buildings in the EU have to be nearly zero-energy buildings (17) in line with the
requirements of the amended energy performance of buildings directive (EPBD – Directive (EU) 2018/844).
Each country’s speci昀椀c targets and policy measures are set out in the national energy and climate plans, as well as the long-
term renovation strategies being prepared by Member States under the EPBD. EU funds can support the related (signi昀椀cant)
investment needs (18), for example through the ‘renovation wave’ initiative of the EU Green Deal and the ‘greener, carbon free
Europe’ policy objective of the European Structural and Investment Funds, the Just Transition Fund and the Modernisation Fund.
This chapter focuses on the EA methods for energy e昀케ciency projects in buildings. A similar conceptual framework can also
be applied to investments in other typologies of assets, for example for the evaluation of energy savings stemming from the
refurbishment of district heating networks, industrial facilities or public lighting systems.
For large energy e昀케ciency projects (or schemes) where a full feasibility analysis is developed, the EA should be based on a CBA
that, in addition to the energy savings bene昀椀ts and associated externalities, should also include other e昀昀ects related, for example,
to the extended life of the building or the reduced maintenance costs. (19)
At the stage of the selection and approval of projects to be 昀椀nanced by EU funds, it is important that the national authorities
responsible for project evaluation base their decisions on an assessment of the expected economic bene昀椀ts (e.g. the value of
energy savings and associated CO2 emissions) relative to the project costs, to ensure e昀케ciency and e昀昀ectiveness (20). In this
respect, a simpli昀椀ed CBA tool with a set of prede昀椀ned unit bene昀椀t values could be developed by the national authorities to be
used in call-for-project proposals to rank and select energy e昀케ciency investments.
III.3. Economic appraisal
While the 昀椀nancial analysis is mainly done from the point of view of the owner of the building, the economic CBA attempts to
evaluate the socioeconomic impact of the energy e昀케ciency investments on society as a whole. The cost savings monetised
in the 昀椀nancial analysis do not necessarily re昀氀ect society’s willingness to pay (WTP) for the avoided energy generation, for
example because energy tari昀昀s may be subsidised and may not (fully) include the value of externalities such as CO2 emissions
or the increased security of supply. For this reason, the economic analysis should be based on a shadow price re昀氀ecting the
socioeconomic value of the energy saved thanks to the project – typically heat, but also electricity. Annex II (‘Renewable energy’)
provides a detailed description of the di昀昀erent components of the shadow price of heat (and electricity) that can be used to
monetise the energy savings associated with the project.
16
The target is set relative to the 2007 modelling projections for 2030.
17
Nearly zero-energy buildings are buildings that have very high energy performance and whose (limited) energy consumption is mostly covered by energy from renewable sources.
18
There are several market failures that prevent a socially optimal level of investment in energy e昀케ciency and justify public intervention. Access to capital is one of those, with other examples from the literature
being imperfect information, hidden costs, split incentives and bounded rationality. A recent EIB working paper found that the availability of favourable 昀椀nancing together with the provision of technical assistance
increased by one third the probability of investment in energy e昀케ciency (EIB, 2020).
19
For example, in the case of projects funded by EIB loans, the bank’s economic assessment is based on a CBA that includes energy savings and reductions in GHG emissions (tier 1 bene昀椀ts), but also other economic
bene昀椀ts such as the extension of the economic life and a reduction in maintenance costs (tier 2 bene昀椀ts), when they are measurable and quanti昀椀able. In the case of bank-intermediated EIB operations, the economic
case is assumed ex ante to be met for the individual measures on the basis of the cost optimality of the national standard measures. However, in the latter case, economic assessment is also required at an aggregate
level, based on the expected energy savings of the overall operation and other quanti昀椀able bene昀椀ts.
20
According to the European Court of Auditors, the allocation of EU cohesion policy funds to energy e昀케ciency projects in buildings was in most cases done on a 昀椀rst-come-昀椀rst-served basis, without a proper
consideration of the relative costs and bene昀椀ts of the projects. The court recommends that, for the 2021–2027 period, improved selection procedures are used to ‘(i) set minimum and/or maximum thresholds for
key parameters (e.g. the quantity of energy to be saved, the minimum energy rating the building should reach after project, the net present value, the simple payback time or the cost per unit of energy saved); (ii)
assess the relative costs and bene昀椀ts of projects and select those delivering higher energy savings and other bene昀椀ts at lower cost’ (European Court of Auditors, 2020).
46
Economic Appraisal Vademecum
Moreover, owing to the existence of split incentives in building renovations, some bene昀椀ts are appropriated by di昀昀erent individuals.
For instance, tenants normally bene昀椀t from a reduction in energy bills, whereas property owners bene昀椀t from the extension of
the economic life of the building elements. However, regardless of the bene昀椀ciary, all of the bene昀椀ts contribute to the overall
economic return of the project.
The reference period used in the CBA would depend on the project measures and the components and equipment replaced. In
general, it can range from 10 to 25 years for projects also investing in the building’s envelope. For new construction, Article 2(14)
of the EPBD de昀椀nes the building life cycle as 30 years for residential buildings and 20 years for non-residential buildings.
On the costs side, only investment costs directly related to energy e昀케ciency are usually included in the CBA. Changes in operating
costs associated with the project are normally presented as part of the (energy) cost savings that underpin the economic bene昀椀ts.
Where relevant, costs taken from the 昀椀nancial analysis can be adjusted to better re昀氀ect social opportunity costs (e.g. using a
‘shadow wage’ for the labour cost component).
On the bene昀椀ts side, the International Energy Agency has identi昀椀ed no less than 15 di昀昀erent sources of bene昀椀ts (International
Energy Agency, 2014). Energy e昀케ciency investments generate not only energy savings and reductions in GHG emissions, but also
other economic bene昀椀ts, such as the extension of the economic life of the replaced building elements, a reduction of maintenance
costs and an increase in property values. In addition, energy e昀케ciency investments in buildings improve the comfort and quality
of the working and living environment. When these bene昀椀ts are quanti昀椀able, they should be incorporated into the CBA. However,
the value of certain direct bene昀椀ts (e.g. energy savings) may be partly embedded in some other indirect bene昀椀ts (e.g. an increase
in property values), so particular attention should be paid to not double counting bene昀椀ts.
In general, the economic analysis of building refurbishments should aim to include the following two groups of bene昀椀ts.
1. Energy-related cost savings, including externalities (21) (Box 2). The following bene昀椀ts should be included in
the CBA, as the methodology used to estimate these bene昀椀ts is well documented (EIB, 2013) and the data needed to
produce robust estimates are generally available.
- Avoided emissions of GHGs. The shadow price to be used for the monetisation of the estimated changes in
CO2 emissions can be taken, for example, from the values used by the EIB (see Section 2.5 of Part I of the EAV).
- Avoided emissions of air pollutants (e.g. SOx, NOx and PM). Unit damage values (e.g. from the Needs project)
can be used (23). The values can be escalated over the reference period using the expected real GDP growth (24).
- Enhanced security of supply, in cases where the primary energy saved comes from imported fossil fuels, such
as natural gas. For electricity from a gas-昀椀red combined-cycle gas turbine, the EIB uses, for example, a value of
EUR 10/MWhel – assuming a plant e昀케ciency of 58 %, the value of the unit economic bene昀椀t can be estimated at
approximately EUR 1.60/gigajoule (GJ) of natural gas saved by the project (25).
21
This group of bene昀椀ts would typically also apply to projects for the refurbishment of district heating networks that result in a lower level of heat losses.
22
For example, in relation to the time deferral or capacity reduction of replacement investment
. See the Needs project website for more information (http://www.needs-project.org/); in particular, see RS3a D 1.1, Report on the procedure and data to generate averaged/aggregated data.
23
24
In the Needs project, evidence was found that monetary values for health risks for future years increase with an intertemporal elasticity to GDP per capita growth of 0.7 to 1.0.
25
In the case of projects in district heating networks, security-of-supply bene昀椀ts can also be related to a reduction in heating disruptions. They can, for example, be valued at the avoided economic cost associated
with the use of individual electric heaters during periods of district heating disruptions.
47
Economic Appraisal Vademecum
An investment programme for the thermal rehabilitation of residential dwellings is targeting an aggregate 昀椀nal energy (heat)
saving of 50 gigawatt-hours (GWh)/year (equivalent to some 55 GWh/year of avoided primary energy) compared with a
baseline scenario without the project. The following economic LCOH generation from a domestic condensing gas boiler is used
to estimate the economic value of the annual bene昀椀t associated with the energy savings:
16
Capital cost
Fuel cost 55
Other operating and
2
maintenance costs
Shadow cost of CO2 emissions 40
The total economic value of heat savings can then be estimated to be equal to EUR 120/megawatt-hours (MWh). The
annual value of the corresponding bene昀椀t to be considered in the economic analysis is then forecast at 50 GWh × EUR 120/
MWh, which is equal to EUR 6 million a year. The LCOH breakdown can be used to calculate the annual value of the speci昀椀c
subcomponents of the energy-saving bene昀椀t.
2. The impacts on the use and value of the building enabled by the project. Estimating these bene昀椀ts can be
more challenging. Therefore, they should be included only on a case-by-case basis, subject to the availability of reliable
data and a robust estimate for the speci昀椀c project. In addition, speci昀椀c attention should be paid to not double counting
bene昀椀ts. The following are examples of such bene昀椀ts.
- Extension of the economic life of the building (elements). The related annual value could, for example, be
estimated as the constant annuity over the operational phase of the reference period whose NPV equals the NPV of the
project investment cost net of the residual value of the equipment replaced by the project (e.g. heating, ventilation and
air conditioning equipment, electrical equipment).
- Reduction in building maintenance costs. The bene昀椀t is more easily determined for commercial (and public) buildings,
but can also apply to residential buildings. The possible reduction in costs relates to both preventive (i.e. scheduled)
maintenance activities and estimated corrective maintenance (i.e. the repair of equipment when it breaks down) (26).
- Improved thermal comfort, for cases where a comfortable room temperature can be achieved only after the building
refurbishment. Where feasible, this bene昀椀t can be monetised on the basis of the value of hypothetical additional energy
savings associated with a hypothetical higher energy consumption in the without-project scenario that would have been
needed to reach the same new temperature in the with-project scenario (27). In certain cases, better comfort would be
triggered by the improved a昀昀ordability of heating enabled by the project cost savings (28).
- Increase in property values associated with the improved aesthetics and comfort of buildings (in excess of what
was possibly already accounted for in the previous bene昀椀ts). Assumptions need to be made about the current average
market price of buildings covered by the project and the expected increase in value following the thermal rehabilitation.
However, the increase in property values should in principle also embed the value of avoided energy costs, which are
already monetised separately. Therefore, to avoid double counting, the economic CBA should only include the di昀昀erence
between the expected increase in property value and the NPV of the energy cost savings as quanti昀椀ed in the 昀椀nancial
analysis. The bene昀椀t can be distributed over the reference period by calculating the related equivalent constant annuity.
26
The reduction of maintenance and repair costs is also typically a bene昀椀t of investments in district heating networks.
27
See the numerical example provided in the European Commission’s Guide to cost bene昀椀t analysis of investment projects (European Commission, 2014) – see the box on p. 228 on the valuation of increased energy
e昀케ciency in buildings.
28
According to the European Commission, around 50 million consumers in Europe struggle to keep their homes adequately warm. Investment in energy e昀케ciency can contribute to tackling energy poverty.
48
Economic Appraisal Vademecum
In the case of energy e昀케ciency investments in public buildings that are used to provide services to the public (e.g. hospitals,
schools and libraries), the project can also enable the continuation or even a quality improvement of the public service provision.
In this case, the economic analysis may need to be complemented with the addition of indirect bene昀椀ts for the relevant sectors
concerned (e.g. health, education and culture).
49
Economic Appraisal Vademecum
IV.1. Introduction
In the framework of the cohesion policy for 2021–2027, municipal waste management projects will be developed as part of the
Member States’ e昀昀orts to move towards a circular economy. These projects should be consistent with the Member States’ waste
management plan(s) as stipulated in Annex IV of the common provisions regulation. However, the transition to a circular economy
does not require a modi昀椀cation to the EA methods for municipal waste management projects.
In July 2018, the circular economy package entered into force. The circular economy package sets new and ambitious targets
for recycling municipal waste: 55 % by 2025, 60 % by 2030 and 65 % by 2035 (29). Member States also have to ensure that, by
2035, less than 10 % of the total amount of municipal waste generated is sent to land昀椀ll. Achieving these targets will require
substantial legal, organisational and 昀椀nancial e昀昀orts in the Member States. Less advanced Member States, in particular, will
need to try to catch up and build the basic infrastructure that they are currently missing. Essential changes and investments
will be required in expanding separate waste collection, treatment and material recovery systems and in developing markets
for the secondary raw materials recovered. Some of these investment projects will include circular economy components, which
are consistent with the higher steps of the waste management hierarchy. Table 4 includes the circular economy categories in
the waste management sector and typical projects/investments indicated in the Categorisation System for the Circular Economy
(European Commission, 2020) published by the European Commission Expert Group on Circular Economy Financing.
Table 4. Circular economy categories of waste management activities and typical projects/investments
The objective of this chapter is to provide an overview of the now well-established EA methods for municipal waste management
projects. These methods are usually applied to entire (integrated) waste management projects, which may consist of di昀昀erent
components (some of them contributing to the circular economy and some of them not).
29
Speci昀椀cally, according to Article 6(1), subparagraphs (f) to (i), of the packaging directive (Directive 94/62/EC): (f) no later than 31 December 2025 a minimum of 65 % by weight of all packaging waste will be
recycled;
(g) no later than 31 December 2025 the following minimum targets by weight for recycling will be met regarding the following speci昀椀c materials contained in packaging waste: i. 50 % of plastic; ii. 25 % of wood; iii.
70 % of ferrous metals; iv. 50 % of aluminium; v. 70 % of glass; vi. 75 % of paper and cardboard;
(h) no later than 31 December 2030 a minimum of 70 % by weight of all packaging waste will be recycled;
(i) no later than 31 December 2030 the following minimum targets by weight for recycling will be met regarding the following speci昀椀c materials contained in packaging waste: a. 55 % of plastic; b. 30 % of wood; c.
80 % of ferrous metals; d. 60 % of aluminium; e. 75 % of glass; f. 85 % of paper and cardboard.
50
Economic Appraisal Vademecum
When projects are compliance driven, it is suggested that the project options be assessed based on the cost-
e昀昀ectiveness of investments. The levelised unit cost (LUC) (also called dynamic prime cost or dynamic generation cost) is the
cost-e昀昀ectiveness indicator normally used to analyse and compare options at the early stage of the project development cycle,
when options have the same or similar objectives, expected outputs and bene昀椀ts. It is usually expressed in EUR/tonne of waste
treated. It is derived by dividing the NPV of the total project life cost in monetary terms – comprising CAPEX, operating expenses
(OPEX) and replacement costs over the reference period – by the NPV of the treated waste in physical terms (weight).
Years
1 2 3 4 5–12 13 14–21 22 23–29 30
Total investment cost 13 000 27 000 23 000
Operating cost 10 300 12 000 12 300 17 000 … 17 000 … 17 000 … 17 000
Replacement cost 0 0 0 0 … 5 000 … 6 000 … 0
Total costs 23 300 39 000 35 300 17 000 … 22 000 … 23 000 … 17 000
Where there are signi昀椀cant di昀昀erences between the various options appraised (e.g. in terms of GHG emissions),
a simpli昀椀ed CBA (i.e. based on rough estimates of costs and outputs) should be seen as the preferred method for
option analysis. For the selection of the location for project facilities, qualitative considerations are typically used based on
MCA.
Only for non-compliance-driven projects, when there is a lack of benchmarks or there are signi昀椀cant changes in the expected
externalities, the selected option should also undergo a detailed CBA at the stage of the feasibility study.
The results of CBAs are highly dependent on the quality of data used and the assumptions made, and need careful and nuanced
interpretation to be used correctly. Historical data on waste 昀氀ows and composition might not always be available at the required
level of detail or reliability, which introduces uncertainty in long-term forecasts for waste generation, collection and treatment.
The valuation of impacts is costly and time-consuming to carry out and, therefore, the results are often transferred from one
study to another, adding another layer of uncertainty (i.e. regarding their transferability from one country or region to another).
To address the uncertainties in the data and assumptions used, the CBA should be accompanied by a sensitivity analysis for
key input parameters and assumptions, as well as a report elucidating the methodology and assumptions applied and the data
sources used. Besides quanti昀椀ed economic costs and bene昀椀ts, the report should also include a description of non-monetised
environmental impacts. The large amount of resources and time needed for carrying out CBA explains why it is typically adopted
mostly for large strategic investments.
The reference period for municipal waste management projects should take into account the economically useful life of the
project and is typically up to 20 years (or at least 15 years of operation). In cases, when, for example, a public–private partnership
contract is to be signed with an operator, the reference period should take into account the duration of the public–private
partnership contract.
The table in Section 4.2 of the 2014 CBA guide provides examples of quanti昀椀able bene昀椀ts and valuation methods in the economic
assessment of EU-funded waste management projects. This section presents updates, clari昀椀cations and additional information
for the calculation of economic bene昀椀ts in the municipal waste management sector.
Material recovery and recycling
The economic bene昀椀ts of material recovery and recycling could be estimated from the following elements.
- Savings in land昀椀ll costs. For the purpose of the economic analysis of waste management projects, every tonne of
waste that is diverted from land昀椀ll as a result of the project reduces the cost of land昀椀lling and should therefore be
credited with the unit cost of land昀椀ll per tonne of waste. The valuation of the unit cost of land昀椀ll should be based
on the long-run marginal cost (LRMC), assuming that the bene昀椀ts of diverting waste from land昀椀ll correspond to the
avoided cost of a future land昀椀ll. The LRMC is obtained by plotting the capital and operating costs (including land cost)
over the land昀椀ll’s lifetime and calculating its LUC, applying the discounted cash-昀氀ow method. The size of the land昀椀ll and
thus its LRMC will depend on the total annual amount of waste that is diverted from land昀椀ll as a result of the project.
- Market value of separately collected recyclable materials. The economic bene昀椀t of recovering secondary raw
materials (e.g. plastic, glass and metals) and/or composts and other natural fertilisers from waste is typically approximated
by the corresponding market value for each subproduct. The annual bene昀椀t can be calculated by multiplying the amount
of recycled material expected to be recovered because of the project by its price. An assumption is made that the value
captured via the market prices of such products re昀氀ects the full social value of avoided extraction, processing and
transport of virgin raw materials (30).
Energy recovery in the form of electricity and heat (or biofuel)
As illustrated in Section 4.2.7 of the 2014 CBA guide, this bene昀椀t arises when waste is used for the production of energy in the
form of electricity or heat. In this case, the energy recovered (using waste as the source) replaces the use of energy from an
alternative source/fuel (e.g. coal), which, in turn, leads to cost savings.
For projects involving energy recovery from waste, the opportunity cost of the substituted and substituting sources/fuels (oil,
natural gas, biomass, nuclear, solar, wind, hydro, etc.) should be considered as valuing the variation of energy costs. For example,
the avoided costs of alternative fuel can be computed by multiplying the amount of fuel required to produce the same amount
of energy (electricity or heat) by the prices of fuels used in the without-project scenario. For more details, please refer to the
economic value of electricity/heat described in Annex II (‘Renewable energy’).
The opportunity cost of energy recovered from waste should be based on the LRMC of alternative energy production, re昀氀ecting
the total social cost incurred to produce an extra unit of energy, plus the transport cost of the energy source from the place where
it is produced to the place where it is used, if applicable.
If the substituted source is fossil fuel, an additional bene昀椀t related to displaced GHG emissions is generated through energy
generation from the renewable waste fraction.
Health and environmental hazards
To estimate the external cost of pollutant emissions, the usual approach consisting of quantifying the emissions avoided thanks
to the project (measured in kg/tonne of waste) and valuing them with a unit economic cost (measured in EUR/kg of emissions)
applies. For changes in emissions of airborne pollutants (e.g. PM, NOx and SOx), unit damage values (e.g. from the Needs projects)
could be used (31). To estimate the expected annual bene昀椀t, the forecast reduction of pollution (calculated by comparing the
emissions of the pollutant in the scenarios with and without the project and expressed in tonnes/year) is multiplied by the
economic cost of the pollutant (expressed in EUR/tonne).
Leachate control
The economic bene昀椀ts of the avoidance and proper collection and treatment of leachate can be estimated using the avoided
costs of not having to clean the a昀昀ected areas and also using the marginal damage approach. These bene昀椀ts would apply to
projects comprising the closure and remediation of dumpsites and non-compliant land昀椀lls. In the case of projects diverting
waste from land昀椀lls, such bene昀椀ts would be internalised in the LRMC of land昀椀ll, assuming that such land昀椀lling would meet the
requirements of the land昀椀ll directive.
Greenhouse gas emissions
Generally, the largest GHG emission reductions are obtained at the higher levels of the waste hierarchy. However, GHG emission
reductions can vary quite signi昀椀cantly for di昀昀erent materials and technological processes within the same level of the waste
hierarchy (Ballinger, 2015).
The highest reduction in GHG emissions is achieved when waste is (in order of importance):
- prevented in the 昀椀rst place (e.g. through refuse, reduce, repair and reuse strategies);
- recovered in the form of secondary raw materials and sent for recycling, replacing virgin materials, which have a
larger carbon footprint;
30
A possible source for the price of recyclable materials can be found at the Eurostat website (https://ec.europa.eu/eurostat/statistics-explained/index.php/Recycling_%E2%80%93_secondary_material_price_
indicator#Price_and_trade_volumes).
31
See the Needs project website for more information (http://www.needs-project.org/); in particular, see RS3a D 1.1, Report on the procedure and data to generate averaged/aggregated data.
52
Economic Appraisal Vademecum
- recovered in the form of compost or other natural fertilisers for bene昀椀cial use (e.g. in agriculture) in the case of
biowaste;
- used for energy generation as a substitute for fossil fuels (in the case of non-recyclable waste);
- treated to reduce and stabilise the biodegradable components before being properly disposed of (in the case of
biowaste fractions in mixed residual wastes).
In the 昀椀rst and second cases, the decrease in GHG emissions results from the reduction of virgin raw material consumption (i.e.
avoided emissions from raw material extraction, transport and processing). In the third and 昀椀fth cases, the decrease in GHG
emissions, mainly methane, originates mainly from a reduction in untreated biodegradable waste deposited in land昀椀lls. In the
fourth case, energy recovery from waste enables a reduction in GHG emissions that would have been produced by alternative
energy sources using fossil fuels.
Normally, the calculations should also take into account the prevention and reuse of waste, which avoid energy-related emissions
generated for the production of goods from raw materials.
As good practice, the estimation of the project economic bene昀椀ts resulting from the reduction of GHG emissions
requires two parameters: standard speci昀椀c emission factors to quantify the reduction of emissions and standard
values to monetise them. By comparing the situation with and without the project (in tonnes/year) it is possible to estimate
the change in terms of emissions due to the project. The shadow price to be used for the monetisation of the CO2 emissions
component can be taken from the values used by the EIB (see Section 2.5 in Part I of the EAV).
53
Economic Appraisal Vademecum
ANNEX V. TRANSPORT
V.1. Introduction
This chapter focuses mainly on standard methods for appraising transport projects with an emphasis on updating, standardising
and simplifying (where possible) the transport appraisal approach and sources of the 2014 CBA guide, while ensuring that project
bene昀椀ts and costs are well captured and presented in a proportionate but meaningful way.
Acceleration of the process of CBA preparation is promoted below, for example by reference to pre-prepared sets of updated
country unit values at the European level such as the Handbook on the External Costs of Transport (Directorate-General for
Mobility and Transport, 2019; the 2019 handbook).
The voluntary guidance applies to projects in all transport sectors eligible for funding from EU-funded sources (both passengers
and freight).
In the context of the 2021–2027 cohesion policy funding, the voluntary guidance could be applied to transport projects meeting
the speci昀椀c objectives of policy objective 3, ‘A more connected Europe by enhancing mobility’, of the common provisions regulation
for 2021–2027. The speci昀椀c objectives directly relevant to transport are objectives 3.2, ‘Developing a climate resilient, intelligent,
secure, sustainable and intermodal TEN-T’, and 3.3, ‘Developing and enhancing sustainable, climate resilient, intelligent and
intermodal national, regional and local mobility, including improved access to TEN-T and cross border mobility’.
The guidance also applies to actions meeting the speci昀椀c transport objectives set out by the European Commission mainly to
contribute to the development of projects of common interest relating to e昀케cient and interconnected networks and infrastructure
for smart, sustainable, inclusive, safe and secure mobility.
EA tools such as CBA (with a simpli昀椀ed level of detail of underlying analysis) and MCA can be used/combined in a strategic way at
the level of transport plans to consider alternative solutions, but always in the context of a prior thorough analysis demonstrating
basic strategic issues and a clear related statement of strategic objectives.
Similarly, at the level of assessing investment programmes of projects (usually derived from a transport plan), CBA and MCA are
commonly used as prioritisation tools to indicate the projects in the pipeline o昀昀ering the most value for money (which is then
consolidated with considerations of maturity).
The impacts of transport on GHG reduction are most achievable at strategic level, where there is greater scope to in昀氀uence unit
emissions of vehicles and shifts to lower emission modes. The scope for GHG reduction at the level of project option analysis is,
however, also important, allowing further optimisation of the strategic choices.
The appraisal of signi昀椀cant individual project investments in the transport sector traditionally uses CBA, which is the primary
public policy tool used to assess if a proposed project is socioeconomically viable or to compare the value for money of di昀昀erent
project options.
MCA is used in transport for project option analysis when a project has multiple key objectives/impacts for assessment, which
cannot be comprehensively or practically assessed using CBA (e.g. when key e昀昀ects such as certain environmental impacts cannot
be monetised or when a large set of project options are being shortlisted). Outcomes or elements of CBA can be integrated into
an MCA assessment as part of the criteria set.
CEA is intended for use when a speci昀椀c outcome or objective is already de昀椀ned and decision-makers wish to compare how
e昀케ciently di昀昀erent options meet such an objective. An example in transport might be achieving compliance with the tunnel
safety directive (Directive 2004/54/EC) or the mandatory implementation of European tra昀케c management systems such as the
European rail tra昀케c management system (ERTMS) / European train control system (ETCS).
V.3. Economic appraisal
Standardised and simpli昀椀ed treatment of the project impacts in economic appraisal
Table 6 summarises the impacts of investments that are typically assessed in the EA of transport projects and the primary
appraisal methodology for each impact.
54
Economic Appraisal Vademecum
Primary evaluation New content provided in this document regarding transport CBA
Impacts
method simpli昀椀cation and standardisation
Perceived passenger New recommended methods/sources for unit values of value of time
Monetisation
time and detailed advice on door-to-door perceived time treatment
Freight time Monetisation Reference to a recent JASPERS rail freight guidance document
providing a standardised approach and EU country unit values of time
Vehicle operating and operating costs (see section ‘Costs and bene昀椀ts of rail freight
Monetisation
costs enhancements’)
More detailed guidance and references to new EU country unit values for
Safety Monetisation
accident costs
Environmental
Speci昀椀c updated reference to sources of EU country unit external cost
emissions / local Monetisation
values per mode
health
Updated references for evaluating the unit cost of carbon (see
Climate change Monetisation
Section 2.5 in Part I of the EAV)
Speci昀椀c updated reference to sources of EU country unit external cost
Noise Monetisation
values
Other environmental Qualitative
Explanation of the need for qualitative assessment
impacts assessment
Wider economic Mainly qualitative
References to literature and recommendations on evaluation method
bene昀椀ts assessment
Speci昀椀c advice related to the set-up of the without-project scenario and
O&M costs Monetisation
related O&M costs
For setting of basic unit in-vehicle values of time, a number of approaches/sources can be recommended.
- Ideally, new unit values of time should be set at the national level based on stated and/or revealed preference
surveys.
- An alternative approach would be to set values of business time in line with o昀케cial (Eurostat) data on average
hourly labour costs (including a mark-up for overheads), with commuting estimated at approximately 25–40 % of
business time and other/leisure trips estimated at approximately 20–35 % of business time.
In line with the advice of the 2014 CBA guide, it is not generally recommended that values presented in the IER Germany
(2006) study be adopted for passenger value of time sets in national methodologies, primarily because that study contains an
increasingly out-of-date data set, and national-level surveys represent a superior method.
Countries may opt to select di昀昀erent values for di昀昀erent modes (e.g. because of di昀昀erences in user income levels) or simply
select one set of values to be applied to all modes.
At least for urban and regional public transport projects, it is good practice to consider the value of door-to-door time savings:
di昀昀erentiating at least between walk access/egress, in-vehicle time and wait time / headway penalties, with di昀昀erent weightings
or functions applied to each category. This is best assessed through national stated and revealed preference surveys; however,
there is a wide body of international evidence available on door-to-door elements of perceived travel time.
Table 7 displays an approximate range of typical weights applied to in-vehicle unit value of time based on the international
literature of stated preference survey outcomes (Wardman and Hine, 2000; Wardman et al., 2012) (32).
32
See also units A1.3 and M3.2 of Department for Transport (2021).
55
Economic Appraisal Vademecum
Weighting on in-
Common perceived time vehicle unit value
Comment
elements of time or 昀椀xed
penalty
Regarding passenger travel time reliability, there is a body of evidence available evaluating the higher value of time related to
delay (lateness) and the additional signi昀椀cance of delay risk (usually expressed as the standard deviation of travel time).
Assessments of the perceived time value of comfort are best made using local stated preference surveys (e.g. the comfort of
di昀昀erent aspects of increasing comfort in a rolling stock project).
Bene昀椀ts are most commonly calculated by applying unit values of time to estimated time savings derived from a transport tra昀케c
model, where time savings can be calculated using (i) aggregate modelled estimates of time savings, (ii) a link-by-link approach
or (iii) demand model skims on an origin–destination basis.
When travel time savings are not derived from detailed integrated network transport models, care must be taken when calculating
for users transferring between modes, ensuring that the full impact on door-to-door perceived travel times is taken into account,
not just the time spent in vehicles.
Safety
Avoided accidents typically constitute a signi昀椀cant project bene昀椀t, especially in road projects, for public transport projects involving
a signi昀椀cant mode shift from road, for railway crossings and cycling infrastructure projects. Section 3.8.4 of the 2014 CBA guide
contains a detailed description of relevant concepts (e.g. direct/indirect costs and the value of a statistical life).
Road accidents
Projects involving, for example, a shift of tra昀케c from single-carriageway roads (with uncontrolled accesses and no safety barriers
between opposing tra昀케c 昀氀ows) to motorways or dual carriageways (with restricted accesses and barriers between opposing
tra昀케c 昀氀ows) can substantially reduce accident risk (33). Public transport projects involving a mode shift (from cars to public
transport modes) may also generate large accident savings.
A good practice in project appraisal is for countries to produce data on national accident rates (in terms of number of accidents
per million vehicle-km), severity splits (the percentage of accidents involving fatalities, serious injuries, minor injuries or material
damage accidents only) and casualties (average number of fatalities, serious injuries and minor injuries per fatal, serious or
minor injury accident) for each carriageway type. These estimates are produced by combining information from national accident-
reporting sources (e.g. police accident report forms) with data from tra昀케c volumes on each section of the road network. To
account for the phenomenon of accident underreporting and/or underrecording, correction factors may be applied to the number
33
See Chapter 4 of Transport Infrastructure Ireland (2020).
56
Economic Appraisal Vademecum
Estimates of the monetary value of each accident/injury (di昀昀erentiated by severity), from, for example., stated or revealed
preference studies, are also needed. When such surveys are not available, suitable estimates can be taken from adjacent
countries with similar levels of per capita GDP, or values may be taken from Table 7 of the 2019 handbook (Directorate-General
for Mobility and Transport, 2019).
In the event that the abovementioned data are not available at the country level, or if link type information was not available
from the demand model, accident savings can be incorporated into CBA in a relatively rudimentary manner by the application
of estimates of the per km cost of road accidents - from Table 8 of the 2019 handbook ꟷ to modelled changes in vehicle-km of
travel on the road network.
Rail, air and public transport accidents
Country-speci昀椀c estimates of accident rates and costs per mode may be available from national appraisal guidelines. If these are
not available, default accident costs per passenger-km, for each mode of transport, are available from Tables 8–10 of the 2019
handbook. These may be applied to modelled changes in vehicle-km for relevant transport modes to calculate accident savings
that are the result of transport interventions.
Environmental emissions and local health impacts
The local health impacts of environmental emissions constitute a signi昀椀cant project bene昀椀t, especially in road projects and public
transport projects involving a signi昀椀cant mode shift from roads.
The recommended methodology to calculate the external costs caused by air pollution remains unchanged from the 2014 CBA
guide (see Section 3.8.6 of that guide).
To calculate the total air pollution costs, quantities of air pollutants additionally emitted or avoided are estimated using suitable
emission factors (tonnes of pollutant per vehicle-km) and available transport performance data (e.g. vehicle-km) derived from
the transport model. The estimated emission quantities are then multiplied by the unit costs per air pollutant.
Updated unit costs for air pollutants, per country, emitted in road, rail, inland waterway and maritime transport are available from
Tables 14 and 15 of the 2019 handbook.
Air pollutants – road transport
A good practice in the estimation of quantities of air pollutants for road projects would be for countries to produce speci昀椀c
emission factors as a function of the vehicle type, road type, road condition and average speed. The vehicles are di昀昀erentiated
by vehicle type, capacity or weight, fuel and emission standard in order to consider the country-speci昀椀c 昀氀eet composition.
Calculations of the air pollutant quantities could be done on a link-by-link basis or by using aggregate modelled estimates of
vehicle-km, where possible broken down by vehicle type and by road type. Technical guidance to prepare national emission
inventories is provided in the European Environment Agency air pollutant emission inventory guidebook (European Environment
Agency, 2019). The same source can be used for default emission factors if country-speci昀椀c data are not available.
If only aggregated modelled estimates of vehicle-km are available, where possible di昀昀erentiated by vehicle category, average
country-speci昀椀c air pollution costs per vehicle-km for road transport are provided in the annex entitled ‘Complete overview of
country data’ accompanying the 2019 handbook (35).
Air pollutants – rail, air and public transport
Country-speci昀椀c estimates of emission factors per vehicle type and mode may be available from national appraisal guidelines. If
these are not available, marginal air pollution costs per passenger-km and tonne-km, for each mode of transport, are available
from Tables 20–23 of the 2019 handbook. These may be applied to modelled changes in passenger-km and tonne-km for
relevant transport modes to calculate air pollution impacts of transport interventions.
Climate change impact
The accuracy of the assessment of the increase/decrease in GHG emissions due to a project largely depends on the availability
of local data on road vehicles (cars and buses), speed and road conditions, as well as energy consumption for rail-based modes
(railways, tramways and metro). This allows the relevant emission factors to be properly selected. In the absence of project-
speci昀椀c data, the European Environment Agency (2019) air pollutant emission inventory guidebook can provide default emission
factors for transport and energy production.
A unit cost of carbon in EUR/tonne of CO2 equivalent must be applied to monetise the impact for use in an economic assessment
in line with the values suggested in Section 2.5 of Part I of the EAV.
34
See Table 5 of Directorate-General for Mobility and Transport (2019).
35
The values are also included in a dedicated section of the spreadsheet template complementary to the EAV that is currently being considered by Innovation and Networks Executive Agency for smaller projects
applying to the Connecting Europe Facility transport call for proposals for 2021-2027.
57
Economic Appraisal Vademecum
In the framework of the e昀昀orts of the Member States to evolve towards carbon-neutral transport systems, an accurate assessment
of the quantity of generated/avoided GHG emissions using the principles stated above provides important information for
assessing the progress made towards the achievement of GHG reduction targets set at the national/regional level in sector-
speci昀椀c strategies or in overall climate change mitigation strategies.
Noise impact
The recommended methodology to calculate the external costs caused by noise pollution remains unchanged from the 2014 CBA
guide (see Section 3.8.5 of that guide).
Tables 37 and 38 of the 2019 handbook and the accompanying annex entitled ‘Marginal costs air pollution, climate, WTT, noise’
provide unit values of marginal cost of noise for road and rail transport, di昀昀erentiated by vehicle type, time of day, tra昀케c situation
(dense or thin) and area type (metropolitan, urban, suburban or rural). The unit costs are EU-28-speci昀椀c values and they are
provided in EUR/passenger-km, EUR/tonne-km or EUR/vehicle-km. To calculate noise pollution costs, they are applied to modelled
changes in passenger-km, tonne-km or vehicle-km for relevant transport modes. If only aggregated modelled estimates of
vehicle-km are available, where possible di昀昀erentiated by vehicle category, average country-speci昀椀c noise pollution costs per
vehicle-km for road and rail transport are provided in the annex entitled ‘Complete overview of country data’ accompanying the
2019 handbook.
Other environmental impacts
Other environmental impacts (e.g. the impact on Natura 2000, namely biodiversity) are assessed qualitatively; owing to the
di昀케culty of physically quantifying or attributing money values to such impacts, they are generally not monetised and thus are
excluded from the project CBA. Impacts can, however, often be scored subjectively on a scale and, as required, included in a wider
MCA process to compare options.
Operating and maintenance costs of infrastructure
The main comments here are related to the set-up of the without-project scenario and related O&M costs. As was discussed in
the 2014 CBA guide, there are a number of valid ways of setting up the without-project scenario depending on the context (e.g.
a business-as-usual scenario leading to further degradation of the infrastructure or a more do-minimum type of scenario with
more aggressive replacement interventions in order to maintain the current operating conditions).
Whatever the approach chosen, it is very important that the operational parameters of the infrastructure (e.g. track speed) and
the O&M elements in the without-project scenario are fully consistent with each other. In a number of cases seen in 2014–2020,
this relationship was not always apparent or well documented.
Costs and bene昀椀ts of rail freight enhancements
For many rail infrastructure development projects with strong elements of improvement for freight transport, a signi昀椀cant part
of the economic bene昀椀ts is attributable to improvements in freight travel time and travel time reliability, operating costs and
external cost reduction from mode shift.
The method and parameters of appraisal of railway corridor enhancements that provide for enhanced freight operations are
somewhat fragmented and often misunderstood in the wider appraisal community, often leading to double counting in CBA or
underestimation of certain impacts. JASPERS therefore developed guidance on appraising rail freight measures, with the support
of leading experts in the 昀椀eld (EIB and JASPERS, 2017) (36), to o昀昀er a state-of-the-art, logical and consistent framework for the
appraisal of impacts of rail infrastructure projects with rail freight enhancement elements. The guidance separates freight costs
into the time value of transport (the cost of crew, vehicle depreciation, overheads, etc.), the time value of goods (capital costs and
degradation of the value of the goods during transport) and purely distance-related operational costs of transport (e.g. traction
and track access costs). The guidance further includes reference unit values for time and operating costs per EU country with
advice on escalation if countries do not have their own unit sets.
Wider economic bene昀椀ts
These are induced bene昀椀ts that arise because of the impact of improved transport infrastructure being transmitted into the wider
economy. Research in the United Kingdom (UK Department for Transport, 2005; Venables, 2016) has highlighted a number of
potential wider economic bene昀椀ts including output changes in imperfectly competitive markets, agglomeration e昀昀ects and the
tax implications of a move to more productive jobs.
While there is robust literature supporting the existence of such bene昀椀ts, the actual likelihood of these bene昀椀ts occurring is very
context speci昀椀c. In fact, as the data requirements to establish such impacts are beyond what is normally available for CBA, they
should generally only be addressed qualitatively, unless (exceptionally for very large projects) the potential impacts justify a
quantitative approach.
Real growth in the unit value of bene昀椀ts
Growing economies and income levels can increase the real unit value of the economic bene昀椀ts (in addition to in昀氀ation e昀昀ects).
To capture real increases, unit values can be increased proportionally. The following provides an update on the methods for
determining the real escalation elasticities of unit values of time and externalities.
36
http://www.jaspersnetwork.org/plugins/servlet/documentRepository/searchDocument?category=Rail%20and%20Public%20Transport
58
Economic Appraisal Vademecum
Value of passenger time. The escalation elasticity of the unit value of time to real income (GDP/capita) depends on the nature
of the underlying data set. Values based on multi-country data should follow the elasticities inherent in the underlying meta-
equations (e.g. the Wardman et al. (2012) study data gave the real income elasticity between the value of time and GDP/capita
as approximately 0.8 for business trips and 0.7 for other trips). For data sets based on o昀케cial (Eurostat) data on average hourly
labour costs, an elasticity of 1 may be used as a default for all trip motivations. In the case of countries developing their own sets
of values based on national/local surveys, escalation elasticities should be considered consistently with the method of setting
the unit values.
Value of freight time. This is covered in the EIB and JASPERS (2017) guidance and indicates that only the element of crew time
would be expected to have a signi昀椀cant real elasticity to GDP/capita.
Externalities (including accidents). The 2019 handbook suggests escalating the unit values of the externalities (excluding
CO2) proportionally to GDP/capita as well, with an elasticity of 0.8 determined based on an extensive meta-analysis by the
Organisation for Economic Co-operation and Development, which concludes that the real income (GDP/capita) elasticity for the
WTP of environmental and health-related goods falls between 0.7 and 0.9.
Reference period
The evaluation reference period for a transport project is ideally set to re昀氀ect the value-weighted average lifetime of the various
elements of the asset. This, however, should generally be restricted to a reasonable time limit of future forecastability of the net
future economic cash 昀氀ows, usually no longer than 50–60 years, which is much shorter than the lifetime of tunnels and some
bridges, for example.
An equivalent (and often simpler) approach is to have a 昀椀xed maximum evaluation period, for example of 30 years, but allowing
projects with a shorter lifespan to have a shorter evaluation period. Added to this is any residual value of net economic cash
昀氀ows over the remaining project lifetime, usually with simpli昀椀ed forecast assumptions and again up to a reasonably forecastable
time limit.
V.4. Other economic appraisal tools to simplify analysis and improve decision-making
Use of cost-e昀昀ectiveness analysis (or multi-criteria analysis) in the transport sector for compliance-driven
projects
CEA is used to demonstrate solution optimality by comparing the ratio of the quanti昀椀ed level of accomplishment of a particular
singular objective (output) with life-cycle costs between two or more project options.
In the transport sector, its main usage in the 2014–2020 funding period was for national elements of European-level projects,
which represent legal compliance objectives such as the implementation of the ERTMS in the railway sector, where the output
has been de昀椀ned in terms of simple physical outputs such as length in kilometres. Where such simple physical outputs are
considered, CEA is generally advisable only when the outputs of the options have the same quality and functionality, otherwise
the CEA is not a fair comparison. Two examples follow.
1. CEA is generally appropriate as a decision-making tool when, for example, two technical options of the global
system for mobile communications for railway (GSM-R) (37) are proposed (with a di昀昀erent solution architecture or using di昀昀erent
technology) that, however, o昀昀er the same (required) quality and functionality. In this case, the discounted lifetime costs for each
option can be divided by the output in kilometres and the resulting CEA values can be compared.
2. CEA is not generally appropriate when, for example, two di昀昀erent GSM-R options are considered and one option
has a higher level of signal reliability (e.g. by using double coverage of radio base station transmitters) corresponding to higher
operational needs of ETCS (38) level 2 and the other option is cheaper and less reliable (with only single base station transmitter
coverage). CEA is not a suitable tool here, as it would automatically favour the cheaper option, which is of worse quality and may
not meet the operational needs of reliability.
In the latter case, option selection may be better guided by MCA, taking into account the quality, functionality and/or risks of
di昀昀erent solutions as the main impact criteria together with the lifetime cost as a balancing criterion. This might take place
after a prior assessment of minimum operational requirements in terms of quality and functionality as a threshold for option
acceptability.
The two examples above are not mutually exclusive, and a CEA (used to decide between two shortlisted options of comparable
quality) might follow an MCA (used to identify the optimal balance of quality and price) in the appropriate circumstances (39).
International unit price benchmarking (for the type of solution chosen) and tender outcomes (when there is more than one bidder)
are recommended in all cases as a complementary check on the absolute value for money.
37
GSM-R is a standard digital railway radio communication technology, which is an element of the ERTMS and underpins the ETCS.
38
The ETCS is part of the ERTMS.
39
Compliance-driven projects requesting the 昀椀nancial support of the Connecting Europe Facility are generally not subject to the requirement of submitting a CBA (detailed requirements depend on each particular
call for proposals). However, applicants are free to reinforce the economic case of their project with any type of EA approach or combination of approaches.
59
Economic Appraisal Vademecum
In some cases, a formal MCA is performed, with scoring and weighting of di昀昀erent criteria (taking care to avoid double counting)
leading to a single MCA score; in other cases, the outcomes are simply presented against various criteria without weighting to
inform a consensual political decision. Finally, the multi-criteria approach can be a hybrid of both approaches.
For major political decisions, a single-value MCA outcome is often considered too opaque and subjective an indicator and is at
risk of being marginalised in practice. Clear presentation of the main quanti昀椀ed and unquanti昀椀ed outcomes of various options is,
in such a case, not just a presentational exercise but a fundamental input for real-life decision-making.
Examples of actual processes used in Ireland and Germany for major scheme decision-making and plan prioritisation, respectively,
are described below.
Irish major project scheme appraisal approach
For major transport schemes in Ireland (similar to UK practice), an overall appraisal table is required as a key input for decision-
making. Table 8 is a simpli昀椀ed example of an appraisal summary table.
Assessment
Impacts Summary of key
impacts
Quantitative Qualitative Monetary (EUR, NPV)
Present value of
Summary of Average time savings
Qualitative assessment time-saving bene昀椀ts
Time savings any time-saving per user
of time-saving bene昀椀ts (passengers and
bene昀椀ts Hours saved per year
freight)
Economy
Average operating
Summary impact Qualitative assessment
Vehicle costs per vehicle Present value of vehicle
on vehicle of vehicle operating
operating costs (without and with operating cost savings
operating costs cost changes
project scenarios)
Generally excluded
Summary of any Number and quality of Qualitative assessment
Wider economic but, where applicable,
wider economic indirect jobs created of potential for wider
bene昀椀ts present value of wider
bene昀椀ts (if any) economic bene昀椀ts
economic bene昀椀ts
Additional
economic … … … …
objectives …
60
Economic Appraisal Vademecum
Additional
environmental … … … …
objectives …
Additional social …
… … …
objectives …
German approach
The German methodology (40) used to prepare the long-term national transport infrastructure investment plan (but which could
equally be used to provide a higher level of detail for a project appraisal summary assessment) is based on four modules:
1. CBA, covering all of the common elements also addressed by the 2014 CBA Guide – this is the only module based
on monetisation of impacts;
2. environmental protection, addressing all topics relevant for the environmental dimension not covered by the CBA,
for example land consumption, protection of sensitive areas and habitat fragmentation;
3. spatial planning, addressing the connectivity and accessibility of agglomerations in terms of distributive equity;
accordingly, this di昀昀ers from the allocative bene昀椀ts of accessibility included in the CBA in terms of time savings;
4. urban planning, addressing the local impacts of transport infrastructure projects that a昀昀ect the quality of urban
areas – this applies, for example, to projects able to relieve urban areas of through tra昀케c or decongest them (note
that the national plan does not address investment in urban transport infrastructure).
Modules 2, 3 and 4 do not rely on monetisation but, for each of them, a strictly standardised and largely quantitative evaluation
scheme is given, ensuring a high degree of objectivity and comparability of results. In a subsequent phase, the investment
options are assessed against a detailed, multi-level set of given strategic goals. To this end, the scores resulting from each
module are not aggregated to a single indicator. The particular way in which each project, as de昀椀ned by its four individual scores,
contributes to the strategic goals is assessed. This eventually allows a broadly based, informed investment decision to be made.
V.5. Standardising and streamlining demand modelling as an input to economic appraisal for road, rail and
urban transport
Demand models generally form the key source of input and assumptions for a transport CBA, so their quality and objectivity are
an essential prerequisite of a sound transport economic analysis.
Demand models provide forecasts (without and with project investment) of tra昀케c levels that are a key basis for the assessment
of time savings, cost savings and externalities. The creation of a transport model is, however, a costly and time-consuming
exercise. It is therefore appropriate at an early stage of the project to consider what form the model should take.
In the 2014–2020 programming period, best practice in terms of demand modelling was outlined in Section 3.5 of the 2014
CBA guide, and this remains valid. However, based on a review of transport projects submitted to the European Commission for
40
Bundesministerium für Verkehr und digitale Infrastruktur, Bundesverkehrswegeplan 2030 (BWP 2030), and in particular: PTV at al., Methodenhandbuch zum Bundesverkehrswegeplan 2030, Karlsruhe, 2016
61
Economic Appraisal Vademecum
approval in the 2014–2020 programming period, a number of common weaknesses have been identi昀椀ed relating to demand
modelling practices, including:
- the need for a new transport model and the use of existing models;
- an inappropriate geographical scope of the model;
- an insu昀케cient level of model network and zoning detail;
- insu昀케cient attention paid to model calibration and validation, and a lack of underlying data;
- inappropriate or poorly documented forecasts;
- incomplete travel time, cost estimation and data exports from public transport models.
Need for a new transport model and the use of existing models
Transport models are both expensive and time-consuming to create and therefore the decision to create one should not be taken
lightly. In the 2014–2020 programming period, in a limited number of cases, decisions were taken to create new demand models
when the modi昀椀cation of existing models might have su昀케ced. There were also a limited number of cases of major projects using
demand forecasts from clearly unreliable, outdated models. At an early project stage, existing models (where available) should
be reviewed and pragmatic decisions should be taken on whether the demand model needs to be updated/replaced. Even when
a new demand model is required, existing sources of information (in the form of tra昀케c counts, origin–destination surveys and
coded supply networks) should be used to the maximum extent possible. The proliferation of national transport models provides
a useful source of information; it is possible to extract basic information from these (on supply network and demand matrices),
which may aid in the creation of local models.
Incorrect geographical scope of the model
Sometimes models do not have the correct geographical scope, with the modelled area being either too small or too large. The
minimum required modelled scope should be the area within which the main expected transport impacts of the types of plans
and/or projects are expected to occur. Particular issues are found with major cross-border projects and investments in rail freight
facilities, where European travel data are essential. European data such as from the European Transport Policy Information
System (ETIS+) and Eurostat, the Trans-European Transport Network Policy (TEN-T) information system (TENtec), the latest
European models (a new model called TRIMODE is being developed) and European forecasts (e.g. the EU reference scenario 2016
(European Commission, undated), which is being updated to a 2020 scenario) should be considered when possible in such cases.
The development and use of national models and the data of neighbouring states should also be considered.
Insu昀케cient level of model network and zoning detail
This is often observed when national models are applied to regional transport projects or regional models are applied to local/
urban transport projects. Existing higher level models may need to be cut (taking only the relevant part of the network) and
further detailing made in terms of network and zoning in order to become applicable for project assessment at a lower level,
especially in the area of direct in昀氀uence of the project.
Insu昀케cient attention paid to model calibration and validation, and a lack of underlying data
Transport models require proper calibration and validation (often understood just as calibration). Calibration essentially entails
estimating the multitude of constants and parameters in a given transport model based on transport data; validation establishes
the credibility of the model by demonstrating its ability to replicate observed tra昀케c behaviour.
Data used for validation should be independent (i.e. they should not have already been used in the 昀椀rst steps of model calibration).
For four-stage models used for public transport / rail projects, production / attraction, distribution and mode share model step
parameters should be calibrated based on the outcome of census data (if recording trips) and speci昀椀c mobility surveys.
To con昀椀rm the suitability of a model, statistical tests such as the GEH test may be used as part of a rigorous model acceptability
test in the validation process. In the 2014–2020 programming period, there were no 昀椀xed requirements for model calibration and
validation. The majority of transport projects followed best practice in this regard.
Inappropriate or poorly documented forecasts
Demand forecast models normally contain mathematical relationships relating travel demand (per trip purpose) to external
driving factors such as GDP, school places or population. Ideally, demand forecasts will use o昀케cial forecasts of these external
factors to assess probable future demand (again at the trip purpose level). In the 2014–2020 programming period, some
forecasts were based not on this methodology but rather either on simple unjusti昀椀ed assumptions or on the application of
simple growth factors. Forecasts should be transparently documented linking, underlying variables with the justi昀椀cation of the
quantitative link between demand and these variables.
Incomplete travel time, cost estimation and exports from public transport models
When a project has a substantial impact on di昀昀erent elements of a door-to-door trip, such as a new railway stop, it is advisable
that the model and its output into the CBA should take into account the perceived cost of each element of the trip, such as access
to a public transport stop, waiting time and in-vehicle time. Without this, the full bene昀椀ts of the project will not be measured,
which may lead to a low ERR or a distorted option analysis.
62
Economic Appraisal Vademecum
For more detailed descriptions of best international practice relating to demand modelling, please refer to the UK Department for
Transport highway assignment modelling (UK Department for Transport, 2020) and the JASPERS publication The use of transport
models in transport planning and project appraisal (JASPERS, 2014) or, for multi-modal freight modelling, see EIB and JASPERS
(2017).
63
Economic Appraisal Vademecum
Speci昀椀cally, in relation to digital infrastructure, the European Commission introduced, in 2016, its strategy on connectivity
for a European gigabit society. The document recognises that the full economic and social bene昀椀ts of the digital transformation
will only be achieved if Europe can ensure widespread deployment and take-up of very high-capacity networks, in rural as
well as urban areas and across all of society. The gigabit society strategy sets out a number of targets to increase the
coverage and quality of broadband infrastructure in Europe. The vision for 2025 includes gigabit access to major social
economic drivers, ultrafast internet access (above 100 megabits per second (Mbps), upgradable to gigabit speed) to all European
households, and uninterrupted 5G wireless broadband coverage in urban areas and along major rail and road infrastructures.
Over recent years, there has been a shift in the type of projects that have received public support. While many of
the digital infrastructure projects in the earlier multiannual 昀椀nancial frameworks focused on the presence of a high-capacity
telecommunication backhaul infrastructure, predominantly through investment in the deployment of 昀椀bre, the 2014–2020 one
concentrated more on projects related to high-speed access to end users, ensuring that they can better bene昀椀t from capacity-
demanding applications, such as internet protocol television (IPTV) and various streaming services. More importantly, however,
these projects have paved the way for tighter integration of ICT services in everyday life, empowering more teleworking options
through more reliable, higher quality and more responsive video conferencing, as well as facilitating the deployment of several
e-services in the areas of e-health, e-commerce and e-government. By unlocking investments in digital infrastructure in rural
areas, the European Commission’s investments have worked towards reducing the digital gap, bene昀椀ting citizens across the
continent and creating new growth opportunities.
In the light of the above changes in the broadband landscape and policy objectives, this chapter also provides
an update to the approach presented in the 2014 CBA guide. Whereas the focus of analysis was previously on projects
deploying backhaul infrastructure, this version also takes into account the rollout of next-generation access networks all the way
to the end users.
For broadband projects, it is industry practice, in both publicly and privately 昀椀nanced projects, to develop a project feasibility study,
including a 昀椀nancial analysis to demonstrate the rationale for the project and its sustainability during operations. In addition, the
analysis needs to demonstrate if the project is bankable or in need of EU grant support. For many projects, in particular when
required by the authority providing grants or loans, the analysis extends to the economic level, aiming to demonstrate the value
of the investment at large for the target population and society as a whole. This chapter focuses on the economic analysis
of broadband projects.
Apart from compliance with policy, broadband interventions are duly justi昀椀ed only when their scope re昀氀ects the current
and expected future demand for the project infrastructure. The current demand can be based on the national broadband
map, EU and national regulator reports or information provided by telecommunication operators. Estimations of the future
demand would typically be based on market research and evidence of market interest (i.e. public consultations and operator
investment plans) focused on the intervention area, as well as analysis of the future services that can trigger demand and their
bandwidth requirements. Demand analysis, both current and expected, should equally consider aspects of a昀昀ordability, ICT
literacy and patterns of increase in penetration rate in comparable markets. The results of the demand analysis, such as the
number and groups of users, will form the basis of economic assessment of the project.
The broadband demand analysis is followed by option analysis, in which the most cost-e昀昀ective technical and business solutions
are selected, within the desired policy goals and the results of the demand analysis. For broadband projects, there are
usually also a number of strategic choices when it can be more e昀昀ective to consider these qualitatively. An MCA can
allow the relative merits of possible strategic options to be compared, including di昀昀erent business models or considerations of
di昀昀erent locations or size of investments. Strategic options can be assessed, for example, from a legal perspective within State
64
Economic Appraisal Vademecum
aid and procurement law, the need for public oversight of investment or risk transfer between public and private partners. The
results of the 昀椀rst-level analysis would lead to the identi昀椀cation of the possible business/institutional options. An
evaluation and shortlisting of suitable technological alternatives should be done next, such as variants of FTTx, including 昀椀bre-
to-the-home or 昀椀xed or mobile wireless access.
In the next level of option analysis, it is recommended that the feasible options be compared using a simpli昀椀ed CBA,
as this method can help in considering the e昀케ciency of limited public resources at the early stage of project identi昀椀cation and in
choosing the option with the highest value for money and impact on the local society and economy. This step involves preparing
the 昀椀nancial and economic models based on approximate values, which will be made more accurate for the chosen option. The
next section gives more recommendations on the economic analysis.
Once the project option has been selected, it will be used as the basis of the technical design. For telecommunication,
a number of tools and methods are used for network design and the calculation of related equipment needs. An important
element of this is to take into account the presence of existing infrastructure that can be reused in the project.
Next, the 昀椀nancial model can be re昀椀ned with more accurate project cash 昀氀ows: capital and operating costs,
reinvestments, 昀椀nancial revenues and residual value. There are di昀昀erent considerations related to the bene昀椀t of carrying
out pro昀椀tability analyses at the level of the owner or operator. For example, the selection of the private partner through fair,
transparent and competitive procedures should allow the best value for money to be assured. For public owners, the calculation
of 昀椀nancial ‘pro昀椀tability’ may not be meaningful when the institutions are subject to budgetary balance. Moreover, there are
also often speci昀椀c provisions set out by State aid decisions (i.e. a clawback mechanism). However, if there are public and
private partners involved in the project, it is important to carry out 昀椀nancial sustainability analysis at the level of each of the
stakeholders. Economic analysis of the selected option can be also performed at this stage, especially if there are major changes
to the assumptions on the costs or scope of the project.
The project should 昀椀nally be subject to a risk and sensitivity assessment, whereby potential shortcomings are tested and mitigated
to ensure the viability of the undertaking for implementation and operation.
The research literature on the socioeconomic bene昀椀ts of broadband has been evolving in the past decades alongside the continued
growth in the reach of networks, their speeds and the range of applications and services available. While the positive impact of
high-speed networks is generally recognised, it is equally noted that the exact impact remains di昀케cult to measure.
Moreover, the challenge in proposing a generic model is that infrastructure projects aimed at improving access
to broadband networks in a given area or region may di昀昀er signi昀椀cantly because of the speci昀椀c needs of the
intervention area. For example, they may di昀昀er to the extent to which they aim to connect public administration, healthcare or
schools, in addition to improving general broadband access. Projects focused on improving the connectivity of a particular public
service or group of users would need to consider additional economic costs and bene昀椀ts that are sector and project speci昀椀c.
Despite these challenges, there are studies that demonstrate that there are ways to quantify a set of economic
bene昀椀ts. Consequently, decision-makers can evaluate the economic viability of publicly funded investments in broadband
projects. The template CBA, developed for the bene昀椀ciaries of EU funds and available on the JASPERS website, can be adapted
to be used independently of the sources of 昀椀nancing (JASPERS, 2020). The model assumes that the impact of the project will
depend on the di昀昀erence in speeds between the existing broadband provision and those resulting from the investment in the
project area. This di昀昀erentiation in capacity is partially also linked with the various types of services and technologies on the end
user side that are enabled through the di昀昀erent speed ranges (from email and web sur昀椀ng in the case of lower speed broadband
to IPTV, streaming, video conferencing, etc. as the available speed increases; Table 9).
65
Economic Appraisal Vademecum
Following a literature review of available studies, two parameters are proposed to be used in the model: (i) consumer
bene昀椀ts per household and (ii) business bene昀椀ts derived from productivity rises estimated per employee in the
project area. The model has a built-in 昀氀exibility, which allows it to be modi昀椀ed according to the particular circumstances of a
given project or bene昀椀ciary. Project promoters can use other types of bene昀椀ts in their assessment or can modify parameters of the
bene昀椀ts considered in the model (Table 10 gives a checklist of a number of possible bene昀椀ts, including additional considerations
to make). In such a case, however, the methodology or assumptions used should be properly explained. As a ‘living document’,
the model is can be updated, when new data emerging so require.
The European Commission’s 2014 CBA guide has promoted a microeconomic approach in the estimation of bene昀椀ts and the
above follows this approach. However, project promoters and evaluators often follow an alternative macroeconomic assessment
of broadband investments based on GDP growth. While there are advantages and disadvantages to both methods, it is important
to note that the two methods cannot be combined, as this can lead to double counting of bene昀椀ts.
Monetary Qualitative
Topic/issue Comment on treatment
evaluation assessment
Consumer bene昀椀t √ There is su昀케cient evidence, although the estimates
vary across studies. The values of the bene昀椀t would
Business bene昀椀t √ depend on the net increase in the available speed
Social inclusion √ Intangible bene昀椀t
e-Education – bene昀椀t of
√ √
connectivity to home
e-Farming – increase in
farm production through the √ √
adoption of new methods
Environment – limitation of
Impacts are likely to be mixed; a variety of small
negative impact thanks to √
e昀昀ects are likely, which are di昀케cult to estimate
reduced travel
41
Basic broadband is de昀椀ned as being between 2 Mbps and 10 Mbps, fast broadband is de昀椀ned as 10 Mbps to 30 Mbps, superfast broadband is de昀椀ned as 30 Mbps to 100 Mbps and ultrafast broadband is de昀椀ned
as greater than 100 Mbps.
66
Economic Appraisal Vademecum
- compliance related, where the focus is on ensuring safe and reliable drinking water together with adequate
collection and treatment of wastewater;
- e昀케ciency related, where the aim is to improve resource usage, save costs and reduce carbon footprint, while also
allowing for lower end user prices and reduced a昀昀ordability constraints.
In practice, many projects combine elements of both, with the 昀椀rst group tending to result in increased operating costs, while the
second has the potential to decrease such costs, reducing the impact.
Policy for compliance-driven projects is oriented towards meeting the requirements of the directives for the provision of water
and wastewater services, such as the water framework directive (WFD; Directive 2000/60/EC), the directive on the quality of
water intended for human consumption (Directive 98/83/EC) and the urban waste water treatment directive (UWWTD; Directive
91/271/EEC), and is measured in terms of the relevant population connected to services, but also in terms of the quality and
security of supply.
The directives also make reference to the polluter pays principle, the need for full cost recovery and the importance of the end
user a昀昀ordability of services. This, combined with the scarcity of water, which is exacerbated by climate change impacts, sets the
agenda for e昀케ciency-related projects.
Countries 昀椀nd themselves confronted with the need for investments that promote climate change adaptation, risk prevention
and disaster resilience in the water sector. Thus, while the larger part of existing funding has been oriented towards directive
compliance, new types of projects will increasingly be considered, such as those focusing on leakage/in昀椀ltration reduction,
drought resilience and water reuse schemes.
In considering the method of appraisal, some common features of water operators need to be considered.
- Typically, integrated water and wastewater service providers operate in a de昀椀ned geographical area with existing
operations, which comprises a ‘natural’ monopoly, where it is not cost-e昀昀ective to have multiple networks (i.e. they
will usually have a mandate to operate exclusively in that area and without competition).
- Often, such entities are owned by national or regional/local governments, but can also have private sector
involvement.
- Water operators typically have a relatively simple tari昀昀 structure (water vs wastewater collection and treatment)
and relatively few customer types dominated by domestic consumers.
- Such entities also have a relatively simple operating cost structure with a high level of 昀椀xed costs (e.g. capital
(depreciation/debt service) and salary (semi-variable)).
- Stable and predictable cash 昀氀ows make operators suitable for debt 昀椀nance with long tenors.
The following represents a codi昀椀cation of existing good practices, which have evolved over the last few funding phases.
While assessing the measures, project promoters should carefully assess the cost per connection, connections made per
metre of pipe needed or similar indicators, based on national (or other reasonable) benchmarks, and in the case of wastewater
consider the provisions of Article 3 of the UWWTD:
Where the establishment of a collecting system is not justi昀椀ed either because it would produce no environmental bene昀椀t or
because it would involve excessive cost, individual systems or other appropriate systems which achieve the same level of
environmental protection shall be used.
67
Economic Appraisal Vademecum
In the case of more complex projects not dealing exclusively with compliance with the directives but also involving investments
dealing with, for example, climate change adaptation, risk prevention and disaster resilience in the water sector,
ultimate investment decisions should or could be based on a thorough assessment of the economic costs and bene昀椀ts, through
a fully 昀氀edged CBA.
A fully 昀氀edged CBA, in terms of the development of a cash-昀氀ow/economic cost and bene昀椀t forecast model is usually done at the
feasibility stage. Its development should both be driven by and inform the technical development of the project in an iterative
process to ensure consistency of assumptions, and to test scenarios for prioritisation and phasing to ensure that the outcome can
reach a balance between a昀昀ordability and sustainability. A 昀椀nancial cash-昀氀ow analysis is recommended to test such scenarios
(see the following section).
The main considerations to be taken into account in the EA include cost recovery tari昀昀s ensuring sustainable operations (as
required by the WFD), a昀昀ordability considerations and the need for cash-昀氀ow projections and economic analysis, as discussed
below.
- operating cost,
- asset maintenance cost (a minimum level may need to be set),
- capital costs through depreciation provisions (42) (historical asset values may need to be re-evaluated),
The regionalisation of services helps to spread costs over a larger area with a single uni昀椀ed tari昀昀 structure. This is also known
as the solidarity principle, even if it represents an implicit cross-subsidy between more densely populated areas (i.e. cities) and
less densely populated (i.e. rural) areas.
A昀昀ordability considerations
The WFD also mentions that ‘water pricing policies’ should ‘have regard to social’ e昀昀ects. This is interpreted as meaning that
tari昀昀s should not result in amounts billed that exceed reasonable a昀昀ordability thresholds. In current practice, these thresholds
are often taken to be in the range of 2–3 % of average disposable household income (although higher levels are used, even up
to 5 % in low-income areas where low incomes make such levels unavoidable and the bene昀椀ts of the project are high).
In this respect, a key challenge is matching the operator’s need for 昀椀nancial sustainability (i.e. the cost recovery tari昀昀) and the
end users’ a昀昀ordability constraint. It is worth noting that it is hard to be explicit about how fast a project needs to achieve cost
recovery or with respect to absolute levels of a昀昀ordability, as it depends on the level of needs and levels of income at the country
(or even regional) level. It is normally in the interest of the project promoter that the path to full cost recovery is as short as
possible, subject to the a昀昀ordability constraints. Often, 3–3.5 % of average disposable household income is seen as an upper
limit with respect to average household income in the EU context, but sometimes this may need to be exceeded.
As good practice in such cases, subsidy schemes for low-income users can be considered. Such schemes could, for example,
give discounts to user groups that are identi昀椀ed as having di昀케culty in paying bills, and should be structured (as far as possible)
as a social support measure and not imposed as a cost to the water operator. If designed to carefully target low-income users
or otherwise vulnerable or displaced communities, this approach could ensure that a昀昀ordability issues are addressed in a cost-
e昀케cient manner.
Table 11 reviews some good practices on how to cope with issues related to tari昀케ng and a昀昀ordability.
42
If capital costs are 昀椀nanced by debt, then there may need to be an extra provision in the tari昀昀 to the extent that debt service (principal and interest) exceeds depreciation charge. This can happen if the repayment
period is shorter than the expected useful lifetime of the relevant assets used for the depreciation charge.
68
Economic Appraisal Vademecum
Cash 昀氀ow at the operator level needs to remain Apart from operating cash 昀氀ow, this should include the replacement
cumulatively positive throughout the projection of assets and debt service on historical and new (i.e. project-
period related) debt
No user group should pay a tari昀昀 greater than the full cost of the
service provision. If industrial treatment tari昀昀s are higher than
Cross-subsidy should be avoided between (i)
domestic tari昀昀s, this needs to be reconciled with requirements to
non-domestic and domestic user groups for the
pre-treat industrial wastewater. If an operator is active on other
same services and (ii) regulated and any other
markets (other than water supply and wastewater collection and
services performed by the same entity
treatment), a proper cost allocation and separate accounts need to
be secured
- are built based on historical revenues and costs adjusted for the incremental impact of the project applied to foreseen
changes in demand (also needed for project investment speci昀椀cation), foreseen operating cost developments (split
between 昀椀xed and variable, expected real term growth in salaries, etc.) and adequate maintenance levels (on both
existing and project assets);
- need to quantify a tari昀昀 commitment (say 5 years) for project approval, but with some 昀氀exibility with respect to
future demand if actual demand varies signi昀椀cantly from that forecast.
The worked example in Table 12 is a very simpli昀椀ed cash-昀氀ow projection done at the project level simply to demonstrate
the balancing of a昀昀ordability with cash 昀氀ow through the phased approach to charging depreciation. A tari昀昀 inclusive of full
depreciation recovery is achieved in year 15, but su昀케cient cash is accumulated to fund replacements due in year 15 and ongoing
debt service. Note that, in the example, the aim is to have a昀昀ordability at 2.5 % of household income, but it is accepted that it
may rise to 3 % provided that there is a long-term prospect to reduce it back to 2.5 % (which can be driven by forecast growth
in household income in real terms).
43
It is assumed that the methodology for the EU grant calculation in the next phase of the cohesion policy will specify 昀椀xed rates. If calculated rates are still allowed, then this will become an additional requirement
for cash-昀氀ow projections.
69
Economic Appraisal Vademecum
Revenue 55 70 85 85
Operating cost 50 50 50 50
Replacement 20
Debt service 5 5 5
Annual cash 昀氀ow 5 15 10 30
Cumulative cash 昀氀ow 5 40 100 150
Cover of depreciation (new assets), % 0 50 100 100
A昀昀ordability, % 2.5 2.75 3.0 2.75
Economic analysis
As mentioned before, quantitative economic analysis should not be the main focus for compliance-driven standalone investment
components. Rather, the justi昀椀cation should be based on showing that the least-cost solution (capital and operating costs
combined over the economic life of the investment, that is, use of the life-cycle cost analysis) has been chosen after evaluating
all viable alternatives.
For e昀케ciency-related investments (especially loss reduction) and those of a multipurpose nature (e.g. combining compliance-
driven measures and resource e昀케ciency, climate change adaptation and risk prevention measures), an analysis of economic
costs and bene昀椀ts should be undertaken for di昀昀erent levels of output to show the optimal level of investment. In this respect,
it can also be considered the ‘resource cost’ associated with the scarcity value of water as referred to in Article 9.1 of the WFD.
Di昀昀erent types of projects will gain precedence as Member States move closer to compliance (e.g. water resource and security
(possibly induced by climate change), storm water, wastewater reuse and other). In those cases, the principles of analysis remain
valid (as already discussed in Sections 4.1 and 4.3 of the 2014 CBA guide), but it needs to be shown that the economic bene昀椀ts
exceed the economic costs. Similarly, all kinds of interventions aiming at improving 昀氀ood prevention, climate change adaptation,
risk prevention and disaster resilience should be subject to economic evaluation.
The following are the main types of economic bene昀椀ts applicable to water and wastewater projects:
- improved access to water and wastewater services (costs avoided in building/operating private wells and/or septic
tanks);
- improved quality of drinking water (costs avoided to purchase drinking water from the market);
- improved reliability of water sources and security of water supply service, including avoided costs caused by water
supply disruptions;
- variations in GHG emissions due to changes in electricity consumption and the e昀케ciency of wastewater collection
and treatment facilities, including sludge management;
- health impacts (care should be taken not to double count bene昀椀ts with improved quality of drinking water);
- avoided costs of local 昀氀ooding due to ine昀케cient sewers and/or storm water systems;
- improved environmental quality of the water bodies and preservations of ecosystem services;
70
Economic Appraisal Vademecum
E昀케ciency-related measures (e.g. loss reduction through rehabilitation) should be balanced with compliance-related measures
(e.g. a new treatment facility), as the operating cost savings from the former can help to balance the incremental operating costs
of the latter.
71
Economic Appraisal Vademecum
Problem Character
Death is the natural end of life, which, in some circumstances, can be postponed through e昀昀ective
Excessive mortality
disease (or health problem) prevention or treatment
The length of life increases with civilisation’s development. The life expectancy of individuals in
Reduced longevity
every age category may be shortened if diseases are not prevented or treated e昀昀ectively
Disease prevention measures may lead to a reduction in disease onset (incidence) and the
Excessive disease
consequences of disease (burden), such as reduced quality of life, loss of productivity and costs
incidence
for the social (including health) protection system
The duration of a disease, which could otherwise be cured or of which symptoms could be
Persistence of
diminished, has an impact on the degree of consequences (burden), such as reduced quality of
diseases
life, loss of productivity and costs for the social (including health) protection system
Long waiting times for health intervention may lead to the deterioration of health status
Delay in access to
(including death) and could prolong the period of deteriorated quality of life (su昀昀ering, anxiety,
care
etc.)
Medical activity is mostly based on evidence, and the optimal patterns of care are often
presented in the form of clinical guidelines, usually published by medical associations. Departure
Inappropriate care
from the guidelines is regarded as inappropriate, leads to worse outcomes and the use of
unnecessary resources, and may cause harms to patients’ health
Diminished quality Imperfect health may reduce quality of life owing to physical and mental su昀昀ering, imperfect
of life functioning and limited capabilities
Diminished Health threats (e.g. pandemics and substance abuse) that a昀昀ect younger groups of the population
productivity of the may have a signi昀椀cant impact on goods’ and services’ production processes, diminishing the
workforce overall well-being of the whole population
The development of health technologies allows for the treatment of an increasing number of
A昀昀ordability
cases; however, 昀椀nancial accessibility is limited owing to the costs of such treatment
The proper identi昀椀cation of challenges enables the de昀椀nition of the goals, objectives and aims of the intervention.
Goals and objectives should represent statements that describe what the project is expected to accomplish and should be
embedded in wider strategies set at the national, regional and EU levels, if applicable. Health strategy setting and the mapping of
needs, as enabling processes for the implementation of cohesion policy operational programmes, are natural points of reference
when setting goals and objectives. Goals are usually high-level statements that present the overall context of what the project
wants to achieve. Objectives are lower level statements that describe the speci昀椀c outcomes that the project is expected to deliver
(Pepper, 2007). In de昀椀ning the objectives, it is useful to follow the rule of SMART (Doran, 1981). Project goals and objectives
should be embedded in wider strategies that are set at the national, regional and EU levels, if applicable. The objectives should
allow projects outcomes to be de昀椀ned, among which should be economic gains (e昀昀ects and bene昀椀ts), which should be used later
72
Economic Appraisal Vademecum
After de昀椀ning goals and objectives, the next step is to de昀椀ne alternatives/options (i.e. di昀昀erent ways to address the problems
identi昀椀ed) and prepare a shortlist of the most relevant ones. At the preliminary stage, the strategic options assessment
should include the development of a simpli昀椀ed list of costs and outputs/bene昀椀ts for each alternative, and data
should be gathered to quantify them for the alternatives/options identi昀椀ed. For large/strategic investments, the EA should
be further updated at subsequent stages of development of the proposal as more information comes to hand.
The following methods of EA are usually applied to health projects (Drummond et al., 2005).
- Least-cost analysis (LCA) is used when a well-de昀椀ned / single result is going to be achieved and the only
dilemma is related to the associated costs. Least-cost analysis is typically used as an element of technical option
analysis, when one decides on which technical component of a complex infrastructure to adopt by comparing the
costs of di昀昀erent options.
- Cost e昀昀ectiveness analysis (CEA) is used when one needs to compare di昀昀erent options that have the same
e昀昀ect but with di昀昀erent intensities (e.g. number of lives saved). CEA particularly useful when assessing disease
prevention programmes with speci昀椀c health gains (e.g. breast cancer screening for reducing fatalities among cancer
patients). CEA is more convenient when only one e昀昀ect is achieved, and is usually carried out by calculating the cost
of the intervention per unit of e昀昀ect.
- Cost–utility analysis (CUA) – is appropriate for interventions that result in both an increase in life years and an
improvement in quality of life. It compares costs with expected number of acquired disability-adjusted life years
(DALYs) and quality-adjusted life years. Cost–utility analysis is appropriate for all projects that generate gains in the
form of reduced mortality and improved quality of life or reduced disability.
- Cost bene昀椀ts analysis (CBA) combines di昀昀erent types of gains converted into monetary values and compares
them with invested resources (costs). CBA is generally the recommended tool for sizeable health infrastructure
projects resulting in a series of heterogeneous outcomes. As for the quanti昀椀cation of bene昀椀ts, this is not always an
easy exercise, but some good practices exist, as described further in the document (44).
It is worth noting that the EA tools described above can be used in a strategic way to consider alternative solutions, but should
always be used in combination with a qualitative analysis demonstrating basic strategic issues and a clear connection between
the project and the overall strategic goals and objectives.
Identifying the health-related gains of di昀昀erent interventions is mainly associated with presenting a cause–e昀昀ect relationship
between the interventions and the bene昀椀ts. The project promoter should provide evidence and data that are logically connected
with the expected results of the intervention, as well as its targets and size. Health interventions may have various characteristics.
They may be health infrastructure development projects, possibly accompanied by organisational change (restructuring), the
modi昀椀cation of operations or health programmes. Alternatively, they may be disease prevention programmes or projects
implementing new e-health functionalities. The underlying logic is that the intervention modi昀椀es the ongoing routines of health
system operations, generating incremental economic bene昀椀ts several years after the project is completed (Figure 2).
44
There are, however, cases when bene昀椀ts quanti昀椀cation is di昀케cult, namely in the absence of statistical data or research studies to provide values for the bene昀椀ts to be quanti昀椀ed, or the size of the project does not
justify it; in these cases, cost e昀昀ectiveness or cost–utility analysis is the methodology of choice.
73
Economic Appraisal Vademecum
Health sector
Intengible costs
Health outcomes
saved
Patients/Families
Other sectors
Figure 2 illustrates the elements of the EA of health interventions and their associated costs; these include CAPEX and the
incremental value of OPEX over the reference period, as well as e昀昀ects on health gains and savings of resources. It is also
commonly expected that an e昀昀ect of the health intervention will be the improvement of the health status of individuals and/or
the entire population.
The typical bene昀椀ts of interventions in the health sector can be grouped as follows:
- patients’ health status improvement, including mainly reduced mortality, disability, morbidity, burden of disease
or adverse e昀昀ects of medical procedures – the valuation of these bene昀椀ts usually consists of estimating the savings
in both direct costs of treatment and indirect costs such as productivity losses to society, as well as perceived value
of health;
- improved e昀케ciency/productivity of the healthcare system, usually resulting from cutting costs (e.g. reduced
number of hospitalisations and reduced length of stay), but also from improving organisation of service delivery –
this bene昀椀t usually consists of 昀椀nancial gains for the health system in general or time savings for patients;
- patients’ satisfaction improvement due to the perceived increase of quality of service or health status,
measured in patients’ WTP;
- reduced externalities such as energy consumption and vehicle operating costs.
Achieving any of the above bene昀椀ts is typically a result of a series of measures, of which infrastructure improvement is one
component.
Table 14 at the end of this chapter provides a detailed illustration of the typical bene昀椀ts of health interventions, together with
a description of the bene昀椀t, the unit of measurement and the suggested monetary evaluation method. In what follows, some
examples of bene昀椀t quanti昀椀cation (for reduced mortality, avoided hospitalisation costs and improved accessibility to services)
are presented for illustrative purposes.
An adjustment factor (the average reduction in the fatality rate) is applied to estimate the potential number of life years saved
(or avoided deaths), and a monetary value is attributed to the additional number of years of life gained (or the avoided deaths).
74
Economic Appraisal Vademecum
where:
A = projected admissions to the emergency department
ΔFR = average reduction in the fatality rate among emergency department patients due to decreased overcrowding
YLG = assumed number of years of life gained (or avoided deaths)
vYLG = value of 1 year of life gained (or value of statistical life: vOSL)
When considering a project that aims to replace inpatient care with outpatient care, one can consider both capital and operational
cost savings of hospital care as bene昀椀ts (Box 4). The avoided operating costs are estimated based on the di昀昀erence between
the average cost per acute hospitalisation and the average cost per non-admitted service event. The avoided capital costs are
estimated based on the avoided hospital bed days.
where:
ΔOPEX = average reduction in operating costs of hospital care per non-admitted patient
ΔCAPEX = reduction in capital costs of hospital care resulting from reduced hospital admissions:
In principle, e-health interventions can help to achieve better health outcomes and save costs, for both providers and patients.
The area in which the e-health intervention is applied determines the bene昀椀ts. One of the most frequent applications of e-health
is e-prescriptions, which bring bene昀椀ts to all actors involved in the process of drug dispensing in terms of increased accessibility
(Box 5). For patients, the bene昀椀ts are the time saved for visiting a doctor (remote prescribing), convenience (one never loses the
prescription) and certainty (the content is readable and errorless). For doctors, after some practice and if the use of e-prescriptions
is economic, it is estimated that time savings can reach between 30 and 60 minutes per day. Furthermore, the whole of the
health system bene昀椀ts (including pharmacies, insurance companies, etc.) as a result of a reduction in errors, better control of
prescription patters among doctors, and fraud detection and prevention (Cooke et al., 2010; Parv et al., 2016).
75
Economic Appraisal Vademecum
where:
ΔP = cost and time savings of patients
ΔD = time saving of prescribing doctors
ΔPh = time saving of pharmacies’ personnel
ΔS = administrative cost savings of reimbursement entities/insurers
Table 14. Typical economic benefits, units of measurement and methods of monetary evaluation
People with a disability or ill health and Number of Direct (operating and
their informal carers are often not fully health services capital) costs of health
professionally active, which results in avoided system and long-term
productivity losses in the economy. Disabled care
Time of
people also often remain under either
temporary Indirect costs of ill
institutionalised or informal care.
inability to work health due to:
A reduction in disability implies an increase in
Reduced disability Time of - income/production
2 productivity and a reduction in cost for formal
and ill health permanent losses
and informal care over the years of the lasting
inability to work
disability - short-term and long-
term absenteeism (self
and next of kin) (HCM)
- quality of life (WTP)
76
Economic Appraisal Vademecum
77
Economic Appraisal Vademecum
Digital solutions may reduce external costs, EUR per tonne Economic cost of carbon
notably in relation to the energy consumption of CO2 (see Section 2.5 of
of data centres and networks. These can be Part I of the EAV)
EUR per vehicle-
estimated well enough using emission factors
Reduced external km Avoided vehicle
10 and the social cost of carbon. Other external
costs operating costs (see
impacts can also be considered in relation to,
Annex V)
for example, savings in transportation costs
(unless these are trivially small)
NB: HCM, human capital method.
78
Economic Appraisal Vademecum
IX.1. Introduction
The aim of this chapter is to outline the key aspects of EA that decision-makers and project promoters should/could
consider when designing projects with large ICT components. The European Commission has highlighted digitalisation
as one of its key goals to ensure Europe’s international competitiveness, to support regional cohesiveness, to improve living
conditions across Europe and for Europe to deliver better services to citizens and businesses. Digitalisation enables increases in
productivity, e昀케ciency and e昀昀ectiveness. The widespread use of ICT raises, however, many systemic challenges. These include, on
the one hand, concerns in relation to data protection, privacy rights and cybersecurity and, on the other, the possibility of making
ICT bene昀椀ts available to all by deploying digital infrastructures and developing the required digital skills.
A number of EU policy initiatives and funding sources could 昀椀nance investments in di昀昀erent digital sectors. Given
that ICT cuts across all sectors, it is not possible to address the development of the sector under one policy objective. Recognising
the potential of digitalisation, the European Commission presented in February 2020 three broad pillars of its strategy for
Europe’s digital future (European Commission, 2020). The strategy aims to provide the right legal and ethical environment for
the users and the market. Possible sources of public support for projects with large ICT components include the Horizon Europe
research programme, the Digital Europe (European Commission, 2018) programme, the Connecting Europe Facility, and the EU
regional policy. Regarding the EU regional policy, Smarter Europe is one of the two priorities (together with the Green Europe
policy objective) that are expected to receive the majority of EU regional policy funds in the next phase. It will encompass
measures related to, among other areas, e-service development.
This section focuses on the EA of the introduction of ICT into the provision of public services. Public services delivered
with the support of ICT do not di昀昀er in scope from services delivered in the traditional way. In this sense, objectives, expected
bene昀椀ts and evaluation methods are those typical of their relevant sectors, such as broadband, energy, transport or health, and are
not discussed here. However, when shifting to the digital provision of services, some cross-cutting, not sector-speci昀椀c,
issues have been observed and should be taken into account, including e昀케ciency gains for the service provider, improved
quality of the services and the interdependency with other infrastructures. This chapter contains examples of approaches for
project preparation and of the project bene昀椀ts of e-services applied in e-education and e-government projects. The principles
outlined below may also apply to further projects such as digital identi昀椀cation cards and di昀昀erent types of publicly run service
portals, etc.
For example, e-government projects often form part of wider public sector reform that aims to streamline public institution
processes through ICT. In this process, it is important to consider all of the relevant stakeholders, their requirements and their
existing ICT infrastructure, which may need to be updated or modi昀椀ed. The lack of interoperability between di昀昀erent actors’
systems would signi昀椀cantly reduce the bene昀椀ts achieved by the project.
Field experiments can be used to determine the e昀昀ects of ICT projects. Through pilot projects, e昀昀ectiveness studies can be
undertaken before a national roll-out or phased introduction. The advantage of a pilot project is that the measure is tested in the
‘real world’, all the time bearing in mind the extent to which the results of the pilot project can be generalised (CPB Netherlands
Bureau for Economic Policy Analysis, 2017).
Likewise, the integration of ICT into learning, teaching and school administration processes is a response to the need for schools
to adapt to the complex and changing contexts in which they operate, including the digital era and the increasing diversity among
pupils. These issues require not only the adaptation of school curricula, but also more diverse teaching and learning methods to
address the needs of all students.
Regarding early screening and the selection of technology, the following aspects need to be considered for e-services
projects: interoperability and compliance with standards, the availability of technology, and the overall cost of
investment and the operating phase. Regarding the 昀椀rst element, it is critical to consider interoperability and compliance with
relevant standards and other services put in place or planned at the national, European or international level. Diverting from such
standards, or not taking into account other services or platforms, would render the development of the solution costly and time-
consuming and would increase implementation risks. As a next step, it is suggested to consider if there are technologies readily
available. Even in cases in which standard solutions are followed, existing solutions may need to be modi昀椀ed to meet the speci昀椀c
requirements of a project, and the cost of such adaptation should be taken into account. Finally, if there are a number of possible
solutions, the overall cost of the project should be determined – the choice of technology may a昀昀ect the design, implementation
or operation phase, including possible costs of upgrades.
79
Economic Appraisal Vademecum
This chapter assumes generally that the socioeconomic impact of the project is veri昀椀ed by means of a CBA approach. Moreover,
each di昀昀erent type of e-service also entails qualitative bene昀椀ts, which are more typical of speci昀椀c areas, for instance e-pharmacy
or e-school. Applying an MCA methodology could also be considered for such projects to capture the impacts beyond quantitative
economic impacts, for instance quality of life or contribution to climate change.
The 昀椀rst general observation for projects that replace an existing service with the possibility of a digital or remote
service, such as e-government, e-health or e-school projects, is their e昀케ciency gains. They can be valued in an
economic analysis by assigning monetary values to cost savings and time savings.
- Regarding the cost savings, these can occur 昀椀rst for the owner of the infrastructure / provider of a service, for
example a governmental department or agency, hospital or school, but also for the service users. As a rule, all cost savings
that occur for the owner of the infrastructure / provider of a service are already considered in the 昀椀nancial analysis
(and consequently in the economic analysis). Cost savings enjoyed by users, who are – in the case of e-government
projects – other government departments or agencies, citizens or businesses, are not captured by the 昀椀nancial analysis.
They should be regarded as economic bene昀椀ts and included in the economic analysis. User bene昀椀ts through cost savings
can be quanti昀椀ed in the CBA by estimating direct travel cost savings (e.g. fuel) and the reduced cost of transmitting
information (e.g. phone, post or paperless interactions).
- Time savings can represent a signi昀椀cant bene昀椀t of e-service projects. For the EA of travel time savings, the
length of the avoided travel time and the economic value of time need to be estimated. For example, an e-government
project that enables the implementation of user interfaces that allow personal documents to be requested online will
eliminate the travel time from local residents to local government agencies. In addition to the travel time saved, the
implementation of an e-government project can lead to time savings due to faster service provision (e.g. because of
avoided queuing at public agencies or reduced processing time of requests). The length of the time saved should be
estimated based on documented assumptions.
Improvements to the services delivered, which translate into increased convenience for users, are the second most
common group of impacts of e-services projects. For example, in the case of e-education through integrating ICT within
schools, students can bene昀椀t from improved educational services (e.g. personalised learning curricula and innovative teaching
practices). In addition, the resulting increase in digital skills can in turn also lead to better employability in the future. The
bene昀椀ts can be estimated by adopting the WTP approach, according to which the economic value of the service rendered by a
(public) education project is usually larger than the fees applied to students, if any. In the case of e-government services, users
might consider that better service delivery, reduced error rates, increased reliability and easier communication are important
bene昀椀ts, and it could be possible to quantify this category of bene昀椀ts by means of traditional sample surveys or qualitative focus
groups (45).
The third group of bene昀椀ts of e-services projects lies in the common aim of these projects to increase the security
level of electronic services, improve reputation and raise user trust and con昀椀dence. The valuation of information
security solutions requires su昀케cient data about incidents and their consequences. While some studies have attempted to
measure the bene昀椀t of improved security, and while quanti昀椀cation of these bene昀椀ts may be possible in individual projects, as a
general recommendation, it is suggested that these bene昀椀ts be considered qualitatively.
Another observation common to e-services projects is the di昀케culty in quantifying the net environmental impact.
In the case of projects that a昀昀ect a large number of users, such as e-government or e-education projects, research on the
impacts of GHG emissions today is not mature enough to measure the net e昀昀ect of digital services on energy consumption and,
more generally, on the environment. It is therefore recommended, until relevant studies become available, that this bene昀椀t be
considered in qualitative terms rather than by valuing its impact in the CBA model (46).
It is equally important to note that ICT projects are interdependent with other infrastructure put in place, such as
broadband connectivity, computers and end user applications, as well as on users having the right skills to take up new and
innovative services. When the relevant infrastructure is not in place and additional substantial investment needs to be made by
a third party or by users for the given type of bene昀椀ts to emerge, the estimated project bene昀椀ts should be distributed pro rata.
The relevant net bene昀椀t ratio (calculated as the proportion of project costs in the total costs needed for the bene昀椀t to emerge)
should be applied to the bene昀椀ts quanti昀椀cation.
45
The project analyst should, however, make sure not to double count this category of bene昀椀ts with users’ cost and time savings, as these can be assumed to automatically translate into an increase in users’
satisfaction.
46
If the project entails a quanti昀椀able reduction in transportation costs (e.g. avoided car trips), the reduction in GHG emissions can be valued following the methodology illustrated in Annex V (‘Transport’).
80
Economic Appraisal Vademecum
Finally, the full impact of ICT projects is not straightforward to quantify in monetary terms. In the case of several
economic bene昀椀ts, it is very di昀케cult or maybe impossible to 昀椀nd a way to monetise their value. ICT projects are also an enabler
of a multitude of di昀昀erent services, for which ICT, infrastructure and hardware provide the backbone.
As mentioned, it is not possible to easily provide recommendations for all possible sector investments and related bene昀椀ts. This
section exempli昀椀es and outlines a possible summary approach to a CBA analysis in two di昀昀erent sectors: e-services in public
administration and in education. In general, the principles in these sectors, including the common bene昀椀ts and the sector-speci昀椀c
bene昀椀ts, can be used as a guide for other projects in the area.
For the purpose of this document, an e-government project is designed and implemented with the aim of generating wider
bene昀椀ts to society. Consequently, the 昀椀nancial revenues and cost savings that occur to the project owner do not capture the
full impact of the project. Besides a number of quanti昀椀able bene昀椀ts to the users, such as cost or time savings, there are many
qualitative bene昀椀ts that can signi昀椀cantly a昀昀ect the lives of citizens, but which no 昀椀rm methodology can quantify. An example of
a bene昀椀t evaluation is given in Table 15.
Monetary Qualitative
Economic bene昀椀t Comment on treatment
evaluation assessment
Cost saving approach, including direct travel cost saving
User bene昀椀ts in terms of
√ and reduced cost of transmitting information (e.g. phone,
cost savings
post or paperless interactions)
User bene昀椀ts in terms of Time savings owing to shorter travel time, reduced
√
time savings processing time, task elimination, etc.
User bene昀椀ts in terms of Better and increased revenue collection (e.g. online tax
√ √
increased revenues 昀椀ling and processing systems to enhance transparency)
- better and timely information to facilitate policymaking (allows more, greater and new data to be collected, and
greater information-sharing capacity);
- improved service delivery and enhanced customer service (more understandable services and personalisation);
- improved service consistency and quality (interoperability and improved multi-agency cooperation);
It should be noted that, in many circumstances, e-service projects have a wide impact on the national economy and on society
81
Economic Appraisal Vademecum
as a whole. For instance, investors’ location decisions can be in昀氀uenced by an improved level of public services in a particular
country. These wider bene昀椀ts may include:
- impacts on location decisions (the increased e昀케ciency and better quality of the services enhance the attractiveness
of the country as a business location and improve competitiveness and productivity);
The role of ICT in learning has been discussed by several studies, and its positive, as well as negative, e昀昀ects are reported in the
literature. Nevertheless, partially owing to the complexity of the various educational systems, and the wide di昀昀erences in digital
maturity between di昀昀erent countries, no widely accepted and tested methodologies to quantify and value bene昀椀ts in monetary
terms exist. It is therefore di昀케cult to propose a uniform methodology, as only guidance can be given, depending on the scope of
each ICT learning project.
Table 16 provides some initial approaches for the possible quanti昀椀cation of bene昀椀ts. It is suggested that a CBA be carried out only
on direct bene昀椀ts accrued by the ‘users’ of the project, including students, teachers and school administrative sta昀昀.
It needs to be underlined, however, that there is limited experience of the use of CBA in the appraisal of this type of project, given
the di昀케culties in the estimation of monetary values of bene昀椀ts in education investments. Consequently, other techniques, such
as MCA, may also be suitable to appraise projects that aim to introduce ICT tools into learning.
Savings in management,
Cost savings approach – if not already included in the 昀椀nancial analysis
administration and work planning
WTP – the economic value of the improved education service rendered by a public
Improved education services to
project can be proxied by the tari昀昀/charges applied to students of private schools
students
o昀昀ering similar services
WTP – the wage di昀昀erential between private and public sectors in the education
system can be used as proxy, or the avoided cost of attending training courses
Professional development
supplied in the private market that allow the development of the same level of
digital competence can also be used
82
Economic Appraisal Vademecum
X.1. Introduction
Territorial development with a particular view to unlocking local economic potential, encouraging smart
development, promoting climate change action and improving living conditions is a key policy focus of the EU.
The European Commission has published guidance on the process of designing sustainable urban strategies for urban projects
and programmes (JRC, 2020). It also supports innovation in Member States through programmes aimed at digitalisation and
smart specialisation (47) and has launched the new European Green Deal (European Commission, 2019). These policies require
multisectoral investment programmes that are anchored in integrated plans combined with spatial planning.
In the 2021–2027 programming period, in addition to the strategic emphasis on the climate change agenda (e.g. the Paris
Agreement), the focus will be on economic recovery after COVID-19. It is expected that the emphasis on regional smart
development (including smart city investments, the circular economy and ‘just transition’ projects) will continue.
The investment programmes of the regions or cities (public promoters) must re昀氀ect the development strategies embedded in
their spatial development plans and the policies at local, regional, national and international levels. The authorities, through such
investment programmes, attempt to stimulate local growth and development conditions and improve the quality of life (welfare)
of their inhabitants, primarily through public works and the provision of public services. The funding sources for such territorial
programmes may include European funds (48). The tool that is often used in this context is integrated territorial investment
(URBACT, 2019). Integrated territorial investments allow EU Member States to bundle funding from several priority axes of one or
more operational programmes (EU programmes) to ensure the implementation of an integrated strategy for a speci昀椀c territory.
In this chapter, we will focus on the MCA methodology, in particular policy-led multi-criteria analysis (PLMCA),
which is speci昀椀cally suited to territorial and urban programmes with multisector investments.
The PLMCA methodology allows the expected bene昀椀ts to be assessed against an explicit set of policies and objectives – in other
words, the framework in place – that the decision-making body has identi昀椀ed. It also helps identify synergies between projects
(e.g. transport, broadband, water and energy e昀케ciency) and where social funds can be employed. The MCA tool can be used
to consider urban–rural linkages and ‘rural’ municipalities in integrated territorial strategies and delivery models. It assists in
bundling the projects of di昀昀erent local authorities and municipalities to facilitate their access to di昀昀erent sources of 昀椀nancing.
- the principles of sustainable urban development to be embedded locally and a rigorous integrated planning
regime;
- consensus on the means to identify, record/register and describe key risks and opportunities.
The example used in this chapter is the application of the PLMCA tool to a sustainable urban development programme.
The MCA methodology can be applied in the following stages of the development of a territorial investment
programme (Figure 3), including sustainable urban development.
47
See, for instance, the Smart Specialisation Platform, which supports Member States (https://s3platform.jrc.ec.europa.eu/)
48
Sustainable urban development programmes and projects can be 昀椀nanced by a number of European funds and/or a combination of other funds.
83
Economic Appraisal Vademecum
MCA
Local/regional/ Local/regional/ MCA
CBA, CEA
national national MCA MCA
or MCA for
authorities decide authorities decide
option analysis
how to prepare how to prepare
- The de昀椀nition of an urban strategy or a territorial investment programme requires an integrated, multisectoral
planning approach, including the participation of the representatives / key stakeholders of all of the expected areas of
investments (subsectors). A sustainable urban strategy is founded on relevant applicable policies and on local needs and
can apply to di昀昀erent levels of urban policy. The JRC (2020) provides more information about the European Commission
guidelines on how to de昀椀ne a sustainable urban strategy. If PLMCA is expected to be used at the selection/prioritisation
stage of projects, it is helpful to set up the criteria and relevant framework at the strategy-making phase to obtain a
more coherent exercise (e.g. start building the PLMCA matrix as presented in Section X.3 at this early stage of strategy
making).
- The setting up and management of an investment plan or programme require the participation of all the
stakeholders, to ensure that the programme or plan includes all of the policy objectives of the strategy that it seeks to
implement. PLMCA can also be recommended for the de昀椀nition of investment plans or programmes, because it clearly
portrays the path and indicators of the actions and their potential bene昀椀ts, helping to trace them back to the policy
objectives. It also provides an assessment of the adequacy of the policy objectives themselves (i.e. it is a way to check
the consistency between the policy and bene昀椀ts and vice versa). As above, if work on the PLMCA has already started or if
it starts at this stage, the application of the PLMCA method in the next stage (i.e. the selection/prioritisation of projects)
becomes a more coherent exercise.
- MCA can be a useful tool for the provision of a sound basis for the prioritisation of projects by reference
to a speci昀椀c set of strategic documents. MCA facilitates the comparison of di昀昀erent projects or sets of projects,
considering all of the criteria/indicators (even those that are not monetised) and relates them back to the policies that
the strategic and planning documents pursue in a direct visual way. The 昀椀nal scores can be used to establish a list of
priorities (e.g. by starting with the projects that have received the highest scores).
- The appraisal or analysis of individual projects traditionally uses CBA or CEA. MCA may be useful in the context
of an EA to compare the strategic options for a single project (see Sections 1.3 and 3.2 of Part I of the EAV).
- Ongoing monitoring/evaluation and continuous adjustment of the programme is necessary. The MCA (like
all EA tools) can be rerun at di昀昀erent stages of the project cycle to check that the 昀椀nal set of projects constitutes a
programme.
The participation of the most relevant stakeholders from the beginning of the appraisal process improves the quality of the
whole analysis. This multi-stakeholder team participates in the whole process as the analysis moves on. In this way, the city/
territory develops a holistic view of investments, reducing the risk of silos and improving governance. It is important to note
that the governance structure of cities is di昀昀erent in di昀昀erent constituencies and in di昀昀erent countries, which would need to be
re昀氀ected in the stakeholder set-up. What is needed is a balanced top-down / bottom-up approach to drive integrated sustainable
urban development, in other words an approach that includes the policy-driven considerations of the administrations and the
needs-driven considerations of representatives of the concerned population according to the sector (mobility, education, health,
energy e昀케ciency, services, digitalisation, etc.).
X.3. Example of an urban regeneration programme supported by policy-led multi-criteria analysis
The example presented in this section illustrates the application of MCA to the appraisal of an urban regeneration
programme. The method described is replicable in other stages of the process of urban/territorial development, as
explained above. The key request by the local authorities pertained to the facilitation of the process of prioritising and selecting
projects in order to develop the strategy’s investment programme and optimise its delivery and subsequent impact. To this end,
JASPERS suggested the deployment of a speci昀椀c tool, a PLMCA methodology, as an Excel-based tool that assists decision-
makers with the selection of packages of measures and the timing of the delivery of such measures. In this particular case,
the regeneration packages – housing, skills, culture, transport and business – were included as columns referred to as ‘priority
84
Economic Appraisal Vademecum
In the example, the aim was to assess a regeneration programme developed for a run-down district in a city. The programme
had identi昀椀ed 昀椀ve areas of action (‘regeneration packages’) mentioned above: housing, skills, culture, transport and business.
Under each area, a number of potential investments had been listed (e.g. for culture, proposals included several restorations of
buildings with historical and cultural value; for transport, proposals included upgrades of roads and the introduction of electric
bicycles).
The PLMCA framework starts with the step of structuring the problem by de昀椀ning the context of the decision, in particular the
policy and institutional guidance that applies. Columns 1–5 in Table 17 illustrate this process.
Social Choice and Improve provision and access To invest in health and -PA Thematic Objective
Provision of to facilities, amenities & social infrastructure 9: Promoting social
accessible facilities services including hospitals, which contributes to inclusion, combating
schools, community centres, national, regional and poverty and any
leisure facilities, housing, local development, discrimination
transport infrastructure, reducing inequalities -OP1 Axis 6 Investment
retail, water, energy and in terms of health Priority 9b - support for
e-governance status, promoting physical, economic and
social inclusion through social regeneration of
improved access to deprived communities
social, cultural and
recreational services
and the transition
from institutional to
community-based
services (PA Thematic
Objective 9 Expected
Results
85
Economic Appraisal Vademecum
Social cohesion and Promote equity & provide Promoting social -PA funding priorities
inclusion opportunities that are inclusion and combating
accessible to all groups of discrimination (PA
society, including women, Thematic Objective 9
ethnic minorities, and people
with disabilities
The dimensions (column 1), should be drawn from global best practice on sustainable urban and regional development and core
national policy documents. The following seven dimensions constitute a standard set and they are the ones used in the example:
institutional, territorial, social, environmental, economic, 昀椀nancial and technical.
The subdimensions (column 2) are also identi昀椀ed from global best practice and national documents. In the example provided, the
subdimensions of the social dimension are choice and the provision of accessible facilities, employment generation, a昀昀ordability,
and social cohesion and inclusion.
The dimensions and subdimensions establish the area in which the programme’s impact is going to be assessed. For example,
how does housing (one of the priority actions of the regeneration programme) a昀昀ect the social subdimensions (one of the areas
in which there will be an impact)?
The following columns (3 and 4) de昀椀ne the objectives and subobjectives for each subdimension obtained from local, national and
international policy, including the partnership agreement, the operational programmes and other recommendations (e.g. JASPERS
Guidance Notes).
Column 5, namely the justi昀椀cation for inclusion of the objectives/subobjectives, is a record of the sources of the objectives and
subobjectives (e.g. partnership agreement thematic objective 9 – ‘promoting social inclusion and combating poverty and any
discrimination’).
The next phase is to select appraisal criteria/indicators to use for each policy area and objective and decide on their relative
importance through the use of weights and/or ranking. Column 6 depicts the 昀椀rst part of this phase (i.e. deciding which criteria or
indicators to use for the 昀椀rst subdimension, that is, the choice and provision of accessible facilities; Box 6).
86
Economic Appraisal Vademecum
(6)
Criteria
Qualitative
· Extent of provision and/or upgrading of social infrastructure/public facilities/cultural facilities to match demographic
needs and meet or exceed national standards including extent to which the proposal includes the building of
thealth and wellness infrastructure to support population
· Extent to which the proposal improves access to a昀昀ordable, sustainable and high quality services, including health
care and social services of general interest (PA Thematic Objective 9 Expected Results)
· Provision of support for physical, economic and social regeneration of deprived communities in urban and rural
areas (PA Thematic Objective 9 Expected Results).
· Improvement to social / health service quality through measures aimed at addressing the speci昀椀c needs of the
social and health sectors (PA Thematic Objective 9 Expected Results).
· Extent of Investment in health and social infrastructure which contributes to national, regional and local
development, reducing inequalities in terms of health status, promoting social inclusion though improved access
to social, cultural and recreational services and the transition from institutional to community based services (OP1
Investment priority 9a).
· Extent of promotion of sustainable transport practice (PA Thematic Objective 7 – expected results)
Quantitative
· Population living in areas with integrated urban development strategies (OP 9b)
· Persons bene昀椀tting from new/upgraded infrastructure (including equipment/service as). (Investment Priority 9a
· Population covered by improved social services (Investment Priority 9a)
The model use phase involves determining the performance of the project/programme relative to each criterion/indicator,
usually using a numerical scoring system. Columns 7–17 illustrate the results of this process (Tables 18 and 19). Columns 7–11
are exclusive to this example, as they present the 昀椀ve priority action areas in the regeneration programme already mentioned. A
colour code has been used in Tables 18 and 20 to show the scores for each area of action. Column 12 summarises the extent to
which the areas of action of the regeneration programme meet the criteria (column 6).
The next columns, namely columns 13–17, represent the steps in the calculation of and the 昀椀nal weighted score (Table 19). As
the weighted scores align with the colour coding of the priorities in this example, the majority of green boxes correspond to a
maximum weighted score of 10. In this example, the weights are always 2, because all of the subdimensions and objectives were
considered to be equally important. In such cases, the weight column can be removed, as applying the same weight throughout
does not change the relative scoring.
The risks, mitigations and opportunities (i.e. columns 13 and 14) apply to all of the subdimensions in each dimension. They inform
the 昀椀nal decision on the scores.
87
Economic Appraisal Vademecum
Table 20 uses the same scoring and colour coding system for the subdimension ‘employment generation’ as that used in
Table 18 for the social dimension. In Table 20, the score is very low, as only one of the programme’s priority actions addresses
employment generation in the example.
88
Economic Appraisal Vademecum
The 昀椀nal scores for each dimension and the whole programme under analysis are reached by adding up the individual weighted
scores of each subdimension and comparing them with the maximum possible score for the whole dimension; the outcome is
usually presented in percentage terms. In the example, the whole programme had a score of 71.4 % and none of the dimensions
had a score below 60 %. In this case, it was decided that the scores obtained render the programme positive for the objectives
and policy context under which it was proposed.
The weighted scores for each dimension provided guidance for the prioritisation of the priority actions and their corresponding
investment proposals. In addition, by including the priority actions and colour coding them, it was clear to see how each
subdimension performed against the objectives and therefore which aspects to emphasise. For example, in the subdimension
‘culture and heritage’ (within the environmental dimension), the objective ‘to seek to conserve, protect, promote and develop
the natural and cultural heritage’ was not achieved by the transport or skills priority actions (colour coded red). This objective
was, however, well achieved by the culture and business priority actions (colour coded green), while the housing priority action
moderately achieved the objective (colour coded orange). Therefore, the proposals of the red-coded actions might need a greater
focus on the preservation and promotion of the natural and cultural environments. Alternatively, the decision-makers might
choose to focus on the dimensions and corresponding objectives that have the highest number of ‘green boxes’ (high scores for
the priority actions).
89
Economic Appraisal Vademecum
Challenges Mitigation
Urban projects (especially housing) Policy leadership of the appraisal is essential (to provide legitimised guidance).
require clear criteria/indicators. There must be national, regional and/or local ‘urban policies’ with clear
In urban programmes, criteria/ guidance on objectives and appraisal eligibility indicators.
indicators need to be multisectoral.
It is not always a straightforward Key to urban development is place-based, integrated planning to carry out
matter or practical to apply the policy. The criteria/indicators need to be clearly derived from a sensible
indicators that have been generated combination of existing sectoral and spatial plans. These then need to inform
for other sectors the action measures or the investments
Assistance and capacity-building actions for MAs and bene昀椀ciaries to learn how
to use any type of MCA tool is available (including from JASPERS).
Managing Authorities (MAs)/
bene昀椀ciaries may be unfamiliar with The 昀椀rst time a PLMCA is used, expert support may be needed. After a
how to perform a proper MCA municipality or other decision-making body has bene昀椀ted from expert advice
in the use of the tool once, the experience gained should be su昀케cient to use it
again without external support
90
Economic Appraisal Vademecum
BIBLIOGRAPHY
EIB (2013), The economic appraisal of investment projects at the EIB (https://www.eib.org/attachments/thematic/economic_appraisal_of_
investment_projects_en.pdf).
EIB (2017), Economic analysis of research infrastructure projects in the programming period 2014–2020, JASPERS sta昀昀 working paper.
European Commission (2014), Guide to Cost-Bene昀椀t Analysis of Investment Projects – Economic appraisal tool for cohesion policy 2014–2020,
Publications O昀케ce of the European Union, Luxembourg (https://ec.europa.eu/regional_policy/sources/docgener/studies/pdf/cba_guide.pdf).
Florio, M., Forte, S., Pancotti, C., Sirtori, E. and Vignetti, S. (2016), Exploring cost–bene昀椀t analysis of research, development and innovation
infrastructures – An evaluation framework, working paper No 01/2016.
Florio, M. (2019), Investing in Science: Social cost-bene昀椀t analysis of research infrastructures, MIT Press.
Gi昀昀oni, F. and Vignetti, S. (2019), Assessing the Socioeconomic Impact of Research Infrastructures: A systematic review of existing approaches and
the role of cost-bene昀椀t analysis, L’industria, Società editrice il Mulino, pp. 75–102 (http://www.csilmilano.com/docs/WP2016_01.pdf).
JASPERS (2011), Best practice in the preparation of projects in the culture sector (http://www.jaspersnetwork.org/plugins/servlet/
documentRepository/displayDocumentDetails?docu mentId=203).
JASPERS (2017), Economic analysis of research infrastructure projects in the programming period 2014–2020, JASPERS sta昀昀 working paper
(http://www.jaspersnetwork.org/plugins/servlet/documentRepository/displayDocumentDetails?documentId=342).
Reid, A. (2020), ‘Designing a socio-economic impact framework for research infrastructures: preliminary lessons from the RI-PATHS project’, in
Beck, H. and Charitos, P. (eds), Economics of Big Science. Science Policy Reports.
Rousseau, S., Catalano, G. and Daraio, C. (2021), ‘Can we estimate a monetary value of scienti昀椀c publications?’, Research Policy, Vol. 50, No 1,
104116.
EIB (2020), ‘EU member states approve EIB Group Climate Bank Roadmap 2021–2025’ (https://www.eib.org/en/press/all/2020-307-eu-
member-states-approve-eib-group-climate-bank-roadmap-2021-2025).
ENTSOG (2019), 2nd ENTSOG methodology for cost–bene昀椀t analysis of gas infrastructure projects 2018 (https://www.entsog.eu/sites/default/
昀椀les/2019-03/1.%20ADAPTED_2nd%20CBA%20Methodology_Main%20document_EC%20APPROVED.pdf).
ENTSO-E (2020), 3rd ENTSO-E guideline for cost bene昀椀t analysis of grid development projects, draft version, 28 January 2020 (https://
eepublicdownloads.blob.core.windows.net/public-cdn-container/tyndp-documents/2020-01-28_3rd_CBA_Guidleine_Draft.pdf). Final draft
pending European Commission approval.
European Commission (2018), Cost Development of Low Carbon Energy Technologies, JRC technical reports, Publications O昀케ce of the European
Union, Luxembourg (https://publications.jrc.ec.europa.eu/repository/bitstream/JRC109894/cost_development_of_low_carbon_energy_
technologies_v2.2_昀椀nal_online.pdf).
European Commission (2019), The Costs of Not Implementing EU Environmental Law, Publications O昀케ce of the European Union,
Luxembourg (https://op.europa.eu/en/publication-detail/-/publication/2c05c9e6-59aa-11e9-a8ed-01aa75ed71a1/language-en/format-PDF/
source-115844964).
Hirth, L. (2013), ‘The market value of variable renewables’, Energy Economics, Vol. 38, pp. 218–236.
International Energy Agency (2014), Capturing the Multiple Bene昀椀ts of Energy Ef昀椀ciency.
Lamont, A. (2008), ‘Assessing the long-term system value of intermittent electric generation technologies’, Energy Economics, Vol. 30,
pp. 1208–1231.
OECD (Organisation for Economic Co-operation and Development) and Nuclear Energy Agency (2018), The Full Cost of Electricity Provision
(https://www.oecd-nea.org/ndd/pubs/2018/7298-full-costs-2018.pdf).
Ste昀昀en, B. (2020), ‘Estimating the cost of capital for renewable energy projects’, Energy Economics, Vol 88, 104783.
World Health Organization (2018), Circular Economy and Health: Opportunities and risks (https://www.euro.who.int/en/publications/abstracts/
circular-economy-and-health-opportunities-and-risks-2018).
91
Economic Appraisal Vademecum
EIB (2020), How Can Favourable Financing Improve Energy Ef昀椀ciency Investments? Evidence from new experimental data, economics working
papers 2020/01.
European Commission (2014), Guide to Cost-Bene昀椀t Analysis of Investment Projects – Economic appraisal tool for Cohesion Policy 2014–2020,
Publications O昀케ce of the European Union, Luxembourg (https://ec.europa.eu/regional_policy/sources/docgener/studies/pdf/cba_guide.pdf).
European Court of Auditors (2020), Energy Ef昀椀ciency in Buildings: Greater focus on cost-effectiveness still needed, special report 11/2020
(https://eca.europa.eu/en/Pages/DocItem.aspx?did=53483).
International Energy Agency (2014), Capturing the Multiple Bene昀椀ts of Energy Ef昀椀ciency.
European Commission (2020), Categorisation System for the Circular Economy, Publications O昀케ce of the European Union, Luxembourg (https://
op.europa.eu/en/publication-detail/-/publication/ca9846a8-6289-11ea-b735-01aa75ed71a1/language-en/format-PDF/source-120460723).
Annex V – transport
CEDEX (2010), Economic Evaluation of Transport Projects – Guidelines.
De Jong, G., Vignetti, S. and Pancotti, C. (2018), ‘Ex post evaluation of major transport infrastructure projects’, at European Transport Conference
2018 (https://signi昀椀cance.nl/wp-content/uploads/2019/04/2018-GDJ-Ex-post-evaluation-of-major-transport-infrastructure-projects.pdf).
Directorate-General for Mobility and Transport (2019), Handbook on the External Costs of Transport, Publications O昀케ce of the European Union,
Luxembourg.
EIB and JASPERS (2017), Guidance on appraising the economic impacts of rail freight measures (http://www.jaspersnetwork.org).
European Environment Agency (2019), EMEP/EEA Air Pollutant Emission Inventory Guidebook 2019: Technical guidance to prepare
national emission inventories, Publications O昀케ce of the European Union, Luxembourg (https://www.eea.europa.eu/publications/emep-eea-
guidebook-2019).
Flyvbjerg, B., Holm, M. K. S. and Buhl, S. L. (2004), ‘What causes cost overrun in transport infrastructure projects?’, Transport Reviews, Vol. 24,
No 1, pp. 3–18.
Flyvbjerg, B., Holm, M. K. S. and Buhl, S. L. (2005), ‘How (in)accurate are demand forecasts in public works projects? The case of transportation’,
Journal of the American Planning Association, Vol 71, No 2, pp. 131–146.
IER Germany (2006), Developing harmonised European approaches to transport costing and project assessment – Deliverable 5 (Proposal for
Harmonised Guidelines) (https://trimis.ec.europa.eu/sites/default/昀椀les/project/documents/20130122_113653_88902_HEATCO_D5_summary.
pdf).
JASPERS (2014), The use of transport models in transport planning and project appraisal (http://www.jaspersnetwork.org/plugins/servlet/
documentRepository/displayDocumentDetails?documentId=222).
Laird, J. J. and Venables, A. J. (2017), ‘Transport investment and economic performance: a framework for project appraisal’, Transport Policy,
Vol. 56, pp. 1–11.
Mackie, P. and Preston, J. (1998), ‘Twenty-one sources of error and bias in transport project appraisal’, Transport Policy, Vol. 5, No 1, pp. 1–7.
Mackie, P., and Worsley, T. (2013), International Comparisons of Transport Appraisal Practice, Institute for Transport Studies for the UK
Department for Transport.
Transport Infrastructure Ireland (2020), Project Appraisal Guidelines for National Roads Unit 6.11 – National parameters values sheet, PE-
PAG-02030 (https://www.tiipublications.ie/library/PE-PAG-02030-03.pdf).
Turro Calvet, M. (2004), RAILPAG: Railway Project Appraisal Guidelines, European Commission.
UK Department for Transport (2005), Transport, Wider Economic Bene昀椀ts and Impacts on GDP, DfT, London.
92
Economic Appraisal Vademecum
UK Department for Transport (2020), WEBTAG Unit M3.1 Highway Assignment Modelling, DfT, London (https://assets.publishing.service.gov.uk/
government/uploads/system/uploads/attachment_data/昀椀le/427124/webtag-tag-unit-m3-1-highway-assignment-modelling.pdf).
Venables, A. (2016), ‘Incorporating wider economic impacts within cost–bene昀椀t appraisal’, discussion paper 2016-05, International Transport
Forum.
Venables, A., Laird, J. J. and Overman, H. G. (2014), Transport Investment and Economic Performance: Implications for project appraisal.
Wardman, M. and Hine, J. (2000), Costs of Interchange: A review of the literature, working paper, Institute of Transport Studies, University of
Leeds, Leeds, UK.
Wardman, M., et al. (2012), European Wide Meta-analysis of Values of Travel Time, University of Leeds, Leeds, UK.
Annex VI – broadband
The Commission’s strategy on Connectivity for a European Gigabit Society: https://ec.europa.eu/digital-single-market/en/broadband-europe
European Commission (2013), EU guidelines for the application of State aid rules in relation to the rapid deployment of broadband networks,
2013/C 25/01 (https://eur-lex.europa.eu/legal-content/GA/TXT/?uri=CELEX:52013XC0126(01)).
European Commission (2013), The Broadband State Aid Rules Explained – An eguide for decision makers, Publications O昀케ce of the European
Union, Luxembourg (https://ec.europa.eu/regional_policy/sources/conferences/state-aid/broadband_rulesexplained.pdf).
ECOTEC (2001), The bene昀椀ts of compliance with the environmental acquis for the candidate countries, ECOTEC, Birmingham, UK (https://ec.europa.
eu/environment/archives/enlarg/pdf/bene昀椀t_long.pdf).
European Commission (2018), ‘Blue2 study: assistance for better policy-making on freshwater and marine environment’ (https://ec.europa.eu/
environment/blue2_en.htm).
Markandya, A. (2016), Cost Bene昀椀t Analysis and the Environment: How to best cover impacts on biodiversity and ecosystem services, OECD
environment working papers No. 101, OECD Publishing, Paris.
OECD (Organisation for Economic Co-operation and Development) (2018), Cost–Bene昀椀t Analysis and the Environment: Further developments
and policy use, OECD Publishing, Paris.
Drummond, M. et al. (2005), Methods for the economic evaluation of health care programmes, Oxford University Press, Oxford, UK.
Hietbrink, F., Houwer, R. M., van Wessem, K. J. P., Simmermacher, R. K. J., Govaert, G. A. M., de Jong, M. B., deBruin, I. G. J., de Graaf, J. and Leenen,
L. P. H. (2020), ‘The evolution of trauma care in the Netherlands over 20 years’, European Journal of Trauma and Emergency Surgery, Vol. 46,
No 2, pp. 329–335.
Mohan, H. M., Mullan, D., McDermott, F., Whelan, R. J., O’Donnell, C. and Winter, D. C. (2015), ‘Saving lives, limbs and livelihoods: Considerations
in restructuring a national trauma service’, Irish Journal of Medical Science, Vol. 184, No 3, pp. 659–666.
Morley, C., Unwin, M., Peterson, G. M., Stankovich, J. and Kinsman, L. (2018), ‘Emergency department crowding: a systematic review of causes,
consequences and solutions’, PLoS One, Vol. 13, No 8, e0203316.
NSW Health (2018), Guide to cost–bene昀椀t analysis of health capital projects, NSW Health (https://www1.health.nsw.gov.au/pds/
ActivePDSDocuments/GL2018_021.pdf).
OECD (Organisation for Economic Co-operation and Development) (2012), Mortality risk valuation in environment, health and transport policies,
OECD, Paris (https://www.oecd.org/environment/tools-evaluation/valuingmortalityimpacts.htm).
Parv, L., Kruus, P., Mõtte, K. and Ross, P. (2016), ‘An evaluation of e-prescribing at a national level’, Informatics for Health and Social Care,
Vol. 41, pp. 78–95.
Pepper, J. (2007), What Really Matters: Service, leadership, people and values, Yale University Press, pp. 147–148.
93
Economic Appraisal Vademecum
European Commission (2018), ‘EU budget: Commission proposes €9.2 billion investment in 昀椀rst ever digital programme’, press release (https://
ec.europa.eu/commission/presscorner/detail/en/IP_18_4043).
European Commission (2013), Urban Development in the EU: 50 projects supported by the European Regional Development Fund 2007–2013,
AEIDL, Brussels (https://ec.europa.eu/regional_policy/en/information/publications/studies/2013/urban-development-in-the-eu-50-projects-
supported-by-the-european-regional-development-fund-during-the-2007-13-period).
European Commission (2017), A social multi-criteria framework for ex-ante impact assessment operational issues, JRC technical reports,
Publications O昀케ce of the European Union, Luxembourg (https://publications.jrc.ec.europa.eu/repository/bitstream/JRC107899/jrc107899_
smce-ia-operational.pdf).
JRC (2020), Handbook of Sustainable Urban Development Strategies, Publications O昀케ce of the European Union, Luxembourg (https://ec.europa.
eu/jrc/en/publication/eur-scienti昀椀c-and-technical-research-reports/handbook-sustainable-urban-development-strategies).
OECD (Organisation for Economic Co-operation and Development) (2019), ‘OECD principles on urban policy’ (https://www.oecd.org/cfe/urban-
principles.htm).
UN Habitat (2009), Global Report on Human Settlements 2009 – Planning sustainable cities, Earthscan, London (https://unhabitat.org/sites/
default/昀椀les/download-manager-昀椀les/Global%20Report%20on%20Human%20Settlements%202009%20Planning%20Sustainable%20Cities.
pdf).
94
Europe Direct is a service to help you 昀椀nd answers
to your questions about the European Union.
00 800 6 7 8 9 10 11
(*) The information given is free, as are most calls (though some operators, phone boxes
or hotels may charge you).
ISBN:978-92-76-40462-0
doi:10.2776/182302
Neither the Commission nor any person acting on the Commission’s behalf may be held responsible
for the use which may be made of the information contained therein.
The guidance may be updated in light of the experience with the implementation of the concerned
EU legislation. The present guidance may be complemented with international, national or sectoral
considerations or guidance.
Reproduction or translation is permitted, provided that the source is dully acknowledged and no
modi昀椀cations to the text are made.
Quotation is authorised as long as the source is acknowledged along with the fact that the results
are provisional.
Getting in touch with the EU
In person
All over the European Union there are hundreds of Europe Direct information centres. You can 昀椀nd
the address of the centre nearest you at: https://europa.eu/european-union/contact_en
Europe Direct is a service that answers your questions about the European Union. You can contact
this service:
– by freephone: 00 800 6 7 8 9 10 11 (certain operators may charge for these calls),
– at the following standard number: +32 22999696 or
– by email via: https://europa.eu/european-union/contact_en
Online
Information about the European Union in all the o昀케cial languages of the EU is available on the
Europa website at: https://europa.eu/european-union/index_en
EU publications
You can download or order free and priced EU publications at: https://publications.europa.eu/en/
publications. Multiple copies of free publications may be obtained by contacting Europe Direct or
your local information centre (see https://europa.eu/european-union/contact_en).
For access to legal information from the EU, including all EU law since 1952 in all the o昀케cial
language versions, go to EUR-Lex at: http://eur-lex.europa.eu
The EU Open Data Portal (http://data.europa.eu/euodp/en) provides access to datasets from the EU.
Data can be downloaded and reused for free, for both commercial and non-commercial purposes.
KN-03-21-321-EN-N
ISBN:978-92-76-40462-0
doi:10.2776/182302