KPI Monitoring Manual
KPI Monitoring Manual
KPI Monitoring Manual
Improvement Manual
This publication was made possible by grant number 1U2GPS00284 from
the US Center for Disease Control
Table of Contents
Page
Abbreviations 5
Glossary 7
Section 1 Introduction 11
1.2 Background 11
6.1 Purpose 89
6.4 Participants 89
7.1 Purpose 91
7.4 Participants 91
Appendices:
Appendix 4 109
Appendix 8 Survey Protocol: Emergency Patients Triaged Within 5 min of Arrival 193
Appendix 13
List of Figures
HR Human Resources
TB Tuberculosis
Abdominal surgical delivery Removal of the foetus, placenta etc through a surgical
incision in the belly
Day surgery unit Department in the hospital where patients are operated on
then go home the same day
Emergency attendance Occasion when a patient goes to the emergency room for
treatment
Gestational age Age of the baby in the womb during pregnancy, i.e. how far
on in pregnancy
Haemorrhage Bleeding
Intensive care unit Department in the hospital for acutely ill patients with higher
levels of medical and nursing care
Key performance indicator An agreed measure that all facilities collect in the same way
Medical record Papers that document the care and treatment a patient
received
Mortality Death
Part of the hospital where patients pay for all services they
Psychiatry receive
Wound dehiscence Area of damaged skin for example from an injury or surgery
This manual has been developed to help hospital senior management teams (SMTs),
Governing Boards (GBs) and higher health offices to monitor hospital performance, focusing
on a core set of Key Performance Indicators (KPIs) to ensure the effectiveness, efficiency and
quality of services provided. The manual sets out a framework for hospital performance
monitoring using the KPIs, and outlines how the framework has been developed and why
performance monitoring using a core set of KPIs is important at all levels. The manual
provides detailed guidance to ensure that hospitals collect and analyze accurate KPI data and
provides guidance on performance improvement methods that will assist hospital
management and staff to act upon the findings of the KPIs. The manual also provides
guidance for the Federal Ministry of Health (FMOH) and Regional Health Bureaus (RHBs) to
receive, review and analyze KPI information, and to conduct site visits and facilitate review
meetings that aim to strengthen hospital performance.
Please note: The indicators and guidance outlined in this document do not remove the
responsibility of hospitals for implementing the routine reporting, review and monitoring
processes of the Health Management Information System (HMIS). The guidance in this
document is complementary to HMIS, and HMIS processes should still be established in all
hospitals.
1.2 Background
The FMOH and RHBs are leading a sector wide reform to strengthen and improve health
services in Ethiopia. Hospitals are central to these reform efforts and a number of recent
initiatives have specifically sought to improve hospital performance. Such initiatives include
Health Care Finance Reform (HCFR), Business Process Re-engineering (BPR), Health
Management Information System (HMIS), and the Ethiopian Hospital Reform
Implementation Guidelines (EHRIG), among others.
Hospital Governing Boards have been established and Chief Executive Officers (CEOs) have
been appointed to the majority of hospitals, thereby increasing the autonomy of hospitals.
Through BPR „Curative and Rehabilitative Core Process Teams‟ have been established
within RHBs. The main role of the CRCPTs is to oversee health service delivery within
hospitals and health centers. Similarly the Medical Services Directorate (MSD) has been
established within the FMOH to oversee the performance of Federal Hospitals and to support
RHBs in their efforts to improve hospital and health centre performance in each Region.
To achieve their functions, these stakeholders (Governing Boards, CRCPTs and MSD)
require accurate and timely information about hospital performance to ensure that
expectations are being met and to take timely action to address any problems identified.
Nationwide, hospital performance monitoring has been conducted by RHBs using different
methodologies. Some regions have established hospital performance indicators, in some
regions supportive supervision has been conducted and some regions have established regular
hospital review meetings. However, there has been no systematic effort to share performance
monitoring experience between regions and the efforts of stakeholders (e.g. MSD staff,
CRCPTs, hospital staff and partners) are poorly coordinated.
This Manual sets out a Framework for Hospital Performance Monitoring and Improvement
focused on a core set of KPIs that seeks to address the above needs and challenges. The
Manual outlines processes by which hospitals, FMOH and RHBs can collaborate to
strengthen hospital performance monitoring, thus maximizing resources and preventing
duplication of efforts.
The Framework and KPIs presented in this Manual were first drafted by MSD and presented
to representatives from all Regional CRCPTs (with the exception of Afar Region) for
discussion and review at a two-day workshop held in Addis Ababa in September 2010.
During the workshop participants split into small groups for critical review and discussion on
the proposed Framework and KPIs. Following feedback, the Framework and KPIs were
revised and presented once again to meeting participants. All participants accepted the
revised Framework and KPIs, and agreed that each Region would subsequently work towards
implementation of this Performance Monitoring Framework and KPIs, with the support of
MSD and relevant partners as required.
Additionally, field visits were conducted by CRCPT, MSD and Clinton Health Access
Initiative (CHAI) staff to 9 hospitals in 4 Regions. During the field visits the definitions,
inclusion and exclusion criteria and data sources for each KPI were critically reviewed and
training needs ascertained.
Following agreement on the Performance Monitoring Framework and KPIs, MSD and
the CRCPT of RHBs developed this Manual with the technical assistance of CHAI.
Common tools for performance improvement include both problem solving and change
management. Although there are many approaches to both problem solving and change
management, some common elements are apparent. These can be summarized in the „8
Step Scientific Method of Problem Solving‟ which is described below.
To successfully move from one step to the next, leaders can rely on a number of useful
management tools including:
Root cause analysis, including fishbone diagramming, flow charting, and histograms,
Gantt chart.
Each step, together with the associated management tools, is described in detail below.
The first step to solving a problem is to define the problem (the „problem statement‟) in a
way that allows us to find solutions. Defining the problem requires analysis of the current
situation and how it differs from the desired situation. To devise a good problem
statement the following should be considered:
1. Focus on a single problem: The challenges that leaders face are complex, but it is
important to identify one single problem to work on, rather than getting lost in a tangle of
multiple problems.
3. Keep it short: Simply state, “The problem is…” Long, complex problem statements can
be confusing and may result in a lack of a shared understanding of the problem.
4. Find statements that are shared widely by key constituents: In order to gain support for
your solutions, key players must all believe that this problem exists and is important.
5. Do NOT include solutions themselves: This first step simply states the problem.
Subsequent steps focus on identifying solutions. Good leaders often may have a solution
in mind, but a clear strategy starts with the problem, and next focuses on generating
multiple solutions.
Figure 1 below shows some common mistakes in defining the problem and gives
suggestions for improvement.
The overall objective should be phrased to address or solve the problem. The objective identifies
where the organization wants to be regarding the specific problem. In this sense, the defining of
the problem (i.e., reflecting the current state) and the setting of the objective (i.e.,
Your overall objective has been defined, but how can you best reach your goal? A root cause
analysis will help identify the factors that cause the problem. Like peeling away the layers of
an onion, finding the root cause requires careful analysis of multiple layers. Several
management tools can help leaders find the root causes of the problem, including:
1) Fishbone diagram,
3) Histograms.
Fishbone Diagram
A fishbone diagram helps leaders identify multiple causes of a single problem. The diagram
takes its name from its shape, which resembles the skeleton of a fish as shown in Figure 3.
The problem statement is written at the “head” of the fish. Causes of this problem are
grouped into four categories:
3) Equipment: Is there any equipment, including supplies, that contribute to the problem?
4) Environment: Does the immediate environment (i.e., the building or compound), or the
broader environment (i.e., the community, town, or nation) contribute to the problem?
As you identify factors that contribute to the problem, place them on the appropriate
“fishbone.” For each factor that you identify, ask, “What leads to that factor?” For example,
in the diagram above, the laundry machines were identified as an important factor in the lack
of sanitation. This is an equipment issue, and “Laundry Machines Broken” was placed on the
equipment fishbone. The laundry machines were broken because of two factors: lack of parts
and a budget shortfall. Both of these were added to the diagram.
1) Allows for open session: Involves everyone in an open session. Using a chalkboard or
other display to brainstorm allows everyone to contribute their ideas, no matter how
big or small.
2) Ideas are generated quickly: Generates an abundance of diverse ideas quickly. Because
there are many bones, there is room for many ideas.
3) Group understanding develops: Helps group members understand and appreciate others‟
perspectives. Some participants will be more focused on the environmental factors while
others will focus on factors related to people. The diagram makes room for all of these
perspectives.
One drawback to the fishbone diagram is that this tool cannot display the importance
or commonality of a particular issue.
Flow Charting
Figure 4 indicates a sample flow chart for medication ordering. Notice that the start and end
points are indicated by circles, and each step in the process is shown in a rectangle. If there is
a decision point, or question, that must be asked along the way, this is indicated by a diamond
shape.
4) Foster a team that “owns” the whole process, not simply individuals focused only on
fragments, and
While a flow chart is useful for identifying breakdowns in the process, this tool does not
tell how often breakdowns occur.
Histogram
A histogram is a useful tool for quantifying the frequency of common causes of the problem.
By quantifying the frequency, managers can focus on the biggest issues first. The histogram
below shows reasons that in-patients do not receive required drugs:
70
% of problems
60
50
40
30
20
10
0
Pharm is out Order not MD order not MD order Pharm lost
of drug brought to transcribed missing order
pharm
Histogram analysis provides a useful representation of data that allows managers to prioritize.
This analysis also helps generate alternative approaches and provides a tool for showing
progress. One drawback is that this analysis shows the frequency of the problem without
indicating possible solutions.
To the point above, the problem solving process has focused on identifying all of the
factors that contribute to a problem, including the root causes, or underlying factors. After
identification of the problem‟s cause(s), the next step is to start generating solutions. By
generating multiple alternatives for solving the problem, the chances of reaching a solution
are increased. Effective leaders are creative in developing these alternatives.
Clearly described,
Mutually exclusive, so you can compare and choose one of the options:
o Do A and do not do B,
o Do B and do not do A, or
o Do both A and B
When a few alternative interventions have been generated, the most promising intervention
must be identified. Comparing these alternatives can be challenging, as some members of the
group may prefer one alternative, while other members may champion a different alternative.
An Options Appraisal allows for a side-by-side comparison of the strategic alternatives using
evaluative criteria to select the best option. Consider the following options for addressing low
productivity:
In order to compare these 3 options, the group must agree on a set of evaluative criteria.
Evaluative criteria are factors that are important to the group and the organization. For
example, they may include effect of the problem, expense, political feasibility, or time to
implement. The Options Appraisal can be qualitative or quantitative as shown in Figure 6.
Note: Each option ranked on a score of 1-5 with 5 being the best, or strongest, option. In this
case, if each evaluative criteria is weighted equally, improve supervision is the best option
with a total score of 16.
Estimating the values within the matrix is not a perfect science. A sensitivity analysis allows
managers to determine whether the final decision, or best option, would change if some of the
estimates inside the matrix were changed, or if the estimates were slightly wrong. In other
words, how much can each estimate change without changing the selection of the best
strategy?
Often, managers only estimate the impact of interventions and not the other factors. An
options appraisal and the sensitivity analysis allows managers to think through whether being
slightly “wrong” would change the choice of the best option.
Once you have selected the best intervention, the Implementation Plan is the strategy that
you will use to turn your ideas into reality.
1) Identify specific tasks: Identify tasks to be completed to meet specific objectives,
including who is responsible for each step, what resources are needed, and conditions
necessary for success.
2) Develop timeline using a Gantt chart: The Gantt Chart is a tool for defining the tasks,
timeline and persons responsible for accomplishing the project objectives. When
developing the Gantt chart, key persons responsible should be involved in the process of
defining the target dates and their role(s) for each task. This step will ensure their support
and commitment. The Gantt chart should be reviewed on a regular basis (e.g., weekly,
monthly, and quarterly) and adjusted and revised to reflect changes in the environment to
ensure progress towards objectives (see Figure 7).
Person Week
Responsible
Task Description 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
1 Development of Methodology
Evaluation is the process by which one determines if the program achieved its overall
and specific objectives; it usually is an assessment at one point in time to determine
the impact of the project.
A monitoring plan provides a set of indicators that will be monitored regularly to show the
impact of the management interventions. Indicators should be selected that reflect both
processes and outcomes. Process indicators measure interim impacts, such as the number of
The management team can use information generated from monitoring and evaluation to
assess if interventions are working as expected and identify where further work is needed
to improve performance in desired areas.
To ensure the provision of effective, efficient and quality health care by all
Ethiopian public hospitals
To identify areas for further improvements within hospitals where targeted support, by
the RHB, MSD or other partners is necessary.
As illustrated in Table 1 and Figure 8 below, the Framework for Hospital Performance
Monitoring and Improvement has three main elements:
2) Supportive supervision site visits to hospitals, led by the respective RHB CRCPT and
including other bodies such as MSD or partners as relevant; and
3) Review meetings:
Regional (or cluster) review meetings between each RHB and all hospitals in the
respective Region; and
MSD and all Regional CRCPTs review meetings.
Element Description
A set of core hospital KPIs that meets the needs of Governing Boards, CRCPTs,
MSD and the public will streamline reporting processes and prevent duplication of
efforts by the different stakeholders. The burden on hospitals will be minimized.
A common set of KPIs will allow hospital performance to be tracked over time,
and comparisons between hospitals and regions can be made
The KPIs can be used by Governing Boards to monitor hospital performance.
KPIs Problems will be identified at an early stage, allowing the Governing Board to
take remedial action where necessary.
KPIs should be reported by each hospital to the RHB CRCPT every month.
Comparisons between hospitals can be made, identifying best practice as well as
areas where improvement is needed.
The MSD can review regional and hospital performance and identify areas where
additional support is needed
Supportive supervision site visits to hospitals should be conducted in order to
check (validate) hospital performance in relation to the KPIs, to identify good
practice, and to provide supervision and guidance to help hospitals to improve
areas that require strengthening
Supportive Supervision should be conducted by a team of supervisors. The supervisors could
supervision include RHB CRCPT staff, MSD staff, staff from other hospitals (e.g. CEOs) and
site visits other partners such as CHAI. It would not be necessary for all stakeholders to
attend every supervision visit, rather the team for each visit can be drawn from the
different stakeholders.
All supervision should be under the direction of the respective CRCPT. No
stakeholder should conduct supervision without the approval of the CRCPT.
Regional
Review meetings between the CRCPT and hospitals (either region wide or in
clusters) will allow for benchmarking and the dissemination of good practice.
At each review meeting hospitals should present a performance report based on
their KPIs. Hospitals will have the opportunity to share successes and challenges
in order to learn from each other.
Regional „all hospital‟ review meetings can also be used to discuss other relevant
Review
topics
meetings
National
Review meetings between MSD and all regional CRCPTs will allow for
benchmarking and the dissemination of good practice between regions.
At each review meeting CRCPTs should present a regional performance report
based on their KPIs. Regional CRCPTs will have the opportunity to share
successes and challenges in order to learn from each other.
MSD/CRCPT meetings can also be used to discuss other relevant topics.
MSD
Feedback/Response
Quarterly
RHB CRCPT
Monthly
Feedback/Response Feedback/Response
Hospital Management
Experience sharing
An indicator is a way to measure a specific issue, or a way of saying "how much" or "how
many" or "to what extent”. Performance Indicators help to understand a system, compare it
1
and improve it.
Different types of indicators are used for different purposes. For example indicators could be
used to monitor implementation of a specific program, to monitor the financial performance
of a hospital, to monitor the quality of care provided by each clinical team or to monitor
implementation of the hospital annual plan.
However, it is easy to get overwhelmed by indicators and measurements, and to gather too
much information that is not really useful for overall performance monitoring. It is like trying
to drive a car while inspecting the engine, instead of using the dashboard!
Wrong trying to drive while inspecting Right using the dashboard!
the engine
“Dashboard”
There are 36 National Key Performance Indicators which are organized into 10 categories:
hospital management, outpatient services, inpatient services, maternity services, referral
services, pharmacy services, productivity, human resources, finance and patient satisfaction.
Hospital Management
KPI 1: % of EHRIG operational standards for hospital reform met
Outpatient Services
KPI 2: Outpatient attendances
KPI 3: Outpatient attendances seen by private wing service
KPI 4: Outpatient waiting time to treatment
KPI 5: Outpatients not seen on same day
Emergency Services
KPI 6: Emergency room attendances
KPI 7: Emergency room patients triaged within 5 minutes of arrival at ER
KPI 8: Emergency room attendances with length of stay > 24 hours
KPI 9: Emergency room mortality
Inpatient Services
KPI 10: Inpatient admissions
KPI 11: Inpatients that are admitted to private wing services
KPI 12: Inpatient mortality
KPI 13: Delay for elective surgical admission
KPI 14: Bed occupancy
KPI 15: Average length of stay
KPI 16: Pressure ulcer incidence
KPI 17: Surgical site infection
KPI 18: Completeness of inpatient medical records
Referral Services
KPI 23: Referrals made
KPI 24: Rate of referrals
KPI 25: Emergency referrals as a proportion of all referrals made
Pharmacy Services
KPI 26: Average stock out duration of hospital specific tracer drugs
Productivity
KPI 27: Patient day equivalents per doctor
KPI 28: Patient day equivalents per nurse/midwife
KPI 29: Major surgeries per surgeon
KPI 30: Major surgeries conducted in the private wing
Human resources
KPI 31: Attrition rate - physicians
KPI 32: Staff satisfaction
Finance
KPI 33: Cost per patient day equivalent
KPI 34: Raised revenue as a proportion of total operating revenue
KPI 35: Revenue utilization
Patient Satisfaction
KPI 36: Patient satisfaction
The Health Management Information System (HMIS) draws its data from routine service and
administrative records and is primarily designed to monitor and refine implementation
2
programmes of the Health Sector Development Plans . Additionally, the indicators are based
on the priorities of the Plan for Accelerated and Sustained Development to End Poverty, the
needs and priorities of local authorities, and the requirements of international agreements,
such as the Millennium Development Goals.
On the other hand, the hospital KPIs, are a small set of 36 indicators with the primary
function of assisting hospital SMTs, Governing Boards, RHBs and FMOH to oversee hospital
operations. The hospital KPIs do not replace the HMIS indicators and existing HMIS
reporting, review and monitoring processes should continue.
Hospitals should develop suitable mechanisms for collecting KPI data. These mechanisms
should ensure that the information is accurate and that it has been properly checked prior to
submission. To achieve this, each KPI needs an assigned data owner and the organization
needs a named KPI focal person.
The data owner should be an individual who is responsible for the primary data source (e.g.
register, record or database) from which the KPI is drawn and who has responsibility for
the service area that is being measured.
Submitting the KPI to the KPI focal person at the end of each reporting period
Reviewing the KPI, and identify any action that is needed as a result (i.e.
performance improvement plan)
For example the Head of Human Resources (HR) could the KPI data owner for KPI 31:
Attrition rate - Physicians and KPI 32: Staff satisfaction
2 FMOH (2008) HMIS/M&E Indicator Definitions: HMIS / M&E Technical Standards: Area 1.
A single focal person should be assigned to collect all KPIs and the data elements from the
data owners and to prepare the hospital KPI report. The KPI focal person should be a member
of the hospital quality committee (see 4.6.1 below). If the hospital has a separate HMIS
performance monitoring team the KPI focal person should be one of the HMIS team
members. A deputy KPI focal person should also be assigned to act in the absence of the KPI
focal person.
Collecting KPI data from every KPI data owner at the end of the reporting period
Checking the accuracy of the KPI data, by reviewing data sources and conducting
spot checks for accuracy on the data sources and the KPIs submitted by data owners
Entering the KPI data into the electronic Hospital KPI Database
Preparing the KPI report (including data elements and KPI results) from the KPI
Database
Submitting the KPI report to the hospital Quality Committee and CEO
Training the KPI data owners, ensuring that each understands the meaning of the
KPI, how to maintain the primary data source and calculate the KPI.
Ensuring the availability of all required computer hardware and software, stationery
and forms for the collation and submission of KPIs.
Table 2 on the following page, can be used to list the people assigned to each KPI. If a staff
member changes, the Table should be updated with the name of the new person assigned as
the data owner. The list should be established and updated by the KPI focal person with any
changes approved by the CEO.
An electronic Hospital KPI Database has been created (in Excel) into which the KPI focal
person should enter all KPI data elements. The KPI Database will automatically generate KPI
results and related tables and charts. KPI reports can be printed from this Database.
After entering and checking the data, the KPI focal person should print the KPI report and
submit this to their quality committee and the CEO. The hospital CEO should check and sign
off the KPIs before submitting them to the Governing Board Chair.
Additionally, KPI data should be submitted to the RHB. Ideally, the KPI focal person should
email the electronic KPI Database to the RHB ever month. If this is not possible, the KPI
focal person should print a copy of the data elements and a copy of the KPI results directly
from the KPI Database and should fax these to the RHB.
th
KPI reports should be submitted to the RHB by the 10 of each month.
Hospitals should also keep track of progress towards attainment of EHRIG standards. To
assist with this, a Hospital EHRIG Database has been created into which the KPI focal person
should enter all EHRIG self assessment results (see Section 5 below and Appendix 6). The
EHRIG Database will automatically generate tables and charts from the entered data.
The KPI focal person should email an electronic copy of the EHRIG Database to the RHB
every quarter. If this is not possible then a hard copy of the EHRIG self assessment tool (see
Appendix 6) should be faxed to the RHB.
Each RHB should assign a focal person to receive KPI and EHRIG databases/ reports from
all hospitals, and should share the name, contact telephone number and email address of the
focal person with each hospital.
An electronic Regional KPI Database has been created (in Excel) into which the RHB should
enter all KPI data elements reported by each hospital. The KPI Database will automatically
generate KPI results and related tables and charts, including regional averages. KPI reports
can be printed from this Database.
Additionally, a Regional EHRIG Database has been created (in Excel) into which the RHB
should enter all hospital EHRIG reports. The EHRIG Database will automatically generate
tables and charts, including regional averages, from the entered data.
Every quarter, the RHB should email electronic copies of the Regional KPI Database and
Regional EHRIG Database to MSD. If it is not possible to send electronically then hard
copies of the KPI Data Elements and KPI Data Results, together with a hard copy of the
average attainment within the Region of each EHRIG should be faxed to MSD.
- How does the KPI compare to the target for the reporting period? Has the target been
reached? If the target has not been reached, why not?
- Is there a need for further improvement on this KPI?
- Is additional information required?
- Is further support (e.g. trainings, supervision) required from the RHB or other partners
to support the hospital to make improvements?
The KPI data owner, together with case team and other relevant colleagues should analyze
the performance and develop actions that need to be taken to improve performance, using the
tools outlined in Section 2.
Each hospital should have a performance management or quality committee (QC) to oversee
performance monitoring and improvement functions across the hospital. The name of such a
committee may differ from hospital to hospital but the important issue is not the name of
team per se, but rather to ensure that the functions/responsibilities described below are
carried out by designated individuals.
The QC should be comprised of a chairperson and between 4-6 quality officers. The QC
should be multidisciplinary, with members appointed from different clinical, administrative
and support case teams within the hospital. The chair of the QC should be a member of the
hospital senior management team. Where circumstances permit, and depending on the size of
the hospital, the chair and quality officers should be full time in their role. Where this is not
a) To develop hospital performance and/ quality management strategy and present to the
Senior Management Team for approval,
b) To develop an implementation plan for the overall improvement of hospital performance
and monitor its execution,
c) To ensure that performance management activities relate to the vision and mission of the
hospital, and are aligned with the hospital strategic and annual plans,
d) To co-ordinate all hospital performance improvement activities,
e) To promote and support the participation of all staff in hospital performance
improvement activities,
f) To receive and analyze feedback information from patients, staff and visitors,
g) To receive clinical audit reports and maintain a record of all clinical audit activities,
h) To review selected hospital deaths
i) To monitor KPI data
j) To monitor HMIS performance
k) To conduct peer review in response to specific quality and safety concerns and to take
appropriate action and follow-up when deficiencies are identified, and
l) To update hospital staff on hospital performance improvement activities and findings
including:
a) Comparisons across time
b) Comparisons between case teams/departments
c) Comparisons with other health facilities.
The KPI focal person should be a member of the quality committee. The KPI focal person
should present all KPI reports to the quality committee for review. Further guidance on the
role of the quality committee, and hospital quality management can be found in Chapter 12,
Quality Management, of the Ethiopian hospital Reform Implementation Guidelines.
For example, if the Patient Satisfaction Score is low or is decreasing, the Governing Board
could ask the CEO to present the full results of the Patient Satisfaction Survey to see if there
are any particular areas of concern, and could ask the CEO to describe actions that the
hospital is going to take to improve patient satisfaction. Or, if inpatient mortality is high or
increasing, the Governing Board could ask the CEO if there are any factors to explain this
(perhaps a communicable disease outbreak) or to provide additional information on the
mortality rate for each ward or specialty (e.g. surgical mortality rate, paediatric mortality rate
etc) to identify if there is a particular problem area.
When reviewing the hospital KPI data and discussing with the CEO, questions that
Governing Board members should consider include:
- How does each KPI compare to the last reporting period? Is there improvement? No
change? Is performance worse than before?
o If there is improvement, how did this take place? Should special recognition
be given to any staff members or case teams who are responsible for the
improvement?
o If performance is worse why has this taken place?
o How does each KPI compare to the target for the reporting period? Has the
target been reached? If not, why not?
- Is additional information required from the CEO?
- What action should be taken by the CEO/hospital in response to the KPI results?
- What support (e.g. trainings, supervision) is required from the RHB or other partners
to support the hospital to make improvements?
When reviewing individual hospital KPI reports, the RHB should consider the same
questions as outlined above for Governing Boards. In addition, the RHB should compare
performance between hospitals, in particular:
- Which hospitals are showing the best performance overall? Which are showing poor
performance?
- Which hospitals are improving? Which hospitals show slow or no improvement?
- What are the particular strengths in the region as a whole, what are the weaknesses?
The RHB should give feedback to each hospital on the KPI reports, asking for clarification or
further information where required.
The FMOH should assign a focal person to receive KPI reports from all RHBs, and should
share the name, contact telephone number and email address of the focal person with each
RHB. FMOH should review all regional KPI reports to compare regions, to monitor changes
over time and to calculate national averages. The electronic National KPI Database can be
used for this purpose.
When reviewing regional KPI reports, FMOH should consider the same questions as RHBs.
In addition, FMOH should compare performance between regions, in particular:
- Which regions are showing the best performance overall? Which are showing poor
performance?
FMOH should give feedback to each RHB on the KPI reports, asking for clarification or
further information where required. FMOH should not contact hospitals directly in response
to the KPI reports, but instead should discuss first with the RHB so that a joint response can
be made to the hospital and any follow up action can be agreed jointly between FMOH and
the RHB.
In particular, KPI reports should be used as input for hospital site visits and regional and
national review meetings (see Sections 6 and 7).
The KPIs are calculated from individual data elements numbered Q1 to Q59, which are listed
in Table 3. These data elements form the numerators and denominators of each KPI and,
using the formulae, are used to calculate the 36 national KPIs.
The following tables present a detailed guide to each KPI, outlining the importance of the
indicator, the data sources and formula for calculating the indicator.
(Please note: The tables below, together with data entry forms for each KPI, are presented
again in Appendix 5. The KPI tables can be photocopied from Appendix 5 and given to the
data owner of each KPI to assist with collection of the data elements and calculation of the
KPI by the data owner).
Why is this In order to provide quality, effective and efficient health care, hospitals must
important? have well functioning management systems.
The EHRIG operational standards for hospital reform are a set of minimum
standards that a well functioning hospital should have in place. There are a
total of 124 standards across 13 management areas:
Hospital Leadership and Governance (6 standards)
Patient Flow (13 standards)
Medical Records Management (6 standards)
Pharmacy Services (12 standards)
Laboratory Services (11 standards)
Nursing Care (6 standards)
Infection Prevention (8 standards)
Facilities Management (14 standards)
Medical Equipment Management (9 standards)
Financial and Asset Management (11 standards)
Human Resource Management (13 standards)
Quality Management (8 standards)
Monitoring and Reporting (7 standards)
By measuring attainment of each standard (i.e. whether a standards is met or
unmet) hospitals can identify areas of weakness in their management
systems, identify priorities for improvement and monitor progress over time.
Unit of
%
measurement
Numerator Number of EHRIG operational standards for hospital reform met
Denominator
124 (i.e. total number of EHRIG operational standards for hospital reform)
Formula Number of EHRIG operational standards for hospital reform met (Q1) ÷ 124
(i.e. the total number of EHRIG operational standards for hospital reform)
(Q2) x 100
Data sources
Assessment tool for operational standards of the EHRIG (see Appendix 6)
Frequency of
Quarterly
reporting
Why is this Hospitals need to know the number of patients treated (inpatient,
important? outpatient and emergency) in order to plan staff numbers, equipment
and supply needs. This information informs the annual plan and budget
preparations. By monitoring the number of patients treated a hospital
can also assess if patient demand is increasing or decreasing over time
and investigate further if unexpected changes are seen.
EXCLUDE:
All patients attending the emergency department
All emergency maternity attendances (any gestational age)
Unit of
measurement Absolute number
Why is this Through Health Care Finance Reform (HCFR), hospitals are
important? permitted to establish a private wing service. The number of
outpatient visits to the private wing service, and the proportion of all
outpatient visits that are seen at the private wing, are measures of
service availability, patient demand for private wing services and of
the success of HCFR implementation by the hospital.
Definition The proportion of all outpatient visits that are seen at the private wing
service.
Private wing outpatients includes both new and repeat outpatient visits
that are seen by the private wing service
All outpatient visits includes all new and repeat visits to any
outpatient clinic, including:
General Outpatient clinics
Specialty outpatient clinics (including Dental, Ophthalmic,
Psychiatry etc)
TB clinics
ART clinics
VCT clinics
MCH clinics (EPI, IMCI, well baby clinics, ANC, PNC,
family planning etc)
Private wing clinics
EXCLUDE:
All patients attending the emergency department
All emergency maternity attendances (any gestational age)
Unit of
%
measurement
Numerator Number of new and repeat outpatient attendances at private wing (Q4)
Denominator Number of new and repeat outpatient attendances at public facility
(Q3) + Number of new and repeat outpatient attendances at private
wing (Q4)
Formula Number of new and repeat outpatient attendances at private wing (Q4)
÷ [Number of new and repeat outpatient attendances at public facility
(Q3) + Number of new and repeat outpatient attendances at private
wing (Q4)] x 100
Data sources Outpatient registration books; private wing registration book or central
registration book/database; HMIS tally forms
Frequency of
Monthly
reporting
Why is this The time that a patient waits from arrival to treatment is a measure of
important? access to health care services. Long waiting times indicate that there
are insufficient staff and/or resources to handle the patient load or that
those available resources are being used inefficiently.
For patients who do not have an appointment, the time of arrival means
the time of arrival at the patient registration or the time of arrival at
triage (whichever is first)
EXCLUDE:
Patients not seen on the same day
Unit of
Minutes
measurement
Numerator Sum total of outpatient waiting time (in minutes) (Q5)
Denominator Number of outpatient waiting time cards completed (Q6)
Formula Sum total of outpatient waiting time (in minutes) (Q5) ÷ Number of
outpatient waiting time cards completed (Q6)
Data sources Survey – see protocol for survey to measure OPD wait time in
Appendix 7
Why is this
important? All patients should be seen in the OPD on the same day that they
register for treatment. By measuring the number and proportion of
patients that do not receive a same day service the hospital can assess
if there is a need for extra personnel and/or other resources in the
outpatient department and/or to review patient flow processes to
increase the efficiency of service provision.
Definition
The proportion of all outpatients that do not receive treatment on the
same day as registration in the outpatient department
Unit of
%
measurement
Numerator
Number of outpatients not seen on same day as registration in OPD
during the reporting period (Q7)
Frequency of
Quarterly
reporting
Why is this Hospitals need to know the number of patients treated (inpatient,
important? outpatient and emergency) in order to plan staff numbers, equipment
and supply needs. This information informs the annual plan and budget
preparations. By monitoring the number of patients treated a hospital
can also assess if patient demand is increasing or decreasing over time
and investigate further if unexpected changes are seen.
INCLUDE:
All patients registered in the emergency room (all ages)
EXCLUDE:
All patients triaged and sent to OPD
Patients who were already dead (i.e. no vital signs present) on
arrival
Unit of
Absolute number
measurement
Formula
Number of emergency room attendances (Q8)
Data sources
Emergency room registration book
Frequency of
Monthly
reporting
Why is this Triage is a process of sorting patients into priority groups according to
important? their need and available resources. The aim of triage is to give priority
treatment to those with the most critical conditions, thus minimizing
delay, saving lives, and making the most efficient use of available
resources. The first five minutes of arrival in the emergency room (ER)
is the most critical time to save lives. If assessment and treatment is not
initiated during this time then lives will be lost unnecessarily.
Frequency of
Quarterly
reporting
Why is this important? Through BPR and other hospital reforms, emergency
medical services are being strengthened. Hospitals have
emergency room beds where patients can stay for a short
period of time to receive emergency treatment. However, the
length of stay in the emergency room should always be less
than 24 hours. If a patient requires treatment for longer than
24 hours then he/she should be transferred to a ward. If
emergency room beds are occupied by patients for more than
24 hours then the emergency room will become congested
and there is a danger that the emergency room will not have
the capacity for any NEW emergency attendances.
Definition The proportion of all emergency room attendances who
remain in the emergency room for > 24 hours
INCLUDE:
All patients registered in the emergency room (all
ages)
EXCLUDE:
Patients who were already dead (i.e. no vital signs
present) on arrival
Unit of measurement
%
Numerator
Total number of attendances who remain in emergency room
for more than 24 hrs (Q11)
Denominator
Total number of emergency room attendances (Q8)
Formula
Total number of attendances who remain in emergency room
for more than 24 hrs (Q11) ÷ Total number of emergency
room attendances (Q8) x 100
Data sources
Emergency room registration book
Why is this
The emergency room mortality is a measure of the quality of care
important?
provided by the emergency room of the hospital. A high mortality
could indicate that the hospital is providing poor quality emergency
care with unnecessary patient deaths.
Definition The number of deaths in emergency room from patients who were
alive (i.e. any vital signs present) on arrival per 100 emergency room
attendances.
INCLUDE:
All deaths in emergency room from patients who were alive (i.e. any
vital signs present) on arrival
EXCLUDE:
Patients who were already dead (i.e. no vital signs present) on arrival
Unit of
%
measurement
Numerator
Number of deaths in emergency room from patients who were alive
(i.e. any vital signs present) on arrival (Q12)
Denominator
Number of emergency room attendances (Q8)
Formula
Number of deaths in emergency room from patients who were alive
(i.e. any vital signs present) on arrival (Q12) ÷ Number of emergency
room attendances (Q8) x 100
Data sources
Emergency room register/database
Frequency of
Monthly
reporting
Why is this important? Hospitals need to know the number of patients treated
(inpatient, outpatient and emergency) in order to plan staff
numbers, equipment and supply needs. This information
informs the annual plan and budget preparations. By
monitoring the number of patients treated a hospital can also
assess if patient demand is increasing or decreasing over time
and investigate further if unexpected changes are seen.
Definition
% of all admitted patients who were admitted to the private
wing during the reporting period.
Unit of measurement
%
Numerator
Number of patients admitted to private wing (Q14)
Denominator
Number of patients admitted to public facility (Q13) +
Number of patients admitted to private wing (Q14)
Formula
Number of patients admitted to private wing (Q14) ÷
[Number of patients admitted to public facility (Q13) +
Number of patients admitted to private wing (Q14)] x 100
Data sources
Inpatient register/admission and discharge book/database
Private wing registration/admission and discharge
book/database
Frequency of reporting
Monthly
Why is this
important? The inpatient mortality is a measure of the quality of care provided by the
hospital. High inpatient mortality could indicate that the hospital is
providing poor quality care with unnecessary patient deaths.
Definition
The number of deaths per 100 discharged inpatients.
INCLUDE:
All deaths among patients admitted to public
facility Private wing inpatient deaths
EXCLUDE:
All deaths in emergency room
All deaths among non admitted maternities (any gestation)
Unit of
%
measurement
Numerator
Number of deaths among admitted inpatients (Q15)
Denominator
Number of deaths among admitted inpatients (Q15) + Number of
patients discharged alive (including transfers out) (Q16)
Formula
Number of deaths among admitted inpatients (Q15) ÷ [Number of
deaths among admitted inpatients (Q15) + Number of patients
discharged alive (including transfers out) (Q16) x 100
Data sources
Discharge registration book
Frequency of
Monthly
reporting
Why is this Delays in surgery for different conditions are associated with a
important? significant increase in morbidity and mortality.
Through BPR, the Government has set a stretch objective that any
outpatient who requires a bed should receive the service within 2
weeks.
EXCLUDE:
Elective Caesarean Sections
Emergency Surgery
NB: If a cold case patient is admitted on the same day that the
decision for surgery is made then their number of days on the waiting
list should be counted as zero.
Denominator Number of patients who were admitted for elective (non-emergency)
surgery during the reporting period (Q18)
Formula Sum total of number of days between date added to surgical waiting
list to date of admission for surgery (Q17) ÷ Number of patients who
were admitted for elective (non-emergency) surgery during the
reporting period (Q18)
Data sources Surgical registration book
Frequency of Monthly
reporting
Why is this The bed occupancy rate (BOR) is a measure of the efficiency of inpatient services. Hospitals
important? are most efficient at a BOR of 80 – 90%. If the BOR is lower, resources may be wasted. If
the BOR is higher than 90% there is a danger of staff burnout and of over-crowding during
sudden increases in demand for services.
Knowledge of the BOR helps hospitals to identify inefficiencies in service delivery in order
to investigate and take action to address this, and also to plan for future staff or other resource
requirements.
For a RHB, knowledge of the BOR from each hospital helps to assess health service coverage
and population access to services as a foundation for health service planning.
Definition The average percentage of occupied beds during the reporting period
Unit of measurement %
Numerator The sum total length of stay in days during the reporting period (Q19)
NB: The length of stay should ONLY be counted for the actual reporting period. If a patient
was admitted during a previous reporting period their length of stay during that previous
reporting period should not be counted. Instead, FOR THIS KPI, the patient‟s length of stay
should be counted from the first day of this reporting period to the time of discharge, death or
to the end of the reporting period (whichever is first).
INCLUDE:
Patients admitted to public facility
Patients admitted to private wing
Denominator Average number of operational beds during reporting period (Q20) x number of days in
reporting period (Q21)
An operational (inpatient) bed INCLUDES:
Beds in wards
Beds in clinical facilities (e.g. intensive care units, ophthalmic units where patients
are routinely kept for > 24 hours)
Beds temporarily out of use
Beds/cots in neonatal units
Private wing beds
The following should be EXCLUDED:
Beds in emergency room or emergency gynecology departments
Beds in day units/day surgery
Temporary beds, e.g. stretchers or trolleys
Observation or recovery beds in the emergency department, operating room or
outpatient department
Labour suite beds, e.g. delivery beds/couches, examination beds
Beds for non-patients (e.g. beds for mothers accompanying children)
Beds/cots for healthy babies who are born in the hospital or accompany their mothers
Formula The sum total length of stay in days during reporting period (Q19) ÷ [Average number of
operational beds during reporting period (Q20) x number of days in reporting period (Q21)]
x 100
Data sources Admission/discharge registration books
Why is this By monitoring length of stay hospitals can assess if patients remain in
important? hospital for longer than is necessary, perhaps due to non clinical
reasons, and investigate further if required.
Definition The average number of days from admission to discharge, death or
transfer out.
INCLUDE:
Inpatient discharges: discharge is the process by which a patient
completes a hospital stay and is discharged from an inpatient ward.
Transfer outs: These are patients who are directly transferred from
an inpatient ward to another hospital.
Deaths: All deaths of patients admitted to an inpatient ward should
be included
Patients admitted to public facility
Patients admitted to private wing
Unit of Days
measurement
Numerator Sum of total length of stay for patients who were discharged (including
deaths and transfer outs) during reporting period (Q22)
NB: For this KPI the total length of stay should be counted for all
discharged patients, including their length of stay in previous reporting
periods.
Why is this This is an indicator of the quality of care performed by nursing staff in
important? a hospital. Poor nursing care, with inadequate turning of patients in
their bed can lead to the development of a pressure ulcer (also called
bed ulcer or decubitus ulcer). Pressure ulcers can be fatal when allowed
to progress without treatment.
By measuring the pressure ulcer rate hospitals can assess the quality of
nursing care provided and take action to address any problems
identified.
Definition Proportion of inpatients who develop a pressure ulcer during their
hospital stay.
INCLUDE:
New pressure ulcers that arise during the patients admission,
during the reporting period
EXCLUDE:
Pressure ulcers that were already present at the time of
admission
Pressure ulcers that developed in a previous reporting period
Unit of %
measurement
Numerator Number of inpatients who develop a new pressure ulcer during the
reporting period (Q23)
Denominator Number of patients discharged alive (including transfers out) (Q16) +
Number of deaths among admitted inpatients (Q15)
Formula Number of inpatients who develop a new pressure ulcer during the
reporting period (Q23) ÷ [Number of patients discharged alive
(including transfers out) (Q16) + Number of deaths among admitted
inpatients (Q15)] x 100
Data sources Routine surveillance - Pressure ulcer report form (see Appendix 9)
Frequency of Monthly
reporting
Why is this Complete and accurate medical records are essential to maintain the
important? continuity of patient care and ensure that the health provider has full
information about the patient when providing healthcare.
Why is this
Hospitals need to know the number of patients who deliver at the
important?
hospital, and the number of complicated deliveries in order to plan staff
numbers, equipment and supply needs. This information informs the
annual plan and budget preparations.
Definition
Number of women who gave birth in the hospital
Unit of
Absolute number
measurement
Formula
Number of women who gave birth in the hospital (Q29)
INCLUDE:
All births in hospital, regardless of the department where delivery
occurred
Data sources
Delivery registration book
Frequency of
Monthly
reporting
Why is this In the health care system of Ethiopia, it is expected that hospitals will
important? manage complicated maternity cases and that uncomplicated
pregnancies and normal deliveries should mainly be managed by
Primary Health Care Units. By monitoring the % of attended deliveries
that are complicated, the hospital and RHB can assess if hospital
services are being used appropriately.
Definition Number of births by surgical, instrumental or assisted vaginal delivery
per 100 deliveries attended in the hospital
Numerator Number of Caesarean sections (Q32) + Number of abdominal surgical
deliveries (Q33) + Number of instrumental or assisted vaginal
deliveries (Q34)
Why is this This indicator reflects both the quality of medical care provided at the
important? hospital and the access to maternity services. For example a high maternal
mortality may be due to inadequate treatment of pregnant women after
they arrive at the hospital and/or could be due to long delays in seeking
medical care that result in women arriving at the hospital in a moribund
condition.
Through BPR, the government has set a stretch objective that “deaths
related to pregnancy and maternity should not occur to 99% of mothers
after the patient arrives at the hospital”.
INCLUDE:
All maternal deaths should be included, wherever they occur in the
hospital.
Ante partum deaths (at any gestational age)
Intrapartum deaths
Post partum deaths (from delivery until 6 weeks post partum)
Direct causes (e.g. haemmorhage, ruptured uterus, eclampsia,
obstructed labour, infection etc)
Indirect causes (e.g. heart disease or malaria aggravated by pregnancy)
EXCLUDE:
Deaths in pregnant women due to incidental or accidental causes, e.g.
road traffic accident.
Denominator Number of women who gave birth in the hospital (Q29)
Formula Number of maternal deaths (any gestational age) (Q35) ÷ Number of
women who gave birth in the hospital (Q29) x 100
Data sources Delivery register
Emergency gynecology database/register
Emergency room database/register
Frequency of Monthly
reporting
Why is this
This indicator is a measure of the quality of care during delivery and in
important?
the immediate post-partum period.
A hospital should monitor the early neonatal death rate to assess the
quality of maternity care provided and take action to address any
problems identified.
Definition
The number of deaths within 24 hours of birth per 100 live births
attended in the hospital.
INCLUDE:
All deaths within the first 24 hours of life among babies who were
delivered in the health facility
EXCLUDE:
Deaths among babies who were admitted AFTER delivery
Unit of
%
measurement
Numerator
Number of deaths within 24 hours of birth among babies born alive in
the hospital (Q36)
Denominator
Number of live births attended in the hospital (Q30)
Formula Number of deaths within 24 hours of birth among babies born alive in
the hospital (Q36) ÷ Number of live births attended in the hospital
(Q30) x 100
Data sources Delivery register
Frequency of
Monthly
reporting
Why is this A high number and proportion of referrals made from the hospital could
important? indicate that the hospital is not providing all services required by the
population served, whereas a low number and proportion of referrals
might indicate that the hospital is not following referral guidelines and
is treating patients beyond its capacity. Knowledge of the number and
rate of referrals helps the hospital to plan future service provision.
For the RHB, knowledge of the number and rate of referrals made by
each hospital helps to monitor the regional Referral System and assists
the RHB to identify the need for and plan future healthcare services in
the region.
Definition The total number of patient attendances (inpatient, outpatient,
emergency and maternity) who were referred to another facility with a
referral paper during the reporting period
Why is this A high number and proportion of referrals made from the hospital
important? would indicate that the hospital is not providing all services required by
the population served, whereas a low number and proportion of
referrals might indicate that the hospital is not following referral
guidelines and is treating patients beyond its capacity. Knowledge of
the number and rate of referrals helps the hospital to plan future service
provision.
For the RHB, knowledge of the number and rate of referrals made by
each hospital helps to monitor the regional referral system and assists
the RHB to identify the need for and plan future healthcare services in
the region.
Definition The number of patient attendances (inpatient, outpatient, emergency
and maternity) who were referred to another facility with a referral
paper during the reporting period per 100 patient attendances
Unit of %
measurement
Numerator Number of emergency referrals made (Q38) + Number of non-
emergency referrals made (Q39)
Denominator Total patient attendances, i.e.
Number of new and repeat outpatient attendances at public facility
(Q3) + Number of new and repeat outpatient attendances at private
wing (Q4) + Number of emergency room attendances (Q8) + Number
of patients admitted to public facility (Q13) + Number of patients
admitted to private wing (Q14) + Number of women who gave birth in
the hospital (Q29) + Number of non-delivering emergency maternal
attendances (any gestational age) (Q37)
Formula [Number of emergency referrals made (Q38) + Number of non-
emergency referrals made (Q39)] ÷ [Number of new and repeat
outpatient attendances at public facility (Q3) + Number of new and
repeat outpatient attendances at private wing (Q4) + Number of
emergency room attendances (Q8) + Number of patients admitted to
public facility (Q13) + Number of patients admitted to private wing
(Q14) + Number of women who gave birth in the hospital (Q29) +
Number of emergency maternal attendances (any gestational age)
(Q37)] x 100
Data sources Referral register, admission register, outpatient register, emergency
register, delivery register/log books or databases
Frequency of Monthly
reporting
Why is this
All hospitals should be able to provide emergency medical services. If a
important?
hospital has a high proportion of emergency referrals this would suggest
that the hospital is not providing adequate emergency services.
Definition Number of emergency referrals per 100 referrals
Unit of
%
measurement
Numerator Number of emergency referrals made (Q38)
Formula
Number of emergency referrals made (Q38) ÷ [Number of emergency
referrals made (Q38) + Number of non emergency referrals made (Q39)]
x 100
Data sources
Referral register
Frequency of
Monthly
reporting
KPI 26: Average stock out duration of hospital specific tracer drugs
Why is this The availability of hospital specific essential (tracer) drugs is a measure
important? of service availability. Tracer drugs should ALWAYS be available at
the hospital. If there is any stock out of tracer drugs the hospital should
take action to identify and address the cause.
For the RHB, knowledge of the stock out of hospital specific tracer
drugs in hospitals helps to assess the adequacy of hospital inventory
control processes and the regional Pharmaceutical Supply Chain
Management System.
Definition The number of days in which a hospital specific tracer drug was not
available averaged over all hospital specific tracer drugs.
Why is this This indicator relates to the productivity of doctors and helps the
important? hospital to determine whether doctors are working productively, or are
overloaded. The indicator is useful for planning future staff numbers.
Definition The average number of patient day equivalents per full time
equivalent (FTE) doctor
Numerator Number of patient day equivalents (PDEs) during reporting period
A patient day equivalent is equal to ONE inpatient bed day (i.e. one
overnight stay by one patient) or three outpatient visits or three
emergency visits or three emergency maternity attendances or two
deliveries. It assumes that the cost of one inpatient day is equivalent to
three out outpatient visits or three emergency visits or three
emergency maternity attendances or two deliveries.
INCLUDE:
Inpatient admissions to public and private facilities
Outpatient attendances to public facility and private wing
Emergency attendances
Deliveries attended
INCLUDE:
All doctors (both general practitioners and specialists) funded by
the hospital or RHB
All doctors (both general practitioners and specialists) who are
voluntary or funded by another source
EXCLUDE:
Health Officers
Students
Residents & Interns
Formula {Sum total of length of stay during reporting period (Q19) + [Number
of new and repeat outpatient attendances at public facility (Q3) ÷ 3] +
[Number of new and repeat outpatient attendances at private wing
(Q4) ÷3] + [Number of emergency room attendances (Q8) ÷3] +
[Number of non-delivering emergency maternal attendances (any
gestational age) (Q37) ÷ 3] + [Number of women who gave birth in
the hospital (Q29) ÷ 2]} ÷ Average number of full time equivalent
(FTE) doctors (GP & Specialists) (Q42)
Data sources Inpatient registration book/ admission and discharge register
Outpatient registration book/register
Private wing registration book/database
Emergency registration book/database
Delivery register/database
Human resource/personnel database
Frequency of Monthly
reporting
Why is this This indicator relates to the productivity of nurses and midwives and
important? helps the hospital to determine whether nurses and midwives are
working productively, or are overloaded. The indicator is useful for
planning future staff numbers.
Definition The average number of patient day equivalents per full time
equivalent (FTE) nurse/midwife
Numerator Number of patient day equivalents (PDEs) during reporting period
A patient day equivalent is equal to ONE inpatient bed day (i.e. one
overnight stay by one patient) or three outpatient visits or three
emergency visits or three emergency maternity attendances or two
deliveries. It assumes that the cost of one inpatient day is equivalent to
three out outpatient visits or three emergency visits or three
emergency maternity attendances or two deliveries.
INCLUDE:
Inpatient admissions to public and private facilities
Outpatient attendances to public facility and private wing
Emergency attendances
Deliveries attended
So if the hospital has 30 full time nurses working 40 hours per week,
plus three nurses working 20 hours per week plus two midwives
INCLUDE:
All nurses and midwives funded by the hospital or RHB
All nurses and midwives who are voluntary or funded by another
source
EXCLUDE:
Students
Formula {Sum total of length of stay during reporting period (Q19) + [Number
of new and repeat outpatient attendances at public facility (Q3) ÷ 3] +
[Number of new and repeat outpatient attendances at private wing
(Q4) ÷3] + [Number of emergency room attendances (Q8) ÷3] +
[Number of non-delivering emergency maternal attendances (any
gestational age) (Q37) ÷ 3] + [Number of women who gave birth in
the hospital (Q29) ÷ 2]} ÷ Average number of full time equivalent
(FTE) nurses/midwives (Q43)
Data sources Inpatient registration book/ admission and discharge register
Outpatient registration book/register
Private wing registration book/database
Emergency registration book/database
Delivery register/database
Human resource/personnel database
Frequency of Monthly
reporting
Why is this This indicator relates to the productivity of surgeons, and helps the
important? hospital to determine whether surgeons are working productively, or
are overloaded. The indicator is useful for planning future surgical
staff numbers.
Definition The number of major surgical procedures per full time equivalent
(FTE) specialist surgeon.
Numerator Number of major surgeries (both elective & non-elective) performed
on public patients (Q25) + Number of major surgeries (both elective
& non-elective) performed on private wing patients (Q26))
INCLUDE:
all surgeries conducted on patients admitted to public facility
all surgeries conducted on private wing patients
EXCLUDE:
all ophthalmic surgery
EXCLUDE:
Surgical residents and interns
Ophthalmologists
Formula [Number of major surgeries (both elective & non-elective) performed
on public patients (Q25) + Number of major surgeries (both elective
& non-elective) performed on private wing patients (Q26)] ÷ Average
number of FTE specialist surgeons (excluding Ophthalmologists)
(Q44)
Data sources Surgical/operating room log book
Human resources/personnel database
Frequency of Monthly
reporting
Why is this Through Health Care Finance Reform (HCFR) hospitals are permitted
important? to establish a private wing service.
INCLUDE:
all surgeries conducted on private wing patients
EXCLUDE:
all ophthalmic surgery
Denominator Number of major surgeries (both elective & non-elective) performed
on public patients (Q25) + Total number of major surgeries (both
elective & non-elective) performed on private wing patients (Q26)
EXCLUDE:
all ophthalmic surgery
Formula Number of major surgeries (both elective & non-elective) performed
on private wing patients (Q26) ÷ [Number of major surgeries (both
elective & non-elective) performed on public patients (Q25) + Number
of major surgeries (both elective & non-elective) performed on private
wing patients (Q26)]
Data sources Surgical/operating room log book
Frequency of Monthly
reporting
Why is this The attrition rate (turnover) of hospital staff is an indicator of the
important? quality of the working environment for staff. A high turnover
indicates that employees are not satisfied with their working
environment. When employees are not satisfied in the workplace they
tend to be poorly motivated and are less efficient in their work, and
less motivated to provide quality healthcare.
INCLUDE:
all physicians and specialists employed by the hospital who:
o left voluntarily or compulsorily
o left for training of > 3 months duration
o died during the reporting period
EXCLUDE:
health officers
all voluntary physicians and specialists
short term trainings (<3 months) where the physician is expected
to return to the hospital after completion
Denominator Number of physicians (GP & Specialists) employed by hospital at the
beginning of the reporting period (Q46) + Number of physicians (GP
& Specialists) hired during the reporting period (Q47)
Formula Number of physicians (GPs and specialists) who left the hospital
during the reporting period (Q45) ÷ [Number of physicians (GP &
Specialists) employed by hospital at the beginning of the reporting
period (Q46) + Number of physicians (GP & Specialists) hired during
the reporting period (Q47)] x 100
Data sources HR personnel records
Frequency of Six monthly
reporting
Why is this
important? Hospitals should strive to provide a good working environment for
employees, with opportunities for training and development and
equitable remuneration.
Employees who are satisfied with their working environment are more
productive and provide higher quality care. In contrast when workers
are dissatisfied in the workplace their productivity tends to be low and
the attrition rate is high.
Definition
Average rating of hospital on a score of 0-10 from SEHC survey
Unit of
Absolute number on a scale of 0 - 10
measurement
Numerator
Sum total of rating scores from SEHC surveys (Q48)
Denominator
Number of SEHC surveys completed (Q49)
Formula
Sum total of rating scores from SEHC surveys (Q48) ÷ Number of
SEHC surveys completed (Q49)
Data sources
Survey – The survey tool and protocol are under development
Frequency of
Annual
reporting
Why is this The cost per patient day equivalent is a measure of the efficiency of
important? providing services at the hospital. A high cost per patient day
equivalent suggests that the hospital is not cost effective when using
resources (staff and/or equipment and supplies).
Definition A patient day equivalent is equal to ONE inpatient bed day (i.e. one
overnight stay by one patient) or three outpatient visits or three
emergency visits or three emergency maternity attendances or two
deliveries. It assumes that the cost of one inpatient day is equivalent to
three out outpatient visits or three emergency visits or three
emergency maternity attendances or two deliveries.
The cost per PDE is the average cost of treating one inpatient for one
day in the hospital or the average cost of 3 outpatients, emergency
room or emergency maternity attendances or the average cost of 2
deliveries.
Unit of Ethiopian birr
measurement
Numerator Total hospital operating expenses (Q50). This is all expenses
associated with running the hospital including:
Gross salaries and employee benefits
Consumables and supplies
Cost of outsourced services
Professional fees
Rentals
Interest payments
Insurance payment etc
EXCLUDE:
Capital expenses
Denominator Patient Day Equivalents =
Why is this Hospital income is from two sources: government budget allocation
important? and raised revenue. Through Healthcare Finance Reform (HCFR)
hospitals now have the autonomy to generate income from user fees,
private wing and other sources. This is known as raised revenue or
non government revenue. Hospitals are expected to generate income
that should then be re-invested in the hospital to improve the quality
of services provided.
Raised revenue includes all activities that generate income for the
hospital with the exception of government budget allocation. For
example: user fees, gross income from private wing, sales of food or
services, hall rent, donor, etc.
Denominator Total operating revenue for reporting period, i.e. Government
operating budget allocation* for reporting period (Q52) + raised
revenue (Q51)
NB: The Government operating budget for the reporting period can be
calculated from the annual budget. For example if the reporting period
is quarterly then the government budget allocation for the reporting
period is the annual budget divided by 4.
Formula Raised revenue during reporting period (Q51) ÷ [Government
operating budget allocation for reporting period (Q52) + Raised
revenue during reporting period(Q51)] x 100
Data sources Hospital financial statement
Frequency of Quarterly
reporting
Why is this
important? Each year, hospitals are expected to prepare an annual plan and identify
the budget required to meet that plan. Hospitals should fully
utilize their budget by the end of the year. If a hospital spends more
than its budget then it will run into debt and will be unsustainable in
the long term. If a hospital spends less than its budget this could
indicate either improved efficiency OR a failure to fulfill the annual
plan.
Denominator
Government operating budget allocation for reporting period (Q52) +
Government capital budget allocation for the reporting period (Q54) +
Raised revenue budget allocation for reporting period (Q55)
Formula
[Total hospital operating expenses during reporting period (Q50) +
Total capital expenses during reporting period (Q53)] ÷ [Government
operating budget allocation for reporting period (Q52) + Government
capital budget allocation for the reporting period (Q54) + Raised
revenue budget allocation for reporting period (Q55)] x 100
Data sources
Hospital financial statement
Frequency of
Quarterly
reporting
Why is this
Patient satisfaction with the health care they receive at the hospital is a
important?
measure of the quality of care provided. By monitoring patient
satisfaction hospitals can identify areas for improvement and ensure
that hospital care meets the expectations of the patients served.
Formula [sum total of O-PAHC rating scores (Q56) + sum total of I-PAHC
rating scores (Q58)] ÷ [Number of O-PAHC surveys completed
(Q57) + Number of I-PAHC surveys completed (Q59)]
Data sources Survey – protocol for the patient satisfaction survey is presented in
Appendix 12.
Data entry and analysis can be undertaken using the electronic Access
database and Excel pre-programmed analytical tool through which
summary tables, charts and the average satisfaction rating can be
calculated.
Frequency of
Quarterly
reporting
To assure the RHB that KPI and any other performance data reported by the hospital
to the RHB is accurate
To identify, recognize and learn from good practice, which can then be shared
with other hospitals
To identify areas where additional support from the RHB or other partners is
required, and to plan with the hospital for the provision of that support
These are common to all site visits conducted by the RHB but there may be additional
reasons for site visits. For example, the site visit could be conducted collaboratively with
Faculty from the Masters in Hospital and Healthcare Administration Program (MHA) and
have an additional aim to assess „on site‟ the performance of a hospital CEO who is
participating in the MHA, or the site visit could be conducted with a partner NGO to assess
a specific area where the partner has provided direct assistance to the hospital.
The purpose of the site visit and specific areas of focus should always be agreed by the site
visit team and should be informed to the hospital in advance of the visit taking place (see
Section 5.4 below).
A timeline for each of the above steps is presented in Figure 10 followed by detailed
descriptions of each step.
Site visit briefing document and agenda sent to hospital 1 week before site visit
CEO Dates of site visit meeting confirmed
Site Visit Report & Hospital Response & Action Plan are 4 weeks after site visit
distributed to relevant stakeholders
The first step in the site visit process is to determine membership of the site visit team.
The site visit should be led and coordinated by the RHB in collaboration with other partners
as relevant. Potential participants include FMOH staff, staff from other hospitals (e.g. a
respected hospital CEO), CHAI EHMI staff, MHA Faculty or others.
A minimum of three individuals should conduct the site visit. This will allow each person to
carry out specific functions during the site visit and minimize the time required at the
hospital.
A team leader should be assigned by the RHB to oversee the site visit process. The roles of
the team leader include:
To co-ordinate the site visit process, following the steps outlined below
To ensure communication between site visit team members both before and after the
site visit is conducted
To communicate with the hospital CEO both before and after the site visit
To prepare the site visit report and distribute to relevant stakeholders (e.g. RHB Head,
Hospital CEO and GB Chair, site visit team members).
To ensure the hospital provides a written response to the site visit report. To follow up
on any action described in the site visit report or the hospital response
To ensure the site visit report and the hospital response are maintained on file by the
RHB
To establish the date or timeline within which the next hospital site visit should be
conducted
The success of a site visit is dependent on adequate planning and preparation by both the site
visit team and hospital management.
Collate information
Firstly, the site visit team leader should collate all available evidence about the performance
of the hospital, in order to identify specific areas that should be addressed during the site
visit. Much of this evidence will already be on record with the RHB. As a minimum, the
following information should be reviewed:
The most recent site visit report and the hospital response & action plant
The most recent, and previous hospital self assessment reports on attainment of EHRIG
standards
The hospital KPIs and attainment of EHRIG standard reports should also be compared with
other hospitals in the region to assess how well the hospital is performing in relation to
others.
If any of the above information is not available in the RHB, the team leader should contact
the hospital CEO to request them to submit the missing information.
After gathering the above information, the site visit team leader should review all evidence
and based on this should prepare a site visit briefing document. This should include:
Evidence that requires validation (e.g. selected KPIs, selected chapters of EHRIG self
assessments etc)
Additional information for the hospital to prepare for the site visit team. For example, if
the patient satisfaction rating score is low, the team leader may ask the hospital CEO to
prepare the full results of the patient survey for review at the site visit. If the physician
attrition rate is high the team leader may ask the CEO to provide a breakdown of the
Consultation and finalization of site visit briefing document with site visit team members
The team leader should send the draft site visit briefing document together with all the above
evidence (KPI reports, previous site visit report etc) to all site visit team members. Each team
member should review and give comments.
All team members should then meet in person, or communicate by telephone or email, to
agree the areas to be addressed during the site visit.
The team leader should then assign specific tasks and responsibilities to each team member
and should prepare a schedule for the site visit which describes in detail the role of individual
team members. A sample site visit schedule is presented in Figure 11, below.
After finalization of the site visit briefing document and schedule the team leader should
contact the hospital CEO to confirm the dates of the site visit. The site visit briefing
document and schedule should be sent to the CEO so that he/she can ensure that the required
hospital staff are available on the days of the site visit, and can prepare the additional
evidence requested by the site visit team
After receiving the site visit briefing document and schedule, the hospital CEO should share
these with the senior management team and should prepare any supplementary evidence
requested in the briefing document.
The CEO should inform all hospital staff that a site visit is being conducted; giving a general
overview of the purpose of the site visit and priority areas that the site visit team will review.
In particular, the CEO should ensure that the management and staff of all service areas that
will be visited during the site visit are available on the days of the site visit.
The site visit should last between one to two days, although may be lengthened if necessary.
On arrival at the hospital, the site visit team should first have an opening meeting with the
CEO and SMT to give an overview of the purpose of the site visit, to confirm the schedule
and to receive any additional information that had been requested from the hospital. The
SMT should also be given opportunity to comment on the schedule and to add any areas
that they think are missing and that they would like the site visit team to review. The site
visit team may also take this opportunity to update the SMT on any relevant regional or
national developments that the hospital should be aware of.
The team should then split up, each team member visiting the departments and
services within the hospital as per the planned schedule.
Each team member should prepare detailed notes on their activities during the site visit,
ensuring that the specific questions raised in the site visit briefing document are addressed.
After visiting the different service areas, the site visit team should meet together and should
report back to on their assigned tasks. Together, the team should agree initial findings of the
visit, including strengths and weaknesses of the hospital, recommendations to the hospital
and specific areas that the hospital should address. The team should also identify areas
where additional support from the RHB is required and a provisional date/timeline for the
next site visit.
After the internal meeting among site visit team members alone, the team should then invite
the hospital CEO and SMT to join them for a closing meeting. The team should present their
overall findings as described above, and give opportunity to the SMT to respond to these.
These findings should be seen as provisional, with the possibility of adding further areas
or revising the focus after further reflection.
Following the site visit, the team leader should prepare a detailed report that describes how
the visit was conducted and the main findings and recommendations arising. A template for
a site visit report is presented in Appendix 15.
The report should be reviewed by all site visit team members. When reviewing the
draft report team members should consider:
Does the report present the impression of the hospital that you want it to convey?
Does the report contain the key messages arising from the site visit?
Does the report describe any follow up action that is expected from the hospital?
Does the report identify any follow up action or support that is required from
the RHB?
Will the report help to improve hospital services? If not, how can the report be
improved?
After finalizing the report by the site visit team, the report should be sent to the hospital CEO
who should review and prepare a hospital response & action plan that describes specific
actions that the hospital will take in the light of the report. When reviewing the report the
hospital CEO should consider:
Is the report factually accurate? If not, the CEO should include a correction of any errors
in their written response
What specific actions should the hospital take to address the recommendations made
in the report? In what timeframe?
Does the report describe all areas of support that the hospital expects from the RHB
to assist the hospital to act on the recommendations?
A sample template for the hospital response to a site visit report is presented in Appendix 16.
The CEO should send a copy of the hospital response and action plan to the site visit team
leader.
After finalizing the site visit report and the hospital response, copies of both should be
shared with the RHB Head and all relevant stakeholders. Copies should be kept on file
within the RHB and used as evidence when preparing subsequent site visits and regional
review meetings (see Section 6).
6.1 Purpose
Regular meetings between the RHB and all hospitals in the region provide the opportunity for
communication and experience sharing between the RHB and hospitals. Specifically review
meetings can be used to:
In general the meeting should last for two days, but may be longer if the need arises.
6.4 Participants
a) RHB staff
b) Hospital staff
As a minimum the hospital CEO and Medical Director should attend the
meeting. Additional participants could include other members of the hospital
senior management team and/or the Governing Board Chair.
The FMOH regional focal persons for the region should be invited to attend
since this will maintain strong communication between FMOH, the RHB and
hospitals and will build capacity in FMOH to support the RHB and hospitals
when required.
d) Other
Before each meeting the RHB should determine the venue, set the meeting agenda, identify
participants and send an invitation letter plus agenda to all hospitals, describing which
participants should attend to represent the hospital. Additional partners such as FMOH staff
or NGO partners should be invited as relevant. The invitation letter and agenda should be sent
at least 3 weeks in advance of the meeting, with a follow up email or phone call to confirm
attendance approximately one week in advance of the meeting.
To prepare for each meeting, the RHB should review all hospital KPI reports and the most
recent site visit report and hospital response and action plan. Using these reports the RHB
should identify successes and challenges within individual hospitals or across the region as a
whole.
Based on the findings, the RHB should identify specific hospitals to give presentations or
share experience at the meeting and should inform these hospitals in advance so that the
hospitals can prepare all necessary information.
The meeting should be chaired by the RHB, with additional facilitators for each session or
topic according to need.
Specific individuals from within the RHB, FMOH or partners should be assigned to take
minutes of the meeting.
At each meeting the RHB should give a presentation on the KPI and EHRIG standards
assessment reports from each hospital, including regional averages and recommendations
from the RHB in response to the findings. Other agenda items will vary from meeting to
meeting according to need.
The RHB should prepare minutes and circulate these to all participants within a maximum of
two weeks following the meeting. The minutes may also be sent to others as relevant (for
example the RHB Head and FMOH).
Regular meetings between FMOH and all RHBs provide the opportunity for communication
and experience sharing between regions. Specifically FMOH/RHB meetings can be used to:
In general the meeting will last for two days, but may be longer if the need arises.
7.4 Participants
a) FMOH Staff
All members of the MSD should attend the meeting. Additional FMOH staff
should be invited if the agenda includes topics that are of relevance to them.
b) RHB Staff
Ideally, all members of each CRCPT of all RHBs should attend every
meeting, but as a minimum the RHB core process owner and hospital lead
should be in attendance.
c) Hospital staff
d) Other
Before each meeting FMOH should determine the venue, set the meeting agenda, identify
participants and send an invitation letter plus agenda to all RHBs +/- specific hospitals +/-
other partners as relevant. The invitation letter and agenda should be sent at least 3 weeks in
advance of the meeting, with a follow up email or phone call to confirm attendance
approximately one week in advance of the meeting.
To prepare for each meeting, FMOH should review all regional KPI reports to identify
successes and challenges within individual regions or across the country as a whole.
Based on the findings, FMOH should identify specific RHBs to give presentations or share
experience at the meeting and should inform these RHBs in advance so that the RHB can
prepare all necessary information.
The meeting should be chaired by FMOH, with additional facilitators for each session or
topic according to need.
Specific individuals from within FMOH or partners should be assigned to take minutes of the
meeting.
At each meeting FMOH should give a presentation on the KPI and EHRIG standards
assessment reports from each region, and recommendations from FMOH in response to the
findings. Other agenda items will vary from meeting to meeting.
FMOH should prepare minutes and circulate these to all participants within a maximum of
two weeks following the meeting. The minutes may also be sent to others as relevant (for
example all RHB heads, and other FMOH directors or Ministers).
Background
The Federal Ministry of Health (FMOH) and Regional Health Bureaus (RHB) are leading a
sector wide reform to strengthen and improve health services in Ethiopia. To support these
efforts, the Medical Services Directorate (MSD) of the FMOH, in collaboration with regional
health bureaus (RHBs) and hospital Governing Boards has developed a performance
monitoring framework for hospitals, based on a national core set of 36 Key Performance
Indicators (KPI) which measure hospital performance in the areas of efficiency,
effectiveness, and quality.
The set of KPIs are made up of 59 data elements, which are used in the calculation of the
KPIs. Data elements are collected from sourcing documents at the hospital level and used to
calculate KPIs by “KPI Data Owners”. The hospital “KPI Focal Person” collects all Data
Elements and KPI Results from each and every KPI Data Owner.
The KPI Focal Person is responsible to present the KPI results to the hospital Quality
Committee and CEO. After approval by the CEO the information should be sent to the
RHB. The CEO should also present the KPI results to the hospital Governing Board.
In an effort to support and standardize this process of collection, analysis and dissemination,
an MSExcel tool for hospitals (the „Hospital KPI Database‟) has been developed.
The guidance in this document describes how to use this excel tool in data collection,
reporting, and analysis. Based on the data entered into the tool, automatic tables and reports
are produced that describe an individual hospital‟s overall performance within a given time
period.
Operational Requirements
To use the Hospital KPI Database, Excel 2007 is preferred. Using the tool in Excel 2003 will
compromise some of the functions of the tool and limit its effectiveness in presenting a given
hospital‟s data.
1. Open the empty database and save it for your particular hospital
b. Under the office button highlight “Save As”, click on Excel workbook, and
save under the title of “Hospital_KPI_Database_[your hospital]”
2. Click on the “Hospital_Form” tab and enter the following data into the cells:
b. Reported by should be the name of the KPI Focal Person who was responsible to
collate all the Data Elements and KPI Results from the KPI Owners
c. Approved by: should be the name of the person (most likely the hospital
CEO) who reviewed the data and certified its accuracy
d. The „Approver‟ can enter comments into the comments box if necessary
1. Open the “Data Elements Input Form” under the “Data Elements” tab
2. Don‟t use anything but numbers – remember everything is linked to the data
elements sheet and if there is a problem somewhere else, it is probably the
result of incorrect data entered into the main sheet
3. Enter the data elements collected from the data owners into their respective
cells. Make sure to line up with the proper month and quarter.
a. For Data Elements reported quarterly (Q1, Q2, Q5, Q6, Q7, Q9, Q10, Q27,
Q28, Q50, Q51, Q52, Q53, Q54, Q55, Q56, Q57, Q58, Q59) there is one
box for three months
b. For Data Elements reported bi-annually (Q45, Q46, Q47) there is one box
for six months
c. For Data Elements reported annually (Q48, Q49) there is one box for all
twelve months
NB: Do not try to enter KPI results directly, instead you should ONLY enter the
data elements.
When all of the data elements have been correctly entered into the „Data Elements‟ sheet,
the database will automatically calculate the KPI results and will generate reports for the
different service areas of the hospital.
One report is generated for each of the following service areas: Hospital Management,
Outpatient Services, Emergency Services, Inpatient services, Maternity services, Referral
System, Pharmacy, Productivity, Human Resources, Finance, and Patient Satisfaction.
2. KPI‟s will be generated for all of the reporting periods that data is entered for and will
be displayed in their relevant columns and rows
4. To print reports, select the office button, highlight print, and then choose print (the
report is already formatted so there is no need to alter specifications)
It is possible to set hospital targets for each of the KPI‟s and view them next to the
actual results of the hospital.
To input hospital-level targets into the reports, locate the “Target” row present in each of
the service reports. Input the hospital target for each quarter and it will automatically appear
on the graph, next to actual reported data.
KPI results should be reviewed by the relevant Case Team, by hospital management and by the
Governing Board to identify areas of good performance as well as areas for improvement.
Talking points for the Maternity Service Case Team could include:
Which months are we having higher than average numbers?
Why were some months higher than other months?
How can we anticipate these spikes in the coming years and account for them?
How can we achieve targets across every month of the year?
Why was the maternal mortality ratio high in the months of Tikimt and Ginbot?
Why was the neonatal death rate high in the months of Tehasas and Tir?
Regional Health Bureaus require hospitals to submit KPI reports every month.
Ideally the database should be sent electronically to the RHB by email. If this is not possible
then hard copies of the „Data Element‟ and „KPI_All‟ spreadsheets should be printed and
faxed to the RHB.
Please note that the RHB requires the „Data Elements‟ in addition to the KPI results so
that regional averages can be calculated.
Background
The Federal Ministry of Health (FMOH) and Regional Health Bureaus (RHB) are leading a
sector wide reform to strengthen and improve health services in Ethiopia. Central to these
efforts is the Ethiopian Hospital Reform Implementation Guidelines (EHRIG) which sets out
124 operational standards for hospital management in the areas of:
- Hospital leadership and governance
- Patient flow
- Medical records management
- Pharmacy services
- Laboratory services
- Nursing care standards
- Infection prevention
- Facilities management
- Medical equipment management
- Financial and asset management
- Human resource management
- Quality management
- Monitoring and reporting.
Hospitals are expected to improve their internal management systems in order to attain all
124 EHRIG standards. Hospitals should self-assess their attainment of the EHRIG
standards every quarter and should submit these EHRIG reports to their RHB.
To assist hospitals to record and analyze the attainment of EHRIG standards, and to monitor
changes over time, an MSExcel tool has been created (the „Hospital_EHRIG_Database).
The guidance in this document describes how to use the Hospital EHRIG Database for data
collection, reporting, and analysis. Based on the data entered into the tool, tables and charts
are automatically generated that show the hospital‟s progress towards the attainment of
standards over time.
Operational Requirements
To use the Hospital EHRIG Database, Excel 2007 is preferred. Using the tool in Excel 2003
will compromise some of the functions of the tool and limit its effectiveness in presenting the
hospital‟s data.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 101
Overview of Hospital EHRIG Database
1) Data Input
This is the Master spreadsheet into which the attainment of standards should be entered.
The spreadsheet covers the time period Q1 2004 until Q4 2004.
The rows are organized by EHRIG chapter. Each row represents a single management
standard of EHRIG. At the bottom of the standards for each chapter there are two rows in
which the cells automatically calculate the total number and % of standards met for that
particular chapter. The final two rows of the spreadsheet show the total number of
standards met and total % of standards met for all chapters combined.
First enter the name of your hospital at the top of the spreadsheet. Then, to enter data,
identify the appropriate column in accordance with the time period of the report (Q1 2004,
Q2 2004 etc). Transcribe the hospital EHRIG assessment results into the appropriate cell on
the spreadsheet. If a standard is „met‟ enter the number 1. If the standard is unmet enter the
number 0.
As you enter the data, the spreadsheet will automatically calculate the total number and % of
standards met for each chapter, as well as the total number and % for all chapters combined.
This spreadsheet contains tables and charts that are calculated automatically from the
entered data.
These show the % of EHRIG standards that are attained for each management area and
the total attainment of standards by the hospital, for Q1 2004 until Q4 2004.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 102
Elmer Hospital
100%
90%
80%
70%
60%
50%
40%
30% Q1 2004
20%
10% Q2 2004
0%
Q3 2004
Q4 2004
Regional Health Bureaus require hospitals to submit EHRIG reports every quarter.
Ideally the database should be sent electronically to the RHB by email. If this is not possible
then hard copies of the „Data Entry‟ spreadsheet should be printed and faxed to the RHB.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 103
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 104
Appendix 3 User Guide: Regional KPI Database
Background
The Federal Ministry of Health (FMOH) and Regional Health Bureaus (RHB) are leading a
sector wide reform to strengthen and improve health services in Ethiopia. To support these
efforts, the Medical Services Directorate (MSD) of the FMOH, in collaboration with regional
health bureaus (RHBs) and hospital Governing Boards has developed a performance
monitoring framework for hospitals, based on a national core set of 36 Key Performance
Indicators (KPI) which measure hospital performance in the areas of efficiency,
effectiveness, and quality.
The set of KPIs are made up of 59 data elements, which are used in the calculation of the
KPIs. Data elements are collected from sourcing documents at the hospital level and used to
calculate KPIs by “KPI Data Owners”. The hospital “KPI Focal Person” collects all Data
Elements and KPI Results from each and every KPI Data Owner and, after approval by the
CEO, submits to the RHB.
The RHB should collate and analyze KPI reports from all hospitals in the Region,
give feedback to hospitals, and should calculate Regional average KPI results based
on the hospital data.
In an effort to support and standardize this process of collection, analysis and dissemination,
an MSExcel tool has been developed for each Region (the „Regional_ KPI_ Database_[your
region]‟).
The guidance in this document describes how to use this excel tool in data collection,
reporting, and analysis. Based on the data entered into the tool, automatic tables and reports
are produced that describe the region‟s overall performance within a given time period.
Operational Requirements
To use the Regional KPI Database, Excel 2007 is preferred. Using the tool in Excel 2003
will compromise some of the functions of the tool and limit its effectiveness in presenting a
given hospital‟s data.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 105
Entering Regional Information
1. Open the empty database and save it for your particular region
2. Click on the “Region_Form” tab and enter the following data into the cells:
a. Region name
b. Reporting period: month and year
c. Name of each hospital in the region
d. For each hospital enter „yes‟ or „no‟ to indicate if the hospital has submitted
its monthly KPI report
e. Enter the name of the person who compiled the report and the date the report was
compiled
f. Enter the name of the person who reviewed and approved the report, and the date
of approval. Generally the „Approver‟ would be the RHB Curative and
Rehabilitative Core Process Owner
4. Enter the data elements reported by the hospitals into their respective cells. Make
sure to line up with the proper month and quarter.
For Data Elements reported quarterly (Q1, Q2, Q5, Q6, Q7, Q9, Q10, Q27, Q28, Q50,
Q51, Q52, Q53, Q54, Q55, Q56, Q57, Q58, Q59) there is one box for three months.
For Data Elements reported bi-annually (Q45, Q46, Q47) there is one box for six months.
For Data Elements reported annually (Q48, Q49) there is one box for all twelve months.
Don‟t use anything but numbers – remember everything is linked to the data elements
sheet and if there is a problem somewhere else, it is probably the result of incorrect data
entered into the main sheet.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 106
Analyzing Data and Producing Reports
When all of the data elements have been correctly entered into the „Data Elements‟ sheet, the
database will automatically calculate the KPI results and will generate reports for the region.
KPI‟s will be generated for all of the reporting periods that data is entered for and will
be displayed in their relevant columns and rows.
Do not try to enter KPI results directly, instead you should ONLY enter the data elements.
6. To view reports for each KPI (Leadership and Governance, Patient Flow etc) click on the
appropriate tab.
A table is displayed that shows the quarterly KPI result for each hospital, together with
charts for each quarter.
7. To print reports, select the office button, highlight print, and then choose print (the
report is already formatted so there is no need to alter specifications)
It is possible to set regional targets for each of the KPI‟s and view them next to the
actual results of the region.
Enter the quarter and annual targets for each KPI into the appropriate cells.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 107
The targets will automatically appear on the KPI reports, next to the actual data in the
tables and graphs.
KPI results should be reviewed by the RHB and feedback given to hospitals. The RHB could
present regional reports at the RHB/hospital review meetings and at the MSD/RHB review
meetings.
Ideally the database should be sent electronically to MSD by email. If this is not possible then
hard copies of the „Data Element‟ and „KPI_Master‟ spreadsheets should be printed and
faxed to the RHB.
Please note that MSD requires the „Data Elements‟ in addition to the KPI results so
that national averages can be calculated.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 108
Appendix 4 User Guide: Regional EHRIG Database
Background
The Federal Ministry of Health (FMOH) and Regional Health Bureaus (RHB) are leading a
sector wide reform to strengthen and improve health services in Ethiopia. Central to these
efforts is the Ethiopian Hospital Reform Implementation Guidelines (EHRIG) which sets out
124 operational standards for hospital management in the areas of:
- Hospital leadership and governance
- Patient flow
- Medical records management
- Pharmacy services
- Laboratory services
- Nursing care standards
- Infection prevention
- Facilities management
- Medical equipment management
- Financial and asset management
- Human resource management
- Quality management
- Monitoring and reporting.
Hospitals are expected to improve their internal management systems in order to attain all
124 EHRIG standards. Hospitals should self-assess their attainment of the EHRIG
standards every quarter and should submit these EHRIG reports to their RHB.
RHBs are expected to receive and review hospital reports and to calculate regional averages.
By monitoring progress towards attainment of EHRIG standards across the region, each RHB
can identify priority areas for improvement and can identify areas where hospitals require
additional support from the RHB or other partners.
To assist RHBs to record and analyze the attainment of EHRIG standards by hospitals in the
Region, and to monitor changes over time, an MSExcel tool has been created for each RHB
(the „Regional_EHRIG_Database_[your region]). Each Regional Database lists all hospitals
in the region by name, and contains data entry cells for every one of the hospitals.
The guidance in this document describes how to use the Regional EHRIG Databases for data
collection, reporting, and analysis. Based on the data entered into the tool, automatic tables
and reports are produced that describe each hospital‟s overall performance within a given
time period and the average performance for the region as a whole.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 109
Operational Requirements
To use the Regional EHRIG Database, Excel 2007 is preferred. Using the tool in Excel 2003
will compromise some of the functions of the tool and limit its effectiveness in presenting a
given hospital‟s data.
to establish a database in which to record self-assessment reports from all hospitals in the
region on the attainment of management standards that are described in EHRIG
to assist the RHB with the analysis of data, by providing summary calculations, tables
and charts, all of which are generated automatically when data is entered
to generate summary calculations, tables and charts from which reports and
presentations can be prepared both for the RHB and for dissemination to hospitals,
FMOH and other stakeholders
to provide data analysis that will support hospital supervisory site visits and regional
review meetings
This is the Master spreadsheet into which hospital reports should be entered. The spreadsheet
covers the time period Q1 2004 until Q4 2004.
The rows are organized by EHRIG chapter. Each row represents a single management
standard of EHRIG. At the end of the list of standards for each chapter there are two rows
in which the cells automatically calculate the total number and % of standards met for that
particular chapter.
The final two rows of the spreadsheet show the total number of standards met and total %
of standards met for all chapters combined.
There are separate columns for each hospital. The hospital names are listed across the top
row, and for each hospital there is a separate column for each quarter. To make it easier to
enter and analyze data the columns are colour coded (ie all columns for Q1 2004 are coloured
blue, for Q2 2004 are coloured pink etc).
The final columns are labeled „Regional Average‟. These show the average of all hospitals
in the region combined.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 110
Data entry
a) Identify the hospital name at the top of the spreadsheet, and the appropriate column
for data entry (in accordance with the time period of the report – Q1 2004, Q2 2004
etc)
b) Transcribe the hospital EHRIG assessment results into the appropriate cell on the
spreadsheet. If a hospital reports that a standard is „met‟ enter the number 1. If
the standard is unmet enter the number 0.
As you enter the data, the spreadsheet will automatically calculate the total number and %
of standards met for each chapter, as well as the total number and % for all chapters
combined and the regional averages.
Similarly, the database will automatically create the tables and charts contained in
the remaining three spreadsheets.
You do not need to do any calculations. Only enter the raw data reported by
the hospital. All summaries, tables and charts will be created automatically.
When you enter data for a new quarter update the file name to show the date of the
most recent reports. I.e. “Regional _EHRIG_Database_[your region]_Q1 2004” should
become “Regional _EHRIG_Database_[your region]_Q2 2004” when Q2 data is entered.
i) % standards met, regional average, by chapter: The table lists the Regional
Average % of standards met (all hospitals combined) for each quarter. There is
also a bar chart which presents this information in graphical form.
ii) Total % of standards met, by hospital: The table lists all hospitals and the total %
of standards met by each, together with the Regional Average. The table includes
all quarters between Q3 2010 and Q4 2011. There is also a bar chart which
presents this information in graphical form.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 111
5) Individual hospital data and charts
This spreadsheet contains tables and charts - one for each hospital. The tables show the % of
standards met in each EHRIG chapter by each hospital and also the total % of standards met
by that hospital (all chapters combined). The tables include all quarters between Q1 2004 and
Q4 2004. The charts show the same information in graphical form.
This spreadsheet contains 13 tables and charts – one for each chapter of EHRIG. The tables
show the % of standards met in that particular EHRIG chapter by each hospital, and the
regional average % of standards met in that chapter. The tables include all quarters
between Q1 2004 and Q4 2004. The charts show the same information in graphical form.
The data in the excel file is „Information for Action‟. In other words it is not enough
to enter data, you must look at the results, interpret what they mean and decide what
action should be taken as a result.
- Which hospitals are performing well overall (all chapters combined)? Which
are performing poorly?
- For each individual chapter of EHRIG which hospitals are performing well and
which are performing poorly?
- Which hospitals are showing the most progress over time? Which hospitals are
showing the least progress?
- How is the Region as a whole performing? In which chapters is performance good
or improving across the Region? In which chapters is performance poor or showing
no improvement? Overall, is the Region improving with time?
- What action should be taken by specific hospitals based on the information? What
action should be taken by the RHB?
- Are there any unusual or unexpected results (either good or bad) that should
be questioned or investigated further to check the accuracy of data?
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 112
Providing Data to MSD
Each RHB should provide quarterly reports to MSD on the attainment of EHRIG
standards by each hospital in the Region.
Ideally, the RHB should email an electronic copy of the Database to MSD. If this is not
possible then the Data Input Spreadsheet should be printed and faxed to MSD.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 113
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 114
Appendix 5 Hospital Key Performance Indicator Definitions and Calculations
Why is this In order to provide quality, effective and efficient health care, hospitals must
important? have well functioning management systems.
The EHRIG operational standards for hospital reform are a set of minimum
standards that a well functioning hospital should have in place. There are a
total of 124 standards across 13 management areas:
Hospital Leadership and Governance (6 standards)
Patient Flow (13 standards)
Medical Records Management (6 standards)
Pharmacy Services (12 standards)
Laboratory Services (11 standards)
Nursing Care (6 standards)
Infection Prevention (8 standards)
Facilities Management (14 standards)
Medical Equipment Management (9 standards)
Financial and Asset Management (11 standards)
Human Resource Management (13 standards)
Quality Management (8 standards)
Monitoring and Reporting (7 standards)
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 115
Hospital KPI 1 Data entry form: % of EHRIG operational standards met
Formula: Total number of EHRIG operational standards met (Q1) ÷ 124 (i.e. the total number
of EHRIG operational standards for hospital management) (Q2) x 100
Data entry:
Hospital Leadership and Governance Standards Met = _____
Patient Flow Standards Met = _____
Medical Records Management Standards Met = _____
Pharmacy Services Standards Met = _____
Laboratory Services Standards Met = _____
Nursing Care Standards Met = _____
Infection Prevention Standards Met = _____
Facilities Management Standards Met = _____
Medical Equipment Management Standards Met = _____
Financial and Asset Management Standards Met = _____
Human Resource Management Standards Met = _____
Quality Management Standards Met = _____
Monitoring and Reporting Standards Met = _____
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 116
KPI 2 Outpatient Attendances
Why is this Hospitals need to know the number of patients treated (inpatient,
important? outpatient and emergency) in order to plan staff numbers, equipment and
supply needs. This information informs the annual plan and budget
preparations. By monitoring the number of patients treated a hospital can
also assess if patient demand is increasing or decreasing over time and
investigate further if unexpected changes are seen.
For the RHB, knowledge of the number of patients treated at each hospital
is necessary to calculate population health service coverage rate, assess
access to healthcare services and to plan health care services for the
region.
Definition Total number of new and repeat outpatient attendances (including
specialized clinics). Patients who attend the following services should be
INCLUDED in the outpatient count:
General outpatient clinics
Specialty outpatient clinics (including Dental, Ophthalmic and
Psychiatry)
TB clinics
ART clinics
VCT clinics
MCH clinics (EPI, IMCI, well baby clinics, ANC, PNC, family
planning etc)
Private wing clinics
EXCLUDE:
All patients attending the emergency department
All emergency maternity attendances (any gestational age)
Unit of Absolute number
measurement
Formula Number of new and repeat outpatient attendances at public facility (Q3) +
Number of new and repeat outpatient attendances at private wing (Q4)
Data sources Outpatient registration books/database; private wing registration
book/database; central registration book/database; HMIS tally forms
Frequency of Monthly
reporting
Formula: Number of new and repeat outpatient attendances at public facility (Q3) +
number of new and repeat outpatient attendances at private wing (Q4)
Date entry:
Q3 = Number of new and repeat outpatient attendances at public facility = ___________
Q4 = Number of new and repeat outpatient attendances at private wing = __________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 117
KPI 3 Outpatient attendances seen by private wing service
Why is this Through Health Care Finance Reform (HCFR), hospitals are permitted to establish
important? a private wing service. The number of outpatient visits to the private wing service,
and the proportion of all outpatient visits that are seen at the private wing, are
measures of service availability, patient demand for private wing services and of
the success of HCFR implementation by the hospital.
Definition The proportion of all outpatient visits that are seen at the private wing service.
Private wing outpatients includes both new and repeat outpatient visits that are
seen by the private wing service
All outpatient visits includes all new and repeat visits to any outpatient clinic,
including:
General Outpatient clinics
Specialty outpatient clinics (including Dental, Ophthalmic, Psychiatry etc)
TB clinics
ART clinics
VCT clinics
MCH clinics (EPI, IMCI, well baby clinics, ANC, PNC, family planning
etc)
Private wing clinics
EXCLUDE:
All patients attending the emergency department
All emergency maternity attendances (any gestational age)
Unit of %
measurement
Numerator Number of new and repeat outpatient attendances at private wing (Q4)
Denominator Number of new and repeat outpatient attendances at public facility (Q3) + Number
of new and repeat outpatient attendances at private wing (Q4)
Formula Number of new and repeat outpatient attendances at private wing (Q4) ÷ [Number
of new and repeat outpatient attendances at public facility (Q3) + Number of new
and repeat outpatient attendances at private wing (Q4)] x 100
Data sources Outpatient registration books; private wing registration book or central registration
book/database; HMIS tally forms
Frequency of Monthly
reporting
Hospital KPI 3 Date Entry Form: Outpatient attendances seen by private wing service
Formula: Number of new and repeat outpatient attendances at private wing (Q4) ÷
[(Number of new and repeat outpatient attendances at public facility (Q3) +
Number of new and repeat outpatient attendances at private wing (Q4)] x 100
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 118
KPI 4: Outpatient waiting time to treatment
Why is this The time that a patient waits from arrival to treatment is a measure of access to
important? health care services. Long waiting times indicate that there are insufficient staff
and/or resources to handle the patient load or that those available resources are
being used inefficiently.
By measuring waiting times a hospital can assess if there is a need for extra
personnel and/or other resources in the outpatient department and/or to review
patient flow processes to increase the efficiency of service provision.
Definition Average time from arrival at the outpatient department to treatment consultation
with clinical staff member (minutes)
For patients who have an appointment and who go immediately to the OPD
waiting area (without attending registration or triage), the time of arrival begins
at the time when they reach the OPD waiting area.
For patients who do not have an appointment, the time of arrival means the time
of arrival at the patient registration or the time of arrival at triage (whichever is
first)
EXCLUDE:
Patients not seen on the same day
Unit of Minutes
measurement
Numerator Sum total of outpatient waiting time (in minutes) (Q5)
Denominator Number of outpatient waiting time cards completed (Q6)
Formula Sum total of outpatient waiting time (in minutes) (Q5) ÷ Number of outpatient
waiting time cards completed (Q6)
Data sources Survey – see protocol for survey to measure OPD wait time in Appendix 7
The survey should be conducted on Monday and Thursday of the first week of
the last month of each quarter
Frequency of Quarterly
reporting
Formula: ∑Outpatient waiting time (in minutes) (Q5) † Number of outpatient „waiting
time cards‟ completed (Q6)
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 119
KPI 5: Outpatients not seen on same day
Why is this All patients should be seen in OPD on the same day that they register
important? for treatment. By measuring the number and proportion of patients
that do not receive a same day service the hospital can assess if there
is a need for extra personnel and/or other resources in the outpatient
department and/or to review patient flow processes to increase the
efficiency of service provision.
Definition The proportion of all outpatients that do not receive treatment on the
same day as registration in the outpatient department
Unit of %
measurement
Numerator Number of outpatients not seen on same day as registration in OPD
during the reporting period (Q7)
Denominator Number of new and repeat outpatient attendances at public facility
(Q3) + Number of new and repeat outpatient attendances at private
wing (Q4)
Formula Number of outpatients not seen on same day as registration during the
reporting period (Q7) ÷ [Number of new and repeat outpatient
attendances at public facility (Q3) + Number of new and repeat
outpatient attendances at private wing (Q4)] x 100
Data sources OPD registration book
Frequency of Quarterly
reporting
Hospital KPI 5 Date Entry Formula: Outpatients not seen on same day
Formula: [Number of outpatients not seen on same day as registration during the
reporting period (Q7) ÷ [Number of new and repeat outpatient attendances at
public facility (Q3) + Number of new and repeat outpatient attendances at
private wing (Q4)] x 100
Data entry: Q7= number of outpatients not seen on same day as registration during the
reporting period = __________ patients
Q3 = number of new and repeat outpatient attendances at public facility
Q4 = number of new and repeat outpatient attendances at private wing
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 120
KPI 6: Emergency room attendances
Why is this Hospitals need to know the number of patients treated (inpatient,
important? outpatient and emergency) in order to plan staff numbers, equipment
and supply needs. This information informs the annual plan and
budget preparations. By monitoring the number of patients treated a
hospital can also assess if patient demand is increasing or decreasing
over time and investigate further if unexpected changes are seen.
INCLUDE:
All patients registered in the emergency room (all ages)
EXCLUDE:
All patients triaged and sent to OPD
Patients who were already dead (i.e. no vital signs present) on
arrival
Unit of Absolute number
measurement
Formula Number of emergency room attendances (Q8)
Data sources Emergency room registration book
Frequency of Monthly
reporting
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 121
KPI 7: Emergency room patients triaged within 5 minutes of arrival
Why is this Triage is a process of sorting patients into priority groups according to
important? their need and available resources. The aim of triage is to give priority
treatment to those with the most critical conditions, thus minimizing delay,
saving lives, and making the most efficient use of available resources. The
first five minutes of arrival in the emergency room (ER) is the most critical
time to save lives. If assessment and treatment is not initiated during this
time then lives will be lost unnecessarily.
KPI 7: Data Entry Form: Emergency room patients triaged within 5 minutes of arrival
Formula: Number of surveyed patients who undergo triage within 5 minutes of arrival in
emergency room (Q9) ÷ Number of patients included in emergency room
triage time survey (Q10) x 100
Data entry:
Q9 = Number of surveyed patients who undergo triage within 5 minutes of arrival
in emergency room = ____________
Q10 = Number of patients included in emergency room triage time survey = ______
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 122
KPI 8: Emergency room attendances with length of stay > 24 hours
Why is this important? Through BPR and other hospital reforms, emergency medical
services are being strengthened. Hospitals have emergency
room beds where patients can stay for a short period of time
to receive emergency treatment. However, the length of stay
in the emergency room should always be less than 24 hours.
If a patient requires treatment for longer than 24 hours then
he/she should be transferred to a ward. If emergency room
beds are occupied by patients for more than 24 hours then the
emergency room will become congested and there is a danger
that the emergency room will not have the capacity for any
NEW emergency attendances.
Definition The proportion of all emergency room attendances who
remain in the emergency room for > 24 hours
INCLUDE:
All patients registered in the emergency room (all
ages)
EXCLUDE:
Patients who were already dead (i.e. no vital signs
present) on arrival
Unit of measurement %
Numerator Total number of attendances who remain in emergency room
for more than 24 hrs (Q11)
Denominator Total number of emergency room attendances (Q8)
Formula Total number of attendances who remain in emergency room
for more than 24 hrs (Q11) ÷ Total number of emergency
room attendances (Q8) x 100
Data sources Emergency room registration book
Frequency of reporting Monthly
KPI 8 Data Entry form: Emergency room attendances with length of stay > 24 hours
Formula: Total number of attendances who remain in emergency room for more than 24
hrs (Q11) ÷ Total number of emergency room attendances (Q8) x 100
Data entry: Q11 = Number of patients who remain in emergency room for > 24 hrs = ______
Q8 = Total number of emergency room attendances = _______________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 123
KPI 9: Emergency room mortality
Why is this The emergency room mortality is a measure of the quality of care
important? provided by the emergency room of the hospital. A high mortality
could indicate that the hospital is providing poor quality emergency
care with unnecessary patient deaths.
Definition The number of deaths in emergency room from patients who were alive
(i.e. any vital signs present) on arrival per 100 emergency room
attendances.
INCLUDE:
All deaths in emergency room from patients who were alive (i.e. any
vital signs present) on arrival
EXCLUDE:
Patients who were already dead (i.e. no vital signs present) on arrival
Unit of %
measurement
Numerator Number of deaths in emergency room from patients who were alive
(i.e. any vital signs present) on arrival (Q12)
Denominator Number of emergency room attendances (Q8)
Formula Number of deaths in emergency room from patients who were alive
(i.e. any vital signs present) on arrival (Q12) ÷ Number of emergency
room attendances (Q8) x 100
Data sources Emergency room register/database
Frequency of Monthly
reporting
Formula: The number of deaths in emergency room from patients who were alive (i.e.
any vital signs present) on arrival (Q12) ÷ Total number of emergency room
attendances (Q8) x 100
Data entry: Q12 = The number of deaths in emergency room from patients who were
alive (i.e. any vital signs present) on arrival Number of deaths in ER from
patients who were alive on arrival = ________
Q8 = Total number of emergency room attendances = _________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 124
KPI 10: Inpatient admissions
Why is this important? Hospitals need to know the number of patients treated (inpatient,
outpatient and emergency) in order to plan staff numbers,
equipment and supply needs. This information informs the annual
plan and budget preparations. By monitoring the number of
patients treated a hospital can also assess if patient demand is
increasing or decreasing over time and investigate further if
unexpected changes are seen.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 125
KPI 11: Inpatients admitted to private wing service
Why is this important? Through Health Care Finance Reform (HCFR) hospitals are
permitted to establish a private wing service.
Hospital KPI 11 Date Entry Form: Inpatients admitted to private wing service
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 126
KPI 12: Inpatient mortality
Why is this The inpatient mortality is a measure of the quality of care provided by
important? the hospital. High inpatient mortality could indicate that the hospital is
providing poor quality care with unnecessary patient deaths.
Definition The number of deaths per 100 discharged inpatients.
INCLUDE:
All deaths among patients admitted to public facility
Private wing inpatient deaths
EXCLUDE:
All deaths in emergency room
All deaths among non admitted maternities (any gestation)
Unit of %
measurement
Numerator Number of deaths among admitted inpatients (Q15)
Denominator Number of deaths among admitted inpatients (Q15) + Number of
patients discharged alive (including transfers out) (Q16)
Formula Number of deaths among admitted inpatients (Q15) ÷ [Number of
deaths among admitted inpatients (Q15) + Number of patients
discharged alive (including transfers out) (Q16) x 100
Data sources Discharge registration book
Frequency of Monthly
reporting
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 127
KPI 13: Delay for elective surgical admission
Why is this Delays in surgery for different conditions are associated with a significant
important? increase in morbidity and mortality.
Through BPR, the Government has set a stretch objective that any
outpatient who requires a bed should receive the service within 2 weeks.
By monitoring the waiting time for surgical admission, hospitals can assess
the adequacy of surgical capacity and identify the need for improved
efficiency in systems and processes, and/or the need for additional surgical
staff and/or resources.
Definition The average number of days that patients who underwent elective surgery
during the reporting period waited for admission (i.e. the average number of
days between the date each patient was added to the waiting list to their date
of admission for surgery)
Unit of Days
measurement
Numerator Sum total of number of days between date added to surgical waiting list to
date of admission for surgery (Q17)
EXCLUDE:
Elective Caesarean Sections
Emergency Surgery
NB: If a cold case patient is admitted on the same day that the decision for
surgery is made then their number of days on the waiting list should be
counted as zero.
Denominator Number of patients who were admitted for elective (non-emergency)
surgery during the reporting period (Q18)
Formula Sum total of number of days between date added to surgical waiting list to
date of admission for surgery (Q17) ÷ Number of patients who were
admitted for elective (non-emergency) surgery during the reporting period
(Q18)
Data sources Surgical registration book
Frequency of Monthly
reporting
Hospital KPI 13 Date Entry Form: Delay for elective surgical admission
Formula: ∑number of days between date added to surgical waiting list to date of
admission for surgery (Q17) ÷ The total number of patients who were
admitted for elective (non-emergency) surgery during the reporting period
(Q18)
Data entry: Q17 = ∑number of days between date added to surgical waiting list to date of
admission for surgery = ______________
Q18 = The total number of patients who were admitted for elective (non-
emergency) surgery during the reporting period = _________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 128
KPI 14: Bed occupancy
Why is this The bed occupancy rate (BOR) is a measure of the efficiency of inpatient
important? services. Hospitals are most efficient at a BOR of 80 – 90%. If the BOR is lower,
resources may be wasted. If the BOR is higher than 90% there is a danger of
staff burnout and of over-crowding during sudden increases in demand for
services.
Knowledge of the BOR helps hospitals to identify inefficiencies in service
delivery in order to investigate and take action to address this, and also to plan
for future staff or other resource requirements.
For a RHB, knowledge of the BOR from each hospital helps to assess health
service coverage and population access to services as a foundation for health
service planning.
Definition The average percentage of occupied beds during the reporting period
Unit of measurement %
Numerator The sum total length of stay in days during the reporting period (Q19)
NB: The length of stay should ONLY be counted for the actual reporting period.
If a patient was admitted during a previous reporting period their length of stay
during that previous reporting period should not be counted. Instead, FOR THIS
KPI, the patient‟s length of stay should be counted from the first day of this
reporting period to the time of discharge, death or to the end of the reporting
period (whichever is first).
INCLUDE:
Patients admitted to public facility
Patients admitted to private wing
Denominator Average number of operational beds during reporting period (Q20) x number of
days in reporting period (Q21)
An operational (inpatient) bed INCLUDES:
Beds in wards
Beds in clinical facilities (e.g. intensive care units, ophthalmic units
where patients are routinely kept for > 24 hours)
Beds temporarily out of use
Beds/cots in neonatal units
Private wing beds
The following should be EXCLUDED:
Beds in emergency room or emergency gynecology departments
Beds in day units/day surgery
Temporary beds, e.g. stretchers or trolleys
Observation or recovery beds in the emergency department, operating
room or outpatient department
Labour suite beds, e.g. delivery beds/couches, examination beds
Beds for non-patients (e.g. beds for mothers accompanying children)
Beds/cots for healthy babies who are born in the hospital or accompany
their mothers
Formula The sum total length of stay in days during reporting period (Q19) ÷ [Average
number of operational beds during reporting period (Q20) x number of days in
reporting period (Q21)] x 100
Data sources Admission/discharge registration books
Frequency of Monthly
reporting
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 129
Hospital KPI 14 Date Entry Form: Bed Occupancy
Formula: The sum total length of stay in days during reporting period (Q19) ÷ [Average
number of operational beds during reporting period (Q20) x number of days
in reporting period (Q21)] x 100
Data entry: Q19 = The sum total length of stay in days during reporting period = __________
Q20 = Average number of operational beds during reporting period = _________
Q21 = Number of days in reporting period = ___________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 130
KPI 15: Average length of stay (ALOS)
Why is this By monitoring length of stay hospitals can assess if patients remain in hospital for longer
important? than is necessary, perhaps due to non clinical reasons, and investigate further if required.
Definition The average number of days from admission to discharge, death or transfer out.
INCLUDE:
Inpatient discharges: discharge is the process by which a patient completes a hospital
stay and is discharged from an inpatient ward.
Transfer outs: These are patients who are directly transferred from an inpatient ward to
another hospital.
Deaths: All deaths of patients admitted to an inpatient ward should be included
Patients admitted to public facility
Patients admitted to private wing
Unit of Days
measurement
Numerator Sum of total length of stay for patients who were discharged (including deaths and transfer
outs) during reporting period (Q22)
NB: For this KPI the total length of stay should be counted for all discharged patients,
Formula: Sum of total length of stay for patients discharged (including deaths and
transfer outs) during reporting period (Q22) ÷ [Number of patients discharged
alive (including transfers out) (Q16) + Number of deaths among admitted
inpatients (Q15)]
Data entry:
Q22 = Sum of total length of stay for patients discharged (including deaths and transfer
outs) during reporting period = ______________
Q15 = Number of deaths among admitted inpatients = ____________
Q16 = Number of patients discharged alive (including transfers out) = ________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 131
KPI 16: Pressure ulcer incidence
Why is this This is an indicator of the quality of care performed by nursing staff in
important? a hospital. Poor nursing care, with inadequate turning of patients in
their bed can lead to the development of a pressure ulcer (also called
bed ulcer or decubitus ulcer). Pressure ulcers can be fatal when
allowed to progress without treatment.
By measuring the pressure ulcer rate hospitals can assess the quality
of nursing care provided and take action to address any problems
identified.
Definition Proportion of inpatients who develop a pressure ulcer during their
hospital stay.
INCLUDE:
New pressure ulcers that arise during the patients admission,
during the reporting period
EXCLUDE:
Pressure ulcers that were already present at the time of
admission
Pressure ulcers that developed in a previous reporting period
Unit of %
measurement
Numerator Number of inpatients who develop a new pressure ulcer during the
reporting period (Q23)
Denominator Number of patients discharged alive (including transfers out) (Q16) +
Number of deaths among admitted inpatients (Q15)
Formula Number of inpatients who develop a new pressure ulcer during the
reporting period (Q23) ÷ [Number of patients discharged alive
(including transfers out) (Q16) + Number of deaths among admitted
inpatients (Q15)] x 100
Data sources Routine surveillance - Pressure ulcer report form (see Appendix 9)
Frequency of Monthly
reporting
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 132
Hospital KPI 16 Date Entry Form: Pressure Ulcer Incidence
Formula Number of inpatients who develop a new pressure ulcer during the reporting
period (Q23) ÷ [Number of patients discharged alive (including transfers out)
(Q16) + Number of deaths among admitted inpatients (Q15) x 100
Data entry:
Q23 = Number of inpatients who develop a new pressure ulcer during the
reporting period = ____________
Q15 = Number of deaths among admitted inpatients = ___________
Q16 = Number of patients discharged alive (including transfers out) = _________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 133
KPI 17: Surgical site infection
Why is this Infection at the site of surgery may be caused by poor infection prevention
important? practices in the operating room or on the ward after completion of surgery. The
surgical site infection rate is an indicator of the quality of medical care received
by surgical patients and an indirect measure of infection prevention practices in
the hospital. By monitoring surgical site infection hospitals can assess the
adequacy of infection prevention practices in the hospital and take action to
address any problems identified.
Definition Proportion of all major surgeries with an infection occurring at the site of the
surgical wound prior to discharge. One or more of the following criteria should
be met:
Purulent drainage from the incision wound
Positive culture from a wound swab or aseptically aspirated fluid or
tissue
Two of the following:
o wound pain or tenderness
o localized swelling
o redness
o heat
Spontaneous wound dehiscence or deliberate wound revision/opening
by the surgeon in the presence of:
o pyrexia > 38C or
o localized pain or tenderness
An abscess or other evidence of infection involving the deep incision
that is found by direct examination during re-operation, or by
histopathological or radiological examination
A major surgical procedure is defined as any procedure conducted under
general, spinal or major regional anaesthesia.
Unit of measurement %
Numerator Number of inpatients with new surgical site infection arising during the
reporting period (Q24)
INCLUDE:
Patients undergoing surgery in public facility
Private wing surgical cases
Denominator Number of major surgeries (both elective & non-elective) performed during the
reporting period on public patients (Q25) + Number of major surgeries (both
elective & non-elective) performed during the reporting period on private wing
patients (Q26)
Formula Number of inpatients with new surgical site infection arising during the
reporting period (Q24) ÷ [Number of major surgeries (both elective & non-
elective) performed during the reporting period on public patients (Q25) +
Number of major surgeries (both elective & non-elective) performed during the
reporting period on private wing patients (Q26)] x 100.
Data sources Routine surveillance – Surgical Site Infection Report Forms (See Appendix 10)
At the end of the reporting period the number of Surgical Site Infection Forms
completed during that period should be tallied from each surgical inpatient
ward.
Frequency of reporting Monthly
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 134
Hospital KPI 17 Date Entry Form: Surgical Site Infection
Formula: Number of inpatients with new surgical site infection arising within the
reporting period (Q24) ÷ [Total number of major surgeries (both elective &
non-elective) performed during the reporting period on public patients (Q25) +
Total number of major surgeries (both elective & non-elective) performed
during the reporting period on private wing patients (Q26)] x 100.
Data entry:
Q24 = Number of inpatients with new surgical site infection arising within the
reporting period = __________________
Q25 = Total number of major surgeries (both elective & non-elective) performed
during the reporting period on public patients = _______________
Q26 = Total number of major surgeries (both elective & non-elective) performed during
the reporting period on private wing patients = _________________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 135
KPI 18: Completeness of inpatient medical records
Why is this Complete and accurate medical records are essential to maintain the
important? continuity of patient care and ensure that the health provider has full
information about the patient when providing healthcare.
Through HMIS a standardized medical record has been introduced
nationwide. The completeness of this medical record is a measure of
the quality of care provided at the hospital.
Definition Proportion of elements completed of the minimum elements of an
inpatient medical record.
The MINIMUM elements are*:
- Patient Card (Physician notes) – present and all entries signed
- Physician/health officer Order Sheet – present and all entries
signed
- Nursing Care Plan – present and signed
- Medication Administration Record – present and all
medications given are signed
- Discharge Summary – present and signed
* The checklist describes the MINIMUM set of documents that should
be present in the medical record of EVERY discharged patient. Some
inpatient records will contain additional documents and forms (e.g.
referral forms, laboratory report forms etc). However for
standardization of this indicator, only the items that are listed in the
checklist should be included in the survey.
Unit of %
measurement
Numerator Sum total of medical record checklist scores (Q27)
Denominator Number of discharged inpatient medical records surveyed (Q28) x 5
(i.e. the number of items in checklist)
Formula Sum total of medical record checklist scores (Q27) ÷ [Number of
discharged inpatient medical records surveyed (Q28) x 5] x 100
Data sources Audit of medical records against checklist
A full protocol for the audit is presented in Appendix 11
5% or 50 (whichever is greater) medical records should be audited
Frequency of Quarterly
reporting
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 136
KPI 19: Deliveries (live and stillbirths) attended
Why is this Hospitals need to know the number of patients who deliver at the
important? hospital, and the number of complicated deliveries in order to plan
staff numbers, equipment and supply needs. This information informs
the annual plan and budget preparations.
INCLUDE:
All births in hospital, regardless of the department where delivery
occurred
Data sources Delivery registration book
Frequency of Monthly
reporting
Formula: Total number of women who gave birth in the hospital (Q29)
Data Entry: Q29 = total number of women who gave birth in hospital
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 137
KPI 20: Births by surgical, instrumental or assisted vaginal delivery
Why is this In the health care system of Ethiopia, it is expected that hospitals will
important? manage complicated maternity cases and that uncomplicated
pregnancies and normal deliveries should mainly be managed by
Primary Health Care Units. By monitoring the % of attended
deliveries that are complicated, the hospital and RHB can assess if
hospital services are being used appropriately.
Definition Number of births by surgical, instrumental or assisted vaginal delivery
per 100 deliveries attended in the hospital
Numerator Number of Caesarean sections (Q32) + Number of abdominal surgical
deliveries (Q33) + Number of instrumental or assisted vaginal
deliveries (Q34)
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 138
KPI 20 Data Entry Form: Births by surgical, instrumental or assisted vaginal delivery
Data entry: Q30 = Total number of livebirths attended in the hospital = ______________
Q31 = Total number of stillbirths attended in the hospital = ______________
Q32 = Number of Caesarean sections = __________________
Q33 = Number of abdominal surgical deliveries = ___________
Q34 = Number of instrumental or assisted vaginal deliveries = _____________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 139
KPI 21: Institutional maternal mortality
Why is this This indicator reflects both the quality of medical care provided at the
important? hospital and the access to maternity services. For example a high
maternal mortality may be due to inadequate treatment of pregnant
women after they arrive at the hospital and/or could be due to long
delays in seeking medical care that result in women arriving at the
hospital in a moribund condition.
Through BPR, the government has set a stretch objective that “deaths
related to pregnancy and maternity should not occur to 99% of mothers
after the patient arrives at the hospital”.
INCLUDE:
All maternal deaths should be included, wherever they occur in the
hospital.
Ante partum deaths (at any gestational age)
Intrapartum deaths
Post partum deaths (from delivery until 6 weeks post partum)
Direct causes (e.g. haemmorhage, ruptured uterus, eclampsia,
obstructed labour, infection etc)
Indirect causes (e.g. heart disease or malaria aggravated by
pregnancy)
EXCLUDE:
Deaths in pregnant women due to incidental or accidental causes, e.g.
road traffic accident.
Denominator Number of women who gave birth in the hospital (Q29)
Formula Number of maternal deaths (any gestational age) (Q35) ÷ Number of
women who gave birth in the hospital (Q29) x 100
Data sources Delivery register
Emergency gynecology database/register
Emergency room database/register
Frequency of Monthly
reporting
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 140
KPI 21 Data Entry Form: Institutional maternal mortality
Formula: The number of maternal deaths (any gestational age) (Q35) ÷ Total number
of women who gave birth in the hospital (Q29) x 100
Data entry: Q35 = The number of maternal deaths (any gestational age) = ______________
Q29 = Total number of women who gave birth in the hospital = ______________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 141
KPI 22: Institutional neonatal death within 24 hours of birth
Why is this This indicator is a measure of the quality of care during delivery and
important? in the immediate post-partum period.
A hospital should monitor the early neonatal death rate to assess the
quality of maternity care provided and take action to address any
problems identified.
Definition The number of deaths within 24 hours of birth per 100 live births
attended in the hospital.
INCLUDE:
All deaths within the first 24 hours of life among babies who were
delivered in the health facility
EXCLUDE:
Deaths among babies who were admitted AFTER delivery
Unit of %
measurement
Numerator Number of deaths within 24 hours of birth among babies born alive in
the hospital (Q36)
Denominator Number of live births attended in the hospital (Q30)
Formula Number of deaths within 24 hours of birth among babies born alive in
the hospital (Q36) ÷ Number of live births attended in the hospital
(Q30) x 100
Data sources Delivery register
Frequency of Monthly
reporting
KPI 22 Data Entry Form: Institutional neonatal death within 24 hours of birth
Formula: Number of deaths within 24 hours of birth among babies born alive in the
hospital (Q36) ÷ Total number of livebirths attended in the hospital (Q30) x
100
Data entry: Q36 = Number of deaths within 24 hours of birth among babies born alive in
the hospital = _____________
Q30 = Total number of livebirths attended in the hospital = __________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 142
KPI 23: Referrals made
Why is this A high number and proportion of referrals made from the hospital
important? could indicate that the hospital is not providing all services required
by the population served, whereas a low number and proportion of
referrals might indicate that the hospital is not following referral
guidelines and is treating patients beyond its capacity. Knowledge of
the number and rate of referrals helps the hospital to plan future
service provision.
For the RHB, knowledge of the number and rate of referrals made by
each hospital helps to monitor the regional Referral System and assists
the RHB to identify the need for and plan future healthcare services in
the region.
Definition The total number of patient attendances (inpatient, outpatient,
emergency and maternity) who were referred to another facility with a
referral paper during the reporting period
Emergency referrals are those patients who were advised to seek
immediate or life saving medical treatment at another facility. This
could include patients referred from the emergency room, patients
referred from the emergency gynecology unit, labouring or non-
labouring mothers referred from the maternity unit, patients referred
from OPD or inpatient wards for immediate or life saving treatment.
Non-emergency referrals are those patients who were advised to seek
medical treatment at another facility but where the need for treatment
was not immediate or life saving.
Referrals made by ANY department or service should be included,
e.g.
Inpatient admissions
Outpatient attendances
Emergency room attendances
Emergency maternity attendances (any gestational age)
Delivering mothers or neonates
Private wing attendances
Unit of measurement Absolute number
Formula Number of emergency referrals made (Q38) + Number of non-
emergency referrals made (Q39)
Data sources Referral register
Frequency of reporting Monthly
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 143
KPI 24: Rate of referrals
Why is this A high number and proportion of referrals made from the hospital
important? would indicate that the hospital is not providing all services required by
the population served, whereas a low number and proportion of referrals
might indicate that the hospital is not following referral guidelines and
is treating patients beyond its capacity. Knowledge of the number and
rate of referrals helps the hospital to plan future service provision.
For the RHB, knowledge of the number and rate of referrals made by
each hospital helps to monitor the regional referral system and assists
the RHB to identify the need for and plan future healthcare services in
the region.
Definition The number of patient attendances (inpatient, outpatient, emergency
and maternity) who were referred to another facility with a referral
paper during the reporting period per 100 patient attendances
Unit of %
measurement
Numerator Number of emergency referrals made (Q38) + Number of non-
emergency referrals made (Q39)
Denominator Total patient attendances, i.e.
Number of new and repeat outpatient attendances at public facility (Q3)
+ Number of new and repeat outpatient attendances at private wing (Q4)
+ Number of emergency room attendances (Q8) + Number of patients
admitted to public facility (Q13) + Number of patients admitted to
private wing (Q14) + Number of women who gave birth in the hospital
(Q29) + Number of non-delivering emergency maternal attendances
(any gestational age) (Q37)
Formula [Number of emergency referrals made (Q38) + Number of non-
emergency referrals made (Q39)] ÷ [Number of new and repeat
outpatient attendances at public facility (Q3) + Number of new and
repeat outpatient attendances at private wing (Q4) + Number of
emergency room attendances (Q8) + Number of patients admitted to
public facility (Q13) + Number of patients admitted to private wing
(Q14) + Number of women who gave birth in the hospital (Q29) +
Number of non-delivering emergency maternal attendances (any
gestational age) (Q37)] x 100
Data sources Referral register, admission register, outpatient register, emergency
register, delivery register/log books or databases
Frequency of Monthly
reporting
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 144
KPI 24 Data Entry Form: Rate of referrals
Data entry:
Q38 = Number of emergency referrals = ______________
Q39 = Number of non- emergency referrals made = ______________
Q3 = Number of new and repeat outpatient attendances at public facility = _____
Q4 = Number of new and repeat outpatient attendances at private wing = ______
Q8 = Total number of emergency room attendances = ___________________
Q13 = Number of patients admitted to public facility = __________________
Q14 = Number of patients admitted to private wing = ___________________
Q29 = Total number of women who gave birth in the hospital = _____________
Q37 = Number of non-delivering emergency maternal attendances (any gestational age)
= ______
Calculation:
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 145
KPI 25: Emergency referrals as a proportion of all referrals made
Why is this All hospitals should be able to provide emergency medical services. If
important? a hospital has a high proportion of emergency referrals this would
suggest that the hospital is not providing adequate emergency
services.
Definition Number of emergency referrals per 100 referrals
Unit of %
measurement
Numerator Number of emergency referrals made (Q38)
KPI 25: Date Entry Form: Emergency referrals as a proportion of all referrals made
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 146
KPI 26: Average stock out duration of hospital specific tracer drugs
For the RHB, knowledge of the stock out of hospital specific tracer
drugs in hospitals helps to assess the adequacy of hospital inventory
control processes and the regional Pharmaceutical Supply Chain
Management System.
Definition The number of days in which a hospital specific tracer drug was not
available averaged over all hospital specific tracer drugs.
Amoxycillin
Oral Rehydration Salts
Arthemisin/Lumphantrine
Mebendazole Tablets
Tetracycline Eye Ointment
Paracetamol
Refampicine/Isoniazide/Pyrazinamide/Ethambutol
Medroxyprogesterone(depo) injection
Ergometrine Maleate Injection/Tablets
Ferrous Sulphate plus Folic Acid
Pentavalent DPT-Hep-Hib Vaccine
Plus an additional 5 drugs, whose availability is mandatory, to be
selected by the hospital
Unit of Days
measurement
Numerator Sum total of stock out days of hospital specific tracer drugs (Q40)
Formula Sum total of stock out days of hospital specific tracer drugs (Q40) ÷
16 (the total number of hospital specific tracer drugs) (Q41)
Frequency of Monthly
reporting
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 147
KPI 26 Data Entry Form: Average stock out duration of hospital specific tracer drugs
Formula: ∑stock out days of hospital specific tracer drugs (Q40) ÷ Total number of
hospital specific tracer drugs (Q41)
Date entry:
Q40:
(a) Stock out days of Amoxicillin = __________ days
(b) Stock out days of Oral Rehydration Salts = __________ days
(c) Stock out days of Arthemisin/Lumphantrine = __________ days
(d) Stock out days of Mebendazole Tablets = __________ days
(e) Stock out days of Tetracycline Eye Oint. = __________ days
(f) Stock out days of Paracetamol = __________ days
(g) Stock out days of Rifampicin/Isoniazide/Pyrazinamide/Ethambuto = __________ days
(h) Stock out days of Medroxyprogesterone Acetate (depot Provera) = __________ days
(i) Stock out days of Ergometrine Maleate Tablet = __________ days
(j) Stock out days of Ferrous Salt plus Folic Acid = __________ days
(k) Stock out days of Pentavalent DPT-Hep-Hib Vaccine = __________ days
Five mandatory additional hospital tracer drugs
(l) ……………………………………………………………………. =__________ days
(m) …………………………………………………………………….=__________ days
(n) …………………………………………………………………….=__________ days
(o) …………………………………………………………………… =__________ days
(p) …………………………………………………………………… =__________ days
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 148
KPI 27: Patient day equivalents per doctor
Why is this This indicator relates to the productivity of doctors and helps the hospital
important? to determine whether doctors are working productively, or are overloaded.
The indicator is useful for planning future staff numbers.
Definition The average number of patient day equivalents per full time equivalent
(FTE) doctor
Numerator Number of patient day equivalents (PDEs) during reporting period
A patient day equivalent is equal to ONE inpatient bed day (i.e. one
overnight stay by one patient) or three outpatient visits or three
emergency visits or three emergency maternity attendances or two
deliveries. It assumes that the cost of one inpatient day is equivalent to
three out outpatient visits or three emergency visits or three emergency
maternity attendances or two deliveries.
INCLUDE:
Inpatient admissions to public and private facilities
Outpatient attendances to public facility and private wing
Emergency attendances
Deliveries attended
So if the hospital has 4 full time doctors working 40 hours per week, plus
one doctor working 20 hours per week plus one doctor working 10 hours
per week then the total FTE is 4.75 (i.e. (4 x 1.0) + 0.5 + 0.25).
INCLUDE:
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 149
All doctors (both general practitioners and specialists) funded by the
hospital or RHB
All doctors (both general practitioners and specialists) who are
voluntary or funded by another source
EXCLUDE:
Health Officers
Students
Residents & Interns
Formula {Sum total of length of stay during reporting period (Q19) + [Number of
new and repeat outpatient attendances at public facility (Q3) ÷ 3] +
[Number of new and repeat outpatient attendances at private wing (Q4)
÷3] + [Number of emergency room attendances (Q8) ÷3] + [Number of
non-delivering emergency maternal attendances (any gestational age)
(Q37) ÷ 3] + [Number of women who gave birth in the hospital (Q29) ÷
2]} ÷ Average number of full time equivalent (FTE) doctors (GP &
Specialists) (Q42)
Data sources Inpatient registration book/ admission and discharge register
Outpatient registration book/register
Private wing registration book/database
Emergency registration book/database
Delivery register/database
Human resource/personnel database
Frequency of Monthly
reporting
Formula: {Sum total of length of stay during reporting period (Q19) + [Number of new
and repeat outpatient attendances at public facility (Q3) ÷ 3] + [Number of
new and repeat outpatient attendances at private wing (Q4) ÷3] + [Number of
emergency room attendances (Q8) ÷3] + [Number of non-delivering
emergency maternal attendances (any gestational age) (Q37) ÷ 3] + [Number
of women who gave birth in the hospital (Q29) ÷ 2]} ÷ Average number of
„full time equivalent‟ (FTE) doctors (GP & Specialists) (Q42)
Data entry:
Q19 = Sum total of length of stay during reporting period = _______________
Q3 = Number of new and repeat outpatient attendances at public facility = ____________
Q4 = Number of new and repeat outpatient attendances at private wing = _____________
Q8 = Number of emergency room attendances = ___________________
Q37 = Number of non-delivering emergency maternal attendances (any gestational age) =
____________
Q29 = Number of women who gave birth in the hospital = ______________
Q42 = Average number of full time equivalent doctors (GP & Specialists) = __________
Calculation:
[Q19+(Q3÷3)+(Q4÷3)+(Q8÷3)+(Q37÷3)+(Q29÷2)]÷Q42= KPI 27
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 150
KPI 28: Patient day equivalents per nurse/midwife
Why is this This indicator relates to the productivity of nurses and midwives and
important? helps the hospital to determine whether nurses and midwives are
working productively, or are overloaded. The indicator is useful for
planning future staff numbers.
Definition The average number of patient day equivalents per full time
equivalent (FTE) nurse/midwife
A patient day equivalent is equal to ONE inpatient bed day (i.e. one
overnight stay by one patient) or three outpatient visits or three
emergency visits or three emergency maternity attendances or two
deliveries. It assumes that the cost of one inpatient day is equivalent to
three out outpatient visits or three emergency visits or three
emergency maternity attendances or two deliveries.
INCLUDE:
Inpatient admissions to public and private facilities
Outpatient attendances to public facility and private wing
Emergency attendances
Deliveries attended
So if the hospital has 30 full time nurses working 40 hours per week,
plus three nurses working 20 hours per week plus two midwives
working 10 hours per week then the total FTE is 32.00 (30 x 1.0 + 3 x
0.5 + 2 x 0.25).
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 151
If the number of nurses/midwives changes during the reporting period
then calculate the AVERAGE FTE for the period,(i.e. [FTE
nurses/midwives at beginning of reporting period + FTE
nurses/midwives at end of reporting period] ÷ 2)
INCLUDE:
All nurses and midwives funded by the hospital or RHB
All nurses and midwives who are voluntary or funded by another
source
EXCLUDE:
Students
Formula {Sum total of length of stay during reporting period (Q19) + [Number
of new and repeat outpatient attendances at public facility (Q3) ÷ 3] +
[Number of new and repeat outpatient attendances at private wing
(Q4) ÷3] + [Number of non-delivering emergency room attendances
(Q8) ÷3] + [Number of emergency maternal attendances (any
gestational age) (Q37) ÷ 3] + [Number of women who gave birth in
the hospital (Q29) ÷ 2]} ÷ Average number of full time equivalent
(FTE) nurses/midwives (Q43)
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 152
KPI 28 Data Entry Form: Patient day equivalents per nurse/midwife
Formula: {Sum total of length of stay during reporting period (Q19) + [Number of new
and repeat outpatient attendances at public facility (Q3) ÷ 3] + [Number of
new and repeat outpatient attendances at private wing (Q4) ÷3] + [Number of
emergency room attendances (Q8) ÷3] + [Number of non-delivering
emergency maternal attendances (any gestational age) (Q37) ÷ 3] + [Number
of women who gave birth in the hospital (Q29) ÷ 2]} ÷ Average number of
„full time equivalent‟ nurses/midwives (Q43)
Data entry:
Q19 = Sum total of length of stay during reporting period = _______________
Q3 = Number of new and repeat outpatient attendances at public facility = ____________
Q4 = Number of new and repeat outpatient attendances at private wing = _____________
Q8 = Number of emergency room attendances = ___________________
Q37 = Number of non-delivering emergency maternal attendances (any gestational age) =
____________
Q29 = Number of women who gave birth in the hospital = ____________
Q43 = Average number of full time equivalent nurses/midwives = __________
Calculation:
[Q19+(Q3÷3)+(Q4÷3)+(Q8÷3)+(Q37÷3)+(Q29÷2)]÷Q43= KPI 28
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 153
KPI 29: Major surgeries per surgeon
Why is this This indicator relates to the productivity of surgeons, and helps the
important? hospital to determine whether surgeons are working productively, or
are overloaded. The indicator is useful for planning future surgical
staff numbers.
Definition The number of major surgical procedures per full time equivalent
(FTE) specialist surgeon.
Numerator Number of major surgeries (both elective & non-elective) performed
on public patients (Q25) + Number of major surgeries (both elective
& non-elective) performed on private wing patients (Q26))
INCLUDE:
all surgeries conducted on patients admitted to public facility
all surgeries conducted on private wing patients
EXCLUDE:
all ophthalmic surgery
EXCLUDE:
Surgical residents and interns
Ophthalmologists
Formula [Number of major surgeries (both elective & non-elective) performed
on public patients (Q25) + Number of major surgeries (both elective
& non-elective) performed on private wing patients (Q26)] ÷ Average
number of FTE specialist surgeons (excluding Ophthalmologists)
(Q44)
Data sources Surgical/operating room log book
Human resources/personnel database
Frequency of Monthly
reporting
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 154
KPI 29 Data Entry Form: Major surgeries per surgeon
Formula: [Total number of major surgeries (both elective & non-elective) performed on
public patients (Q25) + Total number of major surgeries (both elective & non-
elective) performed on private wing patients (Q26)] ÷ Average number of FTE
specialist surgeons (excluding ophthalmologists) (Q44)
Data entry:
Q25 = Total number of major surgeries (both elective & non-elective) performed on
public patients = ________________
Q26 = Total number of major surgeries (both elective & non-elective) performed on
private wing patients = ______________
Q44 = Average number of FTE specialist surgeons (excluding ophthalmologists) = ____
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 155
KPI 30: Major surgeries conducted in the private wing
Why is this Through Health Care Finance Reform (HCFR) hospitals are permitted
important? to establish a private wing service.
The proportion of all major surgeries that are conducted on private
wing patients is a measure of the productivity of the private wing
surgical service and is a measure of service availability, patient
demand for private wing services and of the success of HCFR
implementation by the hospital.
Definition The proportion of all major surgeries that are performed on private
wing patients
Numerator Number of major surgeries (both elective & non-elective) performed
on private wing patients (Q26)
A major surgical procedure is defined as any procedure conducted
under general, spinal or major regional anaesthesia.
INCLUDE:
all surgeries conducted on private wing patients
EXCLUDE:
all ophthalmic surgery
Denominator Number of major surgeries (both elective & non-elective) performed
on public patients (Q25) + Total number of major surgeries (both
elective & non-elective) performed on private wing patients (Q26)
EXCLUDE:
all ophthalmic surgery
Formula Number of major surgeries (both elective & non-elective) performed
on private wing patients (Q26) ÷ [Number of major surgeries (both
elective & non-elective) performed on public patients (Q25) +
Number of major surgeries (both elective & non-elective) performed
on private wing patients (Q26)]
Data sources Surgical/operating room log book
Frequency of Monthly
reporting
KPI 30 Data Entry Form: Major surgeries conducted in the private wing
Formula: Total number of major surgeries (both elective & non-elective) performed on
private wing patients (Q26) ÷ [Total number of major surgeries (both elective
& non-elective) performed on public patients (Q25) + Total number of major
surgeries (both elective & non-elective) performed on private wing
patients (Q26)]
Data entry: Q25 = Total number of major surgeries (both elective & non-elective) performed
on public patients = _______________
Q26 = Total number of major surgeries (both elective & non-elective) performed
on private wing patients = ____________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 156
KPI 31: Attrition rate – physicians
Why is this The attrition rate (turnover) of hospital staff is an indicator of the
important? quality of the working environment for staff. A high turnover
indicates that employees are not satisfied with their working
environment. When employees are not satisfied in the workplace they
tend to be poorly motivated and are less efficient in their work, and
less motivated to provide quality healthcare.
INCLUDE:
all physicians and specialists employed by the hospital who:
o left voluntarily or compulsorily
o left for training of > 3 months duration
o died during the reporting period
EXCLUDE:
health officers
all voluntary physicians and specialists
short term trainings (<3 months) where the physician is expected
to return to the hospital after completion
Denominator Number of physicians (GP & Specialists) employed by hospital at the
beginning of the reporting period (Q46) + Number of physicians (GP
& Specialists) hired during the reporting period (Q47)
Formula Number of physicians (GPs and specialists) who left the hospital
during the reporting period (Q45) ÷ [Number of physicians (GP &
Specialists) employed by hospital at the beginning of the reporting
period (Q46) + Number of physicians (GP & Specialists) hired during
the reporting period (Q47)] x 100
Data sources HR personnel records
Frequency of Six monthly
reporting
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 157
KPI 31 Data Entry Form: Attrition rate - physicians
Formula: Number of physicians (GPs and specialists) who left the hospital during the
reporting period (Q45) ÷ [Number of physicians (GP & Specialists) employed
by hospital at the beginning of the reporting period (Q46) + Number of
physicians (GP & Specialists) hired during the reporting period (Q47) x 100
Data Entry:
Q45 = Number of physicians (GPs and specialists) who left the hospital during the
reporting period = ____________
Q46 = Number of physicians (GP & Specialists) employed by hospital at the beginning of
the reporting period = ____________
Q47 = Number of physicians (GP & Specialists) hired during the reporting period = ____
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 158
KPI 32: Staff satisfaction
Why is this Hospitals should strive to provide a good working environment for
important? employees, with opportunities for training and development and
equitable remuneration.
Employees who are satisfied with their working environment are more
productive and provide higher quality care. In contrast when workers
are dissatisfied in the workplace their productivity tends to be low and
the attrition rate is high.
Formula: ∑ rating score from SEHC surveys (Q48) ÷ Number of SEHC surveys
completed (Q49)
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 159
KPI 33: Cost per patient day equivalent
Why is this The cost per patient day equivalent is a measure of the efficiency of
important? providing services at the hospital. A high cost per patient day
equivalent suggests that the hospital is not cost effective when using
resources (staff and/or equipment and supplies).
Definition A patient day equivalent is equal to ONE inpatient bed day (i.e. one
overnight stay by one patient) or three outpatient visits or three
emergency visits or three emergency maternity attendances or two
deliveries. It assumes that the cost of one inpatient day is equivalent
to three out outpatient visits or three emergency visits or three
emergency maternity attendances or two deliveries.
The cost per PDE is the average cost of treating one inpatient for one
day in the hospital or the average cost of 3 outpatients, emergency
room or emergency maternity attendances or the average cost of 2
deliveries.
Unit of Ethiopian birr
measurement
Numerator Total hospital operating expenses (Q50). This is all expenses
associated with running the hospital including:
Gross salaries and employee benefits
Consumables and supplies
Cost of outsourced services
Professional fees
Rentals
Interest payments
Insurance payment etc
EXCLUDE:
Capital expenses
Denominator Patient Day Equivalents =
Sum total of length of stay during reporting period (Q19) + [Number
of new and repeat outpatient attendances at public facility (Q3) ÷ 3] +
[Number of new and repeat outpatient attendances at private wing
(Q4) ÷3] + [Number of emergency room attendances (Q8) ÷3] +
[Number of non-delivering emergency maternal attendances (any
gestational age) (Q37) ÷ 3] + [Number of women who gave birth in
the hospital (Q29) ÷ 2]
Formula Total operating expenses (Q50) ÷ {Sum total of length of stay during
reporting period (Q19) + [Number of new and repeat outpatient
attendances at public facility (Q3) ÷ 3] + [Number of new and repeat
outpatient attendances at private wing (Q4) ÷3] + [Number of
emergency room attendances (Q8) ÷3] + [Number of non-delivering
emergency maternal attendances (any gestational age) (Q37) ÷ 3] +
[Number of women who gave birth in the hospital (Q29) ÷ 2]}
Data sources 1) Operational expenses: hospital monthly financial statement
2) Patient day equivalents:
Inpatient registration book/ admission and discharge register
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 160
Outpatient registration book/register
Private wing registration book/database
Emergency registration book/database
Delivery register/database
Human resource/personnel database
Frequency of Quarterly
reporting
Formula: Total operating expenses (Q50) ÷ {Sum total of length of stay during reporting
period (Q19) + [Number of new and repeat outpatient attendances at public facility
(Q3) ÷ 3] + [Number of new and repeat outpatient attendances at private wing (Q4)
÷3] + [Number of emergency room attendances (Q8) ÷3] + [Number of non-
delivering emergency maternal attendances (any gestational age) (Q37) ÷ 3] +
[Number of women who gave birth in the hospital (Q29) ÷ 2]}
Data entry:
Q50 = Total hospital operating expenses = ___________________
Q19 = Sum total of length of stay during reporting period = _______________
Q3 = Number of new and repeat outpatient attendances at public facility = ____________
Q4 = Number of new and repeat outpatient attendances at private wing = _____________
Q8 = Number of emergency room attendances = ___________________
Q37 = Number of emergency non-delivering maternal attendances (any gestational age) =
____________
Q29 = Number of women who gave birth in the hospital = ____________
Calculation:
(Q50) ÷ {(Q19) + [(Q3) ÷ 3] + [Q4) ÷3] + [(Q8) ÷3] + [(Q37) ÷ 3] + [(Q29) ÷ 2]}
= ETB KPI 33
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 161
KPI 34: Raised revenue as a proportion of total operating revenue
Why is this Hospital income is from two sources: government budget allocation and
important? raised revenue. Through Healthcare Finance Reform (HCFR) hospitals
now have the autonomy to generate income from user fees, private wing
and other sources. This is known as raised revenue or non government
revenue. Hospitals are expected to generate income that should then be
re-invested in the hospital to improve the quality of services provided.
By monitoring the amount of raised revenue, and the ratio between raised
revenue and total operating revenue the hospital can assess the adequacy
of HCFR activities and plan future service improvements.
Definition Raised revenue as a proportion of total operating revenue (i.e. raised
revenue + government operating budget allocation) for the reporting
period
Unit of %
measurement
Numerator Raised revenue during reporting period (Q51)
Raised revenue includes all activities that generate income for the
hospital with the exception of government budget allocation. For
example: user fees, gross income from private wing, sales of food or
services, hall rent, donor, etc.
Denominator Total operating revenue for reporting period, i.e. Government operating
budget allocation* for reporting period (Q52) + raised revenue (Q51)
NB: The Government operating budget for the reporting period can be
calculated from the annual budget. For example if the reporting period is
quarterly then the government budget allocation for the reporting period
is the annual budget divided by 4.
Formula Raised revenue during reporting period (Q51) ÷ [Government operating
budget allocation for reporting period (Q52) + Raised revenue during the
reporting period (Q51)] x 100
Data sources Hospital financial statement
Frequency of Quarterly
reporting
KPI 34 Data Entry Form: Raised revenue as a proportion of total operating revenue
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 162
KPI 35: Revenue utilization
Why is this Each year, hospitals are expected to prepare an annual plan and
important? identify the budget required to meet that plan. Hospitals should fully
utilize their budget by the end of the year. If a hospital spends more
than its budget then it will run into debt and will be unsustainable in
the long term. If a hospital spends less than its budget this could
indicate either improved efficiency OR a failure to fulfill the annual
plan.
Formula: [Total hospital operating expenses during reporting period (Q50) + Total
capital expenses during reporting period (Q53)] ÷ [Government operating
budget allocation for reporting period (Q52) + Government capital budget
allocation for the reporting period (Q54) + Raised revenue budget allocation
for reporting period (Q55)]
Data entry:
Q50 = Total hospital operating expenses during reporting period = ___________
Q53 = Total capital expenses during reporting period = ____________
Q52 = Government operating budget allocation for reporting period = _____________
Q54 = Government capital budget allocation for the reporting period = ____________
Q55 = Raised revenue budget allocation for reporting period = ______________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 163
KPI 36: Patient satisfaction
Why is this Patient satisfaction with the health care they receive at the hospital is a
important? measure of the quality of care provided. By monitoring patient satisfaction
hospitals can identify areas for improvement and ensure that hospital care
meets the expectations of the patients served. The Out-Patient Assessment
of Healthcare Survey (O-PAHC) and In-Patient Assessment of Healthcare
Survey (I-PAHC) have been developed for use in Ethiopian health facilities.
These survey tools measure the patient experience related to service
availability, cleanliness, communication, respect, medication (prescription,
availability and patient information) and cost.
Definition Average rating of hospital on a score of 0-10 from O-PAHC & I-PAHC
surveys
Unit of Absolute number, on a scale of 0-10
measurement
Numerator Sum total of O-PAHC rating scores (Q56) + Sum total of I-PAHC rating
scores (Q58)
Denominator Number of O-PAHC surveys completed (Q57) + Number of I-PAHC
surveys completed (Q59)
Formula [sum total of O-PAHC rating scores (Q56) + sum total of I-PAHC rating
scores (Q58)] ÷ [Number of O-PAHC surveys completed (Q57) + Number
of I-PAHC surveys completed (Q59)]
Data sources Survey – protocol for the patient satisfaction survey is presented in
Appendix 12.
Data entry and analysis can be undertaken using the electronic Access
database and Excel pre-programmed analytical tool through which
summary tables, charts and the average satisfaction rating can be calculated.
Frequency of Quarterly
reporting
Formula: [∑O-PAHC rating score (Q56) + ∑I-PAHC rating score (Q58)] ÷ [Number of
O-PAHC surveys completed (Q57) + Number of I-PAHC surveys completed
(Q59)]
Data Entry: Q56 = ∑O-PAHC rating score = ___________
Q58 = ∑I-PAHC rating score = ____________
Q57 = Number of O-PAHC surveys completed = ____________
Q59 = Number of I-PAHC surveys completed = _____________
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 164
Appendix 6 Assessment Tool for Operational Standards of the Ethiopian Hospital Reform Implementation Guidelines (EHRIG)
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 165
CHAPTER 2. PATIENT FLOW
Unmet = 0
Std # Standard Method of evaluation Comments
Met = 1
1. Procedures are established to ensure efficient patient Obtain a copy of the following protocols:
flow; such procedures are specific to emergency, o Triage
outpatient, and inpatient settings and seek to reduce o Admission
patient crowding. o Discharge
o Referral
o Hospital access/security
o Appointment systems
2. The Hospital has Emergency triage, staffed with Confirm that the hospital has an emergency triage by visiting
appropriately trained personnel and equipped with the site.
necessary equipment and supplies View emergency triage protocol
Interview Emergency triage officer to assess staff training
and equipment/supply availability in triage area
3. The Hospital has a Central triage, staffed with Confirm that hospital has a Central triage by visiting the site.
appropriately trained equipped with necessary View Central Triage protocol
equipment and supplies Interview Central triage officer to determine if staff have
received training in triage and confirm that necessary
equipment/supplies are available in the triage area
4. All patients (except labouring mothers, patients with an Review triage protocol
appointment for an outpatient clinic or admission) Interview Triage Officer (s) to determine the types of
undergo triage. patients who undergo triage
5. Outpatient appointment systems are in place for all Confirm that an outpatient appointment system exists by
disciplines provided by the hospital. reviewing patient appointment book.
6. Appointment systems are in place for elective inpatient Confirm that an elective inpatient appointment system exists
admissions in all disciplines that are provided by the by reviewing patient appointment book.
hospital.
7. The hospital has a Liaison and Referral service that: Identify Liaison and Referral officer in the hospital
a) Manages bed occupancy Interview the Liaison and Referral officer and confirm that
b) Facilitates emergency and non-emergency he/she:
(elective) admissions o tracks the bed occupancy rate in the hospital
c) Receives referrals from, and makes referrals to, o facilitates admissions
other facilities in the referral network o manages referrals
o
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 166
8. The Hospital has written protocols for the admission and Identify written protocols for patient admission and
discharge of patients that are known, and adhered to, by discharge
all relevant staff. Interview 3 random members of inpatient case team and
confirm that they know the criteria for admission and
discharge
9. The Hospital has a Referrals Service Directory, listing Obtain a copy of the referrals directory and verify that it
facilities which the Hospital may refer patients to or includes a list of facilities which the hospital may refer to or
receive patients from, categorized by the type of clinical receive patients from as well as the clinical services
services which they provide. provided.
10. Criteria for the referral of patients from the Hospital to Identify written protocol for the referral process and
other health facilities are established, including documentation including:
standardized referral and feedback forms and necessary o Criteria for referrals
clinical documents to accompany referred patients, in o Standardized forms
accordance with the national referral implementation
guidelines.
11. The hospital has a standardized method for managing Obtain a copy of the hospital‟s referral protocol.
referrals. Obtain documentary evidence of tracking system (for
example referral log book or database).
12. Hospital staff members are familiar with the referral Interview 3 random staff members from inpatient, outpatient
systems including relevant referral protocol and forms. and emergency case team and ask them to describe the
hospital‟s referral protocol.
All interviewed staff should be familiar with and able to fully
explain the referral system as per hospital protocol.
13. The Hospital promotes and publicizes the referral Interview CEO or Liaison and Referral Officer to identify the
system throughout the community in order to ensure all methods by which the hospital promotes and publicizes the
constituents are aware of the applicable service pathway. referral system throughout the community
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 167
CHAPTER 3. MEDICAL RECORDS MANAGEMENT
Unmet = 0
Std # Standard Method of evaluation Comments
Met = 1
1. The Hospital utilizes a Master Patient Index with a single, Identify the Master Patient Index
unique Medical Record Number for each patient. Verify that unique medical record numbers are
given to all patients.
2. The Hospital utilizes a single, unified registration system Interview Head of Medical Records
for all patients, including in-patients, out-patients, Department (or equivalent) and confirm that
emergency patients, and specialty clinics. only one registration system exists for ALL
patients, including inpatients, outpatients,
emergency patients, and specialty clinic
patients.
3. The Hospital utilizes a paper-based or computer-based View MR tracking system.
system to track where the medical record is located at all
times.
4. The Hospital utilizes a uniform set of forms that comprise a Verify that medical record guideline outlines
complete medical record for the duration of a patient‟s care. the set of forms that must be included in each
medical record.
Randomly sample 10 inpatient medical records
of patients admitted in the past year, and
confirm that each, as a minimum, contains:
physician admission assessment, progress
notes, nursing care plan, discharge summary.
5. The Hospital has medical records management guidelines Obtain copy of written guidelines for handling
for proper handling and confidentiality of medical records. and confidentiality of medical records.
6. The Hospital has orientation and training program for all Review outline of or documents used in new hire
medical records personnel to ensure awareness of and orientation program.
competency in medical record management procedures. Obtain documentary evidence that all MR
personnel have completed the orientation and
training program
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 168
CHAPTER 4. PHARMACY SERVICES
Std # Standard Method of evaluation Unmet = 0 Comments
Met = 1
1. The Hospital has a Drug and Therapeutics Committee Review DTC TOR and confirm that responsibilities include
which implements measures to promote the rational and as a minimum: development of the Hospital Formulary;
cost-effective use of medicines. development of standard treatment guidelines; development
of policies and guidelines for managing formulary and non-
formulary items, establishing mechanisms to identify and
address drug use problems, and establishing and overseeing
the Drug Information Service.
2. The Hospital has a Medicines Formulary listing all Obtain copy of Hospital Formulary. Check date of creation
pharmaceuticals that can be used in the facility. The or date of most recent update/review and confirm this was
Formulary is reviewed and updated annually. undertaken within past year.
3. The hospital has outpatient, inpatient, emergency Interview CEO. Confirm that the hospital has outpatient,
pharmacies and a central medical store each directed by inpatient and emergency room pharmacies and a pharmacy
a registered pharmacist. store. Obtain the names and qualifications of the
individual(s) in charge of each. Confirm that the individuals
in charge are registered BSC Pharmacists.
4. The Hospital ensures that all types of drug transactions Select random sample of 10 inpatient records and check
and patient-medication related information are properly that there is a Medication Administration Record and that
recorded and documented. all drugs administered have been signed by the
administering health professional.
Interview CEO or senior pharmacist in each case team and
confirm that medications are dispensed only with a signed
prescription. Visit each dispensing unit and confirm that a
Prescription Registration Book is maintained in each.
5. The Hospital has SOPs for all compounding procedures Obtain list of all compounding procedures carried out and
carried out. view a copy of the SOP for each.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 169
6. The Hospital provides access to drug information to Visit Drug Information Centre.
both health care providers and patients in order to
optimize drug use. Interview pharmacist in charge to confirm that the service
is available to staff and patients.
7. The Hospital has policies and procedures for identifying Obtain copy of policies for monitoring adverse drug
and managing drug-use problems, including: monitoring reactions, prescription monitoring and drug utilization
adverse drug reactions, prescription monitoring and drug monitoring.
utilization monitoring.
8. The Hospital has a drug procurement policy approved Obtain a copy of the drug procurement policy.
by the DTC that describes methods of quantification,
prioritization, drug selection, supplier selection and Ensure that policy describes methods of quantification,
ordering of pharmaceutical supplies. prioritization, drug selection, supplier selection and
ordering of pharmaceutical supplies.
9. The Hospital has a paper-based or computer-based View inventory management system and confirm that this
inventory management system to reduce the frequency contains mechanisms to monitor stock levels and prompt
of stock-outs, wastage, over supply and drug expiry. for ordering when supplies reach a predetermined level.
Interview Storeroom Manager (or equivalent) to confirm
that all pharmaceutical products are included in the
inventory.
10. The Hospital conducts a physical inventory of all View copy of physical inventory report. Confirm this was
pharmaceuticals in the store and each dispensing unit at conducted within the past one year.
a minimum once a year.
11. The Hospital ensures proper and safe disposal of View protocol for disposal of pharmaceutical waste.
pharmaceutical wastes and expired drugs.
12. The Hospital has adequate personnel, equipment, Observe the inpatient, outpatient, emergency pharmacies
premises and facilities required to store pharmaceutical and central store and interview pharmacists in charge to
supplies and carryout compounding, dispensing, and ensure that each has appropriate space to perform duties,
counseling services. store drugs and supplies.
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 170
CHAPTER 5. LABORATORY SERVICES
Unmet = 0
Std # Standard Method of evaluation Comments
Met = 1
1. A current list of laboratory tests provided by the facility View list of tests and prices.
and the price of each test is accessible to all clinical staff Visit various clinical service areas (e.g. OPD, ER) and
and patients. confirm that copies of the tests and price of each are
available.
2. Laboratory management ensures that advice on Interview Case Team Heads (inpatient, outpatient,
examinations and the interpretation of test results is emergency). Confirm that laboratory advice on
available to meet the needs and requirements of examinations and interpretation of tests is provided to case
customers. teams as required.
3. Hospital management ensures that the Hospital Interview Case Team Heads (inpatient, outpatient,
laboratory has the necessary space, working emergency). Confirm that the space provided within each
environment, reagents, consumables, analyzers and laboratory area is sufficient for needs.
associated equipment needed to conduct the required
repertoire of tests.
6. The Hospital has policies and procedures in place for View policy.
sample collection, transport and disposal.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 171
7. The central laboratory has functional overview of all View organization chart.
hospital laboratories (e.g. emergency room laboratory, Interview senior staff member of Central Laboratory and
in-patient laboratory etc). confirm that Central Lab has functional overview of all
laboratory services.
8. The laboratory work environment is organized and clean Inspect inpatient, outpatient and emergency laboratory
at all times, with safety procedures for handling of areas for cleanliness and tidiness.
specimens and waste material to ensure patient and staff
protection from unnecessary risks at all times.
9. View health and safety manual and check that this includes:
The laboratory has a health and safety manual with
action in the event of a fire, action in the event of a major
procedures that include: action in the event of a fire,
spillage of dangerous chemicals or clinical material; action
action in the event of a major spillage of dangerous
in the event of an inoculation accident; reporting and
chemicals or clinical material; action in the event of an
monitoring of accidents and incidents; disinfection
inoculation accident; reporting and monitoring of
processes; decontamination of equipment; chemical
accidents and incidents; disinfection processes;
handling; storage and disposal of waste.
decontamination of equipment; chemical handling;
storage and disposal of waste.
10. Laboratory management establishes a policy for the View data management policy. Confirm that this addresses:
management of data and information that includes: security, access, confidentiality and data protection, backup
security system, storage, archive and retrieval and data destruction.
access (including level of access)
confidentiality and data protection
backup system
storage, archive and retrieval
data destruction
11. The laboratory has and implements a quality assurance View quality assurance policy. Confirm this addresses pre
policy that covers all aspects of laboratory functions. analytical, analytical and post analytical quality assurance.
Request external QA reports. Confirm laboratory takes part
in external QA activities.
Request internal QA reports to confirm that laboratory
conducts internal QA activities.
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 172
CHAPTER 6. NURSING CARE STANDARDS
Unmet = 0
Std # Standard Method of evaluation Comments
Met = 1
1. The Hospital has established management structures and Identify organizational structures within nursing.
job descriptions that detail the roles and responsibilities of Identify job descriptions for nurses and verify that they
each nursing professional, including reporting include responsibilities and reporting relationships.
relationships.
2. The hospital has a nursing workforce plan that addresses Obtain copy of nursing staffing plan and confirm this
nurse staffing requirements and sets minimum nurse to establishes nurse to patient ratios for each service area (e.g.
patient ratios in each service area. inpatient wards, ER, surgical suite, labour and delivery).
Confirm the plan identifies mechanisms to reassign nursing
staff or call in extra staff to ensure that minimum nurse to
patient ratios are maintained at all times
3. The Hospital has written policies describing the Identify written policies that describe the nursing process.
responsibilities of nurses for the nursing process including Verify that the following are addressed:
the admission assessment, planning, implementation and o Nursing admission assessment
evaluation of nursing care. o Nursing care planning, implementation and evaluation
4. All admitted patients have a nursing care plan that Select a random sample of 10 inpatient records from
describes holistic nursing interventions to address their different wards. Confirm that each contains a nursing care
needs. The plan is regularly reviewed and updated as plan.
required.
5. The Hospital has established guidelines for verbal and Identify written guidelines for nurses‟ verbal and written
written communication about patient care that involves communication about patient care.
nurses, including verbal orders.
6. The Hospital has standardized procedures for the safe and Identify written procedures for process of medication of
proper administration of medications by nurses or administration.
designated clinical staff. Verify that procedure addresses safety, proper
administration, and administration authority.
Review 10 Medication Administration Records from
different wards and confirm that each is completed correctly
with the signature of the transcriber and of the individual
who administered each medicine dose.
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 173
CHAPTER 7. INFECTION PREVENTION
Unmet = 0
Std # Standard Method of evaluation Comments
Met = 1
1. Hospital Management to supports improvement efforts in Interview IP lead or chair of IP committee. Confirm that
infection prevention by ensuring that operational and hospital management supports IP activities by assigning
technical capacity, financial and human resources required adequate budget and personnel for the IP program.
to adhere to infection prevention guidelines are available.
2. A designated group and/or individual(s) are in place to Identify individual(s) responsible for IP activities and review
effectively implement and monitor infection prevention the job description or terms of reference/responsibilities of
activities. the individual or group.
3. The Hospital has an operational plan for the Obtain operational plan for infection prevention guidelines.
implementation of infection prevention activities. The
plan follows national guidelines and includes guidance on Verify that the plan was developed based on national
infection prevention practice and procedures and guidelines.
materials.
4. Standard practices that prevent, control and reduce risk of Review policy/protocol for IP and confirm that this describes
hospital acquired infection are in place. Standard Precautions.
Interview Case Team Heads and confirm that Standard
Precautions are implemented by staff.
5. The Hospital has an adequate plan to address transmission Review policy/protocol for IP and confirm that this describes
based precautions for staff, patients, caregivers and transmission based precautions
visitors.
Interview Case Team Heads and confirm that Standard
Precautions are implemented by staff.
6. The Hospital ensures that equipment, supplies and Interview Head of each Case Team and confirm that:
facilities/infrastructure necessary for infection prevention sufficient PEP materials are available within case team; that
are available. water is available in all patient contact areas. Interview the
Heads of Housekeeping and Laundry (or equivalent) and
confirm that sufficient equipment, cleaning materials and
linens are available. Confirm that the hospital has a
functioning incinerator.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 174
7. All hospital staff are trained using standard infection View IP training materials.
prevention training materials.
Obtain Documentary evidence that all staff members have
been trained in IP.
8. The Hospital provides health education to patients, Interview Case Team Leaders and confirm that each Case
caregivers and visitors, as appropriate on infection Team provides health education to patients, caregivers and
prevention practices. visitors, as appropriate on infection prevention and control
practices.
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 175
CHAPTER 8. FACILITIES MANAGEMENT
Unmet = 0
Std # Standard Method of evaluation Comments
Met = 1
1. The hospital complies with relevant laws, regulations, Interview CEO to identify any relevant laws, regulations or
and facility inspection requirements. inspection requirements and confirm that the hospital
complies with these.
2. Designated hospital staff members are assigned for View organization chart.
facility maintenance and safety functions. Confirm on organization chart (or by interview with HR
Dept Head) that the hospital has assigned individuals for
the following, as a minimum: masonry, plumbing, electrical
installation, landscape and garden, sewerage.
3. The hospital grounds are regularly inspected, Interview Facilities Manager (or equivalent). Check
maintained, and, when appropriate, improved to ensure process/schedule for grounds inspection and maintenance.
cleanliness of grounds and safety of patients, visitors View patient and staff areas (garden, waiting areas etc).
and staff. Confirm that these are tidy, clean and free from hazards
(e.g. discarded equipment or other materials).
4. Potable water is available 24 hours a day, seven days a Interview CEO or Head of Facilities. Confirm that an
week through regular or alternate sources to meet alternative source of water exists (e.g. tank, well). Obtain
essential patient care. documentary evidence that the alternate source/ and or
mains source are tested for safety at a minimum every six
months.
5. Electrical services are available 24 hours a day, seven Interview CEO or Head of Facilities. Confirm that an
days a week through regular or alternate sources to meet alternative power source is available. Confirm that this is
essential patient care. sufficient to provide power to essential patient areas
including wards, emergency room, labour and delivery and
laboratory.
6. The hospital has a maintenance centre with technical View maintenance centre. Confirm that this has adequate
personnel, sufficient space and adequate ventilation to space and is not crowded. Confirm that the medical
conduct maintenance and repair work on the facility equipment service is separated from the general
operating systems (e.g., electrical, water, sanitation, maintenance area. Confirm that there are hand-washing
sewerage and ventilation) and equipment. This includes facilities, facilities for cleaning and disinfection, a storage
proper hand washing facilities, proper disinfection and area and a library
cleaning of equipment facilities, a storage area, and a
library.
.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 176
7. The maintenance centre has appropriate tools and testing Interview Head of Maintenance Dept (or equivalent).
equipment to perform repairs, as well as procedures to Confirm that sufficient tools are available for all
ensure the routine calibration of the testing equipment is maintenance functions and that routine calibration of testing
performed as required. equipment is performed as required.
8. The hospital conducts regular preventive and corrective Interview Head of Maintenance Dept (or equivalent).
maintenance for all facilities and operating systems Confirm that regular preventive and corrective maintenance
(e.g., electrical, water, sanitation, sewerage and is conducted.
ventilation) to ensure patient and staff safety and View maintenance logs. Confirm that maintenance logs
comfort. exist for, as a minimum: electrical systems, water and
sewerage.
9. There is a notification and work order system for facility Interview Head of Maintenance Dept (or equivalent).
and operating system (e.g., electrical, water, sanitation, Confirm that a notification and work order system exists.
sewerage and ventilation) repairs. View at least 5 recent work order requests and reports.
10. The hospital has a transport policy for the use of and View transport policy.
access to hospital vehicles. View logs of two hospital vehicles and confirm that vehicle
use complies with transport policy
11. The hospital has a policy addressing access to the View policy.
hospital premises. Visit two wards and confirm that all caregivers are wearing
appropriate ID badges.
Confirm that all staff interviewed in the course of this
assessment are wearing ID badges.
12. The hospital has a fire safety plan that addresses both View fire safety plan.
the prevention and response to fires. A „Fire and Obtain documented evidence of most recent Fire Drill and
Evacuation Drill‟ is conducted at least annually. confirm that this was conducted within the past one year.
13. The hospital has a plan for responding to likely View response plan.
community or hospital emergencies, epidemics and
natural or other disasters.
14. Staff members are trained and knowledgeable about Interview 10 randomly selected staff members from
their roles in the plans for fire safety, security, different Case Teams. Confirm that each one knows what
hazardous materials, and emergencies. action to take and their individual responsibility in the event
of a fire, security threat or other emergency.
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 177
CHAPTER 9. MEDICAL EQUIPMENT MANAGEMENT
Unmet = 0
Std # Standard Method of evaluation Comments
Met = 1
1. The Hospital has a Medical Equipment Committee Review MEC TOR and ensure the following
composed of doctors, nurses, technicians, pharmacists, responsibilities are included: develop and monitor
and administrative personnel that oversees the medical implementation of medical equipment strategy; oversee
equipment management program. establishment of medical equipment inventory; develop a
model medical equipment list; develop and implement
medical equipment policies; determine annual budget for
medical equipment strategy; review incident reports related
to medical equipment.
Verify that MEC membership consists of doctors, nurses,
technicians, pharmacists and administrative personnel.
2. The Hospital has a paper-based or computer-based View inventory management system and confirm updated
inventory management system that tracks all equipment within past year.
included in the equipment management program.
Confirm (by interview with Head of Equipment
Maintenance (or equivalent)) that all medical equipment in
the equipment management program is listed in the
inventory.
3. The Hospital has a paper-based or computer-based spare View inventory management system.
parts inventory management system. The system is used
for ensuring that there is an adequate supply of spare Confirm (by interview with Head of Equipment
parts on hand. Maintenance (or equivalent)) that the inventory system is
used to manage the stock of spare parts.
4. An Equipment History File is maintained for all medical Take a random sample of 10 Equipment History Files and
equipment containing all key documents for the check that each includes: SOP for equipment use, inventory
equipment. data collection form and risk assessment form.
5. The Hospital has policies and procedures in place for Obtain copy of policies and procedures for medical
acquisition of new medical equipment, commissioning, equipment management and verify that they address
decommissioning and disposal of equipment, the receipt acquisition, commissioning, decommissioning, disposal,
of donations, and outsourcing technical services. donations, and outsourcing technical services.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 178
6. All new equipment undergoes acceptance testing prior Request list of all equipment purchased in the past year.
to its initial use to ensure the equipment is in good Randomly select 10 items (or all items if less than 10 were
operating condition. Equipment is installed and purchased) and review Equipment Log File. Confirm that
commissioned in accordance with the manufacturer‟s this contains a copy of the Acceptance Test Log Form.
specifications.
7. All equipment users are appropriately trained on the Visit a minimum of 3 different departments/case teams (for
operation and maintenance of medical equipment with example ER, laboratory, pharmacy, delivery, patient wards
standard operating procedures readily available to the etc). Select two items of medical equipment in each
user. department. View SOP for each item. Interview staff on
duty and confirm that each one has received training on the
use and maintenance (where relevant) of the item.
8. There is a schedule for inspection, testing and See 6.4 above. For the 10 randomly selected Equipment
preventive maintenance for each piece of equipment as History Files confirm that the schedule for Inspection,
guided by the manufacturer‟s recommendations and that testing, and maintenance is present in the equipment history
schedule is appropriately implemented. file and confirm that inspection, testing and maintenance
has been conducted as described in the schedule.
9. The Hospital has a notification and work order system Identify written protocol for medical equipment work
for the repair of medical equipment. orders.
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 179
CHAPTER 10. FINANCIAL AND ASSET MANAGEMENT
Std Unmet = 0
Standard Method of evaluation Comments
# Met = 1
1. Bilingual fee posters are displayed beside each departmental Visit different departments (OPD, ER, inpatient wards
reception desk, in all waiting areas and at all cash points. and cash collection points) and confirm that bilingual
Each poster shows the fees and exemptions and advises fee posters are clearly displayed.
patients to obtain and keep receipts for all payments. Confirm that the poster shows fees, exemptions and
advises patients to keep receipts for all payments.
2. The hospital Accountant prepares a monthly report for the View last 3 Financial Statements.
Hospital Management with details of credit granted, credit Confirm that these are monthly reports.
repaid and balance outstanding. Confirm that each provides details of credit granted,
credit repaid and balance outstanding.
3. The hospital has a procurement policy, approved by the View policy. Confirm that it details the process of
Senior Management Team that details: submitting procurement requests, the responsible
The process of submitting procurement requests body/person for approval of procurement requests, the
The responsible body/person for approval of means of procuring and the responsible person(s) for
procurement requests purchasing activities.
The means of procuring
Responsible person(s) for purchasing activities
4. Monthly reconciliation is undertaken for every hospital bank Obtain list of all bank accounts and donor grants.
account and any donor grants. View reconciliation documents for last 3 months.
Confirm that reconciliation has been done for all
accounts and grants. Confirm that each, reconciliation is
signed by Accountant.
5. Monthly and quarterly reports on revenue, expenditures, View most recent 3 reports from Finance Dept to Senior
receivables, payables, trial balance, the status of budget Management and Governing Board.
utilization and others including the hospital‟s operating Confirm that these are monthly reports.
margin are prepared by the Finance Department and Confirm that reports contains details of revenue,
submitted to the hospital management and Governing Board. expenditures, receivables, payables, trial balance, status
of budget utilization and operating margin.
6. Internal and external audit of hospital accounts is conducted View most recent internal and external audit reports.
as a minimum annually and audit reports are reviewed by the Confirm this each has been conducted within past year.
Governing Board. Confirm that each was reviewed by the Governing
Board (by reviewing Board minutes)
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 180
7. The hospital has a Memorandum of Understanding with Obtain list of all authorities with which hospital has Fee
Waiver Certificate Granting Authorities providing details on Waiving agreement.
the type of service and mode of payment. Confirm there is an MOU with each authority.
Confirm the MOU details the type of services to be
provided through „Fee Waivers‟ and the mode of
payment.
8. The hospital provides exempted services in accordance with Obtain relevant Regional Health Care Finance Reform
the relevant Regional Legislation and displays a list of Directive.
exempted services at appropriate locations through the Obtain list from CEO of all exempted services that are
hospital for the information of patients, staff and the public. provided by the hospital.
Confirm that the list presented by the CEO matches the
exempted service list in the Regional Directive.
Visit various patient services areas (OPD, ER, MCH,
wards) and confirm that a list of exempted services is
posted at each site.
9. In hospitals where a private wing is established, the Verify if the hospital has a private wing.
operations of the private wing are governed by policies and If yes, view policies and procedures.
procedures that are approved by the Governing Board. Confirm (by reviewing Board minutes or by signature of
Board Chairman on relevant documents) that the
policies and procedures are approved by the Governing
Board.
10. In cases where non-clinical services are outsourced, Verify if any services are outsourced.
procedures are in place to monitor the contract and services If yes, obtain list of outsourced services.
provided. View contract for each outsourced service.
Confirm that there is a manager assigned by the
contacting firm for each outsourced service.
Confirm that a hospital manager is assigned to monitor
each outsourced contract and that clear methods of
monitoring are documented and adhered to (e.g.
evidence of quality of service provided, adherence to
agreed deliverables etc).
11. There is a current hospital accounting manual which View accounting manual and confirm it describes
establishes all policies and procedures relating to financial policies and procedures for financial management.
management in the hospital.
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 181
CHAPTER 11. HUMAN RESOURCE MANAGEMENT
Unmet = 0
Std # Standard Method of evaluation Comments
Met = 1
1. The Hospital has a Human Resource Case Team staffed by Identify designated staff members of the HR case team
individuals with management skills and experience dealing Check experience of case team members and confirm that
with individual personnel matters. personnel staff have requisite skills (training and
personnel management experience).
2. The Human Resources Case Team maintains a personnel Interview Head of HR Case Team. Confirm that the
file for each and every hospital employee. hospital has personnel files for all grades of employees
Take a random sample of 10 personnel files from
different case teams/departments and ensure that they
contain at a minimum: personal contact information,
appointment letter, employee job description, medical
certificate and performance evaluation.
3. The Human Resource Head (or equivalent) is on the Obtain list of SMT members from CEO and confirm that
Hospital‟s Senior Management Team. Head of HR Case Team is a member.
4. The Hospital has a human resource development plan that Review a copy of the human resource development plan.
addresses staff numbers, skill mix, and staff training and Ensure that it addresses staff numbers, skill mix and staff
development training and development.
5. Each employee‟s responsibilities are defined a current job See standard 11.2 above. Confirm that the 10 randomly
description which has been signed by the employee and selected files contain a signed employee job description.
filed in the personnel file.
6. The Hospital has policies and procedures for recruiting and Identify written policies for recruiting and hiring staff.
hiring staff
7. The Human Resource Case Team provides services to Identify documented policies that support employee
employees to ensure satisfactory productivity, motivation, motivation and retention including as a minimum: policy
morale as evidenced by effective policies and procedures for compensation and benefits, training and development
for personnel retention, compensation and benefits, training and employee recognition.
and development and employee recognition
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 182
8. HR policies are documented in an Employee Manual that is Obtain a copy of the hospital‟s Employee Manual
distributed to all staff and updated, at a minimum, every 3 Ensure that it contains Hospital personnel policies and
years. The Employee Manual contains policies and procedures such as working hours, leave, benefits.
procedures that define employee/employer relations.
Ensure that it has been updated and is current (within 3yr
renewal window).
Verify that it has been disseminated among staff by
interviewing a random sample of 10 staff and asking
them if they have a copy of the employee manual.
9. The Hospital has an Employee Code of Conduct that is Obtain a copy of employee code of conduct.
known and adhered to by staff. See 11.8 above: interview 10 random staff members from
different Case Teams and ask if they are familiar with the
Code of Conduct and ask each to describe (in general
terms) the areas covered in the Code of Conduct.
Confirm that each has a general understanding of the
principles and main provisions of the Code of Conduct.
10. The Hospital has a performance management process in See Standard 11.2 above. Confirm that the 10 randomly
which all employees are formally evaluated at least sampled files contain a performance evaluation
annually and action plans for improved performance are conducted within the past year (with the exception of
documented. new employees who are currently in their probation
period). Where relevant, confirm that there is a
documented action plan for any staff member with poor
performance.
11. The hospital regularly conducts a staff survey to assess staff View results of last staff survey.
perspectives on the workplace. Summary results are Confirm that survey conducted within last 6 months.
presented to the Senior Management Team and Governing
Board.
12. ID badges and appropriate uniforms are worn by employees Observation. Confirm that each staff member interviewed
at all times. or observed in the course of the assessment is wearing an
ID badge and uniform
13. The Hospital has occupational health and safety policies Obtain a copy of occupational health and safety policies
and procedures to identify and address health and safety and procedures.
risks to staff.
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 183
CHAPTER 12. QUALITY MANAGEMENT
Unmet = 0
Std # Standard Method of evaluation Comments
Met = 1
1. The hospital has a Quality Committee that is View TOR and list of members of Quality Committee.
responsible to devise and implement a Strategy for View Quality Management strategy. Ensure that strategy
Quality Management. includes:
o Safety and risk management
o Clinical effectiveness
o Professional competence
o Patient focused care
o Patient and public involvement
o Benchmarking
Confirm (by interview with CEO or documentary evidence) that
reports on implementation of QM strategy are received by Senior
Management Team.
2. Procedures are established to assess and minimize risk View risk assessments of inpatient, outpatient and ER case teams.
arising from the provision and delivery of healthcare. Check date of risk assessment and confirm conducted within the
previous 1 year.
3. Procedures are established for reporting and analyzing Confirm that the hospital has an Incident Officer who has a job
incidents, errors and near misses. description that outlines his/her duties in relation to Incident
Investigation and management.
View two recent Incident Reports and confirm that the reported
incidents were investigated and any necessary follow up action
documented by the Incident Officer.
4. Procedures are established to monitor clinical Interview chair of QC and ask for list of clinical outcome
outcome measures and to take action to address any measures that are monitored regularly.
problems identified. Such procedures encourage the Ask chair of QC to show the most recent results of at least 3
participation of all clinical staff. clinical outcome measures.
Determine (by interview with Chair of QC) that appropriate
action was taken in response to the outcome measures.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 184
5. The hospital adopts a statement of patient rights and View statement of patient rights and responsibilities.
responsibilities, which is posted in public places in the Visit patient service areas (as a minimum OPD, ER and inpatient
hospital. wards) and confirm that statement is clearly displayed.
6. The hospital monitors patients‟ experiences with care View results of last patient satisfaction survey.
through patient satisfaction surveys conducted on a Confirm that survey conducted within last 6 months.
biannual basis.
7. The hospital implements a strategy for the View strategy.
involvement of patients and the public in service Confirm (by interview with CEO or Chair of QC) that at least
design and delivery including procedures to be two of the following activities have been conducted within the
followed when engaging with patients and the public. past 6 months:
o Suggestion boxes in patient service areas
o Complaints procedures
o Public meetings
o Establishment of patient groups
o Activities to engage marginalized groups
8. The hospital participates in benchmarking activities to Confirm (by interview with CEO or other documented evidence)
learn from and share good practice with other that hospital participates in benchmarking activities. For example
hospitals. regular attendance at regional hospital/RHB meetings;
participation in hospital cluster activities etc.
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 185
CHAPTER 13. MONITORING AND REPORTING
Unmet = 0
Std # Standard Method of evaluation Comments
Met = 1
1. The hospital has an HMIS Monitoring Team (or 1. Interview CEO. Confirm that HMIS Performance Monitoring
equivalent) that reviews HMIS indicators and takes Team (or equivalent) is in place.
action to address any areas of concern. 2. View TOR of HMIS Monitoring Team to confirm that role
includes review of indicators.
3. View minutes of last 3 HMIS performance monitoring team
meetings to confirm that HMIS indicators are reviewed and
action taken as a result.
2. The hospital conducts a self assessment of its own View copy of last 3 self assessment meetings. Confirm that frequency
performance at a minimum every quarter, using HMIS was at least quarterly.
indicators and any additional local indicators
determined by hospital management.
3. The hospital submits monthly, quarterly and annual View HMIS reports for last year. Confirm that monthly, quarterly and
HMIS reports to the relevant higher office within the annual reports were submitted as per schedule.
agreed time limit.
4. The correspondence between data reported on HMIS View LQAS result on last 3 HMIS reports. Confirm LQAS is > 80%.
forms and data recorded in registers and patient /
client records, as measured by a Lot Quality
Assurance Sample (LQAS) is ≥80%.
5. In collaboration with the CEO, the Governing Board 1. View list of BSC indicators.
has established performance indicators for the hospital 2. View last 3 BSC reports submitted to Governing Board. Confirm
that are described in a Balanced Scorecard (BSC). that frequency of BSC reports to Governing Board was quarterly
BSC reports are presented by the CEO to the as a minimum.
Governing Board as a minimum every quarter.
6. Indicators included in the BSC are a combination of View list of BSC indicators and confirm that some are national
national/regional indicators and other local indicators indicators (HMIS) while others are local indicators set by the
as determined by the Governing Board. Governing Board.
7. Hospital staff are oriented to the BSC and case Identify BSC reports for 3 different case teams (for example
teams/departments determine indicators and monitor Emergency Case Team, Inpatient Case Team, Outpatient Case Team,
their own performance using the BSC. Finance and Procurement Case Team, Human Resource Case Team
etc).
TOTAL
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 186
EHRIG ASSESSMENT TOOL SUMMARY TABLE
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 187
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 188
Appendix 7 Survey Protocol: Outpatient Waiting Time to Treatment
Purpose of survey:
The average OPD wait time is one of the Key Performance Indicators that should be reported
by hospitals to their Governing Board and to the RHB has a measure of hospital performance.
Period of survey:
The survey should be conducted on Monday and Thursday of the first week of the last month
of each quarter.
The hospital should assign an „owner‟ for the KPI „Outpatient Waiting Time to Treatment”.
He/she is responsible to oversee the survey, to select and train surveyors, to issue „Waiting
Time Cards‟ to each surveyor, to receive completed „Waiting Time Cards‟ from the
surveyors at the end of the survey period, and to calculate the average wait time at the end of
the survey period.
Additionally, at the start of each survey period the KPI Owner should inform all OPD staff
that the survey is taking place and should instruct OPD Case Teams to complete the relevant
section on the „Waiting Time Card‟ for every patient seen and ensure that all Waiting Time
Cards are returned to the surveyor at the end of the survey day.
The KPI Owner should assign individuals to act as surveyors. The number of surveyors
required will depend on the patient load. However, there should be sufficient surveyors to
ensure that the waiting time of each and every outpatient is measured during the study period.
As an approximation, the number of surveyors required will be approximately the same as the
number of individuals conducting patient registration.
Ideally, the surveyors should be individuals who DO NOT WORK regularly in the outpatient
department in order to avoid bias. Surveyors could be volunteers from the community,
students or hospital staff assigned from other departments. If necessary, the hospital should
provide payment to surveyors according to the number of hours worked.
The surveyors should follow the methodology outlined below to conduct the survey and
should submit all completed „Waiting Time Cards‟ to the KPI Owner at the end of the survey
period.
A member of each clinical case team should receive the Waiting Time Card from each and
every patient seen during the survey period. He/she should record on the Card the time at
which the clinical consultation begins, and the name of the case team. Instructions should be
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 189
given to each case team to provide all completed cards to the surveyor at the end of the
survey day. Case teams should ensure that no Waiting Time Cards are lost or misplaced.
Methodology of Survey:
: ___________________________________ ___ ( )
: ________________________________ ( )
): ________________________ (
)
: ___________________________________ ( )
Before any of the Waiting Time Cards are given out, Card Numbers should be written
on every card to that they can be easily tracked by the surveyor and the clinical case
teams. As soon as a patient arrives at OPD the surveyor should enter the patient‟s
name and time of arrival on a Waiting Time Card and then hand the Card to the
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 190
patient. The surveyor should instruct the patient to give the card to a member of the
clinical case team.
The Surveyor should keep track of the number of cards issued and the number of
cards completed. To do this he/she should keep a tally of the number of Waiting Time
Cards issued and follow up any that are missing at the end of the day.
On arrival in the consultation room, the patient should hand over the Waiting Time
Card to a member of the case team. If the patient does not automatically hand this
over then a member of the team should request the Card from the patient.
The case team member should record on the Card the time at which the consultation
begins. The case team should keep all Cards received from patients.
At the end of the day (or close of clinic) the surveyor(s) should collect all Cards from
each and every Case Team and should compare this with the list of Cards issued. If
any cards are missing the surveyor(s) should follow up with the relevant Case Team
and determine whether the patient was seen that day.
e) Every effort should be made to ensure that no Cards are missing or lost because this
could lead to an inaccurate survey result.Surveyor calculates waiting time for each
patient
After receiving the Waiting Time Cards from each clinical case team, the surveyor
should calculate the wait time for that patient (in minutes) and should enter it onto the
Card.
At the end of the survey period the KPI owner should collect all Waiting Time Cards
from each surveyor.
The KPI Owner should tally the total wait times and divide by the total number of
completed Cards in order to calculate the average wait time during the survey period.
In cases where the patient was seen on the same day but the Waiting Time Cards were
lost or incomplete, the Waiting Time Cards should be excluded from the survey
count.
After calculating Outpatient Waiting Time the KPI owner should report all data
elements and KPI result to the KPI focal person. The KPI focal person will then
check the calculations and enter them into the KPI report form.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 191
h) Optional, supplementary data analysis
If the average wait time is very long (especially if some patients are not seen on the
same day) then the surveyor may also want to record the range (shortest and longest)
of wait times.
Similarly, the waiting time for each clinical case team could be analyzed separately to
see if there are any differences between clinical teams. This information could help to
assess the efficiency of each case team and/or to determine the need for additional
clinical staff in particular case teams and/or the need for patient numbers assigned to a
specific case team to be decreased or increased.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 192
Appendix 8 Survey Protocol: Emergency Patients Triaged Within 5 Minutes of Arrival
Purpose of survey:
Through BPR, the Ministry of Health has set a stretch objective that „any patient with the
need for emergency treatment should be provided with the service within 5 minutes of
arrival at the hospital”.
The proportion of emergency patients who undergo triage within 5 minutes is one of the
Key Performance Indicators that should be reported by hospitals to their Governing Board
and to the RHB has a measure of hospital performance.
Period of survey:
The survey should be conducted during the following time periods during the final week of
the reporting period:
The hospital should assign an „owner‟ for the KPI „% of patients triaged within 5 minutes
of arrival in ER”. He/she is responsible to oversee the survey, to select and train surveyors,
and to calculate the proportion seen within 5 minutes at the end of the survey period.
Additionally, at the start of each survey period the KPI Owner should inform all ER staff
that the survey is taking place.
The KPI Owner should assign individuals to act as surveyors. The number of surveyors
required will depend on the patient load. However, there should be sufficient surveyors to
ensure that the waiting time of each and every emergency patient is measured during the
study period.
Ideally, the surveyors should be individuals who DO NOT WORK regularly in the
emergency department in order to avoid bias. Surveyors could be clinical or non clinical
staff from other hospital departments. If necessary, the hospital should provide payment to
surveyors according to the number of hours worked.
The surveyors should follow the methodology outlined below to conduct the survey and
should submit all completed „Triage Data Forms‟ to KPI Owner at the end of the
survey period.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 193
Methodology of Survey:
a) Assign surveyor(s)
One or more surveyors should be assigned to the ER Department for each study
time period. The surveyor(s) should be located at the entrance to ER. If the hospital
does not have a separate ER department the surveyors should be located in an area
where they can identify easily identify emergency cases versus outpatient cases.
2 12.40 12.46 6 No
4 2.10 2.25 15 No
As soon as a patient arrives at ER the surveyor should enter the time of arrival on
the Triage Data Form. The surveyor should follow the patient until the time of triage
(ie until assessment by a clinical staff member). The surveyor should enter the time
of triage on the Triage Data Form and calculate the wait time in minutes. The
surveyor should then complete the final column on the Triage Data Form to state if
the patient was triaged within 5 minutes of arrival (yes or no).
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 194
c) KPI Owner calculates % of patients triaged within 5 minutes (KPI 7)
At the end of the survey period the KPI Owner should collect all Triage Data Forms
from each surveyor. The KPI owner should calculated the % of patients triaged within
5 minutes as follows:
After calculating % of patients triaged within 5 minutes the KPI owner should report
all data elements and KPI result to the KPI focal person. The KPI focal person will
then check the calculations and enter them into the KPI report form.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 195
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 196
Appendix 9 Pressure Ulcer Report Form
This form should be used to report new pressure ulcers arising in patients following
admission to hospital.
Pressure Ulcers arise in areas of unrelieved pressure (commonly sacrum, elbows, knees
or ankles).
Ward ( ):
Name of patient:
Date of admission ( ):
Action taken ( ):
Reported by :
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 197
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 198
Appendix 10 Surgical Site Infection Report Form
This form should be used to report infection occurring at the site of surgery in patients
who undergo major surgical procedures (i.e. any procedure conducted under general,
spinal or major regional anesthesia).
Name of surgeon :
Clinical signs ( ):
Action taken ( ):
Reported by :
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 199
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 200
Appendix 11 Audit Protocol: Completeness of Inpatient Medical Records
Purpose of Audit:
The „% of medical records complete‟ is one of the Key Performance Indicators that the
hospital should report every quarter to the Governing Board and Regional Health Bureau.
Frequency of Audit:
The hospital should assign an „owner‟ for this KPI. He/she is responsible to oversee the
Medical Record Audit, to select and train Medical Record staff who will conduct the audit,
and to liaise with the Medical Records Department to select and obtain the Medical Records
which are included in the audit.
The Medical Record Reviewers should be members of the Medical Records Department.
Each should review the assigned Medical Records following the checklist below and submit
their completed Forms to the KPI Owner.
Methodology of Survey:
Identify and list all patients who were discharged from an inpatient ward during the
reporting period. This information can be obtained from the Medical Records
Database or Admission/Discharge Registers.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 201
Medical Record Review Form
MR Number:
Date patient discharged from hospital:
Ward:
Inpatient Medical Record Checklist
Section Yes No
1. Patient Card (Physician Notes):
- Is this present?
- Are all entries dated and signed?
2. Physician/HO Order sheet:
- Is this present?
- Are all entries dated and signed?
3. Nursing Care Plan
- Is this present?
- Are all entries dated and signed?
4. Medication Administration Record
- Is this present?
- Are all entries dated and signed?
5. Discharge summary
- Is this present?
- Are all entries dated and signed?
______ _______
Total number of “Yes” and “No” Checks
MR Reviewed by:
Name of Reviewer: __________________________
Date of Review: _____________________________
After the appropriate number of medical records have been reviewed the KPI Owner
should collect all completed Medial Record Review Forms and calculate the medical
record checklist score (number of “yes” checks). The formula for % of completeness
of inpatient medical records is as follows:
After calculating % of completeness of inpatient medical records the KPI owner should
report all data elements and KPIresult to the KPI focal person. The KPI focal person
will then check the calculations and enter them into the KPI report form.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 202
Appendix 12 Survey Protocol: Patient Satisfaction
Purpose of Survey:
To provide a standardized survey for outpatients‟ and inpatients‟ experiences which hospitals
can use to monitor patient satisfaction with services, and changes in satisfaction over time.
The Key Performance Indicator “Patient Satisfaction” will be calculated using the average
responses to question 19 in the Inpatient – Patient Assessment of Health Care (I-PAHC)
survey and question 16 in the Outpatient – Patient Assessment of Health Care (O-PAHC).
Period of Survey:
Hospitals should perform a total of 50 Inpatient and 50 Outpatient surveys each quarter. The
surveys should be collected over a time period of one to two weeks. No more than 10
surveys should be collected in a day and surveys should be collected on different days and
different times of day (morning and afternoon) over the survey period.
I-PAHC surveys should be administered at the time of discharge. O-PAHC surveys should
be given at the end of the outpatient visit right before the patient leaves the outpatient area.
The hospital should assign an „owner‟ for the KPI „Patient Satisfaction‟. He/she is
responsible to oversee the survey, to select and train surveyors, to issue O-PAHC and I-
PAHC surveys to each surveyor, to receive completed surveys from centralized collection
area, calculate patient satisfaction (KPI 36) and response rate, and give all completed
surveys to a data entry person who will enter them into the O/I-PAHC Access Database.
Each health facility should assign one or more individuals to administer the surveys to
patients. The individual conducting the survey (also referred to as “surveyor”) should
understand the survey well, including all survey questions and answer choices. To minimize
bias the surveyor should not be involved in direct patient care. A surveyor must have good
interpersonal skills to interact sensitively with patients and must not lead the patients to
particular responses but should administer the survey objectively. Each surveyor must be
trained to ensure he/she understands the purpose and process of the PAHC surveys.
Surveyors are responsible for collecting all completed surveys and returning them to a
centralized collection area determined by the health facility.
Surveys can be completed by the patient themselves (written) or the surveyor may read each
survey question to the patient and transcribe the patient response (oral). When orally
administering the PAHC survey, the surveyor should read the question exactly as written on
the PAHC instrument. If the patient has a query about certain questions on the survey,
surveyors should not provide responses or more detail about what the question might be. This
will introduce the surveyor‟s interpretation into the question, which is a form of bias. When
encountering such a challenge, the best approach is for the surveyor to remind the respondent
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 203
that there is no right or wrong response and that the interpretation of the patient is the
best possible one. Then, the surveyor should re-read the question for the patient
Patient recruitment:
Methodology of Survey:
Written Survey:
Surveyors will provide a blank patient survey to the patient to be completed by
him/herself. Patient should complete the survey at the time it is distributed and be
notified of a centralized collection area where they can return their completed survey.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 204
The surveyor should record the Survey No. in logbook and identify it as a
“written survey”.
Oral Survey:
If the patient requests that the survey be conducted orally surveyors will read each
question on the survey to the patient, transcribing the responses of the patient on to
the survey form. The surveyor should record the Survey No. in a logbook and
identify it is as “oral survey”. Once the survey is completed the surveyor should
deliver it to a centralized collection area for the KPI data owner to collect.
At the end of the survey period the KPI owner should collect all completed Inpatient
and Outpatient surveys from the centralized collection area. The KPI owner should
calculate Patient Satisfaction using patient answers to question 19 on the Inpatient
survey and question 16 on the Outpatient Survey, “On a scale of 0-10 (0 being the
worst facility, 10 being the best facility), how would you rate this health facility”.
The formula for the indicator is as follows:
Additionally the KPI owner should calculate the response rate of the
survey. This information should be collected by the surveyors and can be found in
their logbook. The formula for response rate is as follows:
e) KPI Owner reports to KPI focal person and Data Entry Person
After calculating Patient Satisfaction the KPI owner should report all data
elements and indicator to the KPI focal person. The KPI focal person will then
check the calculations and enter them into the KPI report form.
Additionally, all surveys should be given to the appropriate data entry person to enter
into the Access Database. See Appendix 7 for guidance.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 205
I-PAHC Survey:
understand?
8. During this health facility stay, how often was the room 1 2 3 4
you were sleeping in kept clean?
9. During this health facility stay, how often was the area 1 2 3 4
around you quiet at night?
10. During this health facility stay, how often did you have 1 2 3 4
enough personal privacy?
11. During this health facility stay, did you experience any 1 Yes 2 No, Skip 12 & 13
pain?
12. During this health facility stay, how often was your 1 2 3 4
pain well controlled?
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 206
13. During this health facility stay, how often did staff do
1 2 3 4
everything they could to help you with your pain?
14. During this health facility stay, were you given any 1 Yes 2 No, Skip 15 & 16
medication that you had not taken before?
15. Before giving you any new medication, how often did
1 2 3 4
staff tell you what the medicine was for?
16. Before giving you any new medication, how often did
staff describe possible side effects in a way you could 1 2 3 4
understand?
17. Did anyone discuss with you what symptoms to look 1 Yes 2 No
out for after you left the health facility?
18. Was it easy to find your way around the health facility? 1 Yes 2 No
1 2 3 4
20. Would you recommend this health facility to your
friends and family? Definitely Probably Probably Definitely
no no yes yes
21. Did you have to pay for this health facility stay? 1 Yes 2 No, Skip Q22
22. Do you consider this health facility stay too expensive? 1 Yes 2 No
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 207
O-PAHC Survey
Male 1 Female 2 Age Date (DD/MM/YYYY):
Morning/Afternoon Department:
Strongly Strongly
Disagree Agree
Disagree Agree
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 208
15. It was easy for me to find my way around the 1 Yes 2 No
facility.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 209
[Inpatient Assessment of Health Care (I-PAHC)]
.
1 2 (///)
1.
1 2 3 4
?
2. 1 2 3 4
?
3. 1 2 3 4
?
4./
1 2 3 4
?
5./ 1 2 3 4
?
6./
1 2 3 4
?
7./ 1 2 3 4
8. 1 2 3 4
?
9. 1 2 3 4
?
10. 1 2 3 4
?
11.(Pain) 1 2,1213
?
12.
1 2 3 4
(Pain)?
13.
(Pain) 1 2 3 4
?
14. 1 21516
?
15.
1 3 4
? 2
16.
1 2 3 4
?
17.
? 1 2
18.? 1 2
19. 0-10
1()(010 0 1 2 3 4 56 78 9 10
) ………………………
1 2 4
3
20.?
21.? 1 2222
22.? 1 2
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 210
[Outpatient Assessment of Health Care (O-PAHC)]
.
1 2 (///)
/
1. 1 2 3 4
2. 1 2 3 4
3. 1 2 3 4
4. / 1 2 3 4
5. / 1 2 3 4
6. / 1 2 3 4
7./ 1 2
8. 1 2 3 4
9./ 1 2 3 4
()
211,1213
10. 1
11. 1 2
12. 1 2
13. 1 2
14.
1 2
?
15. 1 2
?
16. 0-10
0 1 2 3 4 5 6 7 8 9 10
(010
………………………..
)
17./ 1 2 3 4
18.. 2
1 19
19.
1 2
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 211
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 212
Appendix 13 O-PAHC and I-PAHC Database and Analytical Tool
Two data entry forms have been created in Microsoft Access – one for I-PAHC and the
second for O-PAHC. The questions on each survey are listed in the database exactly as
they appear on the questionnaire.
Data entry should be conducted by individuals with excellent attention to detail and
good keyboarding skills. The data entry person should enter the data reliably and
without error. Data entry should require no more than 4 minutes per survey; therefore,
entering 50 surveys in total should take approximately two hours. This should provide
adequate time for entry and checking entered data. It is the responsibility of the data
entry staff to check all of his/her work before submitting to supervisor for spot check.
Spot checking
After all data has been entered, a supervisor should perform a spot check for each
batch. Spot checking requires randomly selecting a number of surveys per batch (of
50) to check whether the data entry clerk has accurately entered all responses from
the paper surveys. A supervisor should randomly select at least 5 surveys from
each batch of 50 to ensure the accuracy and quality of all entered data. In the event
that any errors are found by the supervisor during the spot check, he/she should
then proceed to checking 100% of that batch for further errors.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 213
Using the Excel Tools to analyze data:
Two Microsoft Excel Analysis Tools have been created to analyze the patient surveys – one
for I-PAHC and one for O-PAHC. The Pre-Programmed Analysis Tools generate tables
and graphs automatically.
3) The following dialog box will appear. Select Excel 97 – Excel 2003 Workbook (*.xls) and
click „OK‟
4) Save the file. The data should show up in a new Excel file as rptIPHAC or rptOPHAC
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 214
Step 2: Copying data from Excel File into Pre-programmed Analytical Tool
1) Open the Excel spreadsheet that you exported from the database (rptIPHAC
or rptOPHAC). It should look like this:
2) In the Excel file, click the cell in the upper left corner to select all cells.
3) With all of the cells selected click on „Edit‟ and select „Copy‟
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 215
4) Now open the pre-programmed Excel Analytical Tool and click on the „Data Sheet‟ tab
5) Select „Edit‟ then „Paste‟. Data should then appear on the worksheet.
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 216
Step 3: Viewing Analyzed Data
1) Click on the „Hospital Report‟ tab to view a table of the analyzed data
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 217
Step 4: Using Analytical Tool tables and charts
Tables depicting I-PAHC and O-PAHC data will be automatically generated by the pre-
programmed analytical tools. When preparing the survey report the tables can be copied and
pasted into a word document.
To copy the tables from excel into a word document take the following steps:
1. In the pre-programmed analytical tool open the spreadsheet entitled Health Facility
Report
2. Highlight the cells that you want to copy
3. Select edit and „copy‟
4. Open the word document
5. Put cursor in area where you want the table to be inserted
6. Select edit and „paste‟.
I-PAHC Report
HEALTH FACILITY NAME: XXXX DATE: 3/25/2011
INPATIENT REPORT
Total N 50
Males 68%
Females 32%
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 218
Table 4: Patient ratings of doctor communication during health facility stay
Never Sometimes Usually Always N
Q4 Doctors/Health Officers treated patients with courtesy 0% 14% 28% 58% 50
and respect
Q5 Doctors/Health Officers listened carefully to patients 0% 16% 36% 48% 50
Q6 Doctors/Health Officers explained things in 0% 14% 38% 48% 50
understandable ways
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 219
Charts depicting I-PAHC and O-PAHC data will also be automatically generated by the
pre-programmed analytical tools. When preparing the survey report the charts can be copied
and pasted into a word document.
To copy the charts from excel into a word document take the following steps:
1. In the pre-programmed analytical tool open the spreadsheet entitled Charts
2. Highlight the cells around the chart that you want to copy
3. Select edit and „copy‟
4. Open the word document
5. Put cursor in area where you want the chart to be inserted
6. Select edit and „paste‟.
80%
60%
Never/Sometimes
40%
Usually/Always
20% 12%
6% 4%
0%
Nurse Showed Respect Nurse Listened Carefully Nurse Explained Clearly
50% Never/Sometimes
40%
Usually/Always
30%
20% 14% 16% 14%
10%
0%
Doctor Showed Doctor Listened Doctor Explained
Respect Carefully Clearly
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 220
Preparing a Patient Satisfaction report
A report on the findings of each patient survey should be prepared for facility management
and other relevant bodies. Useful information to describe in the report includes:
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 221
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 222
Appendix 14 Template for Site Visit Briefing Document
This template should be used in the preparation phase of the supportive site visit process to provide all
team members with information about the hospital. The site visit leader should complete prepare the
document and distribute it to team members prior to the site visit.
Enter here a summary of the action that the hospital was expected to take following the previous
site visit (based on the most recent hospital response and action plan)
Describe (if known) whether the hospital has undertaken this action and any issues that remain.
Enter here a summary of information gathered from the most recent KPI report and EHRIG report
Enter here areas of performance that appear strong based on KPI/EHRIG reports or
information gathered from other sources
Enter here areas of performance that appear weak based on KPI/EHRIG reports or
information gathered from other sources
Enter here any data that should be checked/validated during the site visit. For example selected
KPI data or selected EHRIG standards
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 223
Areas for investigation
Enter here areas of the hospital that should be investigated during the site visit (based on the
information entered above). This could include follow up on actions that should have been
completed following the previous site visit, or performance issues that have been identified through
the KPI or EHRIG reports.
Be sure to include areas that are possible strengths of the hospital so that best practice can also
be identified.
Enter here the specific service areas of the hospital that should be visited by members of the site
visit team. This will be based on the information entered above. For example, MR Department,
Billing Offices/Finance Dept, ER Department, Inpatient Wards etc
Enter here the staff members who should be available for interview during the site visit. This should
be based on the information entered above. For example, CEO, SMT, Head of MR, Finance Head,
ER Case Team Leader, IP Case Team Leader etc
Enter here any addition information that the CEO should prepare for your visit. If feasible this
information should be sent to the site visit team before the site visit. However if this is not possible
then the information may be presented at the opening meeting of the site visit. For example;
patient or staff survey results etc
Enter here any unresolved action from the previous site visit. Include a description of progress
made by the hospital or RHB (if relevant) to resolve the issue.
Section 3: Scheduling
Date of proposed site visit:
Date hospital CEO informed of site visit:
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 224
Appendix 15 Template for Site Visit Report
The following is a template with guidance for preparing a supportive supervision site visit
report. It should be used after conducting a hospital site visit and reviewed by all team
members. Once agreed the report should be sent to the hospital CEO for comments. Once
finalized the report should be distributed to the RHB and all relevant stakeholders.
Cover Page
Should include region, name of hospital, names of site visit team members, date of site visit
and date of report completion
Table of Contents
Introduction
This section should include background information about the site supervision process,
general hospital information (hospital level, services offered, catchment population, etc.)
Main Findings
This section should provide a summary of the findings of the site supervision team. It
informs readers of:
- Key findings from the site visit
- Strengths and improvements made
- Areas for improvement
- Overall progress in implementing hospital reforms (EHRIG, BPR, BSC, etc.)
Recommendations
This section should describe any follow up actions the hospital should take based on
the findings of the site supervision team.
Conclusion
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 225
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 226
Appendix 16 Template for Hospital Response to Site Visit Report
Hospital response:
Enter here any specific comment you have on the Site Visit Report. State if you accept the findings
and recommendations of the site visit report.
If there are any observations or comments made in the site visit report that you think are
inaccurate describe those here.
Action plan:
Enter here any support or action that you expect the RHB or other partners to take to assist the
hospital to fulfill its action plan or to respond to recommendations made by the site visit team.
Enter here any suggestions you would like to make to the site visit team for their next visit to the
hospital. This could be areas of the hospital that were not reviewed during the current site visit
where you would like to demonstrate good practice, or areas where you would like the site visit team
to have better understanding of the challenges you face.
Enter here any other comments you have. For example suggestions on how the site visit
process could be improved
Federal Hospital Performance Monitoring and Improvement Manual – July 2011 227