Key Performance Indicators
Key Performance Indicators
Key Performance Indicators
Prepared by
Deanship of Development and Quality
2019
1
Contents
1. Introduction.
2. NCAAA KPIs.
3. Procedures for identifying indicators.
4. KPIs analysis.
5. Identifying strengths and opportunities for improvement.
6. Formulating improvement/action recommendations and implementing
action plans.
7. Upload Program KPIs data on Daman platform.
2
1- Introduction
Based on the commitment of the Qassim University to adopt the standards of the Center
for Education Evaluation and Academic Accreditation, or NCAAA for short (formerly
the National Authority for Academic Accreditation and Accreditation), and it’s keenness
to work to apply them to its various programs, and also in support of its programs that
seek to obtain national accreditation, the Deanship of Quality Assurance and Accredita-
tion develops a set of manuals to provide technical support for programs at the university
level with the aim of ensuring the proper performance according to the Center’s stan-
dards in a manner that achieves the university’s mission and strategic objectives, and to
qualify advanced programs for national accreditation. Based on this, these guides have
been prepared for the purpose of highlighting this scientific discourse that has high im-
portance, and includes a set of manuals as we include the current manual “Key Perfor-
mance Indicators Guide in Qassim University “, in pursuit of the Deanship of Devel-
opment and Quality in Qassim University to activate mechanisms for measuring these
indicators periodically. This guide has been prepared to provide a detailed explanation of
all the indicators approved the internal quality system in the Qassim University, accord-
ing to specific timetables that clarify the measurement courses, in addition to a unified
mechanism for determining the target values in light of the objectives of the university’s
strategic plan and the Ministry of Education’s plans “Afaak”.
3
Evaluation: The process of estimating and giving value to a particular facility
or activity.
The external evaluation: an independent review to verify the reports that repre-
sent the record of real and correct activity and that the recognized standards have
been achieved.
Quality: The value, quantity, or level awarded to an educational institution or ed-
ucational program compared to generally accepted standards for an educational
institution or educational program of its kind.
Performance indicators: specific forms of evidence (usually pre-selected) that
the institution or any other agency uses to provide evidence of quality of perfor-
mance.
Key performance indicators: Selected performance indicators that are of par-
ticular importance for the purposes of evaluating performance (and that can be
qualitative or quantitative).
4
The use and reliance on these indicators require a continuous assessment/evalua-
tion of these indicators and determining their suitability, the appropriateness and
effectiveness of collecting and preserving the data necessary to calculate these
indicators and then using them to judge the quality of the institution’s perfor-
mance and future planning.
5
Furthermore, NCAAA affirms that “a report describing and analyzing the
results of each indicator (including: performance changes and comparisons ac-
cording to sites and gender) is expected with a precise and objective identifica-
tion of strengths and aspects that need improvement”.
Table No. 1 shows the KPIs divided according to the programmatic quality stan-
dards established by the Center with their symbols and description. While Table
2 shows the objectives, polarity, measurement time, rate of measurement, and the
target value for these indicators.
Table No. 1: KPIs
Key Perfor-
Standard Code mance Indica- Description
tors
Percentage of Percentage of performance indicators of the
--1 achieved indica- operational plan objectives of the program
KPI-P-01 tors of the pro- that achieved the targeted annual level to
Mission and
gram operational the total number of indicators targeted for
Objectives
plan objectives these objectives in the same year
6
Students› Evalu-
Average of overall rating of final year stu-
ation of qual-
dents for the quality of learning experience
KPI-P-02 ity of learning
in the program on a five-point scale in an
experience in the
annual survey
program
Students› evalu- Average students overall rating for the
KPI-P-03 ation of the qual- quality of courses on a five-point scale in an
ity of the courses annual survey
Proportion of undergraduate students who
KPI-P-04 Completion rate completed the program in minimum time in
each cohort
Percentage of first-year undergraduate
First-year stu-
students who continue at the program the
KPI-P-05 dents retention
next year to the total number of first-year
rate
students in the same year
Students›
Percentage of students or graduates who
performance in
--3 were successful in the professional and / or
KPI-P-06 the professional
national examinations, or their score aver-
and/or national
Teaching and )age and median (if any
examinations
Learning
Percentage of graduates from the program
:who within a year of graduation were
Graduates’
a. employed
employability
KPI-P-07 and enrolment b. enrolled in postgraduate programs
in postgraduate
programs during the first year of their graduation to
the total number of graduates in the same
year
Average number of students per class (in
Average number
each teaching session/activity: lecture,
KPI-P-08 of students in the
small group, tutorial, laboratory or clinical
class
)session
Employers›
Average of overall rating of employers for
evaluation of the
KPI-P-09 the proficiency of the program graduates on
program gradu-
a five-point scale in an annual survey
ates proficiency
Average of students’ satisfaction rate with
--4 Students› satis- the various services offered by the program
KPI-P-10 faction with the (restaurants, transportation, sports facilities,
Students offered services academic advising, ...) on a five-point scale
in an annual survey
7
Ratio of the total number of students to
Ratio of students
KPI-P-11 the total number of full-time and full-time
to teaching staff
equivalent teaching staff in the program
Percentage of teaching staff distribution
:based on
Percentage of
a. Gender
KPI-P-12 teaching staff
distribution
b. Branches
c. Academic Ranking
Proportion of Proportion of teaching staff leaving the pro-
teaching staff gram annually for reasons other than age
KPI-P-13
leaving the pro- retirement to the total number of teaching
--5 gram .staff
Percentage of full-time faculty members
Teaching Percentage of
who published at least one research during
Staff KPI-P-14 publications of
the year to total faculty members in the
faculty members
program
The average number of refereed and/or
Rate of pub- published research per each faculty mem-
lished research ber during the year (total number of refer-
KPI-P-15
per faculty eed and/or published research to the total
member number of full-time or equivalent faculty
)members during the year
The average number of citations in refereed
Citations rate in journals from published research per faculty
refereed jour- member in the program (total number of
KPI-P-16
nals per faculty citations in refereed journals from published
member research for full-time or equivalent faculty
)members to the total research published
--6 Average of beneficiaries’ satisfaction rate
Satisfaction of
with the adequacy and diversity of learning
Learning beneficiaries
KPI-P-17 resources (references, journals, databas-
Resources, with the learning
Facilities, and es… etc.) on a five-point scale in an annual
resources
Equipment .survey
Table No. 2: Objectives, Polarity, and Method of Measuring Indicators and the
Target
Measure- Measurement
Code The indicator Goal *Polarity Target
ment time Tools
8
The percentage
of achieved in- Measuring
Statistical data
dicators of the the quality Annually
and analysis
KPI-P-01 objectives of of program Positive (end of aca-
the program›s performance (demic year
Questionnaires
operational in all axes
plan
Questionnaires:
Measuring
employment the quality
agencies of graduates
Annually
evaluation of ‹character-
KPI-P-09 Positive (end of aca- Questionnaires
the efficiency istics and
demic year(
of graduates employers›
program satisfaction
with them
Questionnaires:
9
Mea-
Measurement sure-
Code The indicator Goal Polarity Target
time ment
Tools
Measuring
The ratio of Annually (be-
the quality of Statisti-
KPI-P-11 students to Negative ginning of aca-
education ele- cal data
faculty )demic year
ments
Measuring
The percent- Annually (be-
the quality of Statisti-
KPI-P-12 age of faculty Even ginning of aca-
education ele- cal data
distribution demic year)
ments
10
* a KPI’s polarity indicates its preferable direction. A positive KPI (e.g. KPI-
P-17) means higher values are preferable and vice versa. A negative KPI (e.g.
KPI-P-11) means lower values are preferable and vice versa.
Table 3: KPIs associated with quality criteria and the mechanism of calcu-
.lating the new target
The Indicator Criteria Associated With The Indicator
The percent-
age of achieved
indicators of the
KPI-P-01 All the following criteria
objectives of the
program›s opera-
tional plan
The curriculum takes into account the achievement of the
Students› objectives of the program, its educational outputs, scien-
evaluation of the tific, technical and professional developments in the field
KPI-P-02 quality of learning of specialization, and reviews it periodically.
experiences in the Teaching and learning strategies and assessment meth-
program ods used are consistent with targeted learning outcomes
.of the program at curricular and program levels
Students› evalua- The learning outcomes in the courses are related to the
KPI-P-03 tion of the quality program›s learning outcomes (Matrix for mapping/distrib-
of the courses uting the program›s learning outcomes to the courses.
The curriculum takes into account the achievement of the
objectives of the program, its educational outputs, scien-
tific, technical and professional developments in the field
Apparent comple- of specialization, and reviews it periodically.
KPI-P-04
tion rate
Teaching and learning strategies and assessment meth-
ods used are consistent with targeted learning outcomes
.of the program at curricular and program levels
The curriculum takes into account the achievement of the
objectives of the program, its educational outputs, scien-
tific, technical and professional developments in the field
of specialization, and reviews it periodically.
Retention rate for
KPI-P-05 Teaching and learning strategies and evaluation methods
first year students
in the program vary in proportion to its nature and level,
it enhances the ability to conduct scientific research, and
ensures that students acquire higher-order thinking and
.self-learning skills
The curriculum takes into account the achievement of the
objectives of the program, its educational outputs, scien-
tific, technical and professional developments in the field
Student perfor- of specialization, and reviews it periodically.
mance in profes-
KPI-P-06 Teaching and learning strategies and evaluation methods
sional and / or
national tests in the program vary in proportion to its nature and level,
it enhances the ability to conduct scientific research, and
ensures that students acquire higher-order thinking and
.self-learning skills
11
The curriculum takes into account the achievement of the
objectives of the program, its educational outputs, scien-
Employment of tific, technical and professional developments in the field
graduates and of specialization, and reviews it periodically.
KPI-P-07 their enrollment in Teaching and learning strategies and evaluation methods
graduate pro- in the program vary in proportion to its nature and level,
grams it enhances the ability to conduct scientific research, and
ensures that students acquire higher-order thinking and
.self-learning skills
The numbers of students admitted to the program are
Average number
compatible with the resources available to it (such as:
KPI-P-08 of students in a
the educational staff - classrooms - laboratories – equip-
class
.)ment
Program students and alumni have additional activities to
Evaluation of develop them professionally, in line with targeted learning
employment outcomes and labor market developments.
KPI-P-09 agencies for the
efficiency of pro- The program applies effective procedures to track
gram graduates student progress and ensure that they meet graduation
.requirements
The program offers a comprehensive configuration for
new students, ensuring their full understanding of the
types of services and capabilities available to them
The program introduces students to their rights, duties,
codes of conduct, complaints, complaints and disciplinary
procedures, in a variety of ways, and applies them fairly.
Students in the program are provided with effective
Student satis- services for academic, professional, psychological and
KPI-P-10 faction with the social counseling and guidance, through qualified and
services provided sufficient cadres.
Students of the program have extracurricular activities
in many fields to develop their abilities and skills, and
the program takes appropriate measures to support and
stimulate their participation.
The program takes into account the special needs of its
students (such as: people with special needs, interna-
.)tional students
12
Code The Indicator Criteria Associated With The Indicator
The number of students admitted to the program are
The ratio of stu- compatible/commensurate with the resources available to
KPI-P-11
dents to faculty it (such as: the educational staff - classrooms - laboratories
)– equipment
The program applies appropriate policies and procedures
for selecting faculty members in the program and retaining
.the distinguished ones
The program has a sufficient number of faculty members,
The percentage of in all locations where it is offered (such as: male and fe-
KPI-P-12
faculty distribution )male halves, branches
The faculty members have the necessary competence
(such as: qualifications, certificates, professional licenses
and experience required), teaching effectiveness, and ap-
.propriate mechanisms are applied to verify them
The program applies appropriate policies and procedures
for selecting faculty members in the program and retaining
.the distinguished ones
The program has a sufficient number of faculty members,
The percentage
in all locations where it is offered (such as: male and fe-
KPI-P-13 of faculty dropout
)male halves, branches
from the program
The faculty members have the necessary competence
(such as: qualifications, certificates, professional licenses
and experience required), teaching effectiveness, and ap-
.propriate mechanisms are applied to verify them
The percentage The faculty members participate efficiently in research and
of academic publi- scientific production activities, and their participation in
KPI-P-14
cation of faculty these activities is one of the criteria for their evaluation and
members .promotion
The rate of quota- The faculty members participate efficiently in research and
tions in the refer- scientific production activities, and their participation in
KPI-P-16
eed journals per these activities is one of the criteria for their evaluation and
faculty member .promotion
13
The library has a sufficient number of diverse resources
that are easily accessible, commensurate with the needs
of the program and the numbers of students, and are avail-
able to both male and female students at sufficient and
.appropriate times, and are updated periodically
The program has specialized electronic sources (such as:
digital references, multimedia, software), and appropriate
Percentage of databases and electronic systems that allow beneficiaries
beneficiaries to access information, research materials and scientific
KPI-P-17 .journals from within or outside the organization
from learning
resources The program is provided with laboratories, computer and
technical equipment, and appropriate materials for spe-
cialization and sufficient to conduct scientific research and
studies in accordance with its objectives, and appropriate
.mechanisms are in place to maintain and update them
The faculty, students, and staff of the program have the ap-
propriate preparation and technical support for the efficient
.use of learning resources and means
14
KPI-P-3 =
Method of calculating indicator number 4: the apparent completion rate.
The percentage of undergraduate students who completed the program in the
minimum prescribed period for the program from each batch.
KPI-P-4 =
Method of calculating indicator number 5: retention rate for first year students.
The percentage of first year students in the program who continue in the program
for the following year to the total number of first year students in the same year.
KPI-P-5 =
Method of calculating indicator number 6: Student performance in profes-
sional and / or national tests.
The percentage of students or graduates who passed the professional and/or na-
tional exams, or their average and median scores (if any).
KPI-P-6 =
Method of calculating indicator number 7: Employment of graduates and their
enrollment in postgraduate programs.
The percentage of graduates of the program who:
A- Got Employed.
KPI-P-7-A =
B- Got enrolled in graduate studies programs.
KPI-P-7-B =
During the first year of their graduation to the total number of graduates in the
same year.
Method of calculating the indicator number 8: the average number of students
in a class.
Average number of students in the class (in each meeting / teaching activity: lec-
ture - small group - seminars - laboratory or clinical lessons)
KPI-P-8 -
Method of calculating the indicator number 9: evaluation of employment
agencies for the efficiency of program graduates
15
Average overall estimate by employers of the program’s graduate competence,
on a five-level scale, in an annual survey.
KPI-P-9 =
Method of calculating the indicator number 10: student satisfaction with the
services provided.
The average estimate of student satisfaction with the various services provided
by the program (restaurants - transportation - sports facilities - restaurants - aca-
demic guidance ....) on a five-level scale in an annual survey.
KPI-P-10 =
Method of calculating the indicator No. 11: the ratio of students to faculty.
The ratio of the total number of students to the total number of full-time faculty
or its equivalent in the program.
KPI-P-11 =
Method of calculating the indicator No. 12: the percentage of teaching staff
distribution
Percentage distribution of teaching staff categories in terms of:
A- Gender
Percentage of the male faculty =
Percentage of the female faculty =
B – Branches
% of faculty in the main campus =
% of faculty in branches =
C- Academic rank
% of full-professor faculty =
% of the associate-professor faculty =
% of the assistant-professor faculty =
Method for calculating indicator No. 13: the percentage of faculty dropout
from the program.
Annual ratio of faculty members who leave the program for reasons other than
reaching retirement age to the total number of faculty.
16
KPI-P-13 =
Method of calculating indicator No. 14: the percentage of scientific publication
of faculty members.
The percentage of full-time faculty who published at least one research during
the academic year to the total faculty members in the program.
KPI-P-13 =
Method of calculating the indicator number 15: the published research rate for
each faculty member.
The average number of refereed and/or published research papers per faculty
member during the academic year (total number of refereed and/or published
research to total number of full-time faculty members or equivalent during the
year.)
KPI_P-15 =
Method of calculating the indicator number 16: the rate of quotations in the
refereed journals for each faculty member.
The average number of quotes in the refereed journals from the published scien-
tific research for each faculty member in the program (the total number of quota-
tions in the refereed journals from published scientific research for the full-time
faculty receptor or its equivalent to the total published research.)
KPI-P-16 =
Method of calculating the Indicator No. 17: The percentage of beneficiaries
from learning resources.
The average estimate of beneficiaries’ satisfaction with the adequacy and diver-
sity of learning resources (references - periodicals - databases ..... etc) on a scale
of five levels in an annual survey.
KPI-P-17 =
17
addition to external benchmarks.
The analysis includes linking and comparing the values of the indicator to the tar-
get, and then judging the quality of performance according to this indicator, and
linking this to the performance by considering the criteria and objectives related
to that indicator or a set of indicators.
Also from the objectives of the analysis, and based on the current indicator value
and trend over the years, new target values are identified or the existing values
are established.
Example of Analyzing the Results of KPI
KPI-P-2: Students’ Evaluation of quality of learning experience in the pro-
gram
Average of overall rating of final year students for the quality of learning experi-
ence in the program on a five-point scale in an annual survey
Targeted value: 5.0
Results:
Academic Year
1436/1437 1437/1438 1448/1439 1439/1440
Male 3.2
3.5 3.7 3.8
Female 2.4 3.1
3.5 3.5
-----------------------------------------------------------------------------------------------
---
Head Branch 3.3 3.6
3.7 3.6
Branches 2.7 3.2
3.6 3.8
Last year average result: 3.7 (male: 3.8 Female: 3.5)
Last year average result: 3.7 (Main campus: 3.6 Branches: 3.8)
Analysis:
The results indicates that the actual value of the indicator rises in the last year to
the value of 3.8, but it did not reach the targeted value.
18
The value of the indicator in the Head site has risen from year to year, and it
also increased in the branches. However, it still below the targeted value.
The value of the indicator for both male and female increases by time, and its
rate of increase is high for female. Also, it still below the targeted value.
Investigating the status and trend of the indicator, it has been decided to re-
established the targeted value at 4.0
New Targeted Value: 4.0
19
An example of a Strength point:
In one of the programs, performance indicators (KPI-P-14, KPI-P-15 & KPI-
P-16) were calculated for three consecutive years, and the results were as shown
in Table (4.1). Evidence was also provided of the quality of scientific research
activities, including the signing of two contracts for international cooperation
research projects, several projects supported by the university, and two research
supported by community institutions.
It is clear from the values of the indicators presented in the table, the high rates of
scientific publishing and the quotation ratios in the refereed journals from the re-
search of faculty members. The table shows that the values of the indicators have
achieved and exceeded the target, which confirms that the scientific research ac-
tivities in the program are a visible strength point, and this supports the available
evidence about scientific research projects mentioned in the previous paragraph.
Table 4.1: Results of Performance Indicators (KPI-P-14, KPI-P-15 & KPI-
P-16)
First Year Second Year Third Year
Indicator
Current
Current
Current
The Indicator
Target
Target
Target
Value
Value
Value
Code
The percentage
of academic
KPI-P-14 90% 100% 100% 100% 100% 100%
publication of
faculty members
The published
research rate
KPI-P-15 150% 160% 170% 180% 220% 200%
for each faculty
member
The rate of
quotations in the
KPI-P-16 refereed journals 3.2 3 3.4 3 3.5 3.3
per faculty
member
20
An example of an opportunity to improve:
In one theoretical program, the two performance indicators (KPI-P-11 & KPI-P-12)
were calculated for three consecutive years, and the result was as shown in Table 4.2.
The
The
Current
Current
Current
Indicator Target
Target
Target
Value
Value
Value
Indicator
Code
The ratio of
KPI-P-11 students to 1:30 1:22 1:32 1:22 1:31 1:22
faculty
Proffessor:
:Proffessor Proffessor: Proffessor:
2.5% Proffessor:5%
5%:Proffessor 20% 20% 20%
Asociate Asociate
Asociate Asociate Asociate Asociate
The
Proffessor: Proffessor:
percentage :Proffessor Proffessor: Proffessor: Proffessor:
KPI-P-12
of faculty 10%
15% 10%
distribution % 30 % 30 % 30
Assistant
Assistant Assistant
Assistant Assistant Assistant
Professor:85%
Professor:82.5 Professor:85%
% Professor:50 % Professor:50 % Professor:50
%
It is clear from the previous table that the ratio of students to faculty members is far from
the international proportions in theoretical programs (1:22), and also the distance from
the distribution of faculty members from the target, which was set from the distribution
of that ratio in distinct and peer programs. It is also clear from the table that there is no
tangible improvement in these percentages from year to year, and since there is no evi-
dence of taking measures that promise the prospect of improvement in the near future,
this point “The availability of a sufficient number of faculty members and the diversity
of their academic ranks to suit the needs of the program” is considered an opportunity
for improvement.
21
treatment by following the following steps:
1- Careful and deep analysis of the opportunities for improvement (poor performance
points) with the aim of identifying all the factors that affect the results associated with
this test of inputs and practices.
2- Determine the reasons that led to the poor performance and the shortcomings in the
test.
3- Suggesting improvement recommendations (treatment steps) necessary to address the
defects in these criteria
4- Determine who is responsible for implementing those recommendations (steps) and
the expected time period for implementation.
The Value
The Value The Value Target
of the Indi- Target
of the Indi- Target of the Indi- Target
cator After three
cator Second cator
Third Year First Year
Second Year Years
Third Year First Year
Year
The target was not achieved, as it reached 60% in the third year, while the target was
80%.
Reasons for not achieving the target:
After closer examination, it was found that the reasons are due to
1. The lack of desire of registered students in the programs in which they are registered.
2.The number of hours required to graduate in some programs is many compared to
those in other institutions.
22
3. Lack of careful following-up and reviewing of ongoing programs; as in some pro-
grams there are some courses that students keep failing in and delay their graduation
without finding adequate solutions.
Then the login screen appears where you enter your username and password
from the National Accreditation Authority. Then you will see the main screen
as shown in Figure 1.7. From this screen, several screens branch to facilitate all
operations available to you through the platform. For example, Figure 2.7 shows
the screen for the introduction of performance indicators, Figure 3.7 shows the
user guide for national accreditation.
23
Figure 1.7: The Main screen of Daman.
24
Figure 2.7: KPIs
25
26
Saudi Arabia
Key Performance
Indicators Manual
27
www.qu.edu.sa