Assessment Primer
Assessment Primer
Assessment Primer
MAJOR
A PRIMER FOR DEPARTMENT ASSESSMENT LIAISONS
I. WHAT IS ASSESSMENT?
Assessment is the systematic collection, review and use of information about educational
programs to improve student learning. Assessment focuses on what students know, what
they are able to do, and what values they have when they graduate. Assessment is
concerned with the collective impact of a program on student learning.
One major purpose of assessment is to inform. The results from an assessment process
should provide information that can be used to determine whether or not intended
learning outcomes that faculty have set are being achieved. The information can then be
used to determine how programs can be improved. An assessment process can also be
used to inform departmental faculty and other decision-makers about relevant issues that
can impact the program and student learning, such as the need for additional faculty and
resources. It can be used to support your assertions about your department’s successes
and strengths. Assessment activities can also serve external needs by providing data to
create a body of evidence for external accreditation.
One of the first steps in the assessment process is the development of statements of what
graduates should know, be able to do, and value. These are known as statements of
expected or intended student-learning outcomes. These statements should be based upon
the departmental mission statement, an integral part of the departmental program. The
remainder of the assessment process involves the development of an assessment plan that
includes: 1) the selection or design of appropriate assessment methods; 2) implementing
the assessment methods and gathering data on how well students have achieved the
expected learning outcomes; 3) examining, sharing, and acting on assessment findings to
improve student learning; and 4) examining the assessment process itself—assessing
assessment.
Successful program assessment begins with a clear sense of what the program is designed
to accomplish. The terms “goals” and “objectives” are often used in relation to expected
student learning outcomes. Goals describe broad learning outcomes and concepts (what
you want students to learn) expressed in general terms (e.g., oral and written
communication skills, problem-solving skills, etc.). Objectives are the specific skills,
values, and attitudes students should exhibit that reflect the broader goals (e.g., for
students in a freshman writing course, this might be “students are able to develop a
1
cogent argument to support a position”). Objectives and expected student learning
outcomes are interchangeable terms.
It is generally a good idea to identify between three and five student learning goals for
your program. However, if the department can agree on only one goal, focus on that one.
Program objectives/expected outcomes transform the general program goals into specific
student performance and behaviors that demonstrate student learning and skill
development. What are the specific student behaviors, skills or abilities that would tell
you that a goal is being achieved? What evidence, behavior, etc. would a skeptic need in
order to see that your students are achieving the major goals you have set out for them?
What evidence tells you that students have met these goals?
2
There are three types of student learning objectives/expected outcomes:
V. ASSESSMENT METHODS
When developing assessment methods, make sure your selections are manageable given
available time and money resources and result in useful feedback that highlights
accomplishments and identifies areas requiring attention. Consider data you might
currently have available to you but that you might not be using for assessment purposes
such as exams, assignments, or projects common to a group of students in the major and
senior assignments accomplished as a part of a capstone experience. Because most
course grades represent the sum total of a student’s performance across a host of
outcomes, they provide little information on the overall success of the program in helping
students attain specific and distinct learning objectives. Data on the quality of the
curriculum, faculty qualifications and publications, course selection, faculty/student
ratios, and enrollment are also inappropriate for measuring student-learning outcomes.
New data on student learning can be collected from the following sources:
3
Standardized tests (nationally-constructed or department based to assess cognitive
achievement)
Course-embedded assessment (uses exams, class activities, and assignments)
Portfolio analysis (collection of student work)
Performance-based measures (activities such as writing an essay, making a
presentation, completing a problem-solving exercise, giving a performance, and
simulations)
Capstone courses for graduating seniors (summary course for major)
Surveys, interviews, and focus groups of students, alumni, and employers
Institutional data on graduation and retention
Each department will select and develop assessment methods that are appropriate to their
departmental goals and objectives. These are the methods that will provide the most
useful and relevant information for the purposes that faculty in the department have
identified. Not all methods work for all departments. There should be a balance of direct
and indirect measures. Direct methods ask students to demonstrate their learning and
look directly at student work product. Direct methods include objective tests, essays,
presentations, and classroom assignments. Indirect methods ask students to reflect on
their students and include surveys and interviews. Include qualitative as well as
quantitative measures. Quantitative measures assess teaching and learning by collecting
and analyzing numeric data using statistical techniques. These include standardized test
scores and survey results. Qualitative measures rely on descriptions rather than numbers.
These include exit interviews, participant observations, writing samples, and open-ended
questions on surveys and interviews.
A. DIRECT METHODS
Tests and exams provide direct evidence of student academic achievement and can be
more objective, valid and reliable than subjective ratings. Selecting a standardized
instrument or a locally developed assessment tool depends on specific needs and
resources available. Knowing what you want to measure is key to selecting standardized
instruments. Locally developed instruments can be tailored to measure specific
performance expectations for a group of students. Locally developed instruments are
directly linked to the local curriculum. Putting together a local tool and developing the
scoring method is time-consuming and the results cannot be compared to state or national
norms. Standardized tests can be expensive to purchase, and they may not link to local
curricula.
4
evaluating assignments not on the basis of a course grade but according to the degree to
which students achieve objectives/expected outcomes for the program; 3) translating
objectives into criteria; 4) creating specific, behaviorally-anchored, rating scales for each
criterion and attaching point values to each level; and 5) adding the point values attained
to produce an overall score for overall assessment. This method is often effective and
easy to use because it builds on the structure of the course. It takes preparation and
analysis time and is better for measuring and improving performance in individual
courses than entire programs.
Portfolios are collections of student work over time that are used to demonstrate student
growth and achievement in identified areas. A portfolio may contain all or some of the
following: research papers, process reports, tests and exams, case studies, audiotapes,
videotapes, personal essays, journals, self-evaluations and computational exercises. With
this assessment method, students collect examples of work that illustrate achievement of
the identified student learning objective/expected outcome and write a reflective
commentary. Faculty periodically assess the portfolios of a cohort of students against the
objective/expected outcome with a view to improving the program. Using portfolios
involves 1) isolating the objectives/expected outcomes that can be assessed through
portfolios; 2) selecting a sample of students; 3) providing students with a binder or
indicate relevant assignments; and 4) using standardized evaluation sheets (or rubrics) to
assess achievement of objectives/expected outcomes of each student. Portfolios
demonstrate learning over time and provide direct evidence of achievement. They are
costly, time-consuming and require extended effort on the part of students and faculty.
Performance assessment uses student activities to assess skills and knowledge. These
activities include class assignments, auditions, recitals, projects, presentations, and
similar tasks. Performance assessment is linked to the curriculum and uses real samples
of student work. Articulating the skills that will be examined and specifying the criteria
for evaluation may be time-consuming and difficult.
Many direct methods of assessment require the use of scoring rubrics. Scoring rubrics
identify criteria for successfully completing the assignment and establish levels for
meeting these criteria. Rubrics can be used to score everything from essays to
performances. Holisitic rubrics produce a global score for a product or performance.
Primary trait analysis uses separate scoring of individual characteristics or criteria of the
product or performance. (See the publication Scoring Rubrics: A Compilation of Rubrics
5
Collected from Texts, Web Sites, Conference Presentations, and Generous Colleagues,
California State University.)
B. INDIRECT METHODS
Surveys and interviews ask questions of groups who are able to assess the cognitive,
behavioral, or affective performance of the program. These groups include current
students, graduating students, recent graduates, alumni, and employers. These
assessment methods provide indirect evidence of the effectiveness of the program in
achieving its student learning objectives/expected outcomes. Questions can be both
open-ended and closed-ended. Surveys and interviews can be conducted in writing,
orally (face-to-face), or by telephone. Surveys can be relatively inexpensive and easy to
administer and can reach participants over a wide area. It can be difficult to reach the
sample population and it can be time-consuming to analyze the data. Employer surveys
help the department determine if their graduates have the necessary job skills, although
responses may not provide enough detail to make decisions about specific changes in the
program. Alumni surveys can provide a wide variety of information about program
satisfaction, how well students are prepared for their careers, what types of jobs or
graduate degrees majors have obtained, starting salaries, and the skills needed to succeed
in the job market or in graduate study. Alumni can be difficult to locate and it can be
time-consuming to develop an effective survey and ensure an acceptable response rate.
Focus groups are structured discussions among homogeneous groups of 6-10 individuals
who respond to open-ended questions designed to collect data about beliefs, attitudes, and
experiences of those in the group. It is a form of group interview where a facilitator
raises the topics for discussion and collects data on the results. Emphasis is on insights
and ideas. Data collected in this way is not useful for quantitative results.
A variety of institutional data are collected at the university level. These data can tell
you whether or not the program is growing, what the grade point average is for majors in
the program, and what the retention rate is for your students. The data may be less useful
to specific departments because the information collected is very often general and may
not directly relate to program goals and objectives.
The end result of your assessment design will be an effective and workable assessment
plan. It can be a formal document or an informal schedule for department use only. It
will include your student learning goals, student learning objectives/expected outcomes,
and assessment methods. In addition, it will describe other aspects of your assessment
process such as when you will conduct your assessment, who will be responsible for the
components of your assessment, who is responsible for reviewing and disseminating your
assessment findings, and how the data will be used to improve your program or revise
your curriculum. This last step is known as closing the feedback loop. It is necessary to
close the loop in order to ensure that assessment data contribute to program improvement
and resource allocation decisions.
6
APPENDIX A
BLOOM’S TAXONOMY
RELEVANT VERBS
7
APPENDIX B
Examples of Effective Student Learning Goals and Student Learning
Objectives/Expected Outcomes
Social Sciences
Student Learning Goal
Students who major in one of the social sciences will learn that they have responsibilities
to themselves, their families, peer groups, communities, and society.
Student Learning Objectives/Expected Outcomes
Students will be able to identify the role that cultural diversity plays in defining
what it means to be a social being.
Students will be able to identify the origins, workings, and ramifications of social
and cultural change in their own identity.
Students will be able to compare the distinctive methods and perspectives of two
or more social science disciplines.
Natural Sciences
Student Learning Goal
Students who major in the natural sciences will become critical thinkers who are able to
judge scientific arguments created by others and see relationships between science and
societal problems.
Student Learning Objectives/Expected Outcomes
Students will be able to apply scientific methodology.
Students will be able to evaluate the validity and limitations of theories and
scientific claims in experimental results.
Students will be able to identify the relevance and application of science in
everyday life.
Humanities
Student Learning Goal
Students who major in the humanities will begin to recognize themselves as “knowers,”
be self-conscious about their participation in a particular culture, and cultivate their
ability to discover new knowledge for themselves.
Student Learning Objectives/Expected Outcomes
Students will be able to identify the contributions of the humanities to the
development of the political and cultural institutions of contemporary society.
Students will be able to analyze the meaning of major texts from both Western
and non-Western cultures.
Students will be able to apply the humanistic perspective to values, experiences,
and meanings in their own lives.
The previous objectives do not identify specific assignments for measuring the objectives
nor do they set levels of proficiency. Generally, those aspects of the objectives need to
be spelled out after the department has identified its methods for assessing the basic
objectives. Some examples of student learning objectives/expected outcomes that are
more specific:
8
Natural Science
Student Learning Objectives/Expected Outcomes
Students will demonstrate an understanding of basic scientific principles by
restating the principle in their own words and giving a real-world example of the
principle in action.
Students will be able to distinguish between correct and incorrect applications of
the principle when given examples of each on an objective exam.
English
Student Learning Objectives/Expected Outcomes
Students will write five-page essays reflecting the work of an author of their
choice that presents a clear and well-organized argument and uses examples from
the author’s work to support the argument.
Students will use the conventions of Standard Written English in all writing
assignment.
Education
Student Learning Objectives/Expected Outcomes
Students will clearly demonstrate an understanding of curriculum theory and
standards by preparing a two-page curriculum plan and providing justification
from the literature for the chosen curriculum method.
Students will show an understanding of real-world curriculum needs by including
in the curriculum plan details on the content and order of the curriculum, the
appropriate grade level, and the time frame for implementation.
OTHER EXAMPLES:
English
Student Learning Goal
All graduates at the baccalaureate level will develop a depth of understanding in their
major field.
Student Learning Objective/Expected Outcomes:
Graduates will be able to critique a brief draft essay, pointing out the
grammatical, spelling, and punctuation errors.
Students completing the baccalaureate program will be capable of writing an
acceptable journal article.
Accounting
Student Learning Goal
The student is expected to understand the application of fundamental accounting theory
to nonprofit entities.
Student Learning Objective/Expected Outcome
The student must be able to classify government activities into one of the five
categories recommended by the National Council on Government Accounting.
9
Speech Pathology
Student Learning Goal
The student is expected to understand communication processes and strategies.
Student Learning Objective/Expected Outcome
The student will phonemically transcribe all standard English phonemes in
nonsense syllables, words, and connected speech.
Theatre
Student Learning Goal
The student is expected to know the basic elements in at lease one area of technical
theatre.
Student Learning Objective/Expected Outcome
The student should know how to construct a soft covered flat, a standard ridged
platform, and simple step unit.
Literature
Student Learning Objective/Expected Outcome
The student will be able to appraise the implied and non-literal meanings of words
and phrases within a given context through metaphorical use of language and
through irony, understatement, and deliberate incongruity.
Social Work
Student Learning Objective/Expected Outcome
The student will have the ability to identify, select, adopt, and apply the following
approaches to social work practice: structural, task-centered, systems, crisis
intervention, psychosocial, social learning, social developmental, Rothman’s
typology, and conflict based.
10
APPENDIX C
A TEMPLATE FOR STUDENT LEARNING GOALS AND
OBJECTIVES/EXPECTED OUTCOMES
Upon completing the major in __________________, the student will be able to:
Student Learning Goal
Objectives/Expected Outcomes
Cognitive
Action Verb
Action Verb
Action Verb
Behavioral
Action Verb
Action Verb
Action Verb
Affective
Action Verb
Action Verb
Action Verb
11