Review Notes For Assess 1 (Let)
Review Notes For Assess 1 (Let)
Review Notes For Assess 1 (Let)
Page | 2
Page | 3
LESSON 2
CRITERIA FOR HIGH QUALITY ASSESSMENT
Introduction
McMillan (2004) explained that high-quality classroom assessment involves
concerns about how assessments influence learning and provide fair and credible
reporting of student achievement. For teachers, the primary determinant of quality is
how the information influences the students. Thus, the focus is on the use and
consequences of the results and what assessments get students to do, rather than on a
detailed inspection of the test itself.
High quality classroom assessments are technically sound and provide results
that demonstrate and improve targeted student learning. They also inform instructional
decision-making.
Criteria for High-Quality Classroom Assessment
1. Clear and appropriate learning targets
2. Appropriateness of assessment methods
3. Validity
4. Reliability
5. Positive consequences
Page | 4
Page | 5
B. Reliability
Reliability means the extent to which a test is dependable, self-consistent
and stable. It refers to consistency and accuracy of test results. If the measures
exactly the same degree each time it is administered, the test is said to have high
reliability. A test to be reliable should yield essentially the same scores when
administered twice to the same group of students.
Methods in Testing the Reliability of a Test
1. Test-retest
2. Parallel-forms (Form A and B)
3. Split-half method
4. Kuder-Richardson Formula 21
Page | 6
LESSON 4
PRINCIPLES OF TEST DEVELOPMENT
(INSTRUCTIONAL OBJECTIVES)
Introduction:
Page | 7
Convert
estimate
Describe
Translate
illustrate
infer
represent
distinguish
extend
generalize
paraphrase
predict
rewrite
3
.
Applying (Application). This refers to the ability to use a learned rule, method,
procedure, principle, theory, law and formula to solve new situation. Using
abstract ideas, rules, or generalized methods in novel and concrete
situations.
Some of the illustrative behavioural terms or verbs are:
Change
manipulate
Prepare
solve
Compute
modify
Produce
use
Demonstrate
operate
Relate
apply
Discover
predict
Show
construct
carry out
4
.
Analyzing (Analysis). This level refers to the ability to break down materials into
component parts to indentify the relationship. This may include (1)
identification of parts; (2) analysis of the relationship between parts; and
(3) recognition of the principles involved. This level is higher than
comprehension because it requires an understanding of both the content
and structural form of the organizational principles.
Some of the illustrative behavioural terms or verbs are:
Diagram
distinguish
Infer
select
Differentiate
identify
Outline
separate
Discriminate
illustrate
point out
subdivide
Relate
compare
Contrast
classify
Categorize
analyze
break down
5
.
Evaluating (Evaluation). This is concerned with the ability to judge the value of
material for a given purpose. Judging the quality worth or value of
something according to established criteria.
Some of the illustrative behavioural terms or action verbs are:
Compare
criticize
Explain
relate
Conclude
describe
Justify
summarize
Contrast
discriminate
Interpret
support
Appraise
judge
Weigh
evaluate
Verify
confirm
Defend
decide
6
.
Creating (Synthesis). This refers to the ability to put parts together to form a new
whole. This level stresses creative behaviours with emphasis on the
formulation of new structure. This concern on arranging and combining
elements and parts into novel patterns and structures.
Some of the illustrative behavioural terms or action verbs are:
Categorize
devise
Modify
reconstruct
Combine
design
Organize
relate
Compose
explain
Plan
revise
Create
generate
Rearrange
summarize
Assemble
integrate
Propose
conclude
Synthesize
Page | 8
reply
use
observe
listen
2
.
Responding. This refers to the active participation on the part of the students.
Students show willingness to respond and find initial level of satisfaction.
Some of the illustrative behavioural terms or verbs are:
answer
discuss
practice
report
assist
help
present
select
comply
label
read
write
conform
perform
recite
share
follow
respond
react
aid
tell
3
.
Valuing. This level concerned with the worth, value or importance a student
attaches to a particular object, situation or action. Something is perceived
as holding appositive value, a commitment is made.
Some of the illustrative behavioural terms or verbs are:
complete
follow
justify
select
describe
form
propose
share
differentiate
initiate
read
admire
explain
join
report
support
praise
assist
cooperate
participate
conserve
promote
demonstrate
work
4
.
5
.
Characterization. At this level, the student has a value system that has controlled
his behaviour for sufficiently long time. Organized system values becomes
a persons life outlook and the basis for a philosophy of life.
Some of the illustrative behavioural terms or action verbs are:
act
listen
propose
serve
discriminate
modify
qualify
solve
display
perform
question
use
advocate
approve
justify
influence
commit
accept
assert
maintain
verify
Page | 9
Monitor
Observe
Listen
2
.
Set. This refers to readiness to act. It includes mental, physical, and emotional
readiness to act. Perception is an important prerequisite.
Some of the illustrative behavioural terms or verbs are:
begin
move
respond
prepare
display
proceed
show
set-up
explain
react
start
ready
3
.
4
.
Mechanism. This is concerned with performance acts that have become automatic
and can be performed with some proficiency and confidence. This is also
concerned with habitual responses that can be performed with some
confidence and proficiency.
Some of the illustrative behavioural terms or action verbs are:
assemble
construct
fasten
manipulate
build
dismantle
fix
measure
calibrate
display
grind
sketch
demonstrate
collect
draw
use
type
write
5
.
Complex Overt Response. This is skillful performance of motor acts that involve
complex movement pattern. Performance is quick, smooth, accurate and
automatic requiring a minimum of effort.
Some of the illustrative behavioural terms or action verbs are:
assemble
construct
fasten
manipulate
build
dismantle
fix
measure
calibrate
display
grind
sketch
imitate
follow
copy
install
repeat
practice
trace
reproduce
6
.
7
.
P a g e | 10
create
develop
LESSON 5
TEST CONSTRUCTION
After the preparation of the table of specification, the next step is the construction
of the test proper. For the classroom teachers, the construction of the test has become
a routine activity, although a number of them, still feel that objective construction (of the
test) can hardly be achieved. Because of the essential and indispensable role of that
tests play in educative process, the teachers, whether they like it or not, should possess
good understanding of the test. Hence, they are expected to write good and purposeful
questions.
Classroom teachers construct their own test items best suited to local conditions.
Thus, the quality of test items constructed depends largely on the degree of
understanding of the classroom teachers about the construction of the test and the
circumstances under which the test is applied.
The tests constructed by the teachers are called teacher-made tests. Basically,
there are two types of teacher-made tests. These are the objective type and essay type.
Essay Test
Extended
Response
Restricted
Response
Objective Test
Supply/
Constructed/
Free Response
Short Answer
Selected/
Fixed
Response
Completion
Binary Choice
(True-False)
Matching
Multiple Choice
P a g e | 11
Language
Mode
Type
Description
Educational
Tests
Psychologica
l Tests
Verbal Tests
Non-verbal
Tests
Standardized
Nature
and Tests
Administratio
n Process
Interpretation
of Scores
NonStandardized
Test
CriterionReferenced
Tests
NormReferenced
Examples
Achievement Test
Intelligent Tests
Personality Test
Achievement Test
Diagnostic Test
Philippine Nonverbal Intelligence
Test
National
Elementary
Achievement Test
National
Achievement Test
Unit Tests
Quarterly Test
Periodic Test
Teacher-made
Tests
Standardized Tests
P a g e | 12
Tests
Power Tests
Time
Requirements
Item Format
Domain/
Target
Measured
Content
Predictive
Concurrent
or Status
Reliability
Reading Test
Typing Speed Test
Type
Face
Most classroom
tests
Test-retest
Parallel-form
P a g e | 13
Split-half
(Odd and
Even)
Internal
Consistency
Usability
administered to the
group of students, and
the paired observations
correlated.
The test is administered
once, but the test items
are divided into two
halves.
Used with psychological
test which consists of
dichotomously scored
items
Giving clear directions;
Using comprehensible
vocabulary and sentence
structure; Ensuring that
the test items are of
moderate level of
difficulty
Application
Prepare a table of specifications or a test
blueprint and use it as a guide for writing
test items.
Match the test items with the instructional
objectives.
P a g e | 14
5
.
Objective Tests
Objective tests are item types that can be scored objectively. That is, equally
competent scorers can score them independently and obtain the same results. There
are two types of objective tests. These are recall type and recognition.
In recall type objective tests, the answer is not part of the test. This includes
completion test items and enumeration test items.
Completion Test Items. This test consists of a series of items, which requires the
students to fill a word or words on the blanks provided. These test items are useful for
measuring knowledge of factual information. They are applicable to the measurement
of concepts and skills at the lower level of cognitive domain.
The following are some suggestions for constructing completion test items.
1. Avoid lifting sentences directly from the book.
2. Make the blanks uniform length to prevent length as a clue.
3. The blank as much as possible is placed in the column that precedes the
numbers of the items.
4. State the items so that the answer is limited to a word or brief phrase.
5. For numerical answer, indicate the degree of precision expected.
6. Whenever the article a or an is written immediately before a blank, write it in
the form a(n).
7. Allot one point for each correctly filled blank.
8. Prepare a key that contains all acceptable answers.
In recognition type of objective tests, the answer is part of the test. This includes
true-false, matching tests items, and multiple choice test items.
Constructing a True False Test
These test items are simply stated in a declarative form, which the students must
judge as either true or false. These test items are characterized by the fact that only
two answers are possible. They are not applicable to the measurement of concepts and
skills at the higher level of cognitive domain.
The following are some suggestions for constructing true-false test items:
1. Do not give a hint (inadvertently) in the body of the question.
2. Avoid using the words always, never, often and other adverbs that tend to be
either always true or always false.
3. Avoid long sentences as these tend to be true. Keep sentences short.
4. Avoid trick statements with some minor misleading word or spelling anomaly,
misplaced phrases etc. A wise student who does not know the subject matter
may detect this strategy and thus get the answer correctly.
5. Avoid quoting verbatim from reference materials or textbooks. This practice
sends the wrong signal to the students that it is necessary to memorize the
textbook word for word and thus, acquisition of higher level thinking skills are not
given due importance.
P a g e | 15
P a g e | 16
P a g e | 17
3. In an objective test, it is easier to cheat and guess because of the short answer
given for each item.
4. Due to adequate sampling of an objective test items, it is expensive on the part of
the teacher.
5. An objective test requires more time on the part of the teacher.
Essays
Essays, classified as non-objective tests, allow for the assessment of higher
order thinking skills. Such test require students to organize their thoughts on a subject
matter in coherent sentences ion order to inform an audience. In essays tests, students
are requested to write one or two or more paragraphs on a specified topic.
Essay questions can be used to measure attainment of a variety of objectives.
Stecklein (1995) has listed 14 types of abilities that can be measured by essay items:
1. Comparison between two or more thing
2. The development and defense of an opinion
3. Questions of cause and effect
4. Explanations of meanings
5. Summarizing of information in a designated area
6. Analysis
7. Knowledge of relationships
8. Illustrations of rules, principles, procedures, and applications
9. Applications of rules, laws, and principles to new situations
10. Criticisms of the adequacy, relevance, or correctness of a concept, idea, or
information
11. Formulation of new questions and problems
12. Reorganization of facts
13. Discrimination between objects, concepts, or events
14. Inferential thinking
Advantages of Essay Type of Test
1. The essay test can easily be prepared.
2. It trains students for thought organization and self-expression.
3. It is economical.
4. It affords students to develop their critical thinking.
5. the essay test can be used to measure higher mental abilities among students.
6. It minimizes cheating and memorization.
7. It minimizes guessing.
Disadvantages of Essay Type of Test
1. Due to limited sampling of items, the test may become invalid and unreliable
measure of abilities.
2. Questions usually are not well-prepared.
3. It is difficult to score.
4. Scoring is highly subjective due to the influence of the teachers personal
judgment.
5. It is time consuming on the part of the teachers and students.
Rules in Constructing and Grading Essay Tests
1. Phrase the direction in such a way that students are guided on the key concepts
to be included.
2. Inform the students on the criteria to be used for grading their essays. This rule
allows the students to focus on relevant and substantive materials rather than on
peripheral and unnecessary facts and bits of information.
3. Put a time limit on the essay test.
P a g e | 18
4. Decide on your essay grading system prior to getting the essays of your
students.
5. Evaluate all of the students answers to one question before proceeding to the
next question.
6. Evaluate answers to essay questions without knowing the identity of the writer.
7. Whenever possible, have two or more persons grade each answer.
LESSON 6
TABLE OF SPECIFICATION
A TOS, sometimes called a test blueprint, is a table that helps teachers align
objectives, instruction, and assessment (e.g., Notar, Zuelke, Wilson, & Yunker, 2004).
This strategy can be used for a variety of assessment methods but is most commonly
associated with constructing traditional summative tests. When constructing a test,
teachers need to be concerned that the test measures an adequate sampling of the
class content at the cognitive level that the material was taught. The TOS can help
teachers map the amount of class time spent on each objective with the cognitive level
at which each objective was taught thereby helping teachers to identify the types of
items they need to include on their tests. There are many approaches to developing and
using a TOS advocated by measurement experts (e.g., Anderson, Krathwohl, Airasian,
Cruikshank, Mayer, Pintrich, Raths, & Wittrock, 2001, Gronlund, 2006; Reynolds,
Livingston, & Wilson, 2006).
LESSON 7
ITEM ANALYSIS
Item Analysis is a statistical technique which is used for selecting and rejecting
the items of the test on the basis of their difficulty value and discriminated power
OBJECTIVES OF ITEM ANALYSIS
To select appropriate items for the final draft
To obtain the information about the difficulty value(D.V) of all the items
To provide discriminatory power (D.I) to differentiate between capable and less
capable examinees for the items
To provide modification to be made in some of the items
To prepare the final draft properly ( easy to difficult items)
STEPS OF ITEM ANAYSIS
Arrange the scores in descending order
Separate two sub groups of the test papers
Take 27% of the scores out of the highest scores and 27% of the scores falling at
bottom
Count the number of right answer in highest group (R.H) and count the no of right
answer in lowest group (R.L)
Count the non-response (N.R) examinees
Item analysis is done for obtaining: a) Difficulty value (D.V) b) Discriminative power
(D.P)
Portfolio Assessment
P a g e | 19
P a g e | 20
Requiring extra time to plan an assessment system and conduct the assessment
Gathering all of the necessary data and work samples can make portfolios bulky
and difficult to manage
Developing a systematic and deliberate management system is difficult but this
step is necessary in order to make portfolios more than a random collection of
student work
Scoring portfolios involves the extensive use of subjective evaluation procedures
such as rating scales and professional judgement, and this limits reliability
Scheduling individual portfolio conferences is difficult and the length of each
conference may interfere with other instructional activities (Venn 2000)
P a g e | 21
D. Reflection
Analysis of skills and process
How skills and processes have been improved/enhanced
Labelling
Writing diary, logs, journals
Drawing
E. Evaluation
Use of the following tools:
P a g e | 22
Alternative response
Likert scale
Rating scales
Rubrics
P a g e | 23
Process Portfolio. This approach documents all facets or phases of the learning
process. They are particularly useful in documenting students overall learning process.
It can show how students integrate specific knowledge or skills and process towards
both basic and advanced mastery. Additionally, the process portfolio inevitably
emphasizes students reflection upon their learning process, including the use of
reflective journals, think logs, and related forms of metacognitive processing.
Showcase Portfolio. This type of portfolio is best used for summative evaluation of
students mastery of key curriculum outcomes. It should include students very best
work, determined through a combination of student teacher selection. Only completed
work should be included. In addition, this type of portfolio is especially compatible with
audio-visual artifact development, including photographs, videotapes, and electronic
records of students completed work. The showcase portfolio should also include
written analysis and reflections by the student upon the decision-making process(es)
used to determine which works are included.
Stages in Implementing Portfolio Assessment
Stage
Description
1
Identifying teaching goals to assess through portfolio
2
Introducing the idea of portfolio assessment to your class
3
Specification of portfolio content
4
Giving clear and detailed guidelines for portfolio presentation
5
Informing key school officials, parents and other stakeholders
6
Development of the portfolio
Purposes
1. Growth Portfolios
a. to show growth or change over time
b. to help develop process skills such as self-evaluation and goal-setting
c. to identify strengths and weaknesses
d. to track the development of one more products/performances
2. Showcase Portfolios
a. to showcase end-of-year/semester accomplishments
b. to prepare a sample of best work for employment or college admission
c. to showcase student perceptions of favourite, best or most important work
d. to communicate a students current aptitudes to future teachers
3. Evaluation Portfolios
a. to document achievement for grading purposes
b. to document progress towards standards
c. to place students appropriately
How Do You Create A Portfolio Assignment?
Purpose
: What is the purpose(s) of the portfolio?
Audience
: For what audience(s) will the portfolio be created?
Content
: What samples of student work will be included?
Process
: What processes (e.g., selection of work to be included, reflection on
work, conferencing) will be engaged in during the development of
the portfolio?
Management
: How will time and materials be managed in the development of the
portfolio?
Communicatio : How and when will the portfolio be shared with pertinent
n
audiences?
Evaluation
: If the portfolio is to be used for evaluation, when and how should it
be evaluated?
P a g e | 24