Home › Exam notes › CTET › Validity Reliability and Fairness

Validity Reliability and Fairness

Child Development & Pedagogy

Useful for: CTET, KVS, NVS, OTET, OSSTET, UGC NET, EMRS, CTSA / STSS

and 17 more exams

Junior Teacher, OAVS, OSSC Art Education Instructor, OSSC Economics, OSSC English, OSSC Foundation Course, OSSC Geography, OSSC History, OSSC Mathematics, OSSC Odia, OSSC Physical Education Instructor, OSSC Political Science, OSSC Teacher Readiness, Sainik Schools, Special OTET, SSB Lecturer (Degree Colleges), SSB School Teachers

हिंदी में पढ़ें

Overview

A good assessment is valid (measures what it should), reliable (consistent), fair (unbiased) and usable.

Key points

Content validity: items cover the syllabus content.
Construct validity: the test measures the intended trait.
Criterion validity: results agree with an outside measure (concurrent) or predict future performance (predictive).
Reliability types: test–retest, split-half, inter-rater, parallel forms.
A test can be reliable without being valid, but cannot be valid without being reliable.
Fairness requires bias-free items and suitable accommodations.

Explanation

Clear marking schemes improve inter-rater reliability.
Language difficulty can reduce validity in a maths test.
Objectivity means scoring does not depend on the examiner.
Usability covers time, cost and ease of scoring.
Blueprints help ensure content validity.

Step by step

Identify the concept, thinker or policy being tested.
Recall the exact definition, stage or provision.
Prefer inclusive, child-centred and evidence-based choices; reject punitive or labelling ones.

Examples

A maths test full of hard English words → validity problem.
Two teachers give very different marks to the same essay → poor inter-rater reliability.
A scale that always reads 2 kg too heavy → reliable but not valid.

Traps and advanced points

Trap: Saying valid tests can be unreliable.
Trap: Mixing validity types.
Trap: Ignoring fairness.

Quick revision

Valid = right thing; reliable = consistent.
Four reliability methods.
Reliable but not valid is possible.

Practice MCQs

A test that measures what it is supposed to measure is —
1. reliable
2. valid
3. objective only
4. usable only
Read chapter notes · Similar questions
Show answer
Answer: (b) valid. Validity = measuring the right thing.
A test that gives consistent results is —
1. fair
2. difficult
3. valid
4. reliable
Read chapter notes · Similar questions
Show answer
Answer: (d) reliable. Reliability = consistency.
A scale that always reads 2 kg too heavy is —
1. valid and reliable
2. reliable but not valid
3. valid but not reliable
4. neither
Read chapter notes · Similar questions
Show answer
Answer: (b) reliable but not valid. Consistent but wrong.
Which is NOT a method of estimating reliability?
1. Test–retest
2. Split-half
3. Inter-rater
4. Content analysis of the syllabus
Read chapter notes · Similar questions
Show answer
Answer: (d) Content analysis of the syllabus. Content coverage relates to validity.
Items covering the whole syllabus improve —
1. usability only
2. speed
3. content validity
4. inter-rater reliability
Read chapter notes · Similar questions
Show answer
Answer: (c) content validity. Content validity = coverage.
A maths test full of difficult English words has a problem of —
1. objectivity
2. cost
3. validity
4. usability
Read chapter notes · Similar questions
Show answer
Answer: (c) validity. Language difficulty distorts what is measured.
Two teachers giving very different marks to the same essay shows poor —
1. content validity
2. predictive validity
3. usability
4. inter-rater reliability
Read chapter notes · Similar questions
Show answer
Answer: (d) inter-rater reliability. Scorers disagree.
Predictive validity means test scores —
1. predict future performance
2. match the syllabus
3. are consistent
4. are easy
Read chapter notes · Similar questions
Show answer
Answer: (a) predict future performance. A type of criterion validity.
Fairness in assessment requires —
1. fewer items
2. secret criteria
3. bias-free items and suitable accommodations
4. harder items
Read chapter notes · Similar questions
Show answer
Answer: (c) bias-free items and suitable accommodations. All learners must get a fair chance.
Clear marking schemes mainly improve —
1. inter-rater reliability
2. difficulty
3. length
4. cost
Read chapter notes · Similar questions
Show answer
Answer: (a) inter-rater reliability. Consistent scoring across examiners.