Evaluation skills G Balasubramanian
Why evaluate? • Individual position on a learning curve • Position in a given learning cohort • Position in a given universe
What does a marking scheme contain? • A marking scheme contains value points for assessment. • They are suggestive. • The evaluator has the flexibility to award so long as the value point is reflected.
What is the relevance of marking scheme to an evaluator? • It reduces ambiguity in evaluation • It reduces subjectivity in evaluation • Ir provides standards for evaluation. • It is a normative tool for the entire universe of the examinees.
Threats to effective evaluation • Identification of schools/ candidates • Focus on the remuneration by increasing the quantity of evaluated papers • Poor computation of marks • No standardized procedures for addition or recording.
What is the meaning of a Bell curve? • It reflects the performance profile of examinees in a given situation. • It shows a meaningful profile when the volume of the examinees is large • It is just an indicator. • There is no pre-condition that it has to remain always normal. • The standard curve is never forced on a cohort
The skewing of the curve • In all normal conditions the curve is skewed. • Skewing could be positive or negative.
When does positive skewing occur? • When the question paper is too easy. • When the evaluation is quite liberal and subjective. • When the given cohort are high profile and high performing learners. • When the volume of the examinees is quite less. • When the marking scheme is not objective
When does a negative skewing occur? • When the question paper is quite difficult. • When the questions are out of focus or syllabus. • When the performance profile of the learners is low • When the learning experiences have been inadequate • When the evaluation is quite tight and rigorous. • When the marking scheme is not objective
What causes J-effect? • Undue emphasis on a given mark • Psychological pressure on examiners to award a given mark • Moderation or standardization focusing on a given mark • Student performances targeting a given mark
What is standard deviation? • Standard Deviation • The Standard Deviation is a measure of how spread out numbers are. • Its symbol is σ (the greek letter sigma) • The formula is easy: it is the square root of the Variance. • The Variance is defined as: The average of the squared differences from the Mean.
What does standard deviation indicate? • Standard deviation is the measure of dispersion away from the mean, or average, value
How do we assess the performance of a school? • Relating the mean score of a school in a subject with that of the Board score. • Relating the distribution profile of the learners of a school with that of the Board.
Should we give full marks to an answer if it is correct? • Why not? • Why should I? yes No
What kind of variations could occur during evaluation? • Perceptional variations • Indifference in observations • Oversights • Misconceptions about answers/questions
Issues in evaluation • Lack of focus/attention • Speed of assessment • Personal preferences • Poor handwriting • Styles of answers • Ideological differences
Some examples of poor assessment • Case relating to the question • The most ideal man I know
If the examiner doesn’t know • Give an example of Antibiotics.
Issues in evaluation • Does the teacher have adequate knowledge? • Does the teacher have adequate competence? • Does the teacher take the task with seriousness it deserves? • Mindsets in evaluation
Team Evaluation • What are its strengths? • What are its demerits?
Inter-teacher variability • Monitoring • Mentoring • Supervising
Case Study 1 • The format of writing a letter
Case study 2 • Lack of knowledge of the subject area
Case study 3 • All students getting the same marks in a given subject • All students getting the same marks in Maths and sciences
Case study 4 • Data Entry errors