October 10, 2010

Summary of assessment implications for first feedback to Leadership Team

The following represents some summary notes on educational assessment for the purposes of feeding back to the staff at my school. Much of it is the material from the first session of the module on summative assessment, with some reference to formative assessment for the benefit of comparison. Anyone should feel free to comment in any way.


Educational Assessment


What is assessment?


Measurement/judgement about 'how learners are getting on'?


Purposes

  • Summative

  • Formative


These are not interchangeable although some formative apps of summative and vice versa. Different purposes – different ways of assessing.


Summative assessment (the focus of this module)


Summative purpose

Grading, levelling, marks, accountability, external data, reporting back to parents, county, governors. An end product purpose. Not for feeding back per se, although levels are used as incentives and so do feed back into children's learning and motivation. In a positive way? Experience in y5 and y6 generally seemed to indicate that children became more motivated once they were given full knowledge of the levels and what achieving a higher level entailed.


Issues of:

  • reliability – results are replicable for different students of the same level, the same student being assessed in the same way at a different time, the same student taking a parallel test at the different time – all very problematic due to the number of variables. You can't step in the same river twice. No tests or assessment of any kind are very reliable. Some lend themselves more to fixed or closed methods of assessment and so are more likely to be more reliable. Experience in y6 past papers in maths – consistency of marks for each child. English assessment is notoriously unreliable, especially in the use of criteria based assessment methods. Experience of marking of writing 2009 and 2010. Not dependent on the apparent expertise of the markers – discrepancies of 3 levels, grades etc.

  • Validity – the assessment must assess what it purports to assess, for instance, a science assessment should not be assessing the child's ability (or inability) to read. Teaching to the tests would indicate that the tests are assessing something other than the national curriculum requirements. (Poetry writing, for example, is never a requirements for the tests)

  • manageability – any system of assessment will fail if it is not perceived as manageable. Examples of this include the early years of the NC where hundreds of ATs were attempted. Tick sheets – collapse of purpose. Implications for APP – use for all pupils considered unmanageable so 3 selected for scrutiny. Is this use of teacher assessment for learning or is this for accountability? What are we really supposed to be doing for the other pupils?


The payoff


Payoff in the three aspects - increase in reliability = decrease in validity (difficulty assessing everything being learned, sampling size etc) and decrease manageability. Increase validity = major decrease manageability.


Formative assessment


Assessment for Learning. Teacher assessment throughout learning period – marking, tests, questions, observations, discussions. Purpose – feedback, complicity, engagement, decision making, motivation, pupil influence. Improved learning. Does not need to generate a mark, level, reliable consistent result.


Possible implications for school


  • Do we believe everyone shares understanding of what assessment is?

  • Confusion with record keeping and tracking?

  • The act of assessment – what is that?

  • Do we need (is it appropriate) to make summative assessments so often throughout the year?

  • How can we improve the reliability of summative assessments?

  • Given the inherent unreliability of any grades/levels generated by assessment, but particularly by criterion/descriptive methods, is it appropriate to use these to measure teacher (school, county) performance, e.g. 'must make on average at least 4 points progress'?

  • Are we clearly defining the purposes of our assessment? Is it always summative? Do we know when we are assessing for formative purposes and if so, are we attempting to use these in a summative way?

  • Using formative assessment for summative purposes - issues of reliability





- One comment Not publicly viewable

  1. Juliet, I have been busily commenting on your comments on other people’s blogs and realise with horror that I have not commented on yours. So here I am in the midst of a mass catch-up. My apologies. I have alot of positive feedback to give you. Scanning your whole prodigious effort so far, first of all can I thank you for being such a good member of the blogging community, encouraging and engaging with all others. I really appreciate it. Secondly, you demonstrate good analytic and critical thinking skills as evidenced in your well-structured, reflective, thoughtful and carefully composed entries. Each is illustrated with very apt personal and professional experiences and you appear to have no fear of the academic literature and research in this area. You have told me that you are reading a great deal and this really shows. I hope it inspires others to do the same. There is simply nothing like it. There is much in here which you can already draw upon towards the assignment you have chosen and towards your professional practice portfolio for the CIEA. Have you had a chance to do the gap analysis yet? More on that this coming Saturday when we meet with Graham Herbert.

    18 Nov 2010, 13:55


Add a comment

You are not allowed to comment on this entry as it has restricted commenting permissions.

October 2010

Mo Tu We Th Fr Sa Su
|  Today  | Nov
            1 2 3
4 5 6 7 8 9 10
11 12 13 14 15 16 17
18 19 20 21 22 23 24
25 26 27 28 29 30 31

Search this blog

Tags

Galleries

Most recent comments

  • Love the idea of linking the technology to learning – but still very wary of "distraction" – depth o… by on this entry
  • Assessment online has distinct advantages. After moderating work at a centre/school/college it is li… by on this entry
  • I'm fairly sure that it's an issue with the 'digital immigrant' generation and also the interesting … by Juliet Nickels on this entry
  • Yes, I agree that the pace of change does not seem to have been as great as we might have expected –… by Sara Hattersley on this entry

Blog archive

Loading…
Not signed in
Sign in

Powered by BlogBuilder
© MMXXI