Tag Archives: assessment

Listen (11 mins) or read (7 mins)

Slides from Digitally Enhanced Webinars event July 13th 2022

Introduction

I have recently had a few interesting conversations about how our approaches to teaching and assessment in higher education might change post-Covid and it seems apparent that ‘consensus’ is unlikely to be the defining word as we move forward. In a few of those instances I was talking about ‘ungrading’ and, judging by the more dismissive responses, I feel that a fuller understanding of what ungrading could be might help challenge some of my interlocutors’ assumptions and pre-judgements. In this post, I will start with a few provocations that I’d urge you to commit agreement or disagreement to before moving on. I will then offer a brief definition followed by some examples from my own practice and then a rationale with some links to other online articles (that deal with this topic more thoroughly and from a position of much greater expertise) before offering a rudimentary continuum of possibilities all of which can broadly sit under ungrading as an umbrella term. 

Yes or no?

1. It is possible for practiced teachers/ lecturers to distinguish the quality of work to a precision of a few percentage points
2. Double marking will usually ensure fairness and reliability
3. For the purposes of student summative assessment, feedback is synonymous with evaluation
4. Grades (whether percentage scales or A-E) are useful for teachers and students 
5. Individual teachers/ lecturers have little or no agency when it comes to making decisions about how to grade or whether to grade

If you said mostly ‘yes’ then you are likely to be harder to persuade but please read on! I’d very much like to hear reasoned objections to the arguments I try to pull together below. If you said mostly ‘no’ then I would like to hear about your ungrading activities, ideas or, indeed, ongoing reservations or obstacles. 

Ungrading

As I mention above, ungrading is not a single approach but a broad range of possible alternative approaches and ways of seeing assessment and feedback. The reason I posed the yes/ no statements above was because the first prerequisite to trying an ungrading process is to hold (or be open to) a sentiment or value that questions the utility and effectiveness (and ubiquity) of grades on student work. Fundamentally, ungrading is, at one end of the scale, completely stopping the process of adding grades to student work. A less radical change might be to shift from graded systems to far fewer gradations such as pass/ not yet passed (so called ‘minimal grading’). A ‘dipping the toes’ approach might include more dialogue with students about their grades, self and peer assessment or grade ‘concealment’ as part of a process to encourage deeper connection with the actual feedback. Wherever ungrading happens on this continuum, it doesn’t mean not collecting information about what students are doing. By eschewing grades and rigid (supposedly measurable) criteria we open opportunities for wider, qualitative, multi-voiced narratives about what has been achieved. 

My toe dipping

In my previous role I was lucky enough to work on one of the only post grad (PG) programmes across the whole university that did not use percentage grades. Instead, all summative work was deemed pass or fail. The reason for this was because my students were my colleagues studying for a PG Certificate in Teaching in HE. To grade colleagues was seen as problematic for all sorts of reasons and even discourteous. One senior colleague said it would open a can of worms to grade colleagues who would question grades on all sorts of bases. This immediately raises several questions: 

• Why is grading discourteous to colleagues but not to ‘normal’ students?
• How did their status change the degree to which we evaluated (labelled?) them?
• If pass/ fail worked OK (the only student/ colleagues who expressed disappointment at only having pass/ fail were high fliers it should be noted) and they achieved these qualifications, why wasn’t that happening on other qualifications?
• Even if only appropriate with ‘professional’ students, why wasn’t it the default on, say, PG counselling programmes? 

I pushed the ungrading a step further by de-coupling the previous ‘gatekeeping’ aspect of lesson observations from the graded assessment process (each had been deemed pass or fail to that point), by removing grading from formative work and by modifying the language used on first submission summatives to pass/ not yet passed. 

I have also used audio and video feedback and sometimes coupled that with grade discussions/ negotiations and on others with embedding the grades within a multimedia response (harder to skim or ignore than text!). The biggest barriers in both instances were not the students but departmental and institutional pressures to conform to routine practice.  

So why do it?

“When we consider the practically universal use in all educational institutions of a system of marks, whether numbers or letters, to indicate scholastic attainment of the pupils or students in these institutions, and when we remember how very great stress is laid by teachers and pupils alike upon these marks as real measures or indicators of attainment, we can but be astonished at the blind faith that has been felt in the reliability of the marking systems” (Finkelstein, 1913 – yes, 1913)

There are two ways of perceiving the above quote I suppose: 1. The utility of grading has won through. Over a hundred years on, their use is still ubiquitous so surely that’s evidence enough that Finkelstein was mistaken or 2. Once we get stuck in our ways in education it takes a monumental effort to change the fundamentals of our practices (cf. examinations and lectures). 

Jesse Stommel reflects on the ubiquity and normalisation thus:

“Without much critical examination, teachers accept they have to grade, students accept they have to be graded, students are made to feel like they should care a great deal about grades, and teachers are told they shouldn’t spend much time thinking about the why, when, and whether of grades. Obedience to a system of crude ranking is crafted to feel altruistic, because it’s supposedly fair, saves time, and helps prepare students for the horrors of the “real world.” Conscientious objection is made to seem impossible.” (Stommel, 2018)

A century apart, both are objecting on one level to the claims (or assumptions) made in defence of grading: That they can provide accurate and fair measures; that there is no viable alternative; that they somehow prepare students for life after study. Although I admit I have not made a systematic review of the literature, it does seem much easier to find compelling research to suggest that grading has all sorts of reliability problems. Hooking back to my own (dis)interest in judgemental observations on the PG Cert HE, Ofsted (Governmental body responsible for overseeing standards in schools in England), the epitome of graded judgements, were eventually persuaded that the judgements their inspectors made about lesson observations were neither valid nor reliable. If such a body has issues with trained inspectors’ abilities to make fair judgements on a graded scale, it makes me wonder why similar discussions are not happening in that same body about teachers’ abilities to make fair, valid and reliable judgements of their students. One argument I have read to counter this is that it’s the best system we have for allocating places and deciding who is most worthy of merit – this is hardly a glowing accolade. In addition to this:

“ Grades can dampen existing intrinsic motivation, give rise to extrinsic motivation, enhance fear of failure, reduce interest, decrease enjoyment in class work, increase anxiety, hamper performance on follow-up tasks, stimulate avoidance of challenging tasks, and heighten competitiveness” (Schinske & Tanner, 2014)

And all this BEFORE we have even thought about implicit bias, the skewing of grading systems to favour elites and other prejudicial facets that are embedded in the assumptions that buttress them. Many esteemed experts in assessment and feedback are unequivocal in their concerns over grading and/ or the way grading is done. Chris Rust, for example argues:

“much current practice in the use of marks and the arrival at degree classification decisions is not only unfair but is intellectually and morally indefensible, and statistically invalid” (Rust, 2007)

For more detailed critique of the impact of grading I’d recommend Alfie Kohn’s website and especially this article titled ‘from degrading to de-grading’ and for a worked alternative see Jesse Stommel’s account and rationale here. For a forensic consideration of grading, including some interesting historical context I’d also recommend the Schinske and Tanner article. 

Deep end or paddling: an ungrading continuum

So, how might we do something with this? Without actually changing anything I would argue a good starting point would be to develop and share a healthy scepticism about the received wisdom and convention (of grading as well as many other seemingly immutable educational practices). If we read more of the research and feel compelled to act but constrained by the culture, the expectations of students, by the demands of awarding bodies and so on perhaps we could experiment with removing grades from one or two pieces of work. Alternatively, we might begin to change the ‘front and centre’ aspect of grades by, for example, concealing them, within feedback or inviting students to determine or negotiate grades based on their feedback. Going further we might involve students more in determining summative grades as well as assisting us in defining criteria for success at the outset. We may decide to shift to a minimal grading model or elect to grade only major summatives or offer a single grade across an entire module (or year?) or, going further still, use outcomes of peer review and student self-assessment to determine grades. We may invite (with justifications) students to grade themselves (see Stommel example) or perhaps explore the possibilities of offering programmes that do not grade at all. As Stommel (2018) says:

If you’re a teacher and you hate grading, stop doing it.

• Finkelstein IE.  (1913) The Marking System in Theory and Practice. Baltimore: Warwick & York
• Rust, C. (2007) Towards a scholarship of assessment, Assessment & Evaluation in Higher Education, 32:2, 229-237
• Schinske, J., & Tanner, K. (2014). Teaching more by grading less (or differently). CBE—Life Sciences Education, 13(2), 159-166.
• Stommel, J. (2018) How to ungrade. Available at:  https://www.jessestommel.com/how-to-ungrade/ 
• See also 
• Blum, S. D., & Kohn, A. (2020). Ungrading: Why Rating Students Undermines Learning (And What to Do Instead). West Virginia University Press.
• Elbow, P. (1997). Grading student writing: Making it simpler, fairer, clearer. New directions for teaching and learning, 1997(69), 127-140.
• Winstone, N., & Carless, D. (2019). Designing effective feedback processes in higher education: A learning-focused approach. Routledge. (Broader, contemporary issues around feedback and assessment design) 
• Ungrading FAQs https://www.jessestommel.com/ungrading-an-faq/