All entries for October 2022

A Student Perspective on Assessment Diversity and Strategy – Molly Fowler

Over the last two years I have completed 21 assessments of approximately 10 different types - I am a seasoned consumer of assessments. Truly diverse assessment should use a range of valid assessment types that stimulate learning and provide opportunities for learners with varied needs and capabilities.

Assessments where I have synthesised information mined without time pressure, have resulted in the deepest learning. I overcame an irrational fear of epigenetics by writing an essay on the topic. I have been wondering whether real time information acquisition and synthesis could form an equally valuable assessment modality. My recent work experience showed me the readiness of healthcare professionals at all levels to access and deploy ambulatory online information in real time on the ward and in the clinic. As far as I can see, assessment methodologies have yet to catch up with this new reality.

It is perhaps a truism to say that assessments should be a learning methodology. Assessment can be a stimulus to learn content but can also model useful skills and behaviours. I have found that assessments with low ecological validity are less enriching, and regrettably invite purely strategic learning. The best example I have is my French GCSE in which I achieved an A grade without being able to speak a word of the language. The nature of the assessment meant that I did not need to engage with the content or the objectives of the course. I was able to prevail by memorising and regurgitating chunks of text which I promptly forgot after the exam.

Of my recent exams, the methodology that strikes me as most at fault in this respect is the MCQ. This is a highly artificial assessment construct, relying crucially on recall of memorised information, in a specific and stressful environment. I accept that there may be other skills involved such as prioritising options, but this is barely possible without the memorising and recall.

Group assessments might seem to reflect real world behaviour, but I have not always found this to be the case. With no agreed hierarchy it is very difficult to distribute responsibility or manage group members who are either overly assertive or who fail to contribute. This is particularly tricky when all those involved are required to be equal contributors with equal status. Surely this is an unusual circumstance in any working environment. The contrived dynamics of group assessments can introduce an uncontrolled variable that impacts the results of even very good students.

I feel it is of critical importance that students have the opportunity to thoroughly rehearse assessment methodologies that they will face in the high-stakes final year. For example, having done two poster presentations, previously unfamiliar to me, I feel less daunted by the prospect of doing it again for my dissertation module. I now appreciate that this is a common way of disseminating information at scientific conferences so it may be an important skill for me to have in my career.

Personal lives are complex and we are all subject to sudden or dramatic change in our circumstances. Assessments by essays can more easily accommodate and mitigate unforeseen events through flexibility, but fixed assessments such as exams or in-person presentations are much more difficult to rearrange. An advantage of continuous assessment over end-of-year assessments is the feasibility of allowances for such happenings as fewer assessments would be affected. It is also true that students with a reported disability tend to do less well than students with no reported disability (Office for Students, 2022). This raises important questions around equity, and whether the available reasonable adjustments are good enough.

Properly diverse assessment could serve many purposes. Within the mix of assessments should be opportunities for different students to demonstrate their individual proficiency at their preferred method. Diverse assessment should be inclusive of students with reasonable adjustments, but they should also allow for unpredictable adverse events. Finally, where possible, assessments should engender learning and embody activities that will be useful in later life.

Office for Students (2022) Access and Participation Data Dashboard [online] Available from: https://www.officeforstudents.org.uk/data-and-analysis/access-and-participation-data-dashboard/ (Accessed 8 October 2022).

Molly is member of the Diverse Assessment Learning Circle. If you would like to join the LC please contact the co-leads: Leda Mirbahai, Warwick Medical School (WMS) (Leda.Mirbahai@warwick.ac.uk) and Isabel Fischer, Warwick Business School (WBS) (Isabel.Fischer@wbs.ac.uk)

Link to blog one : Introduction to diverse assessment learning circle

Link to blog two: Creative Projects and the ‘state of play’ in diverse assessments

Abigail Ball : 31 Oct 2022 09:28 |  Tags: Assessment Molly Fowler Student Teaching |  Comments (0) |  Close comments |  Report a problem

Tips for new lecturers on the human elements that make students feel included

This short THE Campus piece offers advice about simple things lecturers can do in their lectures to enhance students’ feelings of belonging and inclusion from the very start:

https://www.timeshighereducation.com/campus/tips-new-lecturers-human-elements-make-students-feel-included

Abigail Ball : 24 Oct 2022 10:21 |  Tags: Teaching |  Comments (0) |  Close comments |  Report a problem

Community–sourced introductory and setting the tone activities

Community-sourced introductory and setting the tone activities

Equity Unbound and OneHE have developed a values-led initiative that curates community building activities for educators to use with their students. Their Introductory activities section includes creative ways to undertake student introductions in your first week of classes. The Setting the tone activities section outlines approaches that you can use throughout the term to let students know that you care.

Abigail Ball : 17 Oct 2022 09:27 |  Tags: Teaching |  Comments (0) |  Close comments |  Report a problem

Introducing Warwick’s “AI Essay–Analyst”

By Isabel Fischer, Zhewei Zhang, Lichuan Xiang, Aiqi Jiang, Yiran Xu and Joe Nandhakumar

Three years since its first conceptualisation, we are pleased to introduce the “AI Essay-Analyst”, an academic-writing-tool in support of the mission of Warwick Business School (WBS) “to enable our stakeholders to realise their full potential” and the University of Warwick’s 2030 strategy “to ensure that, irrespective of background, disability, faith, gender, race and sexual orientation, all students have access to equal opportunities to thrive and progress at Warwick”.

A recent WBS survey showed that the majority of students perceive poor academic writing as their main barrier to success. In response, a group of WBS faculty and students developed and piloted a machine-generated automated formative essay feedback tool in-house which is now being made available to an increasing number of students on an optional basis.

Academic writing feedback tools have the potential of providing students with “personalised feedback that is currently only available to a privileged minority”^[1] and can enhance students’ self-determined learning: Formative assessments are seen as “one of the most important mechanisms for improving student learning. Self and peer-assessment are particularly effective in formative learning as they require students to engage more fully with the assessment process”^[2]. Currently, students of select modules are being offered the opportunity to trial the software by submitting their draft essays or dissertations prior to their submission deadlines. Participating students receive a personalised AI-generated feedback report of approximately 15 pages. The report includes images, charts and graphs which students are encouraged to review prior to the formal submission of their assignment.

External providers, such as Grammarly, Turnitin Draft Coach, Bartleby, Writefull, and Hemingway Editor also offer feedback to students, however, most of these tools focus on grammar and spelling. In addition, in most cases, students have to agree that external providers can use their data. The “AI Essay-Analyst” does not use student data and is substantially more comprehensive. For example, by also including the CABS ABS ranking we can check the quality of the journal articles that are cited and referenced. In addition, we offer visualisations such as knowledge graphsand argumentative zoning^[3], which are expressed as PIE charts and knowledge graphs^[4]. These visualisations are very much appreciated by students.

Students who opted to take part in the project so far were very satisfied, commenting: “The overall feedback is very useful for the general understanding of your academic writing skills”, “It is quite cool and it is a new approach I never tried before”, “I have enjoyed the visualisations most since they are interactive and easy to understand” and “Grammar suggestions are useful since they show some spelling and small mistakes that I ignored before.”

Detailed student feedback on specific features included:

1. The most useful are grammar suggestions, because it helps me revise the essay most directly.
2. The spider graph is useful to help me understand where the essay is lacking.
3. The Word Cloud is useful to help me check if the essay is on topic.
4. Systematic stages of negation is helpful as it let me know if my critical thinking has been fully applied.
5. For readability, this is an aspect that I usually find difficult to notice, because everything is readable in my own mind. So that is very helpful.
6. The knowledge graph allowed me to see the bigger picture at a time when I was too focused on the detail. It helped me to break down my essay and also showed the correct as well as incorrect relationships between key concepts.

For comments or questions please contact the project lead Isabel.fischer@wbs.ac.uk

[1] https://oro.open.ac.uk/46517/1/LAK16%20Writing%20Analytics%20Wkshp%20-%20FINAL.pdf

[2] https://www.tandfonline.com/doi/full/10.11120/plan.2010.00230040

[3] https://www.cl.cam.ac.uk/~sht25/az.html

[4] https://medium.com/nlplanet/building-a-knowledge-base-from-texts-a-full-practical-example-8dbbffb912fa

Abigail Ball : 10 Oct 2022 09:08 |  Tags: Isabel Fischer Teaching |  Comments (0) |  Close comments |  Report a problem

A values–laden approach to teaching and learning in Higher Education and why it matters

In this short (20mins) video, Julie Taylor from the Centre for Teaching Education (CTE) shares the work that she and her colleagues have done in CTE to embed a values-laden approach to teaching and learning. The key messages shared are relevant to any discipline or department. The resources she refers to in the video can be accessed below:

• Character education in universities: a framework for flourishing
• The Jubilee Centre framework for character education in schools
• Statement on teacher education and character education
• PowerPoint slides used in the video

Abigail Ball : 03 Oct 2022 10:05 |  Tags: Character Julie Taylor Teaching Values |  Comments (0) |  Close comments |  Report a problem