All 18 entries tagged Assessment

View all 86 entries tagged Assessment on Warwick Blogs | View entries tagged Assessment at Technorati | There are no images tagged Assessment on this blog

June 27, 2022

Promoting Metacognition Through Student Self–Assessment – Emily Atkinson

Please see this blog post by CTE alumni Emily Atkinson on Promoting Metacognition Through Student Self-Assessment:

https://researchschool.org.uk/billesley/news/promoting-metacognition-through-student-self-assessment

There is also an EEF report called Moving forwards, making a difference: A planning guide for schools 2022–23 that Emily features in (page nine).


April 11, 2022

Creative Projects and the ‘state of play’ in diverse assessments – Lewis Beer

As a member of the newly formed ‘Diverse Assessments’ Learning Circle in WIHEA (led by Leda Mirbahai and Isabel Fischer), how have you engaged with this topic during your time in Higher Education, and are there any lessons for the future?

Back in 2015, while teaching on a Shakespeare module in Warwick’s English Department, I worked with several students who chose not to write a standard academic essay, but instead to submit a Creative Project – for instance a painting, an animated film, a screenplay – accompanied by a reflective essay. Students were advised to centre their project on a clear research question, and were also told that the project would be assessed not for its artistic quality but for its achievement ‘as a piece of intellectual exploration’.

None of this was my idea, and frankly it made me nervous. But when I saw the students’ creative outputs and accompanying reflections, and read the feedback my colleagues gave them, I could see the unique benefits of this assessment method. One student, Amy Brandis, produced a 55-minute documentary called Lady Macbeth: From Stratford to Stage. She sourced A/V equipment, enlisted the help of students, staff, and people outside the university, and developed filming and editing skills to a high standard. She also reflected incisively on the intellectual exploration entailed by this process. Amy has since pursued a career as a writer, film-maker, and script consultant. For students like her, the Creative Project opened up types of intellectual discourse, and levels of insight, that fall outside the scope of a ‘standard’ essay. It also enabled students to explore topics in a way that fed into their broader development goals: not just academic development, but also personal and professional.

Five years later, compiling the Student Innovation at Warwick report during my time in Warwick Enterprise, I spoke to over 120 colleagues across 33 departments about the myriad ways in which Warwick students can ‘engage with innovation’. One way is through innovative pedagogy, and especially through non-standard modes of assessment that encourage students to be creative and take risks. Not only in the English Department, but also in Engineering, Psychology, History, and many others, academics model the risk-positive mindset they want to foster: it’s no mean feat to overcome the administrative and pedagogical challenges of creating new assessment schemes, getting them approved, and introducing them to curious but anxious students. In my current role, supporting Warwick’s involvement in the EUTOPIA Alliance, I see this spirit of pedagogic experimentation playing out on an even larger scale. It’s wonderful that there is so much interesting work being done in this area, but more than a little overwhelming.

The WIHEA-funded project we will carry out in the ‘Diverse Assessments’ Learning Circle, between now and the end of 2022, is an opportunity to explore these issues more deeply, and with a sense of focus that makes the exploration feasible. The Learning Circle members are now pooling their knowledge and experiences to understand the current ‘state of play’ regarding diverse assessments at Warwick. We look forward to consulting a wider range of staff and students to understand the benefits and challenges of diversifying assessment schemes, and to help shape Warwick’s future vision regarding diverse assessments.

There’s still room for more people to join our circle! For further information, please contact the co-leads: Leda Mirbahai, Warwick Medical School (WMS) (Leda.Mirbahai@warwick.ac.uk) and Isabel Fischer, Warwick Business School (WBS) (Isabel.Fischer@wbs.ac.uk).


March 14, 2022

Interested in diverse assessments? – Isabel Fischer et al.

Interested in diverse assessments? Join our learning circle for an exciting grant-funded project on the future of assessments.

Authors: Isabel Fischer; Leda Mirbaha; Lewis Beer; Dawn Collins; Peter Fossey; Celine Martin; Natasha Nakariakov; Pula Prakash; Farrah Vogel-Javeri

We have recently created an interdisciplinary learning circle which aims to optimise the learning opportunities for Warwick students. We want to ensure that the teaching and learning opportunities are inclusive and cater for our diverse student community. Assessment and feedback are critical stages in the learning process. Using diverse assessments will ensure that students are not unfairly disadvantaged or advantaged by a specific form of assessment. Although it is worth noting that what may count as diverse assessment in one faculty may not necessary be seen as a diverse assessment approach in another. Therefore, using diverse assessments comes with its own challenges and barriers such as:

  • Diversification without sufficient opportunity for students to practice and get familiar with the new and different forms of assessment, disadvantaging group of students that may not be as familiar with certain style of assessments
  • The resource and time component needed for familiarisation then reduces the uptake and engagement by faculty with more innovative assessment approaches

Therefore, the aim of this learning circle is to capture both staff and student experience of diverse assessments and to involve students, staff, and other stakeholders in shaping the future of assessments. Furthermore, the learning circle aims to develop practical recommendations on overcoming some of the challenges associated with use of diverse assessments which will significantly benefit the community.

To achieve this we need your support!

If we have not yet convinced you to join our learning circle, then read on:

Vision: Our vision is to foster an inclusive environment where assessments are designed and developed in partnership with students, staff, and external stakeholders, to effectively promote learning, valuing students’ uniqueness and considering their future employment(s) and wellbeing, as well as the social and environmental responsibility and sustainability of the wider community.

Mission. Our mission is to:

  • Gather existing data on practices around use of diverse and inclusive assessments, including Warwick staff and student experiences
  • Develop shared understanding of principles and practice of diverse assessment
  • Develop an evaluative framework for measuring the success of diversified assessment strategies at module, year, and course level
  • Capture student and staff views on diverse assessments

To help us achieve our mission we have successfully applied and been awarded a WIHEA funding which will enable us to capture staff and student experiences of some of the diverse and innovative assessment approaches used in different disciplines to address some of the key questions around: 1) perception of diverse assessments from a staff and student perspective, 2) practical tips for successful application of the assessment method and marking, 3) communicating assessed skills and requirements, 4) overcoming challenges. To achieve this, we will conduct interviews with staff and students and will share resources, included but not limited to examples of assessments, marking and feedback rubrics and assessment briefs.

For further information on joining the learning circle please contact the co-leads: Leda Mirbahai, Warwick Medical School (WMS) (Leda.Mirbahai@warwick.ac.uk) and Isabel Fischer, Warwick Business School (WBS) (Isabel.Fischer@wbs.ac.uk)

Stay tuned for further updates and blogs on our initiative, such as: Creative Projects and the ‘state of play’ in diverse assessments – Lewis Beer


October 25, 2021

AI Ethics for Assessments in Higher Education

Warwick University logo

AI Ethics for Assessments in Higher Education: A project example of an interdisciplinary social sciences undergraduate summer research scheme

By Isabel Fischer (Warwick Business School) and Thomas Martin (Economics)

Warwick’s Social Sciences offer students and faculty from economics, education and Warwick Business School (WBS) the opportunity to take part in an interdisciplinary summer research project to improve awareness and understanding of collaborative research work on a topic of the students’ choice. One of this summer’s group focused on AI ethics for assessments where students applied the EU Ethics Guidelines for Trustworthy AI to Higher Education Assessment. Students concluded that despite the limitations of AI, AI has the potential to make assessment processes in higher education more effective and fairer. Students suggested that AI should be embraced, but only with human oversight and agency, and with clear stakeholder communication in place.

Linden Davison, a student from the Department of Economics, commented: “Getting involved in the UG research scheme broadened my awareness beyond my single subject discipline - working in a field I wasn't aware existed when we started! It was a pleasure to work alongside students from different departments and be guided by such engaging, motivated staff alike.” Toby Pia, also from Economics, added: “Throughout my URSS experience I improved my ability to explain complex ideas in a more understandable way. I also got better in conveying a balanced argument as previously I tended to get more entrenched into one side of a debate rather than looking at it from both sides.”

At the end of the project each student produced a research poster, depicting one of the seven overarching themes of the EU Ethics Guidelines for Trustworthy AI. Below an example by Shubhangi Bhatt, a student from the Department of Education Studies, on Transparency.

poster_example.pdf

AI poster (text only version)

Finally, here a link to five articles that explain how AI could be made ethical and trustworthy:

https://www.wbs.ac.uk/news/five-reads-you-need-to-make-ai-ethical-and-trustworthy/

And you also might want to read here how AI can (positively) influence education generally:

https://www.wbs.ac.uk/news/five-areas-ai-can-have-the-greatest-impact/


August 02, 2021

Scholarly blogs part two

Scholarly blogs: An assessment tool to strengthen students’ personal brand by developing an online presence (part two)

Isabel Fischer, Associate Professor Information Systems and Management, WBS

As discussed here, as part of their assessments, WBS Digital Leadership and Design Thinking students submitted scholarly blogs as an authentic assessment in preparation for the digital workplace and to increase their online presence. Many students submitted very engaging blogs, getting readers ‘hooked’ from the start by asking and answering insightful questions. Some examples can be found here:

Please note you will need to login to LinkedIn to access this blog:

For further questions or comments on introducing scholarly blogs as an assessment tool please email: Isabel.Fischer@wbs.ac.uk


March 01, 2021

How can assessment encourage and motivate children to succeed both academically and socially?

by Richard

Teachers plan lessons according to the curriculum and to suit the needs of the students; the planning of assessments should be no different. Bartlett states (2015, p.59) that “assessment of each activity should be part of the planning process and needs to be seamless and focused”. Assessments need to be relevant and authentic to serve our students' needs best. Callison (1998, p.1) claims that “Authentic assessment is an evaluation process that involves multiple forms of performance measurement reflecting the student's learning, achievement, motivation, and attitudes on instructional-proceedings. Examples of authentic assessment techniques include performance assessment, portfolios, and self-assessment”. According to Callison, in order to create authentic assessments that encourage student growth, it is first essential that we take the time to get to know our students. If we do not know our students, it will not be easy to measure what is relevant and meaningful.

Creating a positive classroom environment, where students are encouraged and collaborative relationships are formed, is the first step for making significant and appropriate assessments that inform the teacher and the student and allow for maximum growth. School assessments should assess the process, not the final task. If assessments are authentic, students will be motivated learners and take ownership and pride in their learning, thus taking opportunities to develop the 21st-century learning skills that are so important to learn. I believe that, building positive relationships and creating meaningful and authentic assessments is crucial for the success of our students. As educators, we must ensure that we take any opportunities to learn and reflect upon our practice, to do what is best for our students.

Black and Wiliam (2012, p.2) claim "assessment in education must, first and foremost, serve the purpose of supporting learning". In my teaching, I have used many diagnostic assessments in the past in order to support learning. For example, I have used running records, journals, writing prompts, KWL charts, pre-unit tests, among others. However, the best types of assessments that I have encountered have been meaningful projects that were student led. In these instances, students were collaborative and motivated to succeed because they were passionate about what they were learning. Therefore, in the process, they were academically driven. Whenever possible, I aim for formative and summative assessments to either overlap or integrate, providing it is meaningful and relevant to both myself and my students. If formative and summative assessments are integrated, the criticisms surrounding summative assessments disappear as they can be informative and can help instil confidence in students, while also meeting other objectives.

Self-assessment, in my perspective, is one of the best ways for students to truly take ownership of their learning, and this can also be integrated into formative and summative assessments. With continued effort and understanding, blending formative and summative assessments is something all educators should consider, as it will positively impact both their teaching practice and the students they teach.

We can motivate students to take control of their learning and engage in the reflection process, formative assessments will transform the assessment process from a process that only gives relevant information to teachers, to a process that also gives relevant information to students. Again, all this needs to be done through the development of positive working relationships alongside safe and comfortable learning environments so students can thrive and meet and exceed their potential.

References

Bartlett, J. (2015) Outstanding Assessment for the Classroom. 1st ed. London.

Black, P & Wiliam, D. (2012). Edited by: John Gardner. Assessment and Learning. 2nd Edition. Chapter 2: "Assessment for Learning in the Classroom" Publishing Company: SAGE Publications Ltd City: London.

Callison, D. (1998). Authentic Assessment. School Library Media Activities Monthly 14, no. 5. Retrieved from http://www.ala.org/aasl/sites/ala.org.aasl/files/content/aaslpubsandjournals/slr/edchoice/SLMQ_AuthenticAssessment_InfoPower.pdf


February 23, 2021

Scholarly blogs: An assessment tool to strengthen students’ personal brand

Scholarly blogs: An assessment tool to strengthen students’ personal brand by developing an online presence

Isabel Fischer, Associate Professor Information Systems and Management, WBS

Graduates require an increased (professional) online presence and a ‘personal brand’ for career advancement. To encourage students to communicate opinions that matter effectively - and to strengthen their confidence both at the time of writing as well as later on when reflecting back on the blogs - I introduced this term scholarly blogs as a written assignment tool. A scholarly blog builds on the transferrable elements of academic writing and transposes these into a publishable blog.

The remainder of this post outlines how the scholarly blog could be introduced in practice as an innovative form of assessment.

To write their blogs, students are asked to draw on theories and concepts covered in the module as well as in their extended reading. Blogs should demonstrate expert knowledge and thought leadership. The generic marking criteria for assessments can apply, e.g. (1) Comprehension, (2) Analysis, (3) Critical Evaluation, (4) Academic Writing, and (5) Reflection. Students are asked to submit their blog as not yet live but ‘ready to post’, including, for example, images, hashtags and approx. time for reading. The blog should be scholarly and contributing to knowledge, i.e. ‘serious’ rather than ‘colloquial’ and reviewing existing knowledge prior to adding to knowledge. It therefore should be underpinned by extensive referencing to academic literature and to professional reports/posts/webpages. In addition, students can, but do not have to hyperlink their references.

The ideas/content that the blog conveys need to be convincing and should demonstrate critical thinking. The blog should therefore be thought-provoking rather than explaining concepts in a textbook-style-writing. The blog should be seen as written by a subject matter expert and driver for change in a specific field whose opinion matters. The language used should be formal, yet appropriate for a blog, i.e. more informal than an academic journal article. Students might want to write the blog using a first-person positioning (e.g. ‘A recent WBS module on Digital Leadership made me consider…’ or ‘I suggest…’), yet most sentences will not include any writing in the first person (e.g. ‘Miller (2021) raised the point of….’ or ‘If X than Y (see Jones (2020) and Smith (2021)’).

I communicate to students that I expect to see a clear structure in their blog which is aligned to academic writing without using the same headings. For example, students might start in larger letters with an executive summary of the blog which is similar to an abstract. They might then introduce the topic (without calling it introduction) and provide a review of existing material (without calling it literature review). Students are encouraged to structure their main body in different sections using content-related titles in bold before having their concluding thoughts. Students could then show their list of references/bibliography under a heading such as ‘Useful articles in the domain of X’ and adding hashtags to relevant areas.

For further questions or comments on introducing scholarly blogs as an assessment tool please email: Isabel.Fischer@wbs.ac.uk


May 18, 2020

Digifest 2020 part three – Abigail Ball

Where they have been made available, the slides for the various sessions are on the link below:

https://www.jisc.ac.uk/events/digifest-10-mar-2020/programme

Exploring digital wellbeing

Alicja Shah and Heather Price from JISC ran a workshop introducing JISC’s new definition of digital wellbeing. They got workshop participants to create digital wellbeing trees looking at the challenges organisations face in this area and what the possible solutions to those challenges might be.

Practical approaches to building the digital capability of staff and students

Lisa Gray (JISC), Elizabeth Newell (University of Nottingham) and James Kieft (Activate Learning) discussed their practical experiences of building the digital capability of their students and staff. They outlined the approaches they’ve taken and identified benefits, lessons learnt and next steps. All of these presentations centred around using the JISC Discovery Tool.

Supporting student wellbeing through our virtual learning platform

Kim Blanchard and Faz Masters both from Activate Learning introduced how they have used their VLE to support their learners on their journey at the college. They explained how they have developed key dimensions of core wellness for their students:

  • Occupational
  • Physical
  • Intellectual
  • Emotional
  • Social
  • Spiritual
  • Environmental
  • Financial

And how students can gain badges for the different topics.

Making a learning environment accessible to everyone

In this session Alan Crawford a Microsoft Learning consultant, discussed how to make content accessible in Windows 10. Points discussed included:

  • The mobile accessibility deadline on 23rd June 2021
  • Using building blocks for coding
  • Using the translator functionality – which literally translates word for word (not into meaningful phrases)
  • Eye control/narrator
  • Dictate
  • PowerPoint Designer
  • Accessibility checker
  • Office accessible templates on the web
  • Accessibility Insights on Google Chrome and Microsoft Edge
  • Automated transcripts from videos (not as accurate as you would hope)
  • Immersive reading in Office 365
  • Wellbeing in My Analytics
  • PowerPoint Coach
  • Accessibility Insights 10
  • The importance of using meaningful display names in hyperlinks

The closing keynote was cancelled.

*These notes are my own personal reflections and have not been endorsed by JISC or the individuals who presented the sessions.


May 11, 2020

Digifest 2020 part two – Abigail Ball

Where they have been made available, the slides for the various sessions are on the link below:

https://www.jisc.ac.uk/events/digifest-10-mar-2020/programme

Digital imposter syndrome - Theresa Marriott, digital learning technologist, Bishop Grosseteste University and Kate Bridgeman, teaching enhancement officer, University of Hull

I was quite interested in this session because of the nature of my role and because I am co-lead of the WIHEA Third Space Professional Learning Circle. Many third space professionals view themselves as imposters (although interestingly not with the negative connotations that this presentation implied) so I wanted to see if the presenters had a different perspective to add to the topic. They talked about recognising the signs of digital imposter syndrome including feelings of inadequacy when faced with something new, fear of failure and avoidance. They then moved on to discuss positive steps to help overcome digital imposter syndrome including coaching, the use of a safe/neutral workspaces and drop-in and open-door policies.

Bridging the skills gap: a novel approach to delivering academic skills support

Catriona Matthews from the University of Warwick talked about her experiences of running a pilot programme in an undergraduate classics module, to bridge the student transition skills gap between school or college and university.

Leveraging tech to close student support gaps

Vygo is a mobile platform that enables peer-to-peer tutoring and mentoring for university students via what it calls ‘local tutoring marketplaces.’ Vygo has a mobile app which allows students who need support to contact other students who can provide that support. Joel Di Trapani, co-founder of Vygo and Professor Jonathan Shaw from Coventry University talked about Coventry University’s approach to student support and how they have used Vygo to enable this.

Blackboard Ally

I saw an interesting piece of software at Digifest called Blackboard Ally. This helps staff to make digital content more accessible for students. It works with Moodle; it automatically checks content against WCAG2.1 and AA rules and it generates alternative formats such as semantic HTML and audio braille. This is something that needs to be considered at an institutional level rather than at a departmental level, so I will be encouraging the central Academic Technologies team to explore this further, as I think it is important for our students, particularly in this increased time of online learning.

Digital transformation: the bear in the room – Lindsay Herbert, author of Digital Transformation

According to Lindsay, real transformation comes from tackling problems that matter, but we spend far too much time and energy on ‘elephant in the room’ type problems instead. She argues that we need to tackle ‘the bear in the room’ to create lasting innovations with wide-reaching impact.

Lindsay introduced us to the five stages of personal digital transformation (denial, fear, anger, delight and attachment) and then went on to talk about the BUILD acronym. BUILD is essentially the five stages that all successful transformations have, namely:

  1. Bridge [the gaps between your institution, its stakeholders and the changes happening around it]
  2. Uncover [hidden barriers, useful assets and needed resources to achieve the transformation]
  3. Iterate [use short cycles, test with real users, improve gradually]
  4. Leverage [use successes to access more resources, influence stakeholders and give yourself the space to scale up]
  5. Disseminate [tell people what works and why]!

*These notes are my own personal reflections and have not been endorsed by JISC or the individuals who presented the sessions.


May 05, 2020

Digifest 2020 part one – Abigail Ball

This event (which feels like an eternity ago given lockdown and all of the changes since then) took place across two days in mid-March in Birmingham. Where they have been made available, the slides for the various sessions are on the link below:

https://www.jisc.ac.uk/events/digifest-10-mar-2020/programme

Make way for Gen Z - Jonah Stillman, co-founder, author and speaker

This was an interesting keynote on day one where the very engaging Jonah, explained the difference between his generation (Gen Z) and other generations, such as Millennials or Baby Boomers. He described how Gen Z students:

  1. are realistic
  2. are driven (competitive)
  3. suffer from FOMO (Fear Of Missing Out) - which is why they always have their devices with them
  4. are Phigital (yes apparently that is a real term and means they are comfortable with a blend of physical and digital experiences)
  5. like to engage in hyper-customisation (which means they expect to be able to choose what they want to read/listen to/watch/eat and when they want to do this - think boxset binging and ordering take-aways)
  6. Do It Themselves (are independent and happy to try give things a go)
  7. are Weconomists (another new term which means they engage in a shared economy)

Whilst most of this was fairly light and quite tongue in cheek in some cases, the important point Jonah was making was that our universities are now multi-generational, and we have to accommodate these generations in our teaching practice. What works or worked for Millennials does not necessarily work for Gen Z students and we need to be much more aware of this. He did not provide answers per se, but he did raise awareness which I guess is the purpose of a keynote.

An evidence-based journey of digital transformation - Gavin McLachlan, vice-principal, chief information officer and librarian, University of Edinburgh

Due to the cancellation of the session I had planned to attend, I missed the first part of this session, but Gavin talked about the importance of digital culture and vision and how an institutional digital strategy needed to be aligned with the culture and vision of that institution. He also talked about the importance of having a digital e-safety policy and how the University of Edinburgh has developed a digital transformation programme which is composed of seven pillars:

  1. Every educator is a digital educator (very apposite)
  2. Every student is a digital student (it was almost as if he were psychic)
  3. Every University service is a digital service
  4. Every decision considers the available evidence
  5. Everyone plans and updates their digital skills (particularly liked this one as Edinburgh mandates two digital skills courses per year; controversial I know but probably necessary especially given Covid-19)
  6. Stop wondering about the future and start predicting the future (easier said than done)
  7. Hyper-connected digital economy and digital community (again much easier said than done but a good aspitation to have)

If you would like to know more, Edinburgh have contributed a case study to the JISC website.

*These notes are my own personal reflections and have not been endorsed by JISC or the individuals who presented the sessions.


October 2022

Mo Tu We Th Fr Sa Su
Sep |  Today  |
               1 2
3 4 5 6 7 8 9
10 11 12 13 14 15 16
17 18 19 20 21 22 23
24 25 26 27 28 29 30
31                  

Search this blog

Tags

Galleries

Most recent comments

  • Thank you for setting up this Learning Circle. Clearly, this is an area where we can make real progr… by Gwen Van der Velden on this entry
  • It's wonderful to read of your success Alex and the fact that you've been able to eradicate some pre… by Catherine Glavina on this entry
  • Very interesting conclusion. I think it's important to consider the past when taking IQ tests. by Jane on this entry
  • Amazing article, raises many questions about the future of intelligence testing and its value. by Saachi on this entry
  • Tremendously insightful paper. Who would've thought there were such strong links between the intelli… by Rajesh on this entry

Blog archive

Loading…
RSS2.0 Atom

Twitter feed

Not signed in
Sign in

Powered by BlogBuilder
© MMXXII