All entries for March 2023
March 27, 2023
Is interdisciplinarity learnable in 10 weeks?
A Student - Staff co-analysis from IATL’s Creating Digital Futures module
by Anil Dhariwal, Isabel Fischer, Jamal Lawal, Matthew Leslie, Claire Rocks, Shwetha Roy, Bryon Wandera, and Devon Williams
We created this blog collectively in 1h as part of our last Creating Digital Futures workshop. In the interest of time, instead of using Harvard Referencing we entered Weblinks.
In this blog we look back at a 10-week module which brought together students from different fields for the collaborative development of a digital product, which we pitched to the Warwick #Creative Futures Incubator (https://warwickinnovationdistrict.com/creative-futures-incubator-application/). The purpose of the blog is to reflect on whether students can effectively learn and apply the fundamentals of interdisciplinarity, and if 10 weeks is a suitable amount of time for the benefits of interdisciplinarity to take effect.
3 min read
Source: DALLE.E 2 by OpenAI - retrieved 15/3/23 using these prompts: ‘Interdisciplinarity Creating Digital Futures’
From an educator-side our research has shown that a key pedagogical challenge is to encourage students to move beyond scanning of information towards critical engagement and action (Preuss, Fischer, Luiz, 2023, see: https://onlinelibrary.wiley.com/doi/10.1111/hequ.12429). Payne (1999, p.173) emphasises the potential of interdisciplinarity to enhance ‘democratisation of knowledge construction processes in society’ with Klein (2000, p.18) explaining that ‘Interdisciplinary knowledge strengthens connections between disciplines and in that process it weakens the division of labour in disciplines, exposes gaps, stimulates cross fertilisation and creates new fields of focus for knowledge inquiry’.
Problem based learning is often thought of as a pedagogical approach that can facilitate interdisciplinary learning. Adopting this approach, Creating Digital Futures asked students to create a product or service at the intersection of Digital Technology, Creativity and the Global Sustainable Development Goals. Focussing first on identifying a problem using Design Thinking was intended to encourage students to come out of their disciplinary boundaries to search for solutions. As research has shown that we cannot take for granted that interdisciplinary learning will take place, and that it is necessary to address issues of interdisciplinary learning specifically (Stentoft et al, 2017, https://doi.org/10.1177/1469787417693510), in Creating Digital Futures we scaffolded the interdisciplinary learning by providing 10 weekly taught sessions covering topics such as working in interdisciplinary teams, design thinking, ethical frameworks, storytelling with data and presentation skills.
A ChatGPT (2023) prompt tells us: ‘Interdisciplinarity has become a buzzword in academia, with many universities and institutions promoting collaborative learning and research. But can students truly learn the skills and mindset needed for interdisciplinary work in just 10 weeks? In this blog, we explore [if] it is possible to truly break down the boundaries between disciplines and instil a collaborative mindset in a matter of weeks.’ (ChatGPT, 2023a)
We - the students - found that our interdisciplinary module has a number of benefits, including:
- We were able to develop real world skills such as: critical thinking; communication; collaboration and the ability to synthesise information (Anil, Econ)
- Interdisciplinarity gives the opportunity to see areas that you may lack in due to your subject background and allows you to learn and improve them with the help of others with different perspectives (Byron, Biomed)
- Providing a better understanding of the utility of one’s own skills from their field in the context of the real world (Devon, Comp Sci)
- Really highlights the inherent interdisciplinarity of traditional subjects (Jamal, PPE)
- The helpfulness of application of theory in a practical matter, experiencing, growing and learning from and with others (Matthew, WBS)
- Allows you to produce an impactful and cohesive piece of work that brings together the ideas from different disciplines (Shwetha, Econ).
In conclusion, students have found many aspects of the module rewarding, and have also reflected that it was a good preparation in anticipation of embracing interdisciplinarity in the workplace. A problem based approach seems to be good to foster interdisciplinary learning in just 10 weeks. More importantly though, students appreciated having been taught by members from five different departments. The module convenors - Claire Rocks (Computer Science) and Isabel Fischer (WBS) - would therefore like to thank Elke Thonnes (Stats) and Robert O’Toole (Arts) as well as Rachel Davis, Clare Green and Holly Smeeton (Warwick’s Creative Futures Incubator / Warwick Entreprise) for making time to take this cohort of IATL students on a journey of interdisciplinary discovery.
ChatGPT prompt to help with the initial thoughts on the blog:
ChatGPT 2023 prompt used on 15/3/23: ‘Is interdisciplinarity learnable in 10 weeks, write a short intro to hook readers in for a blog with this title with an interesting question’.
March 20, 2023
Coaching using video – developing teachers internationally: challenges and opportunities
by Anna Donnelly and Jonty Leese
What we did:
Whilst there is tremendous value in learning face to face, there are some situations in which online learning is the only viable option: international teacher education is a case in point. With the growth of demand for HEIs in the UK to undertake teacher education and development internationally, the University of Warwick sought some practical solutions to developing teachers, often thousands of miles and many time zones away.
Using video to support teacher learning (Major and Watson, 2017) and reflection (Hamel and Viau-Guay, 2019) is not a new practice, but the teacher values (Centre for Teacher Education, 2022) that thread through our course and the bespoke approach to coaching at the University of Warwick shaped how we approached using this technology.
We wanted to develop some tools so that when video was utilised on platforms that had the capability to time stamp or pause either pre-recorded or live recordings of teachers, then make a variety of learning comments on this. We shaped the responses to encourage supportive, nurturing and developmental feed forward.
Where is it?
We selected a platform which had the capability for key stakeholders to live-record content (trainee teachers teaching, mentor and trainee coaching meetings) and / or examine pre-recorded content with a reflective and intellectually curious lens (Centre for Teacher Education, 2022). Comments from all stakeholders could then be time-stamped to aspects of practice and specific coaching or teaching attributes could be flagged and discussed within the platform comment facility. These were linked to our Professional Practice Units (PPU) which have a specific emphasis relating to their teacher education. This gave the opportunity for focussed, evidence-based reflections from mentor, mentee, and university professional; integrating closely theory and practice, as well as providing the opportunity to relate learner with readings and other content to support strengthening of the theory-practice link for all involved.
How it will be integrated into future practice?
As we develop our international course as well as look to expanding our remote programme into teacher education ‘cold spots’ across the UK, this platform could provide a useful tool for both teacher education and professional mentor development as well as a step change in how HEI colleagues may undertake part of their role as teacher educators.
- When recording involved people under 16, there were significant barriers in terms of negotiating safeguarding concerns and approaches of individual schools across multiple legal jurisdictions. This is a challenge that the company providing the online platform is still developing in terms of support materials for schools.
- The wider issue around ethics for collecting data GDPR policies and CCTV protocols for under 16s proved to be an ongoing challenge and not one that was solved within the scope of this project.
- There were tremendous gains to be had in terms of purposeful and focussed teacher reflection on practice, as video proved a rich source of statistics and evidence on which to base a coaching conversation. It had the potential to give agency to teacher construction of their own learning as well as supporting coaches in their examinations of the ‘reality’ of the impact of the student teaching on the children’s learning (Knight, 2021).
Centre for Teacher Education (2022) Developing an ambitious ITE Curriculum. Available at: https://warwick.ac.uk/fac/soc/cte/about/ite-curriculum/ (Accessed: 3 March 2023).
Hamel, C. and Viau-Guay, A. (2019) ‘Using video to support teachers’ reflective practice: A literature review’, Cogent Education. Edited by B. Nkuyubwatsi, 6(1), p. 1673689. Available at: https://doi.org/10.1080/2331186X.2019.1673689.
Major, L. and Watson, S. (2017) ‘Using video to support in-service teacher professional development: the state of the field, limitations and possibilities’, Technology Pedagogy and Education, 27, p. In Press. Available at: https://doi.org/10.1080/1475939X.2017.1361469.
March 13, 2023
Recording and Sharing Mentoring Best Practice
by Jonty Leese and Anna Donnelly
What we did:
In Initial Teacher Education (ITE), the role of coaching a student teacher is crucial. For new and established mentors and trainees, the ability to see good examples of coaching is a powerful tool to see and experience this process. Inspired by Knight’s coaching model (Knight, 2021) and combined with the unique lens of Warwick Teacher Values (Centre for Teacher Education, 2022) we were able to build a framework to support understanding of the equality of role within effective coaching. This process supports university tutors as well as school-based mentors.
To facilitate this, we recorded and edited post lesson mentor meetings from a variety of phases (KS1-KS4) in different contexts to build a clearer understanding of effective mentoring with current all stakeholders.
These were real staff and students, so it was an authentic learning conversation and formed part of their regular weekly meeting.
We processed these to add transcripts for accessibility (W3C, 2018) and used software which created a clickable audio and text of the conversations (otter.ai)
These were then shared on a site builder site here: breaking down into different categories for mentors, whether they were new to it or more experienced. See image below:
How it will be integrated into future practice:
These have been embedded into current practice for our online PGCE and will be shared through mentor training, with these as a support resource going forward for all routes.
These can be utilised as an “on demand” resource for mentors and trainees.
This forms a basis of a growing body of real-world examples which will grow incorporating future recordings ensuring that a range of contexts and examples reflecting the unique role of mentorship is captured.
It’s very time consuming to record, edit and upload video – even with an organised workflow, it took longer than anticipated.
The use of AI in technology is fallible – proof reading of automated transcripts is necessary to ensure accuracy and appropriateness of what has been transcribed.
It’s our responsibility to build time into training plans, rather than expect that these are additional and extra to core mentor requirements. This could form part of the compulsory 20 hours mentor training that all mentors are mandated to complete for the start of the 2024/25 academic year.
The recording and disseminating of a mentoring video which is intrinsically a private conversation is a powerful window into another person’s world. This can support lifting practitioners out of a silo mindset and can open them up into seeing practical examples of different approaches within the Warwick framework – giving them agency to transform their practice and to reflect upon their own methodologies.
Recording the videos does not require high production values to have value.
Watching a video as a standalone resource without guided reflection and dialogue- may be a missed opportunity; watching, pausing and reflecting as part of a dialogue can stimulate rich conversations (Alexander, 2021). Using the videos alongside pertinent questions to evoke reflection and transformation of practice is the next step.
Alexander, R. (2021) ‘DIALOGIC TEACHING AND THE STUDY OF CLASSROOM TALK’.
Centre for Teacher Education (2022) Developing an ambitious ITE Curriculum. Available at: https://warwick.ac.uk/fac/soc/cte/about/ite-curriculum/ (Accessed: 3 March 2023).
Knight, J. (2021) The Definitive Guide to Instructional Coaching: Seven Factors for Success. Available at: https://www.amazon.co.uk/Definitive-Guide-Instructional-Coaching-Factors/dp/141663066X/ref=sr_1_3?keywords=The+Definitive+Guide+to+Instructional+Coaching%3A+Seven+Factors+for+Success&qid=1646652872&sr=8-3 (Accessed: 7 March 2022).
W3C (2018) Web Content Accessibility Guidelines (WCAG) Overview | Web Accessibility Initiative (WAI) | W3C, Web Accessibility Initiative. Available at: https://www.w3.org/WAI/standards-guidelines/wcag/ (Accessed: 2 January 2019).
March 06, 2023
On ‘Opportunities of AI in Higher Education’ by DALL.E and ChatGPT
Prologue and epilogue by Isabel Fischer (Warwick Business School)
Since the creation of our task and finish groups on evaluating and shaping the opportunities of AI in Higher Education (for further information see here: https://blogs.warwick.ac.uk/wjett/entry/ai_for_good/) we have had many very insightful ‘human to human’ discussions. The aim of this blog is, however, to show what ‘machines’ draw and write on the topic, to illustrate both the strengths and the weaknesses of generative AI.
The images at the start of the blog represent DALL.E’s take on the topic. Having always been untalented in drawing, I use DALL.E in my business teaching to show live how AI translates the topic we discuss by imitating distinct artists. Students enjoy how DALL.E (OpenAI) shows other – very creative - images while we wait for AI ‘to think & draw’ our images – there are always four images coming up for each prompt. Of course, we also discuss the risks, threats, and ethics behind AI (here an open-access case study which we wrote on AI ethics in the field of ESG investing: https://journals.sagepub.com/doi/full/10.1177/2043886920961782).
While DALL.E generates images that I could not have drawn, ChatGPT generates text that I could have written better and more concisely, with different logical priorities. I could - and actually did - create visualisations to illustrate my points. Nevertheless, ChatGPT did beat me by far on ‘speed’. For anybody who has not yet asked ChatGPT any questions, here are the ChatGPT responses based on five prompts:
- Opportunities for AI in HE
- Strategy for implementing and integrating AI in HE
- Developing research on the opportunities of AI in HE
- Developing an AI based marking and feedback tool
- Common areas of weakness of students’ academic writing
Opportunities for AI in HE
Artificial intelligence (AI) is transforming the world around us, and higher education (HE) is no exception. The potential opportunities of AI in HE are vast, ranging from improving learning outcomes and enhancing student engagement to streamlining administrative tasks and reducing costs. In this article, we explore some of the key opportunities of AI in HE and how they can be realized.
- Personalized learning: AI can help personalize the learning experience by adapting the content, pace, and style of instruction to the individual needs and preferences of each student. This can be achieved through intelligent tutoring systems, which use machine learning algorithms to analyze student performance data and provide customized feedback and support. Personalized learning can improve student engagement, increase retention rates, and enhance learning outcomes.
- Predictive analytics: AI can be used to analyze large datasets of student information, such as grades, attendance records, and behavioral data, to predict future performance and identify at-risk students who may need additional support. This can help educators intervene early and provide targeted interventions to improve student success.
- Virtual assistants: AI-powered virtual assistants can help students with routine administrative tasks such as scheduling, registration, and accessing resources. This can free up staff time and reduce wait times for students, improving their overall experience.
- Automated grading: AI can be used to automatically grade assignments and provide feedback to students, reducing the workload on instructors and improving the consistency and objectivity of grading. This can also provide students with immediate feedback, enabling them to improve their performance more quickly.
- Research and data analysis: AI can be used to analyze large datasets of research publications and help identify trends, patterns, and gaps in the literature. This can help researchers stay up-to-date with the latest developments in their field and generate new insights.
- Adaptive assessments: AI can be used to create adaptive assessments that adjust the difficulty and content of questions based on the student's level of knowledge and ability. This can help educators more accurately assess student performance and provide targeted feedback and support.
- Smart campus: AI can be used to optimize campus operations, such as energy management, facility maintenance, and security. This can reduce costs and improve the overall efficiency of campus operations.
While the opportunities of AI in HE are significant, there are also challenges that need to be addressed, such as ethical considerations, data privacy concerns, and ensuring that AI is used to enhance, rather than replace, human interaction and support. To fully realize the potential of AI in HE, it is essential that educators, researchers, and policymakers work together to develop responsible and effective strategies for implementing and integrating AI technologies.
Strategy for implementing and integrating AI in HE
Implementing and integrating AI technologies in higher education (HE) requires careful planning and consideration to ensure that these technologies are used in a responsible and effective manner. Here are some responsible and effective strategies that HE institutions can use to implement and integrate AI technologies:
- Develop a clear vision and strategy: HE institutions should develop a clear vision and strategy for how AI technologies will be used to enhance the student experience, improve learning outcomes, and support research. This should involve identifying specific use cases and goals for AI, as well as assessing the potential benefits and risks.
- Foster collaboration and communication: Implementing and integrating AI technologies requires collaboration and communication across departments and stakeholders. HE institutions should establish cross-functional teams that include educators, administrators, IT professionals, and students to ensure that all perspectives are considered and to foster buy-in and support for AI initiatives.
- Ensure transparency and ethical considerations: HE institutions should ensure that the use of AI technologies is transparent and ethical. This includes being clear about how AI technologies are being used, ensuring data privacy and security, and ensuring that AI is used to enhance, rather than replace, human interaction and support.
- Invest in staff training and development: AI technologies require specialized skills and knowledge to implement and use effectively. HE institutions should invest in staff training and development programs to ensure that educators and administrators have the necessary skills and knowledge to use AI technologies in their work.
- Pilot and evaluate AI initiatives: Before scaling up the use of AI technologies, HE institutions should pilot and evaluate their effectiveness. This involves testing AI technologies in small-scale pilots, collecting feedback from stakeholders, and using data to evaluate their impact on learning outcomes, student engagement, and other key metrics.
- Engage with the wider AI community: HE institutions should engage with the wider AI community to stay up-to-date with the latest developments and trends in AI. This includes attending conferences and workshops, collaborating with other institutions, and partnering with industry experts and researchers.
- Align AI initiatives with institutional goals and values: Finally, HE institutions should ensure that their AI initiatives are aligned with their institutional goals and values. This involves considering the unique needs and priorities of the institution, as well as the needs and preferences of students, educators, and other stakeholders. By aligning AI initiatives with institutional goals and values, HE institutions can ensure that they are using these technologies in a responsible and effective manner.
Developing research on the opportunities of AI in HE
There are several ways to develop ideas for future opportunities of AI in higher education and organize it as a research topic:
- Literature review: Conducting a literature review of existing research on AI in higher education can help identify the gaps and potential areas for future research. This can involve searching for relevant articles, books, and reports in databases such as Google Scholar, ACM Digital Library, and IEEE Xplore.
- Expert interviews: Talking to experts in the field, such as educators, researchers, and AI professionals, can help identify emerging trends and potential opportunities for AI in higher education.
- Case studies: Conducting case studies of AI implementation in higher education institutions can provide insights into the benefits and challenges of adopting AI technologies.
- Surveys: Conducting surveys of stakeholders such as students, faculty, and administrators can help identify their needs and preferences for AI in higher education.
- Workshops and conferences: Attending workshops and conferences on AI in higher education can provide opportunities to learn from experts and exchange ideas with peers.
Once you have developed ideas for future opportunities of AI in higher education, organizing it as a research topic can involve the following steps:
- Identifying research questions: Based on the ideas developed, identify research questions that are relevant, feasible, and significant.
- Defining the scope of the research: Clarify the boundaries of the research topic and define the key concepts and variables.
- Developing a research methodology: Decide on the appropriate research methods, such as qualitative, quantitative, or mixed methods, and develop a research design.
- Conducting data collection: Collect data using appropriate methods such as surveys, interviews, and case studies.
- Analyzing data: Analyze the data using appropriate statistical or qualitative analysis techniques.
- Drawing conclusions and making recommendations: Based on the findings, draw conclusions and make recommendations for future research and practice.
- Writing up the research: Write up the research in a clear and concise manner, following the conventions of academic writing.
When reviewing emerging trends of AI in higher education after conducting qualitative research, a theory that could be useful is grounded theory.
Grounded theory is a research methodology that involves systematically collecting and analyzing qualitative data to develop a theory or explanation of a phenomenon. The approach emphasizes the need to generate theory from the data itself, rather than imposing preconceived notions or theories on the data.
When conducting a qualitative study of emerging trends of AI in higher education, the grounded theory approach can help identify key themes and patterns in the data that may point towards emerging trends. These trends can then be used to develop a theory that explains how AI is being used in higher education, what the benefits and challenges are, and what the future implications may be.
Grounded theory can also be helpful in identifying gaps in the literature and areas for future research. By systematically analyzing the data, researchers can identify areas where more research is needed, and use the emerging trends to develop research questions that are relevant and meaningful.
Developing an AI based marking and feedback tool
Designing an AI system that can be used to automatically grade assignments and provide personalized feedback to students can be a complex task, but it can be accomplished by following these steps:
- Define the grading criteria: The first step is to define the grading criteria for the assignment. This involves breaking down the assignment into its key components and determining how each component will be evaluated. The grading criteria should be clearly defined and objective, so that the AI system can easily understand and apply them.
- Create a training dataset: To train the AI system, you need to create a training dataset that includes a set of annotated assignments. These annotated assignments should be graded by human experts according to the defined grading criteria. The dataset should be large enough to ensure that the AI system can learn to recognize a variety of different assignment types and styles.
- Choose the appropriate machine learning algorithm: There are several machine learning algorithms that can be used for automatic grading, including decision trees, support vector machines, and neural networks. The choice of algorithm will depend on the complexity of the grading criteria and the size of the training dataset.
- Train the AI system: Once you have chosen the appropriate machine learning algorithm, you can train the AI system using the annotated training dataset. The system should be trained to recognize patterns and relationships in the data, and to identify which components of the assignments are important for grading.
- Test the AI system: After training the AI system, you should test it using a set of unseen assignments that have not been included in the training dataset. This will help you evaluate the system's accuracy and identify any areas where it needs further improvement.
- Provide personalized feedback: To provide personalized feedback to students, you can use the AI system to identify areas where a student may need additional support or guidance. For example, if a student consistently struggles with a particular component of the assignment, the system can provide targeted feedback and resources to help the student improve.
- Continuously improve the AI system: Finally, you should continuously monitor and improve the AI system. This involves regularly updating the training dataset, evaluating the system's performance, and incorporating feedback from students and educators to refine the grading criteria and feedback mechanisms.
In summary, designing an AI system for automatic grading and personalized feedback involves defining the grading criteria, creating a training dataset, choosing the appropriate machine learning algorithm, training the system, testing it, providing personalized feedback, and continuously improving the system. By following these steps, you can develop an effective and efficient AI system that enhances the learning experience for students and educators alike.
Common areas of weakness of students’ academic writing
Academic writing is an essential skill for students in higher education. However, there are common areas of weakness that students often struggle with. Here are some of the most common areas of weaknesses for students' academic writing in higher education:
- Poor organization and structure: Students often struggle with organizing their ideas and structuring their writing in a way that is clear and logical. This can make their writing difficult to follow and reduce the overall effectiveness of their argument.
- Weak thesis statements: A strong thesis statement is essential for guiding the direction of an academic paper. However, many students struggle to develop a clear and concise thesis statement that effectively summarizes the main argument of their paper.
- Inadequate research and citation skills: Effective academic writing requires the use of credible sources to support arguments. However, many students struggle with finding appropriate sources, evaluating their credibility, and correctly citing them in their writing.
- Poor grammar and syntax: Grammatical errors and poor syntax can make writing difficult to read and understand. This can detract from the clarity and effectiveness of students' arguments.
- Lack of clarity and concision: Academic writing should be clear and concise, but many students struggle with using language that is overly complex or wordy. This can make their writing difficult to read and reduce the impact of their argument.
- Inappropriate tone or style: Students may struggle to adopt an appropriate tone or style for academic writing, which can lead to writing that is overly informal or lacking in scholarly rigor.
- Failure to address the assignment prompt: Finally, students may struggle with addressing the assignment prompt in a way that fully meets the expectations of the instructor. This can result in writing that is off-topic or fails to fully address the main requirements of the assignment.
Overall, addressing these common areas of weakness in academic writing can help students improve their writing skills and achieve greater success in their academic pursuits.
Epilogue: For comparison to the above, here are some ChatGPT responses to prompts by Chaoran Yang, a student who is part of my consulting module. I suggested to all students of that cohort to try ChatGPT for idea generation at the start of a consulting exercise for the Warwick Esports centre. Similar to my findings from above, the students also felt that ChatGPT did not provide any major insights. Possibly because we did not ask the right questions, and, more importantly, because ChatGPT is still in its infancy.
In our team we have spent over 2,000 hours developing the Warwick AI Essay Analyst. We used a mixture of non-AI rule-based statistical features and deep-learning algorithms and databases, e.g., Pytorch, Hugging face framework, and Transformer (for further information on our AI-based tool see here: https://nationalcentreforai.jiscinvolve.org/wp/2022/11/16/interested-in-receiving-formative-feedback-on-your-draft-essays-and-dissertations-on-demand-introducing-warwicks-ai-essay-analyst/).
With the current progress in the field of generative AI, developments of future tools will be faster – let’s work together to ensure that all tools, whether developed in-house or bought / endorsed by the university have robust ethical underpinnings. My final suggestions for readers is to review here the Ethical guidelines on the use of artificial intelligence (AI) and data in teaching and learning for educators, produced by the Office of the European Union: https://data.europa.eu/doi/10.2766/153756