Partnership Seminar
- T015 – Bulk actions and new reporting for mass management
- T016 – Support for optional set of questions in exams
- T017 – Support for teams and groups (Managers, Markers, Invigilators…)
- T018 – Improved experience for the Manager role
- T019 – Effective MCQ authoring with quality control
- T020 – Enhanced support for group exams in marking
- T021 – Bulk extension of deadlines and re-assessment information
- T022 – Better oversight, screening and flagging in WISEflow Device Monitor
It’s really apparent that the ability to do things in bulk and have improved scalability in the management of assessment is a priority for all users. Although optional questions (aka – “X of Y” questions) also had moderate interest as a development, the overall demand for these is significantly higher within the UK.
Although not currently in use at UCL (or indeed more broadly at UK institutes), the suggested theme for enhancing the device monitor, a tool for monitoring device activity in WISEflow, really piqued our interest. BI Norwegian Business School elaborated on this further: over the course of a 2 week hackathon event, they fed training data from a mock exam to an AI model. The mock exam had three categories of candidates – those who were not cheating, those who were subtly cheating and those who were really flagrantly cheating. AI detection for non-cheaters and obvious cheaters was very accurate, and while there was less confidence on the group of subtle cheaters, the initial proof of concept was encouraging.
WISEcon24
WISEcon this year was 48 hours jam packed with seven keynotes, twelve educator-led sessions and four UNIwise-led talks. It’s impossible to capture everything in a single blog post, but here are some of our highlights:
Reflective Portfolios: the solution we never knew we needed
Chris Wood of the University of Portsmouth delivered a fantastic presentation on their innovative use of FLOWmulti assessments to deliver ePortfolios. It was lovely to see the different question types in use and to hear about a second successful year of running the project. Just look at that outpouring of positive feedback!
Ante Up! Ensuring “buy in” from Academics in the Transition to Digitised Assessments
UCL’s own offering for WISEcon focused on how to best engage academic users with the adoption of WISEflow (or indeed any new platform), drawing on experiences from multiple universities. This included leveraging different approaches for different mindsets and a variety of practices which are all rooted in change management.
WISEflow API Endpoints and Functionality
In a presentation focused on homebrew developments, Bruno Tavarez explained how Universidade Aberta creates all its flows using a script and a few automated API calls from WISEflow. There were definite parallels in practice that could be seen in the way UCL currently creates all central exams that are delivered in WISEflow, but the Portuguese institute has taken it a step further with Moodle integration which displays marking progress and a clever use of API calls to provide individual invigilator passwords to students and maintain the integrity of their lockdown browser exams.
Online exams – experiences from a large, unvoluntary, but successful experiment
One of the last presentations we saw from Dr. Torsten Eymann at the University of Bayreuth detailed their journey with paper and digital exams through the coronavirus pandemic and beyond, with their diligently conducted evaluation revealing some fascinating insights. As a result of their experiments, they are now pursuing a project to develop personalised AI learning assistants for their students and to re-evaluate the focus of their assessments.
Between the partnership seminar and WISEcon, the two big themes that seemed to emerge were:
- In the advent of AI we need to change what we value in terms of our assessment criteria.
- We need more opportunities to do things in bulk in WISEflow!
All in all it was a few days of good company, good food and good ideas being shared! Many thanks to Bucerius Law School for their hospitality and to UNIwise for organising another great event.
