Tag Archives: #AI #Artificialintelligence

A short history of the development of a College based AI policy⤴

from @ ...........Experimental Blog


A colleague got in touch with me to ask. 

" When the college was creating the guidance for GenAI use what informed this? I’m trying to collect some policy documents for my dissertation on GenAI policy and wondered if you might have any suggestions. I assume SQAs policy was considered but did you use any policies from the Scottish Government, EU, other governing bodies etc "
I thought it was worth sharing the response. I am still watching education asking some of the correct questions but still mainly circling the wagons. 

This story starts in April 2021 pre Chat GPT and being asked to respond and shape a College response to the assumed incidence of the rise of contract cheating across the College. At the time we knew and worked with colleagues in Scottish HE where contract cheating was a thing and we knew how it generally manifested itself.

In short what prompted the initial guidance on artificial intelligence - the first College in the UK to offer some,  was in part some frustration with a new member of SMT from HE who was insistent  that a large number of students at City of Glasgow College were buying essays from essay mills at £50 and more a pop. While we had the knowledge that something else was actually going on. The College at this point kept no central records on instances of academic misconduct. 

We had data to show that this was not happening. We knew from HE that most of the bought in essays raised at least a few flags in plagiarism detection. We knew too that staff teaching generally smaller classes in FE were reasonably vigilant and knew their students.

However, we did know learners were starting to use Microsoft, Google , Grammarly and other tools to ‘improve’ their essay writing. We wanted to do some work around this to support teachers and students. 

For students this would be around when and how to acknowledge that they had used tools to support their essay writing. For teaching staff to raise staff awareness that these tools were in use, it was manageable, permissible and actually supported learners' accessibility needs. We were rolling out Canvas a new VLE in this time frame too and we were very focused on accessibility. 

We spoke to students through the students' association who confirmed that students used a range of tools. There was actually a very low awareness of essay farms. The students highlighted that while there were free tools they were very unlikely to pay for essay creation. They had legitimate fears too that the existing plagiarism software would catch out learners who commissioned essays in this way. 

But more concerningly they were worried about using some of the assistive tools to support their additional learning needs. 

It was clear that the institution and the staff were being blind sided by some of these developments. 

We wanted to change the focus from simply tackling 
'academic misconduct' to one where we could promote academic integrity through changing learner and lecturers' practice. I think we achieved this in the end, but only to some degree. In medium term this will only come with improved digital skills for lecturers and students and fundamental changes in the overall approach to assessment. 

At that point Chat GPT appeared, things accelerated, and a form of hysteria started. 

UCL in London had early guidance on using and referencing AI but it was framed in very Higher Education, University language. It has been refined but still on their website. We took this and clarified it for College staff and students, discussing this with learners, as we moved along, giving UCL due attribution. 

We then shared this internally and externally on the Learning and Teaching Academy website.  The LTA website has since been updated and the supporting documents have disappeared onto the College intranet. I hope they have been refined to support this ever dynamic landscape. 


In the background we met some turbulence. A small but vocal number of staff wanted the college to ban any use of AI tools and or wished for a fool proof AI detection engine. 

We spent a year testing the Turnitin AI detection tool and found it to be generating too many false positives and switched it off before Turnitin came back asking for another fee for this 'service'. We also highlighted that on occasions when Turnitin 'failed' it was indicating that the same assessment had been used for more than five years and required updating.

On occasion we were asked to investigate a claim by academic staff that AI had been used in the creation of some work and not attributed. In some cases we were able to show an academic how the history and tracking of changes works in word. It was all the learner's own work and/or whoever spent several days and hours authoring. 

We worked with Jisc and were the only College to run a Jisc focus group with students around their use of AI.  This helped further refine our guidance. The stats in the slide deck below reflect what students said they were already using in September 2023. It went through a number of iterations and versions but sums up the College's overall approach at the time. 


 

This led to our materials being shared more widely and I was involved with helping SQA create their initial policy and guidance. We shared our work too with the QAA , at the BETT Conference,  EdTech Europe and at other conferences. We were indebted to colleagues in these organisations and to Donald Clark who appreciated what we were doing and who we were doing it for - the learners.

We led  'delivery not delay', was a College mantra. We ran lots of workshops for staff and students around digital skills and literacy including the use of AI, these supported by the LT and Library teams. 

At the time of creation of this guidance, while UAL had some guidance, the work of SQA , Scottish Govt was just starting and in many cases we were involved in shaping policy there. 
The approach was informed by the work of Jisc and the research coming out of the Association of Learning Technology and from European policy documents. The EU work on AI is relatively new. At the time it was around making our AI work align with European Digital Literacy standards for education. Through the LTA teams work on Open Educational Resources we also had the opportunity to see drafts of UNESCO work in the AI space and that helped inform what we were doing. 

I think around this time, the College worked out that we knew what we were doing and we ran a workshop for the College Board around defining an appropriate risk for the College risk register. This in turn led to some workshops and specific support for the Colleges professional services staff. 

The guidance was also shaped by a concern to make sure that learners and teaching staff followed college guidance around using tools that were accessible and met GDPR standards. 

One regret, is that while we were the  first college to pilot Teachermatic I could not get the internal support to roll it out across the College, as for instance Clyde College did later

There is still heavier lifting required. The advent of AI needs some deeper changes to assessment. If anything it highlights that assessment of competence should be a more practical demonstration of a particular skill and not judged on a candidate's essay writing skill. 

This not to demean the skill of communication. The system simply needs to rethink the context in which it values and supports effective communication. Learners still need to learn to craft communications for a variety of audiences, including academic writing. 

Where are things now - with focus on AI and education. 







Talking about Artificial Intelligence @Edutech23 #Edutech23 Amsterdam⤴

from @ ...........Experimental Blog



I was very fortunate to be a guest speaker at EduTech23 in Amsterdam earlier this month. Candidly without sponsorship I'd have been unable to attend.  Colleges in Scotland are in a precarious financial position currently and staff from vocational colleges don't normally have funding to engage in forums like this. But it is critical that we have a voice - so special thanks to the organisers. 

Artificial Intelligence is not as big a threat to vocational education as perhaps it is to the school and university system. 

Why ?  because in the main we offer authentic assessments.  Learners have to demonstrate they can do something not simply write an essay about how they might do it. That is not to downplay any ethical or other issues.

I really enjoyed #Edutech23 and my session attracted a standing room only audience and some very positive feedback on the day and online following the conference. Links to the session slides and what we are actually doing at the College are below.  I was suited a booted most of time but kilt and creative commons t-shirt on for day of session. 

I plugged too all the good work that is happening across the sector in Scotland and from UK in the AI space. 

The conference was well organised and well curated with an excellent set of sessions and was at a scale that encouraged attendees , exhibitors and presenters to engage.  I made some really good new contacts and reconnected with some colleagues from other roles I have held.  

I am just about to follow up with the useful contacts I made over the two days on the conference. Having returned to busy day job. 

Just to reiterate and before my new contacts flood my inbox with requests for sales meetings  at the moment I am always open to ideas and partnerships but we don't have resources to buy new services now or into the near future. I lead a resourceful team and there is a lot we can achieve without hard cash. We are well equipped for blended learning. Probably worth resharing how to work with Colleges in Scotland too,

We have suite that we are content with comprising at it's heart the tools listed below. These provide a sound platform for staff and students to enjoy a blended learning experience. 
  • Canvas by Instructure , Canvas Credentials and Canvas Folio
  • Microsoft Teams etc
  • Click-View
  • Panopto
  • Turnitin
  • Blackboard Ally 
  • Padlet 
  • Thinglink 
  • OneFile portfolio for apprenticeships
  1. Most immediately I am interested in any European College interested in working around with  Canvas Commons sharing vocational learning materials. 
  2. Projects around staff and student digital teaching skills and digital literacy.
  3. Policy around open educational resources at College level and the use of Artificial Intelligence in learning, teaching and assessment.
I'll follow up with post on some of the great folks I met and what we will follow up on. 



AI in world of presentations Try out Gamma App⤴

from @ ...........Experimental Blog

 




This not my presentation for Edutech 2023 - rather me testing out some of the tools I will include in my session.

If  you haven't discovered https://gamma.app/ you should have a look a serviceable and downloadable presentation in under 5 minutes . Quicker than building a Sandcastle - unless of course you use Bing Image Creator