OU blog

Personal Blogs

Christopher Douce

Connecting everything together

Visible to anyone in the world

One of the things I try to always do as a tutor is to connect different bit of a module together. I try to tie the digital materials to the analogue materials, and the tutorials to the assessments, and so on. I also try to connect students together too. 

This short blog post summarises some of the different ways that I connect things together. There was a time when I tried to prepare a graphical model to emphasise the connections that can exist between the different components of a module. As time has gone on, I’ve realised that there are more and more elements that can be tied together by a tutor.

The module that you tutor will have a unique combination of components that can be tied together in different ways. Different tutors may well, of course, emphasise different combinations of components based on their own knowledge and understanding of a subject.

What follows is a summary of what I try to do.

Welcome letter

At the start of every presentation, I write to all my students. In my introductory email, which contains a link to an introductory letter, I direct students to my tutor group forum. To make things as simple as possible, I include a link to the forum, which they can click on. 

In my tutor group forum, I have an introduction thread, where I encourage students to introduce themselves. I also tell them to subscribe to the forum, saying that I use the forum to post updates about TMA marking progress and to share resources that I use in my tutorials. I also share dates about introductory tutorials, encouraging students to put their dates into their diaries. Finally, I will direct students to the module website and the module calendar.

From the very start of the module, I am linking things together, directing students to different tools, places and resources.

Learning outcomes

Learning outcomes drive a lot of the ‘connecting’ that I do. In some ways, could be considered to be ‘academic glue’. I see learning outcomes less of a straight jacket that tells me what I should be talking about, but more as useful pointers.

Module materials sometimes begin with learning outcomes. Assessments are designed to evaluate learning outcomes. Subsequently, tutorials should help students to understand them and what they mean. A part of my role as a tutor to do my best to understand what students understand, and to offer guidance that helps students to move to a place where they can demonstrate an understanding of a learning outcome.

Study calendar

I’ve heard it described that the study calendar, which is available through the module website, is the backbone of a module. It outlines the study pace and rhythm. It is also an important ‘go to’ place to find out when the assessments take place; it gives the date of the TMAs, and the date when the examinable component is due. It also says when a block or a unit begins and ends. I highlight the study calendar during tutorials and introductory letters. I also sometimes post references to it in my forum posts.

Module blocks

Some modules have printed blocks, whereas other modules have everything online. Modules that teach fast moving subjects, such as computing, sometimes present all their module materials online. A module contains a number of units. I direct students to module blocks and units at different points during the course of a module presentation; at the start of a module, and when preparing for an end of module exam.

Online study materials

There are some module materials that can’t be presented through books. A literature module I have studied contained videos of performances, interviews with academics, and audio clips of pieces of music, all of which are presented through the module website. These study materials are linked to the module blocks and the module calendar. As a tutor, I also mention these materials during tutorials. I also share guidance about how online materials can be referenced.

Tutorials

Tutorials are a great way to connect different elements of our tutoring practice together. During tutorials, I might share handouts, do some screensharing to highlight bits from module websites, highlighting various module resources and tools. I connect tutorials to assessments, and encourage students to ask question through the module forums, highlighting that I will use forums to share resources.

Using the screen sharing facilities, I might even take students on a short guided tour of the OU library, demonstrating some custom searches. I might also show students some of the software tools or utilities that they might need to use during the course of their studies.

Forums

Although forums are sometimes underused, since students often talk with each other through various channels outside the university systems, they do represent an important way to share resources and connect things together.

Before some tutorials, I sometimes make a post, sometimes asking a question about what topics students would like to be covered. To make it easier for students to access the tutorial, I also share a link to the online room that is used. If a tutorial relates to an assessment or module materials, I may also share a link to these too.

After every tutorial, I post a link to a recording, if one has been made, also sharing a copy of a PowerPoint formed the basis of a session. If I shared resources during a tutorial, such as Word documents, or PDF files, I also share these too.

Sometimes interesting topics can be raised during tutorials. Forums are great spaces to continue those discussion, and to share resources that deepen understanding of module concepts.

Module materials often contain activities. Sometimes module materials specifically ask students to make forum posts. Other times, students’ complete activities in their own time. Forums are great ways to share activity work.

Towards the end of a module presentation, a forum has the potential to become a useful resource in its own right.

Study sites and materials

The OU has a wealth of really helpful supplementary materials. Tutors can play a really important role in highlighting these resources to students.

A study site is a set of pages and resources that are designed to offer help and support for students who are studying modules which form a wider programme of study. Sometimes these study sites provide pointers to complementary resources and activities. This might even include a range of optional online tutorial sessions that could help with study skills and writing. These resources can be especially useful for students studying at a high study intensity – in other words, studying full time with the university.

The Study Skills pages are also really useful, providing access to a range of helpful booklets on subjects such as preparing assignments, revising for exams, and studying with dyslexia.

A particularly useful resource is the page about good academic practice, which offers a link a some Open Learn resources and a set of pages about References and Plagiarism

Assessments

In some way, all these different components all relate to the assessments. 

I tie together assessments and tutorials, and tutorials with learning outcomes, and learning outcomes with module materials. During tutorials, I sometimes share pointers to the sections of the module materials (such as block and online content) are particularly relevant for assignments (without, of course, giving any answers away).

Some modules ask students to share evidence of engagement with forums in their marked assessments. Also, students might be asked to provide evidence of interaction with software tools or products, but more of this in a moment.

One of best things that tutors can do is to link assessments to wider aims and objectives, to help students appreciate their purpose, and what they gain by completing them. It might be to demonstrate knowledge, or to develop skills. In turn, these skills may be useful within a wider programme or study, or have industrial relevance. In other words, gently answer the question: “why am I doing what I am doing?”

Student support teams

Remind students about their student support team (SST). As a tutor, you’re there to facilitate a student’s learning of the module materials, to answer any questions they may have, to run tutorials, and to mark their assignments and to provide helpful feedback. If you are approached about any non-academic issues, the thing to do is to refer students to the student support team, where they can gain further help and support. Do refer them if you feel that they require substantial study skills help that is above and beyond what you feel you’ll be able to provide.

The SST uses something called an Information, Advice and Guidance model (IAG). When students call, they are often seeking information. If it turns out that a query is more complicated, students are then passed onto advisors. 

Although tutors can sometimes share really helpful information about what a student’s next module might be, it is always worth encouraging students to have a conversation with the student support team, who will be able to offer official university information, advice, and guidance. Module choice is a non-academic issue, although it relates to the study of academic modules. If you’re ever in doubt, always refer students to the SST.

Software tools

Some modules require students to use different bits of software, some compulsory, some optional. These might be bits of software you access through a module website to share images or text with fellow students, or bits of software to download and use to create or edit digital resources.

If your module makes use of bits of software, you can connect them up with bits of the module in different ways: you can mention bits of software in your forum posts, you can introduce them using screen sharing in your tutorials, and emphasise their relevance (and importance) within your correspondence tuition feedback.

During my own tutor practice, I sometimes make some forum posts to make students aware of bits of software that might be helpful to them.

Library

The OU library a fabulous resource. Through the library, you can find resources, articles, and books for every academic subject. The library provides access to really useful collections of journals and eBooks. A bit of a student’s module fee is used to support the library.

Every module uses the library in a different way. Some modules may direct a student to a lot of library resources, and databases that can be accessed through the library.

When working with your students, do remember to refer your students to the library, especially if they have to do some independent study as a part of level 3 or dissertation (or project) modules. It is worth remembering three key bits, which are especially useful: firstly, the library has curated selected resources for your study. Do encourage your students to spend browsing these pages. Secondly, the library often runs a series of events. The library also offers a really comprehensive help and support section, which can be really useful for students who are looking for articles to support their academic writing.

Finally, it's worth mentioning SCONUL to your students, which is an access scheme that enables learners to the use the libraries of other universities. If students lack a quiet place to study, SCONUL is a really useful service.

Correspondence teaching

TMA feedback is one of the most important opportunities tutors have to connect different elements of a module together.  There are, of course, two ways to provide feedback: on the student’s eTMA summary form, and on a student’s script.

When leaving comments on a script, I sometimes provide direct links to module materials, or provide page references to module blocks. Where appropriate, I may also share pointers to module activities that relate to the skills and ideas that were needed to be demonstrated through the assessment. I also may also share pointers to study skills resources, but also explain why I have done this.

In my eTMA summaries, I often mention the dates of an tutorials that are coming up, along with any important forum posts that may have been made to our module material concepts. I use the eTMA summary to provide pointers to what has happened, and what may happen, whilst also explaining why these pointers are important.

Group emails

Throughout a module presentation, I regularly send group email messages to my tutor group. These emails are useful opportunities to direct students to different resources, and also to highlight important deadlines. I don’t tend to put too much in my emails, instead preferring to put more information in an accompanying forum post, which I have shared a hyperlink to. The motivation for doing this is try to guide students to the discussion forums. In my emails I encourage students to subscribe to the forum if they haven’t already done so.

I typically send group emails towards the start of a module, reminding everyone of my introductory tutorials. When I do this, I would share a link that allows student to join the relevant tutorial room, saving them from having to follow a chain of links through the module website. Linking things together is about making things clear and easy for students.

I also send group emails a few days before each tutorial, to offer them a reminder of what is coming up. When reminding everyone about the exam revision tutorials, I might say: “as I have mentioned on your TMA feedback”, to remind them that what I have written may well share some useful guidance.

At the end of module presentation, I use the group email feature to send a short ‘sign off’ email, where I encourage students to consider their next study options. When tutoring on a level 2 module, I would mention (in passing) a combination of different level 2 and level 3 modules, and encourage students to contact the student registration service if they are considering doing their next module.

External news stories and events

Connecting your module to current events and stories can be a powerful way to emphasise its importance and relevance. During tutorials I might highlight a story by asking a question, by asking: “has anyone seen that news feature about…” For students who might not come along to a tutorial, I might post a link to a news article on my tutor group forum. In turn, I might share a relevant link or a news story with fellow tutors by making a post to the module tutor’s forum.

Personal experience

Andragogy is the term used to refer to the practice of teaching adults. One of the great things about teaching adults is that they arrive at your tutorial with a wealth of personal experience. Many students may well already have careers in the topic that is the focus of your module. A good andragogic practice is to draw on the experiences of those who are studying the module, which you may find out about during introductory tutorials and events. When you know a little more about your students, you can then relate their experience with module themes and topics. You may also be able to draw on existing experience of study, to facilitate sharing between students.

Exams and EMA

Many elements of a module can be linked with its examinable component, which could be an end of module exam, or end of module assessment (EMA), or an end of module TMA (emTMA). As a tutor, you may be asked to facilitate tutorials about the final exam or final assessment.

In a tutorial that prepares students for an examinable component, it is useful to offer links and pointers to its structure, individual questions, and back again to the module the module materials. From there, you could link questions to module and unit learning outcomes. You might also link questions to previous TMAs, as well as any earlier points of feedback you may have shared.

It is also worthwhile offering links to other resources: module glossaries, resources about academic conduct, and guides about how to plan for exams.

Careers service

The careers service is sometimes easily forgotten about; it’s a great service. I mention the careers service in the comments of a final TMA that I return. I also mention it during some of my final tutorials and in my ‘sign off’ group emails.

Not only does the careers service provide some really helpful resources, students can also request to have a one-to-one career consultation with a career professional, which can be really useful in terms of identifying next steps. Working in combination with industry, the careers service also advertises jobs and graduate schemes that may be of interest to students who are coming to the end of their studies. It sometimes is used to share information about different types of internships.

It is worth telling your students that they are able to continue to access the OU career’s service a couple of years after graduating, just in the same way that they are also able to access module websites a couple of years after studying a module. Even though a student might not be a current OU student, they are still eligible to give the career service a ring.

Reflections

Connecting different things together is a really important thing to do in online and distance teaching. A module is so much more than just the course materials and the assignments.

I initially thought this list would be a lot smaller than it is. When I started writing it, I thought there would be a maximum of around six entries. Reflecting on my practice as tutor, and reflecting on what I have experienced as an OU student has helped me appreciate that there are so many different pieces that can be proactively connected with each other. Tutors are perfectly placed to do a lot of connecting, to signpost different elements, tools, and resources.

Another reflection is that every module is different. One module that I tutored place a huge amount of emphasis on the use of discussion forums. Another module that I tutor doesn’t really use forums in a prescribed way. Just because a tool isn’t used doesn’t necessarily mean that you shouldn’t use a tool. Digital pedagogy is still something that is very new. We can only uncover best practices, and practices that relate to the modules that we tutor, by trying things out.

Permalink Add your comment
Share post
Christopher Douce

Preparing online tutorials

Visible to anyone in the world
Edited by Christopher Douce, Sunday, 31 Mar 2024, 21:21

Most OU tutorials are currently held online. The term ‘tutorial’ is one that can mean different things in different institutions. In the OU, a tutorial is a ‘learning event’ for a small group of students (although tutorials can sometimes be offered to larger groups of students), that has a specific purpose. The purpose of a tutorial is, of course, linked to module learning outcomes and a module’s assessment strategy.

This blog post shares a sketch of how I prepare for my own online tutorials. Different tutors (and groups of tutors) might adopt different approaches. One way to approach this article is to pick out bits and ideas that work best for you. Think of all the headings that are shared here as representing elements of a really simple framework.

In the earlier days of the university, face-to-face tutorials took place at designated tutorial venues. Depending on your module, tutors might be sent a simple tutorial title or description, such as ‘TMA 1 tutorial’ or ‘block 2’ tutorial. With this title, tutors (who are, of course, have been employed as educational professionals, who know how to teach their subject) would be required to create an event related to those titles. To make best use of the time, tutors would devise different activities to get students interacting with each other, and to help them engage with the ideas that are presented in the module materials.

When preparing online tutorials, it is important to consider the notion of an activity. A challenge with online teaching is that the online tools can themselves become a barrier to sharing and collaboration, which can make it difficult to design interactive and engaging tutorials. In some ways, the tutor has moved from being a ‘learning facilitator’ to a ‘learning producer’, where a tutor produces (or highlights) connections between elements of module materials.

The notion of online tutorial time is different from face-to-face tutorial time. Interactive activities can take much longer to get through when working online, due to the necessary administrative overheads of checking sound levels, allocating students to online rooms, and waiting for responses. On the other hand, you can get through the sharing of some difficult module concepts really quickly since you may choose to record certain elements of your tutorial and encourage students to listen back to your ‘difficult sections’ at a later date. Some aspects of pedagogy transfer well from a face-to-face setting, whereas other do not transfer well at all.

It is true to say that online teaching is difficult since online pedagogy is difficult. It is difficult to check for understanding, and it is difficult to ask questions, since different students may be using their technology in different ways, and it is difficult to run meaningful online activities. It is also probably true to say that technology has been evolving more quickly than online pedagogy.

One way to understand online pedagogy is through a framework called TPACK which is an abbreviation for Technical Pedagogical Content Knowledge. It is useful since it is pretty simple. To do face-to-face teaching well, you need to know your subject (content knowledge), but you also need to know how to teach it (which is pedagogical knowledge). Pedagogical knowledge is, of course, all about the ‘stuff’ that you do in the classroom, such as: giving a lecture, running an activity, asking students questions, or even doing a bit of role play. When we move to the online space, we need to know another bit, which is the technology bit. Essentially, we need to know what buttons to press, and when. To do this well, we need the time to acquire a mental model of how our tools work.

There’s also an added complexity to this in that we need to know how to use our technical tools in a pedagogical sensible way. Whilst we could just share a PowerPoint during a tutorial, that wouldn’t necessarily lead to a good online tutorial. To make a good online tutorial, tutors need to understand intersections between the technical, the pedagogical, and the content knowledge.

What follows is a simple framework to get you started with preparing your online tutorials. Much of this will, of course, sound pretty obvious. Before I get into the framework, here are some things to bear in mind:

  • Accept that online pedagogy is difficult; we’re all trying to figure it out. It can sometimes seem a bit overwhelming, but with time, persistence and practice, it will become easier and less stressful.
  • Think of yourself as a facilitator-producer rather than a facilitator-teacher role. This represents an important shift away from the perspective that you might have adopted previously with face-to-face tutorials. The idea of producer-facilitator (as in an event producer) is an important shift in mindset.
  • Tutorial time is elastic: during your tutorials expect that some types of interactive activities can take a long time, whereas other will take less time than expected. Be prepared to be surprised.
  • Expect silence from students, but also expect that the amount of silence that you have may depend on the online tools that are used, and the confidence of your students in using those tools. Whilst the silence can be a bit unnerving, don’t be worried or put off by it.

Use whatever features you have within your online environment to ‘poll’ your students regularly. Ask them for low demand interactions, such as clicks on buttons, or for simple responses through text chat.

Identify your tutorial dates and titles

Every module has something called a group tuition strategy (which is sometimes known as a group tuition policy). The strategy offers a sketch of what ‘learning events’ are to take place during a module presentation. To all intents and purposes, learning events are tutorials. These tutorial events take place within specified time windows. The learning events can take place for a tutor group (of up to 20 students), a cluster (of up to 10 tutor groups), or they could be module wide. Typically, module wide tutorials are facilitated by module team members or experienced tutors working in collaboration with the module team.

The strategy has a number of related objectives: 

  • It shares what is in the head of the collective module team. In other words, it describes what subjects and topics, and broadly what tutors will present.
  • If a module is delivered across a number of different clusters (which is a group of tutorial groups, all working together), it ensures that these clusters are roughly delivering the same tutorials. It aims to provide consistency to make sure that all students are provided with tutorials that cover similar materials.
  • It provides students with useful description of learning events. It will also describe whether individual tutorial will (or will not) be recorded. This enables students to make a choice about whether they attend specific sessions.

When you begin a presentation, familiarise yourself with the list of tutorials you are required to deliver, and when they are to be presented. Put these dates in your diary. Students can book onto these tutorials at the start of a module presentation, which means that they cannot easily be changed. If this is your first presentation, you may well be asked to team up with either your mentor, or other tutors, to gain experience of what is involved with online teaching. Have a good read of the learning event description; it should allude to some of the module learning outcomes that you need to cover.

Identify the learning outcomes

Irrespective of what you think about learning outcomes, they are important tools that are used by module teams. They are, of course, used to guide what materials are covered and what is assessed. Subsequently, it’s important to make sure you appreciate what you module’s learning outcomes are, how they relate to a learning event description (the group tuition strategy) and what you need to (broadly) cover in your tutorial.

A point to note is that although a learning event description might specify what outcomes you need to cover, it doesn’t always specify how it should be covered. You should apply your technical, pedagogic and content knowledge to make decisions about how you do this. 

Review your module calendar

There is a rhythm to every module presentation, and every module has a module calendar that shares that rhythm with students. Is useful to familiarise yourself with the module calendar to relate your scheduled tutorials to what is being studied and when. Pay particular attention to the dates of the student’s assessments. If your tutorials are close to any points of assessment, it is a good idea to highlight themes that relate to forthcoming assessments in your tutorials.

Prepare your materials

The big question is, of course: what are you going to do during your tutorial? Online tutorials are often structured around a PowerPoint presentation (but they don’t have to be). If you do use PowerPoint, be aware that the university updates its PowerPoint templates from time to time, so do seek out the latest version.

The exact contents of your tutorial will, of course, depend on what is in the group tuition description. Design a number of activities with varying level of interactivity. Also, plan for having different numbers of students at your tuition event: plan for either 2 students turning up, or 20 students.

Activities could include sharing interactive questions, debating an idea, indicating an opinion on a continuum by adding a mark using a virtual pen, screen your sharing with students and asking them for their direction, or putting students into break out rooms and asking students to contribute to plenary discussions.

Do begin your session with a contents and introductory slides. At the end, briefly summarise what you have covered. I remember a colleague saying to me: ‘tell them what you’re going to teach them, then tell them what you’ve taught them’.  At the end of your session, also leave a space for a question and answer session which is not recorded.

When I use PowerPoint, I like to use simple animations. I use animations to show the different parts of a slide a bit at a time. My motivation for using animations is that it can be useful to draw student’s attention to the specific themes and topics, and prevents them being distracted by what is going to be spoken about next. Although animations can sometimes be a bit tricky to work with (PowerPoint has something called an animation window, where you edit how all your animations appears, and what each trigger is to start an animation) I think it is a feature worth getting to know. A practical recommendation is: keep your animations simple. I tend to use only two: an ‘appear’ animation, and I start an animation through a mouse click.

Finally, I make use of the notes section of each PowerPoint slide. This serves a couple of purposes: it acts as a prompt in terms of what I am going to cover within the session, and provides a set of useful notes that I can share with students afterwards.

Tell your groups

Although your tutorials will be visible to students through their StudentHome page and the learning event management system, it is always a good idea to remind them that you are going to be running a tutorial. A few days before a tutorial, do send a group email to all the students in your tutor group reminding that you will be running a tutorial. If appropriate, do emphasise that you will be sharing some guidance about a forthcoming assignment. This should act as a draw, which should then increase tutorial attendance. More students, of course, make for better (and hopefully more interactive) tutorials.

Another way to increase the visibility of your tutorials is to mention their dates and titles on your introductory email and within the TMA feedback you provide. It is a good thing to join together different elements of your tuition together.

Review your registrations

A few days before your tutorial, review the list of students who have registered. Not only will you get a sense of how many students to expect, but you will be able to see whether any of those students have disclosed additional requirements.

If you do notice any students do have records which suggests that adjustments may need to be made during tutorials, it might be necessary to contact them individually in advance, to ask the question: ‘what do I need to be aware of to ensure that I can provide tuition that meets your needs?’ 

Be led by your student. Sometimes, it might be a good idea to adjust the design and layout of your PowerPoint resources, or in other occasions it might be a good idea to send your student a copy of your PowerPoint in advance, so they can read it through in before your tutorial.

Prepare your online room

If you are using Adobe Connect to deliver a tutorial it is important to make sure that your online room is prepared and set up before the day of your tutorial.

Adobe Connect uses an analogy with a real teaching space; your online room will be left in whatever state the previous occupant left it. The previous occupant may have chosen to layout your room in a way that worked for them. Adobe Connect uses an interesting and powerful idea: it uses something called a layout. You can choose your own room configuration by creating and using your own layouts. 

If your room is shared with other tutors, it is a good idea to create a new layout and put your name next to it. You may well want to create different layouts for the various activities you wish to run. Different layouts can be used to collate together text from notes gathered up from breakout rooms, for example.

When you’ve created a layout and have updated your PowerPoint resource, it is then time to upload it to a share pod (which sits within one of your layouts). When this has been done, you can move through all your slides.

If you do a lot of screensharing in your tutorials, it is important to be aware that how your screen appears to you might be different to how your screen appears to students. If you are using a computer with a very high resolution monitor, what you share might be difficult to read to some students who have an older generation monitor. If you want to do some screensharing, a recommendation is to share through a monitor or a display that is set to a lower resolution. It is a good idea to do this before your tutorial. You can change the resolution through your computer’s control panel. 

Running your tutorial

My own practice is to login to my tutorial room approximately fifteen minutes before it is due to start. After logging in I make sure that I have a glass of water, have selected my chosen Adobe Connect layout, uploaded my required PowerPoint (if I’m using one), and make sure my microphone and headset is set up correctly. If you use a laptop with a headset, Adobe Connect might ‘see’ two microphones: one that is built into your laptop, and the other one which is connected to your headset. Do make sure you ensure the correct microphone is selected.

When delivering a tutorial, I use two monitors. One monitor that is used for Adobe Connect, and another that has a copy of the PowerPoint that has been uploaded to Adobe Connect. The reason for this is simple: having two views of my presentation enables me to remember what my next slide is, and also allows me to access the notes that I have prepared earlier.

At the very start of a session, I turn my webcam on, so students get a sense of a real person behind the slides. To prepare for this, also check to make sure that my laptop’s video camera is at a good eye level, and the lighting in my room is reasonable.

After a friendly welcome to all students, I start the recording if this is something that is required by the group tuition plan. If a recording going to be made, I make a point of making all students aware that this is happening. This gives them the opportunity to drop out from the tutorial if they do not personally consistent.

During a tutorial, I might use a number of different layouts, whilst at the same time trying to keep things simple. I typically use no more than three different layouts, but more often than not, I mostly use only two. Before changing layouts, I always make sure to tell students what is happening. I also do the same whenever I’m screensharing.

If I use breakout rooms, or run activities where students are requested to share options or debate ideas, I always pause the recording. One of the main reasons for this is, of course, to encourage students participate freely. Also, if students see they may have potentially missed something interesting, they may well be tempted to come along to the next version.

Finally, if I turn up to a tutorial which is scheduled to be recorded, and no students turn up, I do the session anyway. I make what is known as an ‘empty room’ recording. Even if I don’t have any students at the allotted date and time, students may seek out a recording.

Using advanced features

Online tutorial tools have a lot of features, and these can take quite a lot of time and courage to master. Here is a summary of some of the more advanced features that are provided by some tools:

Breakout rooms: These are student led discussion rooms which can be used to discuss different themes and issues. Since participants are often reluctant to speak, only use them if your group are familiar and comfortable speaking online, or if you have a reasonably large group. In Adobe Connect you can ask students to make notes, which you can then collate on a shared layout. In turn, this can lead to a discussion.

Sharing media: You can show students interesting resources, such as audio or video clips. Make sure they are always relatively short, and make sure that you poll students (ask students to push buttons) before and after sharing a media clip, just to maintain their attention.

Asking questions: To test knowledge and to gain an understanding of experience or opinions, you can share questions in different ways.

Sharing files: Adobe Connect provides a way to share ‘digital handouts’ to students. This can be done through something called a ‘files’ pod, where you can upload any number of files you wish to distribute to students. You might share a copy of a presentation, or maybe a set of notes. Just like face-to-face tutorials, a practical tip is to share handouts towards the end of a session, to avoid students becoming immediately distracted and reading them. Also, do note that files can only be shared through a file pod during a live tutorial, and cannot be distributed through a recording.

Screensharing: Screensharing is a powerful approach to introduce and to talk about different elements of a module, particularly if a lot of module materials are made available through a module website.

Screensharing

Screensharing is a really powerful tool. I do a lot of screensharing. At the start of a module presentation, I use screensharing to give students a quick tour of the key bits of the module website to help them understand what resources available, and what resources are important. I emphasise particular weeks in the module calendar, and talk them through the module assessment strategy. For one of the modules I teach, I show students the university library website and share some tips about how to search for articles.

Screensharing can be a really powerful pedagogic tool for modules that use computer software. One of the modules I used to tutor was called M250 Object-oriented programming. This was a module where students had to learn how to use a programming language and learn how to use a software development environment. To help students to learn more about their tools, I began by providing a tour of some key features. I then took a pedagogic approach where I asked them for their direction. Students attending the tutorial could then ask me questions about the software environment, what it was for, and how it worked.

If you want to use screensharing, the following tips may be useful. Do bear in mind that these relate to Adobe Connect. Other tools, of course, will work differently.

Plan what you are going to show: Before doing any screensharing, do spend a few minutes doing a bit of run through, or practice. This will help you to remember what bits you are going to click on. Don’t worry if you click on the wrong things; your session doesn’t have to be perfect.

Select which monitor you will use for screensharing: The monitor you choose matters. If you choose your main monitor, and this is a very large screen with a very high resolution, when you share your screen, the text you will share is likely to become impossibly small for students. To avoid this happening, adjust the resolution of your main monitor so it has a lower resolution. If you have a multi-monitor setup, make sure that the monitor you use for screensharing has a lower resolution. (You can, of course, check to make sure what students can see by making a test recording).

Create a layout just for screensharing: Create a layout that has an empty share pod. When you move to this layout, you can than then immediately start to share your screen. This avoids having to stop sharing whatever you are sharing, and having to reload it again when you have finished your screensharing.

Move the text chat out of the way: If you have a multi-screen setup, if you are screensharing, move the text chat to the screen that isn’t being shared. If you don’t do this, there will be a bit of the screen recording that will be blocked out for students. Moving the text chat area avoids that happening, and helps you to interact with your student group more easily.

Make sure you have an alternative: Not all students may be able to take advantage of your screensharing. Whatever you do share, make sure your students have a different way to access the same points of learning. You might think about adding additional or complementary notes in your PowerPoint file, or sharing an additional resource which might summarise a set of steps that you illustrated.

Washup, or after your tutorial

Post-tutorial ‘washup’ is an important part of delivering a tutorial.

There are a number of discrete tasks I always aim to complete as soon as a tutorial has finished. If I can’t complete them immediately, I make a note to ensure that I carry out all these activities the following day. 

The first three tasks need to be completed if you have recorded your tutorial.

Check the recording: The key question I ask myself is: did my tutorial record okay? I do this by clicking on the recording link, and listening to a couple of seconds. To save time, I sample a couple of slides, to also make sure that my slide and layout transitions are okay.

Edit your tutorial name and description: After a recording has been made, the recording software will allocate a default title. This title will not give students any information about the aim and objectives of the tutorial. Edit both the tutorial name and description, making it consistent with what tutors have done.

Make your recording visible: Recordings are not visible by default. You have to do something to make them appear for your students. The OU VLE adopts a curious metaphor to facilitate this: it uses an ‘eye’ metaphor. If a recording is not visible, an eye will be closed. You can make a tutorial visible by clicking the eye icon to open it. If you forget to make your recording visible, students may ask you to make it available to them.

Share your resources: After a tutorial make available any resources you might have shared during a tutorial to other students. If your tutorial was a tutor group only tutorial, do post a copy of your resources to your tutor group forum. If your tutorial took place in a cluster room (where students from other tutor groups can attend), do paste your resources in the cluster forum. If your tutorial was recorded, also post a link to the recording.

Let everyone know that tutorial resources are now available: Now that all your resources have been uploaded, there are two final things to do. Firstly, send a message to all students who have attended your tutorial to let them know. You can do this by going to the ‘your tutorials’ section on TutorHome, and clicking on the ‘your past tutorials’ heading. You will then see a ‘send group email’ link. Use this link to let all students who registered for your tutorial know about the available of your resources. Secondly, let all students in your tutor group know by sending them a group email. Even if they haven’t attended, they might find your tutorial resources useful.

Working with others

All these points in this article have been written with a single tutor in mind. Tutorials are sometimes supported by two or even more tutors. Working with one or more tutors gives tutors and students some interesting advantages. Firstly, it offers redundancy. If your internet connection was to experience a temporary outage, the second tutor can immediately jump in and continue a tutorial. Secondly, it enables for an efficient division of responsibilities: one tutor can lead a session, and another tutor can be supporting the session by reading the text chat, and interacting with students. Another benefit is that students, get to hear different voices, which makes it more interesting. Finally, different tutors can facilitate interesting online pedagogies. Two tutors could, for example, argue with each other, adopting opposing viewpoints. The tutors might role-play, to demonstrate some key learning outcomes.

When working with other tutors, planning is important. Make sure you find the time to decide who is doing what some time before a scheduled tutorial. You might decide on this through a short online meeting, or you might develop a plan through an email conversation. You might also decide to work collaboratively on a presentation. Do make sure you share views about whether you have preferences in terms of covering certain learning outcomes, or have any specific technical or pedagogical skills you would like to emphasise or to draw upon. Clear communication facilitates effective collaboration.

Improving your practice

As suggested earlier, running online tutorials is difficult. It requires skills, practice, and different types of knowledge. It is easy to get things wrong, and things will go wrong. Like very many aspects of education, an important element of delivering effective online tutorials links back to the principle idea of reflection. It is important to continually reflect on your practice and aim to continually develop your skills.

When considering reflection, ask the following questions: What worked well? What didn’t work well? What bits did I struggle with? What part of the tutorial am I uncertain about? Also, what bit seemed to work well?

If you are newly appointed to a module, do make sure you have an opportunity to learn what your mentor does. Depending on your module, it might be possible to view another tutor’s tutorials. Ask your line manager and your fellow tutors if they would be happy for you to either come along to one of their tutorials, or listen to one of their recordings.

A key to developing your online teaching skills is to be comfortable taking practical risks. Online tools have a lot of features, and only a very small proportion of these features are used. Improving your practice as an online tutor means that sometimes it is necessary to feel uncomfortable. Don’t be afraid to try new things out. Find new ways to interpret the aims of a learning event. Also, do seek advice from those around you.

Reflections

I used to find all kinds of tutorial overwhelming. I used to ask myself: “what happens if I’m not able to answer a question?” I now know that although this was a legitimate question, the reality is that I’m not expected to answer every single possible question. If I don’t know something, I will say “thank you, I’ll find out and I’ll get back to you”; behind the scenes there is a lot of support: there is your line manager, and fellow tutors to seek help and guidance from.

Another question that I’m sure I have asked myself must have been: “what happens if I get something wrong?” The answer is, of course, you can always share corrections and updates later on.

Online tutorials are difficult. A bit of the difficulty lies with the silence that tutors face; it sometimes feels as if we are talking to ourselves, into a machine. The reality is, however, different. I can assert this since after tutorials, students who have never spoken have sent me an email saying that they have appreciated the tutorials that I have helped to deliver.

I take a practical approach when planning and delivering tutorial; I want students to go away with something. That might be a new way to understand concepts that are presented within the module materials, or a new understanding of what is required for their next tutor marked assignment.

I’m not going to deliver a perfect tutorial every time. Sometimes things go wrong, and I won’t push the right buttons in the right order, and that is okay. After all, we’re all learning.

Acknowledgements

This blog has been written as a part of an eSTEeM project which relates to STEM teaching practice. Thanks are extended to Fiona Aiken whose comments has helped to improve this article.

Permalink
Share post
Christopher Douce

Planning and evaluating impact of a scholarship project

Visible to anyone in the world

On 23 June 23, I attended an online seminar about impact and scholarship, which was facilitated by Shailey Minocha and Trevor Collins. Shailey is the School of Computing and Communications scholarship lead, and Trever used to be a director of the university’s STEM scholarship centre, eSTEeM.

The event is summarised as follows: “we will take you through the toolkit for impact of SoTL and introduce you to various resources of the impact evaluation initiative. By the end of the event, we hope that you will feel prepared to use the resources/toolkit to plan, evaluate, and report the impact of your (past, present and future) SoTL projects and interventions.” Early on in the seminar, there was a reference to a page about impact, which can be found on the eSTEeM website.

Stories of impact

One of the most notable parts of this seminar was the amount of articles and resources that were shared. One of the first articles mentioned was: Impact of Scholarship of Teaching and Learning: A compendium of case studies. In this publication, 16 Scholarship of Teaching and Learning (SoTL) projects were analysed by something called the Impact Evaluation Framework (IEF).

Two other articles were: 

Defining impact

The UK Research Excellent Framework (REF) defines impact as “an effect on, change or benefit to the economy of society”. There is a connection here with the school research fiesta which took place earlier this year: REF impact case studies are important. In terms of SoTL, impact implies demonstrative benefits to learning and teaching that are directly attributable to a specific project.

I noted a question: what has changed (as a result of a project)? What new insights have gained (from the project)? Also, how can the institution put the outcomes into use? What are the current debates that this scholarship relates to?

Impact evaluation framework

The impact evaluation framework was mentioned, but what exactly is it? It is said to contain 12 facets (or aspects) of impact, which are spread over 4 categories. During the session, I attempted to briefly summarise what they are:

  • Learning and teaching: impact on student experience; student retention; evidence of excellence?
  • Transfer to others: an influence on discipline based teaching, research, or practice; dissemination of outcomes; extent of adoption by others?
  • Stakeholder benefits: enhanced mutual understanding; facilitated personal or professional development; recognition of project team members and other stakeholders.
  • Cultural and economic benefits: has it fostered scholarship culture; financial implications (saving of money); funding opportunities.

Relating to this framework, Shailey shared a link to her blog, Impact of scholarship of teaching and learning

This article provides links to related resources, such as an executive summary, case studies, guide for educators, and two workbooks: one about impact evaluation, and another about planning for impact

Six principles (or values) of SoTL

A particularly useful resource which relates to scholarship is a free badged open course from Open Learn: Scholarship of Teaching and Learning in STEM.

This short course has 6 sections, which emphasises what contributes to an effective study:

  1. Grounded in student learning and engagement
  2. Grounded in one or more context
  3. Rigorous and methodological sound research design
  4. Conducted in partnership with students
  5. Appropriately public for evaluation and uptake by peers
  6. Reflection, critical reflection and reflexivity.

Strategies for planning and generating impact

This section of the seminar shared some useful practical tips for anyone who was considering setting up a scholarship project, or thinking about impact. These have been paraphrased as follows:

  • Align scholarship with strategic priorities of institution, school and discipline.
  • Use social media to create community and connection; make use of YouTube channels, and other social media platforms.
  • Make sure you keep a clear record of evidence of impact.

Another thought I did have was: consider developing a scholarship team which has complementary skills.

Impact resources

Building on the section which introduced the impact evaluation framework, this section aimed to highlight resources and ideas that could be useful. A key element of this was the Theory of Change methodology (ToC). This was highlighted as a dominant image methodology which is used by the Office for Students https://www.officeforstudents.org.uk/ . Apparently, the Theory of Change helps scholars plan a project for impact, helping them to consider pathways to impact from the start of project.

Some resources that were highlighted included a ToC visual tool, a SoTL impact evaluation workbook, and the Planning for SoTL impact evaluation workbook. There was also a question driven template, which was considered to be a project management tool.

A key point highlighted in this section: know who your stakeholders are. Without stakeholders, and without influence across stakeholder communities, there is no impact.

Reflections

A question that I always return to is: what is the difference between scholarship and research?

In some respects, the answer to this question is directly linked to the notion of impact. The way that I understand it is that scholarship relates to impact on teaching practice and activities. In turn, scholarship can have a direct impact on the student experience. Research, on the other hand, has impact on an academic discipline, or field of study. There is, of course, cross over between scholarship and research, especially within the domain of education and education studies. 

Another thought I always come back to is that both scholarship and research are important, and that academics should do both: research relates to what we teach, whereas scholarship relates to how we teach. I can’t get away from the perception that due to the Research Excellence Framework (REF) that research activity is valued higher than scholarship activity. This said, there are other metrics and league tables that relate to the student experience: the student satisfaction survey, and the Teaching Excellence Framework (TEF).

This seminar was timely. I’ve just finished setting up what is called my annual Academic Workload Plan. In the forthcoming year, I’m hoping to set up a scholarship project (subject to approval, of course). An important point from this session was: build in dissemination and impact right from the start.

I thought that the tools shared during this session were potentially useful, especially the articles. The session clearly highlighted that there are challenges in planning for and generating impact: projects can often take longer than expected, and project members can become tired at the end of the project. An excellent point was made; sometimes impact could occur years after the completion of a project. This point emphasises the importance of importance of collating impact after a scholarship project has officially finished.

I once heard it said that it is very difficult to change the world by writing an academic article. I understand impact being all about what you do with either your practice or research findings. A lot of academic effort goes into finding things out and getting articles published in prestigious journals. Impact, in my eyes, is all about enabling findings to facilitate positive and constructive change.

Permalink Add your comment
Share post
Christopher Douce

Advice to students, from students

Visible to anyone in the world
Edited by Christopher Douce, Thursday, 22 Dec 2022, 11:12

An interesting question to ask a student is: “what advice would you give to a fellow student about working with TMA feedback?” TMA feedback is, of course, the feedback that a student receives after collecting their marked Tutor Marked Assessment.

This question is one of several that are explored through a scholarship project that has the title Developing student use of feedback on their marked TMAs which was led by staff tutors Carol Calvert and Colette Christiansen, and Clare Morris who was the AL lead on the project. 

A summary of some of their research findings was shared to colleagues through a discussion forum. It struck me that their findings (which takes the form of practical advice) was so useful, I thought it might be helpful to share their findings more widely.

Before looking at the specific points, it is worth emphasising that TMA feedback is typically given in two different ways: through a coversheet (an eTMA form, which is sometimes called a PT3 summary) which offers students with an overview of how they have done (which is typically forward looking), and comments that have been directly provided on a submitted assignment (which is feedback that relates to work that has been done).

Here are Carol, Colette and Clare's collection of useful points:

Collecting and using your TMA feedback – advice from your fellow students

Reading the feedback on your marked TMA can be a bit nerve-racking, but it can also be a really important part of your learning. A recent survey produced a great deal of valuable advice from students, which we’re sharing with you here. All the quotes in green are taken directly from comments by students – and they’re just representative examples of topics which were mentioned dozens of times. This is the voice of experience!

Some preliminary advice – doing and handing in the TMA

  • Complete the dummy TMA [i.e., TMA00]
  • Make sure to read all the guidance about submitting TMAs well in advance
  • Attempt the TMA as soon as possible, and work on it as you go along, straight after completing the relevant unit.
  • Make sure to keep in mind when your assessments are due in, you don't want to have to rush anything.
  • Plan your time and keep disciplined! Once you fall behind, it's tough to get back on track, so don't let it happen.
  • Make a plan and keep it realistic
  • Read the question, answer the question, then read the question again! – but don’t over-think it.
  • Know that the time you spend on learning will pay off and don’t give up.
  • Do what it says on the tin and you can't go far wrong

Picking up your marked TMA…

  • Download the pack [that is, your marked script plus the summary sheet] from the website to save alongside the submission.
  • Print them so easier to refer to. Use for revision.
  • keep all feedback downloaded to use later, keep it stored

… reading and making use of the feedback…

  • Read the feedback initially then go back the next day once emotions surrounding marks have subsided. Read, and review, then revisit the comments a few days later
  • Read through the comments thoroughly and talk to a friend or family member about any mistakes you have made (or things you are particularly proud of), and how you can improve. This helps to keep the feedback in your head, so you have it at hand when tackling the next TMA.
  • Look at the feedback as soon as possible so that you can keep on top of any errors/feedback for completing the next TMA and improving your marks.
  • even if you score highly there is value in reviewing the feedback as tutors will also comment on things such as the style and formatting of the document which can be useful when setting out future assignments.
  • Focus on applying the feedback given rather than focusing on your assessment score
  • Take any general advice on board. It can provide easy extra marks throughout the rest of your studies if you fix general issues on how you show your working or answer written questions.
  • Make use of it. You might be annoyed at first to have dropped marks, but turn it into a positive and learn from your mistakes
  • Take your time to consider the feedback - then redo that part using the feedback provided
  • Take notes of your feedback to refer back to
  • go back to it as many times as needed
  • read the feedback numerous times to take it in properly to be able to use it effective in future TMA's because it is a brilliant resource to support you to improve
  • have the feedback handy for the next attempt at an TMA.

…maybe feeling a bit upset by the comments…

  • Don't take it personally, use it as fuel for doing even better in your next assignment.
  • It's for your own good. If you don't know where you are going wrong, how do you expect to improve?
  • accept it constructively, it is really helpful
  • Don't get too hung up on it
  • Try not to get too upset if your mark isn't as high as you'd hope or wanted
  • [remember] that it is given to encourage and help them
  • Making a mistake and receiving feedback for the mistake is an efficient way for an improvement. So, appreciate it rather than being disappointed
  • Take your time to process the feedback, don't allow your emotions to cloud your judgement.

And if you don’t understand something your tutor has written…

  • don't be afraid to ask your tutor for clarification, especially if you think they're wrong! (you may need help realising you've gotten the wrong idea about something)
  • Don’t be shy to ask for help from your tutor
  • Make the most of having an assigned tutor
  • If you want really clear feedback, you should ask clear questions to your tutor yourself.

Finally…

re-read the feedback from previous TMAs before submitting the next to ensure that you have learned from past mistakes and the feedback was not given in vain

And above all, remember…

TMAs are about much more than marking!

Acknowledgements

Many thanks to Carol, Clare and Collette for giving me permission to share their summary. Their research was carried out within and funded by eSTEeM: the OU centre for STEM pedagogy.

Permalink Add your comment
Share post
Christopher Douce

2nd Annual STEM Teaching Conference 2021

Visible to anyone in the world
Edited by Christopher Douce, Tuesday, 13 Apr 2021, 08:21

On 3 March I found some time to attend an internal OU event that was called the 2nd Annual STEM Teaching Conference 2021. The event has an accompanying conference website  and a detailed programme (PDF). For those of us who were not able to attend, and can access some of the OU web pages, there are also recordings of the various sessions, for anyone who might be interested.

A further note is that this conference was a STEM Faculty event organised and sponsored by Diane Butler and Carlton Wood, who are associate deans. What follows is a quick summary of the sessions that I attended, and a short reflection section that is towards the end of this blog. I do hope this summary might be of interest to some of the follow delegates.

Keynote: Changing the attainment gap

The keynote was given by Dr Winston Morgan, Reader in Toxicology and Clinical Biochemistry, and Director of Impact and Innovation, School of Health Sport and Bioscience, University of East London. An abstract for the keynote is as follows: “Changing from the attainment gap to the awarding gap is an attempt to shift interventions away from fixing the students and their deficits; a strategy which has failed over the last 25 years, to fixing the tutor and their biases. … the presentation will show that making changes to the design and delivery of assessments and assessment practices will not change outcomes, primarily because they assume a student deficit. A more effective strategy would be to highlight the role and impact of tutor bias linked to racialised stereotypes. This is particularly important to the allocation of privileges to students which will enhance performance, the marking of assessments and who is accused of academic misconduct. Finally, the presentation will provide examples of how we can minimise or mitigate the impact of racialised bias on BAME student outcomes, particularly the awarding gap.”

We were introduced to the concept of the awarding gap, and an important question: how do you teach through a racialised world? The point was made that our biases have real impact, and denial about the gap is not an option: we have both a collective and individual responsibilities. Related to this point, I noted down the words (which I hope I’ve noted down accurately): “reflect on how much time you invest in your BAME students, and make genuine effort to engage your BAME students“.

Another point was: within your scholarly activity, seek out people from different groups. I also noted down a “take back to the classroom slide” which presented the point: we live in a racialised world, this leads to bias and inequalities, and this means that we much allocate academic privileges in a fair way.

A few days before editing this summary, I noticed a newspaper article that related to some of the themes that were presented within this keynote: I'm quitting as an academic because of racism and joining Surrey police. The following sentence jumped out at me: “I have found a serious diversity problem; I have been unable to get past overt and subtle prejudice in order to make a difference to BAME students and potential future academics.”

Proactive help for ill-prepared Level 3 students

The first main session I attended was by three colleagues from the School of Life, Health and Chemical Sciences: Louise MacBrayne, Fiona Moorman and Janet Haresnape. Their session was described as follows: “A new proactive support scheme is being piloted for S317 and S315 20J. Students deemed to be ill-prepared were targeted for proactive support. This presentation will update on ongoing results and will reflect on the potential usefulness of such an approach to increase student retention and success at level 3.” For reference, S317 is Biological Science and S315 isChemistry: Further Concepts and Applications

Different criteria were used to identify students that might be potentially at risk, and may potentially benefit from support. One group was students who have a weak pass on important level 2 modules, such as S215 Chemistry: Essential Concepts, and S294 Cell Biology. Another group were students who were new to the university, having transferred academic credit from another institution, or students who may have a limited background in science. Pass rate for these group of students is less than half that of other students.

Two different groups of students were identified: one that was high risk, and another group that was a moderate risk. Students were provided proactive support through one-to-one sessions. There were further plans to develop drop in sessions.

I didn’t make notes of any firm findings, but I liked the approach of attempting to identify groups of students that may potentially benefit from additional support or guidance from tutors.

Caps, quotas and standby lists

The second presentation I attended was facilitated by my Computing and Communications colleague Frances Chetwynd. Her presentation had the subtitle of “a guide to managing student waiting lists (and reducing your stress levels)”. Her abstract description presents the challenge clearly: “with the University seeing unprecedented rises in student numbers … ensuring we have enough tutors on each module is an increasing problem.” One her (and our) aims is to reduce the student waiting list.

Frances offered a definition of a quota. It is something (a number) that limits registrations and reservations, and is set by staff tutors and module team, and is set by academic services. A quota is important since it gives university colleagues time to carry out tutor recruitment, reduces costly deferrals, and can ringfence module places for certain reasons (such as apprentices), and reduces legal challenges. The point was simple: “if you have any uncertainty over student numbers, do have a quota”.

There are a number of resources that can help (within the OU world) that can help to make decisions about the setting of quotas. There are tools called PowerBI and Ratatosk which can provide useful numbers and summarise a trend of student registrations. Also, academic services colleagues also produce weekly/daily data.

Some useful early actions include send messages to ALs about modules that may be advertised, have pre-application briefings to help tutors with their application process, ask to advertise internally and externally, and try to get adverts out to external sites.

It’s important to keep everyone informed, and trying to increase the quote all the time; speaking with staff tutors to get a handle on what potential capacity there might be. Other actions: you can ask the SST to ring around to see if they can register, and interviewing.

After final enrolment date: reserve students will drop off, so standby can be moved to reserve status. We got money to call ALs to call students to remind them to register, and the only way to register, is to ring into student registration services.

A collaborative framework for associate lecturers to enhance student and tutor satisfaction 

Next up was a presentation by my Computing and Communications colleagues Marina Carter and  Richard Mobbs, who spoke about how they provide student support through “the adoption of a collaborative framework” which “enables students to benefit from consistent, coordinated, and enhanced support and the sharing of the tuition workload among associate lecturers (ALs).” They go onto explain that “the framework involves the staff tutor working closely with ALs using tutor forums to support the collaboration.”

An important aspect of this is a tutor forum: “the tutor forum facilitates peer support amongst tutors, sharing of experience of all the key elements of module tuition, including consistency and accuracy of correspondence tuition right through to broader teaching philosophy and pedagogy issues.” Also, “the framework is enhancing student’s tuition provision by the inclusion of topic focussed tutorials hosted by subject experts. Additionally, a weekly teaching email is sent to all students (via their tutor), with one tutor responsible for composing the email each week.” Tutor also share students’ activities, “keep track of student engagement, progression and retention analytics”.

I noted down that some threads were set up on the tutor forum, such as a student cluster forum posting plan, and a TMA marking guide thread that is designed to encourage tutors to share good practices. I also noted down that working together has the potential to mean less work. Through the forum tutors are able to working together to create a set of tutorials and share tuition tasks, such as sharing what needs to be done. When reviewing tutorial attendance, those tutorials that have a focussed topic may be ones that are most popular.

Other benefits of the tutorials are that tutors can cover each other, new ALs paired up with more experienced tutors, and a team approach means that there are high registrations and attendance at tutorials. Collaboration encourages different tutors to do different things and encourages the development of a community of practice.

Producing a module outside the VLE 

Sticking with the theme of Computing modules, the next presentation I attended was given by Michel Wermelinger and Oli Howson, who are also based in the School of Computing and Communications. Michel and Oli have been working on an update to a module called M269 Algorithms, Data Structures and Computability.

Here’s how they introduce their session: “We're producing a Computing module to be fully delivered (study materials and TMAs) via Jupyter notebooks, not the VLE. We're authoring in a simple text format (not Word), automating the process as much as possible, and hosting the production materials on a version control platform to work together.”

They go onto say that: “a new edition of M269 is being authored in a different way to provide more programming practice to students  … [The module is being] authored entirely (both book and TMAs) in Markdown, a very simple and widely used text-based mark-up format. A set of scripts written by [the module team] transforms the Markdown files into Jupyter notebooks, which will be the main medium for students to study M269. … Using freely available software we convert the Jupyter notebooks to PDF and HTML to provide alternative read-only formats to students. Traditionally, the module team, students and ALs work with multiple documents: the TMA questions, the student's solution document, the tutor notes and additional code files. This leads to inconsistency errors and time overhead in authoring, answering, and marking TMAs.”

There’s a lot of technical abbreviations to unpack here, but all makes complete sense. I’ve heard it said that an attribute of a good programmer is laziness, in the sense that good programmers want to find efficient ways of solving problems. Sometimes programmers and developers create (or curate) what might be known as a ‘toolchain’ to solve certain problems. This is exactly what Michel and Oli have done.

One of the most important bits of their toolchain (since students will be using this too) is something called Jupyter notebooks (Jupyter.org). Michel and Oli describe it as follows: “Jupyter notebooks are interactive browser-based documents, allowing students to read the text, run the example programs and solve the exercises without the overhead of switching media.” In essence, can use it to play with (and learn from) a programming language.

Text for M269 is written in Markdown (Wikipedia). I found this really interesting, since I hadn’t heard of Markdown before, but it does look pretty easy to follow and understand. Markdown documents are converted to notebooks, which can also be used to create zip files, HTML and PDF files.

I noted down that they also used something called Nbsphinx which is Jupyter Notebook Tools for Sphinx. This is where everything gets a bit recursive, since Sphinx (Sphinx website) appears to be a documentation tool that is used with Python.

Everything that is created by the module team is saved to GitHub. Michel and Oli described Github as “the worlds largest repository of software; we know who has changed what and why – no more emailing around of Word files”. Plus, each Github repository has a wiki, which is used to document who has changed what.

Since learning the principles behind algorithms isn’t easy, the module team have tried to reduce cognitive load on students. Previously students have to change between different documents and resources. With the current version of the module, using Jypiter notebooks, everything is kept in a simple document. The module team also wanted to reduce the cognitive load on the tutors too. 

The takeaway points from this presentation were simple: automation is important and useful, have proper version control, use Markdown to focus on content, and consider using Jupyter notebooks for interactive content.

Plenary session

The final session of the day was facilitated by Dr Diane Butler, Associate Dean Academic Excellence, from The Open University, Dr Neil Williams, Director of Undergraduate Studies, Faculty of Science, Engineering and Computing, Kingston University, Professor Sally Smith, Head of Graduate Apprenticeships and Skills Development, Edinburgh Napier University and Dr Elinor Jones, Associate Professor, Department of Statistical Science, University College London. 

The broad focus of the plenary was about what “other STEM practitioners and institutions have experienced the last year and how they feel their teaching practices may be permanently altered as a result of the pandemic and the switch to digital delivery of curriculum”. There is an accompanying question, which is whether there have been long-lasting implications for STEM Higher Education both in traditional and distance learning institutions.

Diane began by asking all participants to reflect on the impact of the pandemic in each of their institutions, and also asked: what would you not do, what you might keep, and how has the delivery of HE changed?

A point was that everyone has become learners, since everyone has had to learn new skills. In UCL practice has changed, moving from traditional face-to-face lectures “flipped” learning. I noted down the word “trying” a couple of times: trying to replicate some of the things that happens on campus, and trying to actively facilitate peer-to-peer activities. Assessments have had to be done in a different way. There have been impact on staff. One participant reported that “some are on their knees”, but it has also driven forward staff development activities; staff know more about technology enhanced learning.

What hasn’t worked? It has been harder to ‘connect’ with students, and harder for students to connect with each other. Some students really liked pre-made materials. Difficulties exist since students often have their microphones and video turned off. 

There are contrasts: some students like working in their own time, but not everyone has faired well. There might be a gap between those who have flourished, and those who haven’t. The sudden short term change in practice might lead to a longer term change: more use of the flipped classroom.

What will happen to Higher Education after everyone returns? What is going to stay and what is going to go? I made a note of something called a “blended learning task force”. There might be more independent learning and changes to assessments. The sudden shift to online has also accelerated professional development. There is also a concern that the pandemic has magnified digital divides. 

With everyone, and every institution emerging from the pandemic, there was the suggestion that it may be necessary to find ways to give student and staff reasons to come to the campus.

A final question: is there still a place for the OU if other intuitions are now doing what the OU does? A face-to-face institution isn’t a distance learning university; it’s all about creating a blend with more materials being placed online. One of the final points was that the OU has nothing to fear, since the OU continues to innovate. 

Reflections

For this conference, I mostly stuck with the computing sessions. Looking back, I think there were two reasons for this. The first is that I wanted to support them, and secondly, there were some colleagues that I have not had much contacts with some of my colleagues over the last year, and so it is good to catch up with what they have been doing.

Like with the previous AL development conference I wrote about, I would have much preferred to attended a face-to-face session, rather than an online session. I miss the coffee chats, and when you’re actually attending a conference, you can’t get so easily distracted by emails and phone calls. In a virtual event, it’s too easy to drop out or to move away to do something else. These things said, Dr Winston Morgan’s keynote set the right tone, and presented messages that continues to resonate. I really enjoyed Michel and Oli’s presentation about M269. Finally, a very interesting plenary session.

Permalink Add your comment
Share post
Christopher Douce

Staff tutor focus group: tutorial observations

Visible to anyone in the world
Edited by Christopher Douce, Tuesday, 23 Oct 2018, 10:27

On 7 November 2017, I facilitated a number of focus groups for STEM staff tutors to elicit views about tutorial observations. During this session, I asked the following open questions:  (1) What is the most important reason to carry out an observation? (2) What procedure or procedures do you follow? (3) How do you record an observation? (4) What do you look for? (5) How do you share feedback? (6) Is there anything special about online observations? And (7) Should there be standardised guidelines for STEM?

This blog has taken quite a bit of time to prepare, since I’ve been involved in all kinds of other things, most notably, trying to get everything sorted for the October starts. It seems that November is a month when I can start to do other things.

In some respects, this post is a sister post to the one that I made about some tutor focus groups, that had the title: Tutorials and tutorial observations: what works and what helps tutors?

During this session, each group was asked to make notes about the discussions that took place, and to summarise some of the key themes in a plenary session. What follows is a summary of some of the themes that were discussed in each of the groups, followed by a brief summary of the plenary discussion.

Since a number of discussion points were common between different groups, I have chosen to highlight sections from each group that appear to be the most significant.

Group 1

Group 1 began with the first question: why is it important to carry out observations? Observations can be linked to and connected with staff development; it can facilitate a two way process that is also linked to quality assurance. It also represents an opportunity to get to know associate lecturers. There are other reasons too, which is: staff tutors can get a feel for what is happening ‘on the ground’ and understand how distance learning materials are being used and interpreted by students and whether the tutorial strategy (which is sometimes designed by a staff tutor) is working as planned. Also, observations can help facilitate discussions during a tutor’s appraisal.

Group 2

Group 2 gave a very notable answer to question 4, what to look for: the answer will depend on the level of study, i.e. whether they had recently started at the university, or were coming to the end of their studies. For introductory level (level 1) students, staff tutors would look for: encouragement, enthusiasm, positivity, bounce, involvement, thank students for attending, and whether they were motivating. For final equivalent (level 3) students, staff tutors would look for expertise and subject knowledge, competence, confidence, ability to respond to questions encouragingly and supportively, using the question well, understand where the students ‘are’ and the range of abilities, and how to address any gaps of understanding between where student is and where a student needs to be.

Group 3

Regarding the question of procedure or procedures, group 3 mentioned that observations could relate to an associate lecturers probation period (which lasts for two years), but an observation need not necessarily take place in the first year. A related reflection is that the idea of a ‘one off visit’ to provide support or to ensure that teaching quality may be okay could now be outdated due to online tuition; it is now possible to look at a ‘bigger’ picture (and more points of interactivity).

Group 4

This group gave some reflections about online tutorials, stating that a staff tutor or line manager watching the recording can also be considered as a form of online observation. It was also reflected that online observations does offer unique challenges, in that it is very difficult to observe the effectiveness of online group work. In terms of feedback to tutors, it shouldn’t be in the form of a formal report, but there could be verbal feedback which is then supplemented by written feedback.

Group 5

Group 5 emphasised procedures. A memorable suggestion was: don’t visit the first tutorial for a new associate lecturer. Also, ask tutors which tutorial they would like their line manager to visit so they can showcase a session that they might have been particularly proud of, and also include a visit to the tutor’s tutor group forum to gain a complete picture of their online teaching. Gather observation feedback using a form and if the tutorial is good, send the form to the tutor and give the tutor a copy of the feedback form in advance, so they know what they staff tutor is going to be looking for. If there is a need for development, have a discussion with the tutor. 

Group 6

Group 6 referenced the use of peer observation, which could be used in situations where staff tutors might not have sufficient time to carry out their own observations. There were differences in terms of how tuition observations were recorded: 2 line managers used a proforma with space for qualitative feedback, 3 line managers write notes and then write a summary, and 2 line managers use of a loose proforma to provide semi-structured notes. 

Group 7

Following on from the discussion about recording observations, group 7 noted that the former Faculty of Science used a form. A form should also help to emphasise what went well (within a tutorial), what not so well, and what might be potentially improved. Like the previous group, peer observations was also referenced, in the sense that tutors could present to other tutors. 

Group 8

This final group raised many of the points were highlighted earlier, but placed particular emphasis on online tutorials. Some key points that line managers would look for included: whether or not tutors were prepared, whether they were clear vocally and had a relaxed attitude, whether they encouraged interaction from students and designed interactions. After an observation, members of this group would have an informal chat with a tutor which would be followed by an informal letter. The tone of this correspondence is important: suggestions rather than instructions for improvements would be offered. 

Plenary discussion

Towards the end of the session, there was a facilitated discussion to draw out key discussion points from each of the groups. What follows is a brief summary of the main points, any commonalities between the groups and implications for practice.

An early comment was that observations are important not only in terms of quality, but they also help to develop the line manager’s relationship with the tutor. A useful perspective was that a line manager’s view of tuition of teaching should not begin or end with an observation. Instead, an observation should contribute to a holistic view of tuition practice. One participant made reference to the concept of a ‘learning walk’. 

There were also messages that were common between the groups. In terms of practice, the importance of an informal conversation with the tutor after an observation was emphasised, followed by a letter or an email. There was also the view that there should not be a ‘ticklist’ or standard form that staff tutors should apply to complete observations. Instead, there should be guidelines rather than mandated procedures, to offer flexibility. 

Regarding online tutorials, tutor managers should look for interactivity. Since observations can also be through recordings, it was also noted that the choice of the recordings could be directed by the tutor. 

A further point acknowledged the challenge of online teaching. Online teaching using synchronous tools and live environments requires significant skill, knowledge and experience. Reflecting the TPACK model, tutors need to acquire and apply technical, pedagogical and content knowledge, and dynamically respond to the needs of students. Acknowledging these challenges, one tutor manager reported that it important to tell the tutors that it is okay not to present or deliver a session that is ‘technically perfect’, and what really matters is whether student learning is taking place. Put another way, the tutor line managers cannot only have a role in developing practice and teaching quality, they can also have a role in developing tutor and teacher confidence too.

Reflections

One of the tasks that I have to do in my day job is to carry out tutorial visits. I’ve seen a variety of different sessions, ranging from very informal sessions, sessions that are tightly structured around a PowerPoint presentation, and sessions that showed the use of software tools that are taught within an Open University modules. There have also been these occasions when I’ve been left astonished and the skills and abilities of tutors to convey technical concepts in interesting and creative ways.

In my career as a tutor, I’ve also been observed during a tutorial. I think I’ve been observed three times; once during my first year, and another occasion when only a single tutor arrived at a tutorial. My line manager did some of the things that were mentioned by my peers: there was an informal chat, there were suggestions (and not instructions) about how my teaching might be improved, and I was sent a letter that summarised the observation (and also what happened during the tutorials that I facilitated). Importantly, this always felt like a positive process. I really felt that my line manager had taken the time to listen to and respect what I had done.

I’m sure it comes across in this post that I think that tuition observations are important. My own view is that they should be about developing and supporting tutors (and teachers) first, and about institutional and organisation management second. They should also be fun too.

Permalink Add your comment
Share post
Christopher Douce

7th eSTEeM Conference: 25 and 26 April 2018

Visible to anyone in the world
Edited by Christopher Douce, Friday, 25 May 2018, 09:57

The Open University runs a centre called eSTEeM which funds research and scholarship to enhance and develop STEM education. For the last few years, the centre has run a conference that serves a number of purposes: to showcase research, to create a space to get people talking (and potentially collaborating) with each other, and to offer an opportunity for academic professional development.

What follows is my own personal summary the two days of the conference. There were a number of parallel sessions to choose from. My approach to choose them was very simple: I chose the sessions that packed a lot in. This meant that I chose the paper sessions rather than the various workshop sessions were on offer. At the end of the blog I offer some very short reflections based on my experience of the session.

Opening keynote

The conference was opened by Diane Butler, who introduced the introductory keynote speaker, Tony Bates who used to work at the OU and also the University of British Columbia. Tony has recently written an Open Text Book called Teaching in a Digital Age. I made a note that Tony opened with the observation that there is ‘a lot of change’ and this has direct implications for teaching and learning at the university. One of the key forces of change is the need for skills, i.e. IT skills that are embedded within a subject area; knowing skills that are specific to a discipline. An accompanying question was: what are employers looking for? Certain skills are really important, such as active listening, speaking and critical thinking. 

Learners need to practice and develop skills and to do this they need regular feedback from experts. I made a note about that technology isn’t perhaps the most appropriate way to develop the soft skills that Tony mentioned earlier. An interesting question was posed: what does an advanced course design look like? There were some suggestions (if my notes serve me well): perhaps there might be student generated multimedia content and assessment by e-portfolios.

Tony also spoke about trends: there are new models of delivery; there is face to face teaching on one side, and fully distance learning on the other (and everything in between). An interesting point was that every university in Canada had fully online courses, with 16% of all course enrolment being to online courses and programmes. Traditional universities are moving into the space where distance learning institutions used to dominate.

An interesting new trend was the notion of hybrid learning: looking at what is best done in the classroom and what is best done online. I made a note that Tony said there was ‘no theory about what is done face to face versus online’, which strikes me as surprising.

A significant trend is, of course, MOOCs, but it was reported that there was no MOOC mania in Canada. Other trends included open educational resources and open text books. The point is that we’re now at a point where university professors offer learning support and not content and this has implications for teaching and learning. 

Tony concluded by leaving some points for the university: that technology is continually changing, that there needs to be flexible accreditation for life-long learning, and perhaps there needs to be an agile approach to course (or module) development. Also, all universities will be or are going to be digital (in some way or another). 

Paper session: Supporting students

Lessons in retention success: using video media to influence students

Jessica Bartlett spoke about her experiences working on S282 Astronomy. There are some immediate and obvious challenges: students numbers are falling and the module contains a lot of maths. An interesting point is that 50% of the students studying this module were not from the STEM faculty (which is where all the maths is studied).

The aim of the project was retain more students and help more students to pass exams. The module uses formative tutor marked assessments (TMAs) which means that the module team can reuse questions but can’t (of course) provide model answers to students. I recognised an interesting comment: ‘students don’t often look at their mark, ignoring their feedback’. The module team made videos about how to deconstruct and approach the TMA questions. I made a note of something called ‘reviewing your TMA’ activities, which encourage students to look back at what they’ve done (which sounds like a great idea). There were also weekly videos, where the filming and editing was done by the module team.

Evidence that bootcamps can help student retention and progression

Tom Wilks also spoke about S282 Astronomy but within the context of a ‘bootcamp’ that was designed to offer addition student support. Tom recorded short tutorial sessions that covered a range of topics: basic maths and physics, general OU study skills, how to use the VLE and how to use the Adobe Connect conferencing tool. 28 Adobe Connect sessions were recorded, each lasting between 2 and 10 minutes in length. These sessions were advertised to all students, who could access a forum and an Adobe connect room. Other resources include something called an ‘are you ready for quiz’ which is also used with some computing. Tom commented that tutors can refer students to his recordings if some students were struggling with certain concepts, and he also found that students did re-engage with materials when they were approaching their TMA. 

Flexible/early start M140

Carol Calvert gave a talk on her work on introducing a Flexible or Early start to M140 Introducing Statistics. I’ve heard Carol speak about this subject before, and she always delivers a great talk. Her research is based on an earlier study where she looked at students who succeed despite the odds that are stacked against them. One of the key findings of this research that one thing can really make a difference, and that is: starting early. 

Carol’s intention was to create an ‘early start’ experience that was close to a student’s experience when it officially begins. This means they have access to materials, can access the VLE site, have access to tutors, and can access to resources such screen casts and software. 400 students were sent a message offering them an invite to start early, and 200 responded saying that they would. Tutors offered sessions on study skills and tutorials on content. Another advantage is that if students do start early, they will know sooner whether they are on the wrong module, which can be really useful, since there are significant fee implications if someone finds themselves on the wrong module. If you’re interested, more information about Carole’s scholarship is available on the eSTEeM website

Improving retention amongst marginal students

Anactorial Clarke and Carlton Wood spoke about an access module: Y033 Science Technology and Maths. Access modules are important due to the university’s commitment to widening participation. Y033 is studied by 1K students per year and students who have successfully studied this module (as far as I understand things) can apply for a fee waiver. 25% of students declare a disability and access students are offered 1 to 1 telephone tutorials since previous research has suggested that sympathetic and supportive tutoring is crucial to student success. The study that Anactoria and Carlton introduced use a mixed method. They looked at the completion of S111 Questions in Science and Y033. Students who have taken the access module are more likely to stay with the module; the point being that access level study builds confidence (and emphasises the importance of access).

Paper session: online delivery, tuition and international curriculum

Synchronous online tuition: differences between student and teacher

Lynda Cook and a number of other colleagues asked a really important question: what are online tutorials really like? An accompanying question is: do we meet our student’s expectations? Students on 2nd level modules were surveyed, recorded tutorials were studied, and students and tutors were interviewed. Students reported that very few were using microphones (which isn’t a surprise to anyone who had attended an Adobe Connect session) and an analysis of recorded tutorials suggested that lots of features were not used, with the exception of the chat box.

The interviews with tutors revealed that when the recording button goes on, students are reluctant to talk. One conclusion is that students’ value tutorial recordings but students don’t like to interact. A personal note is that there is a conflict between interactive and recorded lectures and I don’t think the university has quite some way to uncovering the pedagogic opportunities afforded by online tools such as Adobe Connect (and, in some ways, this links back to some of the themes mentioned in Tony’s keynote). 

Understanding tutorial observation practice

It was time for my session. I spoke about a short project that aimed to ask the question: ‘what is the best way to observe tutorials?’ I approached this question by doing three things: carrying out a literature review (with help from a brilliant tutor colleague), and conducting two sets of focus groups: one with tutors, and another with staff tutors (the members of the university who usually carry out tuition observations).

Some of the themes that emerged from the focus groups directly echoed some of the themes in the literature. An important issue is to understand what tuition observations are for: are they for development, or are they for management? (The answer is: they should be used, in the first instance, for development; the observers can learn a lot just by observing). An outcome from the project was to uncover a set of really useful tuition guidelines that have been used and developed by colleagues in Science. The next step in the project is to formally write everything up. 

An international comparative study of tuition models in open and distance learning universities

Ann Walshe, a colleague from the school of Computing and Communications, spoke about her visit to Shanghai Open University (SOU) where she was a part of a group of visiting scholars. Ann reported that SOU emphasises vocational and life-long learning. Whilst it does offer bachelor degrees, it doesn’t offer postgrad qualifications. It was interesting to hear that SOU ‘does its own thing’ and tries not to compete with other local and national universities. It has a particular emphasis on blended learning and face to face teaching, having 41 branch schools for both full time and part time students. Interestingly, students have to attend a mandatory F2F induction.

The visiting scholar group were from a range of different institutions, including Chongqing radio and TV university, University of South Africa, the National Open University of Nigeria, Cavendish University, Zambia, Jose Rizal University, Phillipines, and the Netaji Subhas Open University, India (which apparently has 120 study centres, with more opening). Ann’s talk emphasised the importance of distance learning and its global reach.

Unpacking the STEM students’ experiences and behaviours

Jenna Mittelmeier’s presentation was about the challenges of Online Intercultural group work. I enjoyed Jenna’s talk, since it was a very research focussed talk that asked a very specific question: are students more motivated when they study materials related to their own cultural background? In other words, what are the benefits of matching content and activities to the membership of a multi-cultural group? Jenna described a randomised control trial in the context of a Dutch business school. In an activity, students were asked to look at something called the World Bank statistics dashboard and it was found that students participated more when using content from their own background. A qualitative survey suggested that internationalisation (of a study context) did improve participation but did expose tensions. There was an important point, which is that content needs to be made relevant to student’s lives and experiences.

Paper session: supporting students - STEM practice and engagement

Using a dedicated website in the continuing evolution of a statistics community of learners

Rachel Hilliam and Gaynor Arrowsmith introduced us to something called the Maths and Stats Subject Site. Before the university restructured and closed regional centres, students could attend course choice events where they could look at module materials from the regional centre library and talk to academic support colleagues and speak with other students. In an environment that is increasingly digital, an important question is: can we recreate that in an online environment? I made the note that it is (of course) important that students feel a part of a community.  There is a Maths and Stats advice forum, maths education forum, and information about professional and subject societies. There is also advice about preparing to study, revise and refresh resources, are you ready for quizzes, and early units from some modules.

Implementing additional maths support for Health Science students

Nicola McIntyre, Linda Thomson and Gerry Golding spoke about their experiences on SDK100 Science and health: an evidence based approach. An important aspect of the talk was that a maths tutorial was replaced with 18 short videos covering mathematical concepts, such as decimals, percentages, scientific notation and powers. There were also two workshops which were advertised students by email, and two tutors selected and briefed on format of the workshop. I noted an important point: it’s not enough to only provide videos, the workshops are considered to be an essential component.

Two mathematicians and a ukulele

Hayley Ryder and Toby O’Neil are module team members for M208 Pure Mathematics. The module is run through a single ‘cluster’, which means that there is only one group of tutors who teach on the module, and it has 25 hours of tuition sessions. From what I remember, there was a view that students wanted more contact with module team. 

One way to address this is to record a series of informal online tutorial sessions where Hayley and Toby talk through different mathematical concepts and also discuss what is discussed on the module forum. The idea is to convey a sense of ‘what mathematicians do’ and to build ‘mathematical resilience’, a concept that has a number of aspects: (1) the fostering of a growth mindset, (2) that maths has personal value, (3) knowing how to learn maths, (4) knowing how to find appropriate support. The sessions focussed on the first three of these aspects. 

An important point was that the presenters can easily make mistakes when doing things ‘live’ and this shows that real mathematicians can get stuck, just like everyone else. As for the ukulele, this also connects to the concept of learning; this is an instrument that Toby is learning to play (and I understand that he plays it during sessions!)

A secondary analysis of SEAM responses for programming and non-programming modules by gender

Joseph Osunde from the school of Computing and Communication studies the issue of gender disparity in computing and IT. Joseph offered an important comment during the start of his talk: ‘reasons [for gender disparity] may include learning environment[s] that convey gender stereotypes on interests and anticipated success’. To learn more, Joseph has been looking at university Student Experience on a Module (SEaM) survey results.

As a staff tutor, I regularly get to see SEaM survey results and I have my own views about their usefulness as personal development tools and sources of useful research data. This said, Joseph found that there were no significant differences in achievements between gender for modules that required students to learn about programming and those that didn’t. Joseph (with Anton Dil) looked at M250 Object-oriented Java Programming. It turned out that for modules that contained programming, like M250, men seem to be more satisfied with them. When these were again compared with non-programming modules, the result is a bit more mixed. 

Whilst this is an interesting finding, this does suggest that there is some more research to be done. A related question is: to what extend are different people motivated by modules that contain programming? Also, just as our colleague, Gerry Golding has carried out research (which I mention later on) into ‘mathematics life histories’, I do feel that there might be an opportunity to study something that might be called ‘computing life histories’ to understand the qualitative reasons for differences in satisfaction.

Closing keynote for day 1

The closing keynote by Bart Rientes was entitled a ‘critical discussion of student evaluation scores and academic performance at the OU’. Bart began by telling us that he used to be an economics teacher where his teaching performance was regularly evaluated. Drawing on this experience, he asked a significant question: ‘did my increase in my [evaluation] score mean that I was a better teacher?’  He asked everyone who was attending a similar question: ‘are student evaluations a good proxy for teaching excellence?’ Bart directed us to an article, entitled:  Student satisfaction ‘unrelated’ to academic performance – study  that was featured in the Times Higher.

We were given another reference to some published research that was carried out on behalf of the QAA. Digging into the QAA website later took me to two reports that are both connected to the themes of learning, student satisfaction and quality assurance. The first report, entitled Modelling and Managing Student Satisfaction: Use of Student Feedback to Enhance Learning Experience was by Rienties, Li and Marsh. The second report has the title: The Role of Student Satisfaction Data in Quality Assurance and Enhancement: How Providers Use Data to Improve the Student Experience was by Williams and Mindano.

Onto a personal reflection about this (keynote presentations are, of course, intended to get us thinking!) As mentioned earlier I’m very aware of the OU SEaM surveys. In my experience as a tutor line manager, tutors only tend to receive a couple of responses for a group of twenty students, and the students who do respond often have a particular cause to do so. This observation connects back to Bart’s opening point, which is: what can these measure of performance (or satisfaction) tell us? The fact is that education can be difficult and frustrating, but it can also be transformative. Sometimes we only can truly judge an experience (or feel satisfied with it) when the effects of our experience have become clearer over an extended period of time.

Paper session: Supporting students and technologies for STEM learning 

Using student analytics with ALs to increate retention

Gerry Golding spoke about some of his own research into Maths life histories, an idea that, as far as I remember from Gerry’s talk, originated from a researcher called Cobden. Gerry interviewed people to understand how adults coped when studying advanced maths topics and touched on the importance of high school experiences and maths anxiety. Maths life histories can students help to understand the cause of their anxieties and help them to think about what affected them. In turn, these reflections can be used to build and develop self-efficacy to help them through the hard times and facilitate the development of a growth mindset. In terms of this bit of scholarship, initial contact with students is important. Also, the university virtual learning environment (VLE) is not a big deal, because students are studying using books. I have to confess, that I didn’t pick up on the main outcomes of this bit of research, since I started to think about Gerry’s idea of ‘life histories’.

Analytics for tracking student engagement: TM355 Communications Technology

Allan Jones spoke about TM355 Communications Technology, an important module in the computing and IT undergraduate programme. The module has three 10 point blocks, printed books, 3 TMAs and a final exam. It is also a module that makes extensive use of the VLE. 

Students study what is meant by communication technologies and how they work, such as how you modulate waves and signals, encode data and correct errors. The module also makes use of 30 computer aided learning packages. Data analytics are used to track the use of the online parts and comparisons are made between two presentations and students are interviewed to understand their motivations. 

It’s a bit more complicated than that: STEM OU analyse evaluation

Steve Walker asked a question that was implicitly linked to Allan’s presentation: can learning analytics help students to complete modules? The answer was: no… until something is done with the data. The reason for looking at this subject was both simple and important: retention is important and there is the need to figure out what works, for whom and in what context, and why. 

Steve introduced a term that I had never heard of: realist evaluation, and directed us towards a paper by Pawson and Tilley (PDF) which is (apparently) used in medical education. Points that I noted down that sounded important included: mechanisms, interventions, outcome and context. 7 associate lecturers (ALs) were interviewed by members of a module team using something called ‘intervention interviews’. An observation is that the term ‘analytics’ is used in different ways. I also made a note of a simple model, which has the components: identify, diagnose and intervene.

Java specification checking

Anton Dil spoke about the evaluation of a prototype tool for M250 object-oriented programming tutors. M250 students need to write some object-oriented software code. This includes creating something called ‘classes’. These classes have contain a number of ‘fields’ (or data stores) and are designed to carry out certain actions which are started (or invoked) using something called ‘methods’. Student code can be automatically evaluated in a couple of ways: you could write something called a ‘style checker’ to assess what code a student has written, or you could assess its functionality through using something called unit testing. The module team have written a tool called checkM250 that could be used by tutors.

Eight tutors were surveyed and 6 tutors were interviewed. Tutors didn’t use the tool because they didn’t know about it, didn’t have enough time, or didn’t think they needed it. If they did use it, they were likely to recommend it, but they were unsure whether it could highlight things that were missed. I made note of the quote: ‘if you asked me previously whether I missed things, I would say: of course not’. Tutors did report that it could be useful. My own take on tools for tutors is that any tool may be useful (and I write that in the context of being a tutor!) 

Digital by Design: workshop

The conference workshop was, interestingly, run by a theatre group. The key concept behind the workshop was an observation that the ‘coffee break’ discussions in conferences that can be just as useful as formal presentations. Instead of having further talks, the idea was to create a long session that is, in fact, one long coffee break where participants could move between different discussion groups.

Another important idea is that anyone can propose a topic for discussion. Whenever someone decides on a topic, a delegate chose a post-it note that indicates when the topic is going to be discussed, and where in the large room that discussion is taking place. Participants can see a summary of the topics that are being discussed at any one time and participants are, of course, encouraged to move between different groups, according to their own interests. It was a neat idea.

I proposed a topic: how do we develop and support our associate lecturers to do ‘digital’ in the best possible way?’ Examples of other topics included: how should we be using social media apps to communicate with students and each other, how do we become experts in advising students at how to study onscreen, and how do we decide when digital is appropriate and when is it not?

During our ‘coffee’ conversation, I was joined with two colleagues. I soon began to think about whether there might be something that could be very loosely called the ‘digital associate lecturer capability model’. I sketched out a model that had three levels: university systems and tools (such as Adobe Connect), module tools (such as module specific computer based learning products, like there is in TM355) and common IT systems and products (such as Word, Excel and Powerpoint).

During these discussions, I was reminded of a JISC project called Building digital capability that the OU library was connected to and involved with. This also provided a useful framework that could be used to guide AL development. In later discussions, I discovered that colleagues from the OU library were already using this framework in AL development sessions.

Reflections

Everyone’s experience at a conference is, of course, likely to be different. I had a simple objective when I was attending this eSTEeM conference, which was to attend as many presentations as I could to try to get a feel for the breadth of projects that were happening across the university. In some respects, there was one commonality that jumped out at me, and that was the use of videos or personalised recorded tutors that were customised to the needs of students. Underpinning this is, of course, the use of technology.

During the conference, I heard presentations from module teams and presentation from tutors. I also understand that some students were attending too, but I didn’t get to speak or hear from any of them. This links to an important reflection that it is really important to hear the student voice; we need to hear stories about what has worked and what hasn’t worked. This said, eSTEeM scholars are always asking students questions through surveys and module teams are always looking to figure out what works and what doesn’t.

A final thought is this: I’m still not sure is meant by ‘digital by design’ but I don’t think that really matters. We access materials, write materials, and carry out our scholarship using digital tools. What I think is really important is how we use these digital tools in combination with each other. Digital technologies in their various forms might new and seductive, but ‘digital’ tools cannot be transformative if you can’t see or understand how they might be used. There’s something else that is even more important: what really matters in education is people, not machines. It is people who can show us which digital tools can help our studies.

Permalink Add your comment
Share post
Christopher Douce

Tutorials and tutorial observations: what works and what helps tutors?

Visible to anyone in the world
Edited by Christopher Douce, Wednesday, 25 Oct 2017, 14:02

As a part of an OU funded eSTEeM research project about tuition and tutorial observations, I ran two short focus groups for associate lecturers at an Open University AL development conference which took place in Leeds between 5 and 6 May 2017. 

This blog post represents a set of notes that have been expanded from comments made on flipcharts during the focus groups. Follow on research is to run a focus group with staff tutor colleagues, and then to consolidate all findings by way of internal and external publications about educational practice.

I’m sharing a summary at this early stage, since I feel that it’s important to be open in terms of the research that has been carried out. Plus, through a blog, anyone who has any opinions about the subject or the session should be free to get in contact.

Introducing tutorial observations

A tutorial observation is, as it suggests, an observation of a university learning or teaching event. It can take place either face to face, or online. 

Ever since joining the university I have been aware that different colleagues (within different departments and faculties) have done observations in slightly different ways. One colleague in one school has used a complex form which was a bit like a questionnaire. Another colleague in my school has had a really very simple form to capture a free form description of what happened during a tutorial.

My research question is: what is the best practice that helps associate lecturers? Given that the university has recently completed a faculty merger, this seems like an ideal time to ask this question. 

Accompanying questions are, of course: what are tutorial observations for? An obvious answer is: to ensure that students are given good quality tuition. Although this may be true, a more detailed answer might be a bit more complicate and nuanced.

Introducing the focus group

In order to find out more, my AL support and professional development said that I could run a workshop that gently masqueraded as a focus group. The ‘focus shop’ had the title: Tutorials and tutorial observations: what works and what helps tutors?

The workshop had the accompanying abstract: do you remember when you last observed during a tutorial? If so, what happened, and were you happy with the feedback that you received? This session is all about the concept of a tutorial observations, both on-line and face to face. Chris Douce is leading a research project that aims to learn more about different observation practices, both inside and outside the university. The research project aims to ask two very important questions: (1) what do tutors need? And, (2) how should staff tutors and faculty managers run effective observations? Other questions include: what feedback would help you the most, and do you have any thoughts about how observations should be run when you do team teaching? All welcome and all feedback appreciated; this session can help to develop and (hopefully) enhance tuition observation and develop online and face to face teaching practices.

What follows is a set of notes gathered from both focus groups.

Points captured from the focus groups

Tutors were asking the important question of: what are observations for and what it its purpose? Is it something that is done to monitor the performance of tutors? There was a view that observations shouldn’t be done in a cursory way, or be paying lip service to an administrative process. 

There are a number of different dimensions to observations: they can range from being formal to being very informal. They can also vary in terms of their participants: they can be of an individual, or they can be of a group of tutors. There are further questions: what about recordings? The question about recordings helped us to start to consider other dimensions of observation: in addition to using discussion forums some tutors have, in the past, created their own podcasts, or used tools such as Jing. A suggestion from a tutor was to ask the question: ‘which recordings would you like me to look at?’ and ‘what would you like me to look for?’

There was an awareness that observations have the potential to be negative (or, as noted, be destructive); they can negatively impact on a tutor’s confidence. There was also the point that observations can be used as a way to facilitate a dialogue between a tutor and a tutor manager; after an observation and the receipt of an observation report, tutors may be invited to offer a ‘right to reply’. Another comment was that it should be ‘a two way thing’.

An important question was: how often should observations take place? Opinions about frequency ranged from every two years to every four years, and perhaps be connected with a tutor’s appraisal (which takes place every two years). One tutor reported that they had been observed twice in ten years; another tutor reported they had been observed two times in six months. This raises an accompanying question: now that tutor line management is a lot more complex, who is actually going to carry out an observation? (We now have tuition task managers, lead line managers and cluster managers). 

So, what about the practicalities of carrying out observation? Giving a warning, or notice, was considered to be important. There was also a practice of sending tuition plans to staff tutors in advance of a tutorial so they could see what is planned; some preparatory work needed to be done.

Accompanying the details of the tutorials and the plans, there are other important questions to negotiate; one of those challenges is the extent to which a tutor may wish a staff tutor to be involved in the actual tutorial. Staff tutors might ask the question: ‘what would you like me to do?’ as a way to being negotiation about the extent of involvement. The practicalities of engaging in a tutorial can, of course, depend on the subject and its level.

Feedback was a theme that recurred a number of times. To prepare for an observation, one tutor suggested the use of the question: ‘what would you like me to look at?’ There was also a suggestion that staff tutors should look at only a few things during a tutorial. There was also an emphasis on the importance of expectations. 

A further comment is that feedback should emphasise the good bits, and this is something that could be done immediately after a tutorial. A key phrase I noted down was: ‘how do you phrase things not to be critical?’ An immediate response was to use a ‘feedback sandwich’. 

As expected, the way in which feedback was presented to tutors differed: the school of health and social care used a form, whereas in the school of maths, tutors were sent a letter.

There were a number of other really interesting points that were raised. A question was: perhaps we should ask students what they want? Also, there are opportunities to share examples of practice, activities and reflections. This raises an interesting question about the importance and use of peer observations. This is, of course, connected to the important issue of trust between the observed and the observer. Other points were made about the connection to the importance of correspondence tuition and the role of mentoring.

There was an important acknowledgement that tutorials and tutorial observations can, of course, be stressful and a recognition that personalities play a fundamental role in shaping the teaching environment in which teaching takes place.

Summary

The two focus groups were very different in their composition, but there was a lot of crossover between the themes that emerged: both suggested, for example, the idea of focusing on a selected number of aspects, and there were different experiences in terms of how frequently observations were carried out.

These notes are influenced by one very big factor: myself. I am the researcher, but I am also a tutor, as well as a line manager of tutors. This means that I am the observer as well as being the observed. All this means is that my own views have necessarily affected how I have interpreted and presented the points that have arisen from the two focus groups. This closeness to the subject will, inevitably, cause me to emphasise some points over others.

As mentioned earlier, the next steps in this project is to run a series of focus groups for staff tutors. 

Permalink Add your comment
Share post
Christopher Douce

eSTEeM Annual Conference: April 2017

Visible to anyone in the world

On 25 April I had the opportunity of attending a part of the Open University’s eSTEeM annual conference. eSTEeM is a university body that funds scholarship and research into STEM teaching and learning. More information about the projects that eSTEeM funds can be found by visiting the eSTEeM website.

What follows is a short summary of the conference, from my own perspective. I should add that all these views are my own, rather than those of the university. I’m sharing for two reasons (1) in case anyone who was at the conference might find it useful, and (2) I can remember what I’ve done at the end of the year.

Opening keynote

Due to travel connections I missed the opening address, which was given by eSTEeM director, Clem Herman. I did, however, make it in time to hear the opening keynote, which was given by Nicola Turner (blog), who works for HEFCE. 

As Nicola spoke, I made notes of key points that jumped out at me. One of the early notes I made was that 14 thousand teachers are needed. There is also a skills shortage in STEM. Apparently, 1 in 4 jobs relate to a role that is in a skills shortage area. But what skills are needed, and what skills are considered to be important. One answer is this: digital skills (in the loosest possible sense!) are considered to be important: tech, of course, is a fast growing and changing area.

Investment, of course, can benefit different parts of the country. A worrying point was that Nicola said was that there was no northern city that was a net GDP contributor (a disclaimer is that I don’t personally know where this bit of information comes from, or how you might define what ‘northern’ is). London, however, attracted a substantial amount of investment (but this isn’t much of a surprise), but there are ‘digital strengths’ in the regions. Another point I noted was that there is the need for 1.2 million skilled tech workers by 2022, and 93% of tech employers have reported a skills gap in 2016. The key question is: what can be done?

To show that I was really paying attention, some of the most sought after skills contained the keywords: developer, agile and SQL. There are also skills shortages in the area of cloud computing, big data and analytics. An important point is that workers need to be digitally literate, and this is something that links to that old education idea of ‘lifelong learning’.

If there is a skills shortage, an important question to ask is: why is the unemployment rates from computing graduates surprisingly high? This is something that is referenced in the Shadbolt review : Computer science degree accreditation and graduate employability (UK government website). There is also the Wakeham review into employability of STEM graduates (UK government website).

Nicola went onto talk about the Shadbolt review. As she spoke, I noted down a few points: that employment may come from a pool of students from elite universities and that there is low take up of work experience options (I have to confess, that this was offered to me as an undergraduate, and I didn’t take a year out in industry); this leads to a potential lack of soft skills and interpersonal skills. When it comes to computing and IT, the people side is just as important as the technology side.

I noted down some themes regarding employability. Industry is always after ‘work ready graduate’, but there is a contact challenge that industry is always changing (especially the tech industries). But what are the answers? There are things going on: there is the introduction of degree apprenticeships (of which the Open University is playing a part), ‘200 million in STEM teaching capital’, and government strategies.

There is something called the National Cybersecurity Strategy (UK government website), which is linked to degree apprenticeships, a digital skills strategy (UK government website), and an industrial skills strategy. 

The digital skills strategy was defined as a collaboration between employers, educators and government. There was also a reference to the creation of new institutes of technology, and a national college for digital skills (college webite), which is based in London. Interestingly, the focus appears to be at sixth form students. I have to confess to being perplexed. The website says things like: ‘We develop the mindsets, skillsets and character needed to be a pioneer’ and says that students will ‘join a cutting-edge community of digital-thinkers’.

Another point I noted was about something called the Institute of Coding (HEFCE). A key paragraph on the website appears to be the one that reads: ‘The Institute of Coding initiative aims to create and implement solutions that develop and grow digital skills to meet the current and future needs of the industry’.

One thing is very encouraging: the comment that ‘lifelong learning’ is becoming trendy again. A personal reflection, and one that is echoed in the presentation, is that lifelong learning is an idea comes in and goes out of fashion depending on the government. The OU is, of course, good at delivering supported lifelong learning, but much of its provision has been substantially eroded by the increase in fees.

A connected point is that other higher education institutions are investing in distance learning. There is competition within the sector. At the same time, there may be opportunities in terms of ‘new customers’, which has been something that has been touched on in the current OU strategy.

Paper session

I attended one of the short presentation paper sessions, which consisted of four presentations. 

ByALs-ForALs: an online staff development programme in the STEM faculty

This first presentation was by Janet Haresnape, Fiona Aiken and Nirvana Wynn. I made a note of a point that ‘staff development is often us (the university and its representatives) telling people about things, but it should be more about sharing practice’. I totally agree with this. A personal reflection is when I do staff development, I try to get a balance between the two, but I’m sure I don’t always get it right.

The idea is simple: create an environment where ALs can actively share their experience through a programme of online staff development events. If an AL wants to give a presentation or facilitate a session, they submit a proposal. If they are successful, they will be paid for running the session. Tutors can register to attend different sessions by registering using a simple Wiki, and this feeds into an official professional development record.

A total of 500 associate lecturers have been to the various sessions, with attendance varying between 5 and 54, depending on the topic and the time of day. Interestingly, day time appears to be more popular than evening sessions. Every session is recorded, which means that anyone who wasn’t able to attend can benefit.

Following the merger of the Science and MCT faculties, the programme has been extended to all undergraduate and postgraduate ALs in the new STEM faculty (which now consists of over 1500 tutors). I have to confess to not having been to any of these sessions, but I do know of them, and I always put them in my diary! Two questions were: could this approach be rolled out to other faculties, and secondly, would it be possible to do something similar for the school that I work in? Funding may come from the AL professional development and support team. This is certainly something to think about.

Understanding and supporting the career pathway of mathematics and statistics associate lecturers

This presentation was by Rachel Hilliam, Alison Bromley and Carol Calvert, and related to the Maths and Stats submission to Athena Swan (Equality Challenge Unit website). The presentation was looking at the gender differences between tutors, and asking the questions: do we support tutors in the right way, and what career development is necessary? A mixed method was used: a focus group and a survey.

Some interesting findings between men and women were shared. On average, men had more experience (in terms of tutoring years) than women, and were more likely to have a greater number of tutor contracts.

One area that has interested me for some time is tutor motivation, and this research touches on the reasons why tutors do what they do. Some interesting reasons included: career, challenge and family. A really interesting statistic is that 60% of ALs who responded viewed their AL work as their main job. I also noted down that there was concern about a lack of face to face possibility for staff development.

Success against the odds and the follow through

The presenter for this session was Carol Calvert, from Maths and Stats, but the other contributors to this presentation are: Rachel Hilliam, Linda Brown and Colin Fulford (if I’ve noted this down properly!) The subheading for this talk is: ‘the interesting routes student feedback can open up’.

The interesting aspect of this research is that it adopts the innovate approach of actually speaking to students. To do this, researchers have to find their way through a panel called SRPP, which protects students from being ‘over researched’.

I made a note of top tips and themes that all contributes towards success: the importance of a ‘can do’ attitude, the importance of getting organised, and the need to get ahead. I made a note of another reference: the RSA Animate video entitled How to help every child fulfil their potential (RSA).

Tutorial observations

During the final session I spoke about a project that has been set up to study different approaches to tutorial observations and to ask the important question of what kind of observation or tutorial report would help tutors to develop their teaching practice? At this stage of the project, I don’t have too much to report. So far, a literature review has been completed, and a two focus groups with tutors have been carried out. The next step in the project is to run a focus group for staff tutors (who are, of course, line managers for those tutors).

Workshop: bridge over troubled waters

After taking a bit of time out to attend a module team meeting, I attended an afternoon session that explored the concept of a ‘bridging course’.

A bridging course is a short course that helps student build up their skill and confidence levels before they undertake another module. A bridging course might run between or before modules. An example of a bridging course something called the ‘programming bootcamp’ which helps students to prepare for TU100 (which is to be soon replaced by TM111 and TM112).

The workshop began with a question: ‘would your students benefit from a bridging course to help them transition to the second year?’ There is, apparently, something that is known as a ‘second year slump’. The second year of a degree is where things start to get really serious. To convince us that this was an important issue, Frances Chetwynd presented some evidence, citing research by Douglas and Attewell (American Journal of Education).

So, what things are important, with regard to student progress? Key points include: time management, familiarity with written assessments, unrealistic expectations (which influence drop out), critical thinking skills, and understanding the need to conduct independent research. My notes tell me that Frances also referenced the work of Conley, who has written about college readiness (Education Policy Improvement Centre, PDF). Key points were: cognitive strategies, content knowledge, academic behaviours (which include time management and what it means to be a student), and college knowledge (understanding of how the institution works).

With the scene set, it was time for group discussions. We thought about what our bridging course might contain. An hour isn’t a lot of time. Key points that we chatted about were the importance of tutors and the use of digital materials (and the familiarity of digital materials). A theme that we kept returning to was that of ‘programming’. Another important issue is, of course, study skills.

Closing keynote

The closing keynote, which was entitled ‘is there a role for pedagogy in enhancing the STEM student experience?’ was by Michael Grove, a reader in STEM education. My instinct was to answer this question with a definitive ‘yes’, but to add to this perspective, Michael presented up with a definition of pedagogy from the Oxford English dictionary: pedagogy is ‘the art, occupation or practice of teaching, also the theories or principles of education; a method of teaching on such a theory’.

Underpinning this is definition are the ideas of: preparation, design, development, delivery, evaluation, reflection and dissemination. This helps us to consider other questions: how do you share good practice and encourage wider uptake?

Looking at pedagogy means that we also look at research. An interesting point was made that pedagogy, research and scholarship all blur together, and could all come under the title of ‘education enquiry’. But how does this work? There are approaches that are used, such as case studies, action research, studies that draw on theories and the use of quasi-experimental methods.

I noted an interesting use of terms. To be scholarly means that we inform ourselves, whereas scholarship means that we’re informing a group and using local knowledge. Research, on the other hand, is about disseminating findings to a wider audience. All this is, of course, linked with changes in the HE sector. A particular issue is the development of teaching only contracts, which separates out teaching activity from research activity.

Michael directed us to a document entitled Getting started in pedagogic research within the STEM disciplines (Mathcentre, PDF). It was a document that was mentioned at another presentation, and it looks pretty useful. It contains sections about writing for publication, and list of journals that can be used to disseminate STEM education research. (I also recommend a journal called Open Learning).

In some respects, the original question should have been: ‘is there a role of research in STEM pedagogy?’ I’m instinctively inclined to answer ‘yes’ to this alternative question too. Michael also asks a question about why we should do this. He also offers an answer: it represents an important aspect of our personal academic identify (and also our commitment to our discipline).

Reflections

Although I missed a couple of bits of the conference, I felt the opening and closing speeches worked very well in terms of contextualising the pedagogic research that is done within the university. It is also a reminder that there is a lot to do: not only do academics have to teach (and write module materials), many of them conduct research, and also conduct research into the effectiveness of their teaching strategies and approaches. 

This emphasises that we’re a busy lot: we’re busy reading, writing, thinking and talking pretty much all the time. The event also emphasised how much work is going on, and discussions with others helps us to set our own personal priorities, and learn how we can work with others too.

Permalink Add your comment
Share post
Christopher Douce

Day in the life of a STEM staff tutor (reprised)

Visible to anyone in the world
Edited by Christopher Douce, Wednesday, 15 Feb 2017, 21:14

This blog post echoes a blog post I made in June 2015. The earlier blog was designed to accompany a presentation that I gave to the Computing and IT student support team, who were then based in Birmingham. Since I gave that talk, things have changed: the Birmingham office is just about to close and the functions have relocated to the Open University Manchester Student Recruitment and Support centre.

This post has a similar aim: to accompany a presentation that I gave to my student support colleagues to given them a feel for what Computing and IT staff tutors do. An important point is that every staff tutor has, of course, slightly different roles and responsibilities. Our exact mix of duties and responsibilities depends on our own expertise and interests. 

Another point is that every day can be very different. Here’s what I wrote last time: ‘the below narrative is a collage of aspects from different days. I’ve written it this way so give a sense of the diversity of things that we do. It’s not representative, since every day is different, but it does give a taste of what kind of things a staff tutor gets involved with’

Blitz the inbox

I wake up at any time between 7.00 and 8.00am; I often watch the travel reports whilst I eat breakfast. Now that I’m a home worker, I do find the travel reports strangely satisfying; I take a life affirming moment to reflect that I’m not in the middle of one of those huge snarl-ups on the north or south circular roads.

One of the first things I do is triage my inbox to decide what is important. The exciting thing about being a staff tutor is that anything could happen. I look after approximately sixty associate lecturer contracts (or tutor groups) across three different levels of study. To give an impression of scale, a tutor might (of course) have anything between 18 and 20 students. 

My key objective is to get to the messages that are important. So, glance through announcements about conferences and drainage issues. I delete messages that offer reminders about events in Milton Keynes, even though I’m not working in Milton Keynes. I shift-delete emails about fire alarms and electrical testing, and start to read messages, dropping updates about new procedures into folders (I don’t read things in depth if I don’t need to).

TM356 tutor telephone call

The first scheduled event was a chat with a TM356 tutor. Our tutor has been raising some really good points about the design of some online sessions; he’s also very experienced too. We shared views about how things are going on the module, and I make a note about some things that I need to bring to the module teams attention.

After our chat, I receive a delivery: it’s my new desk. To make things easier at home I’ve been reconfiguring my study area, and this has meant trying to find a bigger work area. I haul a big new desk into my lounge and start to puzzle about what the next step needs to be: my desk needs varnishing. I make a mental note.

It is a busy morning: I email a tutor about organising an additional support session, and then send off another email, this time to AL services in Manchester about transferring TMAs from one tutor to another due to a tutor being away on sick leave; a few days earlier I had found a tutor who was willing to cover.

AL CDSA

A Microsoft Outlook reminder popped up on my screen: it told me that there was an AL CDSA (appraisal) was due in fifteen minutes. I started to get everything sorted out: I opened up the tutor’s draft CDSA form that he had sent to me and the tutor’s ALAR report in a different screen (I have a two screen setup; my new desk will allow me to have three screens!) I familiarised myself with the contents of the ALAR report: turnaround times were very good, and the student surveys were very good (but like with so many student surveys, not many students had responded; this is always a problem that isn’t easily solved).

I get everything sorted out for the CDSA and give the tutor a call. He was great to talk to; he was committed and dedicated. I asked him what kinds of things I might be able to do to help him in his job, and told him to contact me if he has any suggestions about what AL staff development events might be useful.

Academic work

After a drop of lunch and a bit of TV it was onto the afternoon stint. Now that the key emergencies had been sorted out, it was time to get onto some academic work. For me, the term ‘academic work’ can mean a whole range of different things.

Over the last year and a half (or so, perhaps a bit longer) I have been a deputy editor for a publication called Open Learning: The Journal of Open, Distance and e-Learning (Routledge).

The journal has an interesting history: it began as an internal OU publication that shared information about ‘the OU approach to teaching and learning’ amongst its many staff. As time has moved on the journal’s remit has broadened, adopting a more international focus. It is still an Open University institutional publication but it is one that is more outward looking. It does, however, maintain its core focus, publishing research about distance education, technology and educational practice. 

I spend about an hour looking through the status of the submissions. I try to match up newly submitted papers to reviewers. One paper has been reviewed, and there is a positive ‘accept’, which is always good news. I read through the reviewer comments and have another quick read of the paper before making a final decision.

When this is done, I get onto editing a PowerPoint presentation for an online tutorial that is scheduled to take place later on in the day. I send a couple of pictures I have taken from my phone to my laptop, open up the PowerPoint, and then drop them in. I then convert the PowerPoint into the native OU Live format, and upload the new file as an OU Live preload, just to make I’m fully prepared.

I receive an email from an associate lecturer colleague that I’m working with. We’re working on a tutorial observation research project that is funded by something called eSTEeM, which is all about Science Technology Engineering and Mathematics education. My colleague has started work on a literature review and it looks brilliant. I look in my diary and I fix a time to have a chat about how things are going.

One of the things I really enjoy doing is AL development. I enjoy it because it’s great speaking to all the tutors. At the start of the month I ran a TM470 AL development session for purely selfish reasons: I am a tutor on TM470 and I wanted to run some tutorials, but I was also very aware that other TM470 tutors are significantly more experienced than I am. Put simply: I wanted to steal some of their good ideas, and a way to do this is to find a way to get tutors talking to each other. To do this, I ran an online staff development event.

After the event had finished, I had to do a couple of ‘wash up’ tasks. The first one was to send AL services in Manchester a list of associate lecturers who had attended. The second was to write a quick blog post about the key findings, and share that post to all tutors. I spent the next couple of hours going through the recording of the event, making notes, and putting everything into a blog summary of the TM470 AL development event (blog)

Evening

I try not to work evenings (or weekends) but sometimes you just can’t avoid it. It was one of those nights.

At the start of TM356 Interaction Design and the User Experience, some tutors were worried about an event called the ‘Hackathon’. The OU group tuition policy stipulates that each face-to-face event must have an online alternative. The thing is, the TM356 face-to-face Hackathon takes an entire day, and you can’t have an online equivalent of an event that starts at 10.30 and ends at 16.30; it just wouldn’t be humane!

With a blessing from the module team, I made the executive decision to create three ‘parts’ to a longer running online equivalent. After making this suggestion, I realised that I was going to making a substantial contribution to the pedagogic design of these ‘parts’. 

The tutors were asking, quite rightly: ‘how are these sessions going to work?’ 

I made a decision: showing and demonstrating a teaching idea would be significantly easier than writing a document that tutors would then have to try to decode. I had prepped a session, uploaded a session, and I worked with a tutor to deliver a session.

My fellow tutor had some brilliant ideas; we tried a ‘dialogic approach’ to teaching, which means: ‘we asked each other questions’. Listening to two voices is always, in my opinion, more fun than listening to one.

Permalink Add your comment
Share post
Christopher Douce

Horizons in STEM higher education conference 2016

Visible to anyone in the world

This blog has been taken from a set of notes I made when I visited the Horizons in STEM conference at the University of Leicester on 30 June 2016. Attending an event like this, to do ‘something academic’, made me feel weirdly guilty since I had been spending so much of my time doing ‘admin stuff’.

The aim of the conference was all about developing teaching and learning in the STEM disciplines, and sharing practice about what works and what doesn’t. Two speakers gave an opening address: there was the head of STEM from the HEA, and Nick Braithwaite from The Open University. Comments were made about the student voice, commitment to the discipline and the constant importance of professional integrity. I also noted down the words, ‘we want to improve our critical pedagogy; encourage everyone to be critical’. The second keynote speech was especially interesting because it was pretty distant from my know experience and knowledge: it was about how shared laboratory and learning spaces could be used to create an interdisciplinary subject centre.

Day one: first session

The first presentation I attended had the title ‘the educational value of student generated videos’. The idea was to replace a static poster with a five minute videos. As I listened, I thought of the Open University T215 module which requires students to create a short presentation.

One of the presentations that I particularly liked had the title: ‘undergraduate eJournals’. An eJournal is an official university publication for undergraduate studies that was linked to a ten point module. Interestingly, the articles published in an eJournal can be picked up by Google Scholar and the national media. Students could adopt the roles of author, referee and play a role on an editorial board. A new term that I’ve learnt was: synoptic learning. A key point for students was: try to create a paper that links science and fun topics; wacky can be good.

Discussion session

The next session was about discussion. I made notes about issues relating to ‘normative practice’ (without really understanding that this meant), social justice and inclusion.

An interesting question that was posed was: ‘are you aware of attainment gaps [in your programmes and modules]?’ Accompanying questions were: ‘are they discussed in your module team meetings, and do you know why they happen?’ and ‘do you discuss potential solutions?’ There were a series of related points: the importance of transition between levels of study, the importance of data, and the importance of critical reflection. Inclusion was discussed in terms of inclusive curriculum; making a subject relevant to individual students.

Flexibility and Personalisation

Neil Gordon from the University of Hull spoke about two pieces of work: flexible pedagogy and attainment. Flexible pedagogy was defined as giving students more choice about when to learn, where to learn and how to learn (mode, pace and place). Some interesting points that relate to computer science: it is a popular subject, but there appears to be a mismatch between expectations, i.e. computer science does not equal information technology. There are some clear challenges: computer science was noted to be the second worse subject for awarding good degrees (I should add that I’m not sure whether this was a national perspective or an institutional perspective), and 83% of students are male (again, I’m not sure on where this figure was taken from). Are there solutions? Some ideas were: to develop interactive tutorials, to create automated assessment, and look at the transition between school and colleague, and look to community engagement.

The next presentation was by Derek Raine from the University of Leicester. My notes read: ‘personalise the content to match with the aims and objectives for students – usual approach: core, options and a capstone project’.  Other points were: ‘drivers of change include finance, non-standard providers, media, and MOOCs’. The following question could be asked in classes: ‘what would you like to be discussed in the sessions?’

Final session

The final session that I attended was opened by Simon Grey from the University of Hull who spoke about ‘Games, learning and engagement’. Simon presented a brief history of gaming followed by a summary of the concept of gamification and game based learning. I learnt that there were eight different types of fun: sensation, fantasy, narrative, challenge, fellowship, discover, expression and submission (these terms reminded me of usability and user experience goals that are found in interaction design). Other points include the importance of mechanics (rules), dynamics (the system), and aesthetics (the look and feel), before Simon spoke about the concept of flow, and that we needed to give students clear goals, immediate feedback, and challenges that match their skill.

I think it was then my turn to do a bit of speaking. I spoke about a university funded project to study the teaching of a second level module about web technologies. My key points were that students differed significantly in terms of their backgrounds and abilities, and tutors differed significantly in terms of their online teaching practice.

The next session, entitled ‘teaching programming and data analysis with a MOOC’ was given by my colleague Michel Wermelinger. Michel talked about his experience of teaching on a MOOC entitled ‘learn to code for data analysis’ which has been presented through FutureLearn. Michel mentioned some software that students could use: a Python distribution called Anaconda (Wikipedia), something called SageMathCloud (Wikipedia), and Jupyter notebooks (Jupyter website). We were also told of a blog post that Michel had written called the First Principles of Instruction (blog post). The post which presents a very brief summary of five principles of instructional design that promotes learning and engagement. These are: problem centred, activation (of past experience), demonstration (to show new knowledge), application, and integration (of new knowledge into existing knowledge or practice).

It was a good talk. I have one other memory, which was that Michel was pretty robust in his views about much workload running a MOOC actually entails from a lecturer’s perspective.

Day two: first session

The first session had the title ‘development of digital information literacy’ by Eleanor Crabb who was also from the OU. I noted down the terms ‘understanding digital practices, finding information and critical evaluation’. There was a mention of an online pinboard tool, which was a bit like Pinterest, and a presentation about different activities: an icebreaker activity and a collaborative activity where students had to summarise a chemistry paper.

The next session had the title ‘encouraging students’ reflection through online progress files’. All students were required to make comments every week on each module, which in turn, acquire marks – which is an interesting parallel with a scientist’s notebook.  Key challenges included engagement with students and staff and students knowing what to write (which was ameliorated by a set of more detailed guidelines).

A session that I found especially interesting was entitled ‘maths advice and revision for chemistry’.  A key term that I noted down was: ‘the maths problem’; some students didn’t have mathematics as a prerequisite when they started to study chemistry as an undergraduate at Glasgow University. I also noted down bit of research that one of the best indicators of success in chemistry wasn’t having studied chemistry in the past, but instead, having an existing maths qualification. As I listened I started to think about (and remember) my own experience as a computer science student where I had to attend remedial maths classes (since I didn’t study A-level). I had to attend these classes where we were given maths puzzles printed on yellow paper. In Glasgow University, students could attend voluntary labs, workshops and group tutorials. Subjects included complex numbers, vectors, matrices, differentiation and integration. I couldn’t help but feel that such an approach would have been really useful during my own undergraduate studies.

The final session had the title: ‘understanding the process by which students manage their employability’. Employability was defined as ‘personal assets, how they are deployed, how they are presented to employers, and the wider context (such as economic conditions and personal circumstances). Another thought I had was that employability also relates the information that employers might find easily discover about potential employees if they do a quick internet search (which was a theme I think I was introduced to at another HEA workshop). Much food for thought.

Keynote summary:  Future directions in teaching and learning

The second conference keynote was by Derek Raine (who spoke during an earlier session) from the Centre for Interdisciplinary Science from the University of Leicester. Derek mentioned something called the New Directions in the teaching of Physics which presents opinion pieces, pedagogic research and reviews.

Before considering the future, Raine looked to the past to consider the historic and contemporary roles of universities. As well as being centres of study for the sciences and humanities, they can also be considered to be an ‘engine of social mobility, a driver of economic growth, and a cornerstone of our cultural landscape. Points were drawn from the 2016 white paper (THES explanation), and the 1963 Robins Report in Higher Education  (Education England) which states that higher education should be available to all who are qualified by ability and attainment to pursue it (page 9).  

According to Raine (and my notes), the 2016 white paper cites problems: that courses are inflexible, that students are dissatisfied, and there are national skills shortages. An important point is that there is increased competition from different types of education providers which is connected with an important change in perspective. Historically, higher education has been viewed as being a public good (the view that an educated and skilled workforce helps all members of society) whereas it is now being presented as a private good (that an education helps the individual to earn money). My view, and those of others that I work with is that the first perspective needs to be protected.

Another point was that there is research that tells us something about what works in higher education teaching. Key points include: time on task, trained teaching staff, the importance and use of collaborative learning, class sizes, quality of feedback, and the sense of community (Gibbs, Dimensions of Quality, Higher Education Academy PDF).

I made a note of some pedagogies (approaches to teaching) that were mentioned: personalised lecturers (that are based on student questions), flipped classrooms (where students listen to lectures before attending a tutorial), problem-based learning, MOOCs (which I’m very cynical about), gamificiation, extension tasks and student journals. As our speaker was speaking, I made a note that I felt important: ‘an alternative division of labour where pedagogic research or scholarship plays a part’.

Another interesting idea was the importance of sustainability (of higher education, and education per se) as a fundamental idea or principle. I also noted that it is important that ‘history is linked with the present, science linked with society, and economies with social justice, and this is achieved through interdisciplinary and multi-disciplinary’. I agree: connections are important since they offer us perspective.

These final thoughts inspired an interesting point during the concluding question and answer session: ‘it isn’t just about what a university is for, but also what is an economy for; it’s not just about money, it’s about culture and our place within it’. 

Final session

The first of three sessions was from three of my OU colleagues, Ann Walshe, Anne-Marie Gallen, and Anne Campbell who were studying ‘associate lecturer perspectives on supporting students through tuition in groups’. They were asking: ‘what is tuition?’, ‘what can we learn from tutors?’ and ‘are there some common understandings across stakeholders?’ The research is being carried out through workshops and telephone interviews.

The next talk had the title ‘a student monitoring and remedial action system for improving retention of computer science programmes’ by Stewart Green from the University of West of England. I noted that there was a role of a retention co-ordinator. This is someone who gets different sources of data, such as attendance data, VLE logins, and assessment results. A key task is to periodically review the data, and to choose actions supported by student support advisors. Interventions might include email messages, face to face chats, and referrals to advisors. Students may, of course, be affected by a whole range of different issues, including illness, family issues and caring responsibilities.

In some ways Stewart’s role represents a human equivalent of various learning analytics project that I have heard rumours about in the OU. I really like the human element that underlies the looking of reports about attendance and attainment; this backs up my opinion that what really matters in education isn’t technology, but people.

I also noted down a couple of useful reports. The first that I noted had the title: Building student engagement and belonging in higher education at a time of change by Liz Thomas (HEA website). The second was entitled Undergraduate retention and attainment across the disciplines (HEA website).

The final session was called ‘visualising student progress: identifying patterns in the behaviour of students learning databases’. It was given by Andrew Cumming from Edinburgh Napier. Andrew spoke about tutorial exercises, where students had to perform SQL database searches across a number of live databases. I also have made the note ‘can we tell the difference between formal and informal learners?’ but I have no idea what this means.

Concluding thoughts

By the end of the two days at Leicester, I was pretty tired: there had been loads of presentations, and a lot of take in. Even though several months have now passed since the event, I can still remember some highlights. I was particularly interested in three things: the idea of an official ‘student journal’ as a learning tool (it was an interesting pedagogic approach), the idea of a ‘retention tutor’ (retention is a theme which crops up at almost every meeting I attend), and a welcome dose of perspective given to everyone during the second keynote.

There was one theme that seemed to go through every session: the importance of connecting teaching and research. Even though some of us might work in a discipline that doesn’t change very much (such as mathematics), the context and environment in which a subject or discipline sits is, of course, always changing. This means that we must always think about, study and explore ways to engage our students.

Permalink Add your comment
Share post
Christopher Douce

Open University eSTEeM 2016 conference, 14 April 2016

Visible to anyone in the world
Edited by Christopher Douce, Thursday, 5 May 2016, 15:57

eSTEeM is the Open University centre for STEM pedagogy. I think this was the second or third eSTEeM conference I’ve been to, and they’ve always been pretty interesting. This blog post is a quick summary of the different talks that I went to. I’m blogging this, so I can remember what happened, and also just in case it might be useful for anyone else who was there.

Opening keynote

Andrew Smith, Senior Lecturer in networking, gave a thought provoking keynote speech entitled ‘our classroom has escaped’. He began by asking everyone who was users of different social media tools: twitter, Facebook, or LinkedIn. Pretty much everyone put up their hands, showing how popular these tools are.

Andrew said ‘we suffer from the paradigm of monolithic learning; what happens in my classroom doesn’t leak out’, and that we are protective of our content.  His point was: things have been ‘escaping’ for some time. As soon as Andrew mentioned this, I thought of the session about Facebook that was held in the most recent associate lecturer development session (OU blog). A question is: how do people outside our classroom see what is going on?

A challenge is that social media exposes us amongst our peers, but it also offers us a way to engage our audience beyond the classroom. But how might we use these tools to teach? One approach is to automate our social media content. For instance, if you know what your content is you can ‘schedule it and plan it’. There is also the potential to engage students when modules are not running, or students are between presentations.

This is all very well, but how do we great engagement? One approach is to ask open questions. The idea is to create a community of practice, where both learners and tutors participate. There is also the importance of relevance. Social media engagement can also connect current studies to current and changing media stories. One of the roles of an educator is to create ‘sparks of interest’, to inspire, and to facilitate learning.

Would the way that you approach social media be different depending upon the subject that you teach? Perhaps. The thing with networking, is that many things are cut and dried; the situation might be very different with subjects from the humanities, for instance.

(In case you’re interested, Andrew told us about two of his Twitter streams: @OUCisco and @OUCyberSec)

Session C: Online practices

There was a lot going on, so I had to choose from one of many different parallel sessions. The first talk in the ‘online practices’ session, by Vic Nicholas, was all about student perceptions of online group work as they studied a ‘classical science module’. One finding (that was, in retrospect, not particularly surprising) was that students appear to have negative views about group work. One thing that I took away from this session was the use of email to prompt students at certain points throughout the module. (This reminded me that tutors have been requesting a ‘send text message to students’ feature for quite a while now).

The next talk took a very different tone: rather than focussing on the students, it was all about how to use technology to empower academic authors. Angela Coe told us about how a tool called OpenEdx (OpenEdx site) was used to create materials for S309 Earth Processes (OU website). OpenEdx was described as a tool that has been created by STEM developers for STEM developers.

Some interesting points were that the tool exposed more about the author and who they are. The use of the tool also encouraged an informal chatty writing style, and supported ‘in content’ discussions. I seem to remember that Angela also spoke about animations and the sharing of data sets using Google Docs. 

The final presentation in this session was entitled, ‘the trials and tribulations of S217’ (which is entitled Physics: from classical to quantum). This is a module that appears to cover some pretty hard (yet fundamental) stuff, such as thermodynamics, optics and quantum physics. An important issue that needed to be addressed in this module was the accessibility of the mathematical materials. I’ve made a note that they authors had to move Tex content to the virtual learning environment (which is a theme that was mentioned in my previous blog about a BCS accessibility conference). 

Session F: MOOCs

The first presentation of this session, entitled ‘Evaluating the design and delivery of a Smart Cities MOOC for an international audience’ was given by Lorraine Hudson from the department of Computing and Communications. The OU is a central partner in an EU funded project that is all about Smart Cities, or how the operation of cities can be supported by the use of different types of IT systems. In some senses the MOOC seems to be about how to tackle ‘wicked problems’ (problems that don’t have an immediately apparent solution). The subject is also necessarily interdisciplinary. 

Michel Wermelinger and Tony Hirst spoke about their experience of designing a MOOC about using the programming language Python for data analysis. In some respects, Michel’s presentation was a ‘warts and all’ take on designing and running a MOOC. The main point that I took away from his presentation was that MOOCs are a lot of hard work for the academics who have to run them, and there is the perpetual question of whether this is time well spent, especially when we bear in mind the fact that around three quarters of the participants already have degrees (which was a point also mentioned in Lorraine’s talk).

The final presentation was by Kris Stutchbury, who spoke about ‘Supporting the teaching of Science in development contexts: OpenScience Lab and TESSA’. TESSA is an abbreviation of Teacher Education in Sub-Saharan Africa. Kris’s project represented a case study, of a snap shot of what is happening within the TESSA project, which can be thought of as an important aspect to the university’s wider social mission. 

Workshop: Listening to graphs

This session was hosted by Chris Hughes and Karen Vines. Their session opened with the observation that graphs are (obviously) a really effective way of communicating a lot numerical data really easily, but how do we communicate the same information for students who have visual impairments?

There are a number of different ways: figure descriptions, the use of tactile diagrams, and the use of sonification, which means converting a visual representation to an audible one. The challenge is, of course, how do we do it? Chris mentioned that sonification has been around for quite a long time; at least one hundred years. One common example of sonification is the Geiger counter, which translates measurements of radiation of audible clicks.

There are a bunch of ‘sound parameters’ that can be manipulated. These are: pitch, timbre, time, loudness and repetition. By way of a simple introduction we were asked to draw a graph based on an equivalent auditory representation. This is all well and good, but there is a compelling research question which needs to be answered, which is: do sonifications actually work during study? Do they help students to learn?

To try to answer this question Chris, Karen and colleagues designed a study. In their study, they gave five visually impaired students and five sighted six learning scenarios: two were from science, one was from mathematics, and the remaining three were from statistics. Of course, since there was such a small sample size, the study was qualitative and (as I interpreted it) exploratory.

The workshop raised some really interesting questions, such as: how do we best teach through figure descriptions? This also emphasised the extent to which existing student knowledge can influence the interpretation of certain descriptions. The final point that I noted was: ‘we need to think of a blended approach, to use different representations; sonifications, descriptions and tactile diagrams’.

Closing Keynote

The closing keynote was by Helen Beetham, and had the title, ‘supporting lifelong learner’s resilience and care in a digital age’.  Helen began with a definition of ‘learning literacies in a digital age’: capabilities that allow an individual to thrive (to live, to learn, to work) in a digital society. There is a JISC funded project called Learning Literacies for the Digital Age (LLiDA) that accompanies this description; an associated project is the JISC Digital Student project (JISC). But what does it mean to be a ‘digital’ student? (If this is a term can ever be defined?) Perhaps it could be able developing effective study habits and specialist practices, using technology to create relationships with peers. 

A connected idea is the notion of ‘digital literacy’. To help us with definitions, there is a JISC information page called Developing students’ Digital Literacy (JISC) that offers a bit of guidance. Another thought is that perhaps ‘the digital divide might be narrower, and deeper’ with respect to how we use digital tools and consume digital learning media. There is also the notion of ‘digital well-being’, and Helen offers a number of digital well-being references (Google Doc). An accompanying idea is ‘digital resilience’.

An interesting point, and one I’ve come across before, is the importance of ‘career and identity management’ (I think I might have come across this term at a HEA event about employability): our different digital identities have the potential to blur, and knowing how we are presented ‘on-line’ is important.

Helen gave us with two other interesting phrases to consider: the notion of our ‘quantified selves’, which points to the question of how much control we have over what data is collected about us, and whether this might connect to our ‘digital capital’.

Reflections

What surprised me about this conference was how much research and scholarship was going on across the university. The poster session was especially memorable. I don’t know how many posters there were, but there were at least twenty, each relating to a different aspect of teaching and learning. Some posters focussed on teaching practice, others focussed on technology.

To get more of a view about what is going on (and what was happening in the other parallel sessions), I really need to find the time to sit down with a cup of tea and work through the conference proceedings.

More information about eSTEeM funded research can also be found by visiting the Open University eSTEeM website (Open University).

Permalink Add your comment
Share post
Christopher Douce

eSTEeM annual conference: TEL in practice

Visible to anyone in the world

On 16 April, I went to the first day of the Open University’s eSTEeM conference.  eSTEeM is an Open University initiative to bring ‘together academics in Science, Technology, Engineering and Mathematics (STEM) to promote innovation, scholarship and enterprise in open and distance learning’.  The eSTEeM website offers loads of information about the different projects that are funded through the initiative. Before trying to summarise my ‘take’ on the whole event, I should also add that TEL (which is in the title of the event) is an abbreviation for Technology Enhanced Learning.

Opening keynote

Due to travel timing, I missed the opening address, but I managed to get to the opening keynote, which had the title ‘Using technology in teaching and learning: it is scholarly?’ by Linda Price from the Institute of Educational Technology. My immediate instinct to this question was to say ‘yes’, but the point to Linda’s talk was to encourage us all to think about what scholarship means when it comes to TEL.

An interesting point was that educators and institutions used to be the gatekeepers of knowledge, but technology has enabled some information (and knowledge) to become open.  Two examples of this is with the availability of Open Educational Resources (or OERs), and the increase in the number of open access journals.

Linda’s talk offered us a useful caution, that ‘technology will never save us from poor teaching, it will make things worse’.   Another point was about the importance of learner motivation, and that if technology is not properly integrated into a module then there’s a likelihood that it isn’t to be used (or, used poorly).

Another thought is that technology might not be the problem, but pedagogy might be.  Or, in other words, we need to develop our understanding about how best to use new.  Three important questions are: How do we make choices (of what technology to use)?  What evidence is there? Are we looking at opinion based practice or evidence informed practice?

Connecting to the ‘scholarly’ part of her title, we were told about a number of scholarly principles.  These were: the importance of goals, preparation, methods, results, presentation and critique.  These can also be connected with different scholarly approaches, such as the need to thoroughly analyse a problem, understand the context, review the literature, setting aims and objectives, designing of teaching and learning interventions, evaluation methods, and sharing of findings.

A final point that I have made a note of was that we need to think about how theory can relate to and drive our research.  This left me with a question: which theories are important and relevant?  This, of course, connects back to the importance of being aware of current debates, issues and, of course, the literature that relates to a particular area of research.

Workshop: what do you mean by tuition?

The university is introducing something called the Group Tuition Policy which is to affect both on-line and face to face tuition.  The aim of this workshop (which was one of many different events I could have chosen) was to facilitate discussions about how we might begin to plan and implement the policy (which is something that I’ll have to do as a part of my day job).

The workshop was split into two different activities and related to two different perspectives.  The first was to discuss what is meant by the term tuition, from the tutor’s perspective.  The second activity was all about what students should expect from tuition.  For this second activity we were encouraged to draw a ‘rich picture’.

At the end of each section, we shared different perspectives.  Points that I noted down were, ‘we need to up our game when it comes to on-line [tuition]’, ‘you can’t describe on-line as tutorials’ (which was an interesting perspective), and that there is ‘no difference between watching a recording and being on-line (or, participating in an on-line tutorial)’.  It was obvious there were a number of interesting, slightly conflicting, views.

How students learn in Massive Open Online Courses

The third session that I went to was all about MOOCs, or Massive Open Online Courses.  Allison Littlejohn, from the Centre for Learning and Teaching (and the Institute of Educational Technology) began by asking everyone how many had taught or learnt through a MOOC.  A good number of members of the audience put up their hands.

Allison spoke about a topology of learning.  This included dimensions of formal/informal, intentional/unintentional and recognised/unacknowledged.  She then went onto mention a study at Duke University which analysed 75 different MOOCs in terms of whether they adhered to good instructional design.  If I remember correctly, the results were not very positive.

 A key research question that was asked was: how do students learn in MOOCs?  A related question is: do people who are highly motivated behave differently?  To answer his question, a researcher called Barry Zimmermann was mentioned (with regards to his work on self-directed learning), and three case studies.

The first case study was about a ‘connectivist MOOC’ called SRL-MOOC (Glasgow Caledonian University) (I’m not sure what connectivist in this context means – I think I’ve made a note of the term correctly!)

The second case study was an introduction to the data sciences, and was from the University of Washington.  It ran using the Coursera platform, and had forty thousand learners.  We were introduced to an instrument called SQLMQ which was used to analyse learner behaviour, and could connect with factors such as student motivation.  (There was a lot of detail here that didn’t make a note of since this was all new to me!)

After this second case study there was an opportunity to discuss a question: how would we create a MOOC that could help self-regulated learners?  This was an interesting question that led onto quite a bit of debate, about the business models of MOOCs, how you might engage learners that were not ‘self-regulated’, and worries about their terrible completion rates.

 Allison found something interesting about self-regulated learners.  Low self-regulated learners sometimes engaged with MOOCs with the objective of getting a certificate, whereas high self-regulated learners took a more strategic approach, choosing to carry out learning that relates to a job, role or task.  Simplistically put, some high regulated learners tended to dip in and out of a MOOC, gain what they need, and then move on.

I can relate this finding with my own experience.  I have signed up to three different MOOCs, but I haven’t finished any of them.  The first one was about the history of the internet.  I completed the assessment, but then became a bit grumpy about the comments that were coming back from my ‘peer’.  Plus, I was finding there was a bit more reading to do than I expected (so I dropped out!)  My reasons to take the two other MOOCs were all about ‘checking to see what other institutions were up to’, and finding out whether I was missing anything in my teaching.  I dropped out of the first interaction design MOOC when I realised that the content was solid, and offered me some reassurance that my teaching was ‘on target’ with the overall aims of the discipline.  I dropped out of the final MOOC when I realised that the course was pretty baffling and didn’t seem to be teaching the subject in a very satisfactory way.  This relates, in part, to Allison’s opening comment about the importance of effective learning design.

The third case study was a module about clinical trials, and was hosted in the Edx platform.  I didn’t take any notes of this third case study, since I was probably still thinking about the distinction between ‘high self-directed learners’ and ‘low self-directed learners’.

A final activity of the day was to think about some form of recommendations about either MOOC design, or learning design.  Our table chose, instead, to discuss other issues, including the role and importance of face to face tuition.

Short paper session

The next session contained three short ‘paper’ presentations. 

The first was by Clem Herman, and her presentation was entitled ‘putting gender on the agenda: why gender should be a threshold concept for STEM educators’.  Clem spoke about the university’s involvement with an initiative called Athena Swan (Equality Challenge Unit).  

Two of the key objectives of the initiative is to ‘address gender inequalities requires commitment and action from everyone, at all levels of the organisation’ and ‘to tackle the unequal representation of women in science requires changing cultures and attitudes across the organisation’.  To be recognised by the initiative, institutions have to go through an audit process, enabling the university to gain an understanding of the state of gender representation in individual departments. 

It was interesting (and alarming) to hear that the number of women enrolling in the first level undergraduate computing module has been dropping (in comparison to Maths and Statistics, which was reported as being okay). Postgraduate registrations, apparently, have always been low.

During the question and answer session, questions were asked about engagement with external organisations (which have similar objectives), and there was a discussion about unconscious bias and the ‘stereotype threat’.  I think what is means being aware of gender related expectations when it comes to subject specific performance.

The next presentation of the day was by ‘yours truly’.  I briefly spoke about a university funded project that has been carrying out some research into the tutor experiences of teaching on a second level computing module called TT284 Web Technologies (Open University).  I won’t go into the fine detail, but a description of the project is available on the eSTEeM website, with an accompanying project poster (PDF).

The final talk of the day was from Martin Reynolds, who gave a talk entitled, ‘Designing a learning system for postgraduate recruitment and retention based on systemic enquiry’ (I may or may not have made a proper note of his title).  During his talk I remembered him telling us something about a university LinkedIn ‘systems thinking’ alumni forum, where students are continuing to share knowledge and experience beyond the boundaries of the postgraduate modules that they have been studying.

Closing keynote

 The closing keynote, entitled ‘getting data into your eye: live in the field, life in the lab, and augmented reality’ was by Peter Scott, who was from The Open University Knowledge Media Institute (KMI). 

Peter talked us through a series of EU funded projects that KMI had been involved with; I recognised the name of some projects, but not all, such as WeSpot (EU project website), The Open Science Laboratory (Open University website) and Engaging Science (EU project website) which might have been mentioned into an associate lecturer development event that I went to at the University of Sussex.  Another project was called the Field Network System (Open University website), which was about creating a portable network infrastructure for scientific fieldwork.

A big part of Peter’s talk was about applications of something called ‘augmented reality’; a topic that is featured in a module that I tutor called M364 Fundamentals of Interaction Design (OU website).  Augmented reality is where digital technologies can add additional information to a digital scene.  An interesting point was made is that AR can become really useful if we use it in combination with people, which leads us to the term ‘socio-technical augmentation’.

An interesting example of this can be found in a project called TellMe (EU project), an abbreviation for Technology Enhanced Learning Living Lab for Manufacturing Environments.  We were shown a demo where a computer tool offered engineers visual guidance about how to assemble and work with components.   Another perspective is that you could potentially be guided by another engineer who is working at a distance.  During these demonstrations I thought about my own interests in teaching computer programming, and wondered about how these tools might be used in this somewhat different context.

Towards the end of his talk, we were shown a demonstration of a virtual volcano (that was spewing lava) that popped out of a text book.  We could only see the ‘virtual volcano’ is we viewed it through the screen of a smartphone, which hinted at the wide variety of different ways that technology can be used when it comes to teaching and learning.

Final thoughts

There was a lot going on during the day, and I felt that I missed out on quite a few things.  I like days like these, since they force you to sit down, listen and learn.  They are also opportunities to help you to understand what is going on, and to gather up gently clues as to how the teaching and learning of science and technology may be changing.  A connected challenge is to try to find the time to investigate what happened in the other sessions and continue to keep up with the various developments that you are introduced to.

During conference I became involved in a couple of conversations about research about introductory programming, and there was even some talk about organising what might become a mini conference.  The bulk of the talk was an objective for a couple of us (who were interested in similar topics) to try to get our heads together; to try to understand more about where the ‘state of the art’ was heading.  In some respects, this was an outcome that was as just as useful as learning about new projects.  The reason for this is that these new connections and discussions have given me a bit of much needed and welcome motivation.

Permalink Add your comment
Share post
Christopher Douce

eSTEeM Conference – Milton Keynes, May 2014

Visible to anyone in the world
Edited by Christopher Douce, Tuesday, 20 May 2014, 09:50

On 5 May 2014, I was at Milton Keynes again.  I had something called a module team meeting in the morning.  In the afternoon I attended an OU funded conference that had the title (or abbreviation) eSTEeM (project website).

eSTEeM is an initiative to conduct research into STEM education.  STEM is an abbreviation for Science Technology Engineering and Mathematics.  Since I have some connections with some computing modules, which can cross the subjects of Engineering and Mathematics, I decided to submit a proposal that had the objective of learning more about the tutor’s experience of teaching computer programming.  The aim was simple: if we learn more about the tutor’s challenges, we can support them better, and subsequently they will be able to support the students better too.

I have been lucky enough to receive a small amount of funding from the university.  This, of course, is great news, but it also means that I’ve got even more work to do!  (But I’m not complaining - I accept that it’s all self-inflicted, and it’s work that will allow us to get at some insights).  If you’re interested, here’s some further information about the project (eSTEeM website).

A 'pilot' project

The ‘understanding the tutors and the students when they do programming’ project is a qualitative study.  In this case, it means that I’ll be analysing a number of interviews with tutors.  I’ll be the first to admit that it’s been quite a while since I have done any qualitative research, so I felt that I needed to refamiliarise myself with what I needed to do by, perhaps, running a pilot study.

It wasn’t long before I had an idea that could become a substantive piece of research in its own right. I realised that there was an opportunity to run a ‘focus group’ to ask tutors about their experience of tutoring on another module: T320 Ebusiness Technologies (OU website).  The idea was that the outcome from this study could feed directly into discussions about a new module.

During my slot at the conference, rather than talking about my research about programming (which was still at the planning stage), I talked about T320 research, that was just about finished.  I say finished, when what I actually mean is ‘transcribed’; there is a lot more analysis to do.  What has struck me was how generous tutors are with both their opinions and their time.  Their views will really help when it comes to designing and planning the future module that I have a connection.

Final thoughts and links

In case you’re interested, here’s a link to the conference programme.

What struck me was how much ‘internal research’ was there was going on; there are certainly a lot of projects to look through.  From my perspective, I’m certainly looking forward to making a contribution to the next conference and sharing results from the web technologies and programming research project with colleagues.   The other great thing about getting my head into research again is that when you have one idea about what to look at, you suddenly find that get a whole bunch of other ideas.

Permalink Add your comment
Share post

This blog might contain posts that are only visible to logged-in users, or where only logged-in users can comment. If you have an account on the system, please log in for full access.

Total visits to this blog: 2335228