Talking Teaching

May 24, 2011

teaching with panopto

Filed under: education, university — Tags: , — alison @ 4:35 pm

I’ve written previously about the lecture-capture system Panopto as a tool for supporting student learning. Anyway, our Teaching Development folks asked me to write a short piece about it for our in-house teaching support publication & very kindly said that I could post it here as well :-)

Panopto’s a tool for capturing classroom teaching and making it available on-line for students to access whenever they please. I first became aware of it when the University was gearing up for its i-TunesU presence, and decided that the technology had a lot to offer me and my students as a tool to enhance teaching and learning practices. (I am definitely not a fan of technology for technology’s sake – it needs to have a pedagogical benefit.) And I’ve been using ever since – for lectures, for podcasts, for catching up when I’ve had to cancel a lecture due to illness.

Panopto isn’t perfect. In a lecture theatre it picks up what the lecturer’s saying, but misses most or all of the other goings-on – the questions (remember to repeat them) & the discussion around various points. It also loses ‘sight’ of the speaker if they move too far to the left or right, although that shouldn’t stop you moving around, to speak to a group maybe, or to get closer to someone who’s speaking very quietly. But students viewing a recording can see the speaker (provided there’s a camera in the room; otherwise they’ll just get the voice-over), see the powerpoint slides (& any notes or diagrams added to these in class), and watch any videos or animations that were shown in class. They can stop the recording, replay it, view tricky points again and again. To me, this was a key reason for using panopto, because I could see how it gave students the chance to revise and review difficult concepts in their own time and at their own pace.

This was borne out by an informal survey I did with my first-year class last year. The most common reason they gave for using Panopto – and not everyone used it – was as a means of reviewing material that they hadn’t understood in class. ‘Used it to revise for exams’ was also a common response, & indeed, you could tell that anyway by looking at the usage statistics within the Panopto system. But it also turned out to be really useful for students with lecture clashes – and given that we emphasize the ‘flexible learning’ opportunities available at Waikato, that’s got to be a good thing. Students liked knowing that if they were sick they wouldn’t be missing out on too much from my classes. And someone said, ‘you could use it as an excuse to miss classes – but then you’d be missing out on a lot of the ‘extra’ stuff that goes on in the lecture room’. In other words, the students were using Panopto as an additional means of supporting and enhancing their learning.

It’s also an excellent tool for reflecting on my own teaching practices. I often watch a lecture later, looking to see whether something that seemed to go well at the time, really did. It’s actually quite hard to do this to start with, because you’re seeing and hearing yourself as the students do, & that may or may not fit with your own image of how you look and sound in the classroom! It can form the basis of discussion with a friend or mentor: ‘I did this particular thing because I hoped that it would… – do you think it would have had that effect?’ I know TDU have used a recording of mine as the basis of discussion with other lecturers on delivering constructive criticism of a colleague’s class – and the feedback I received from that was extremely useful (thanks, guys!).

So, if you’re toying with the idea of trying out Panopto in your classroom, I’d say, go for it. It’ll seem strange, the first time or two, but after that (as long as you remember to press ‘record’ & turn on the microphone! been there, done that) you really don’t notice it. I was told that the students just wouldn’t come to class but I can’t say I’ve noticed that – if they’re going to wag, they’ll wag, & this is just another excuse. But more seriously – your students will see your use of Panopto as just another sign that you’re interested in & keen to support their learning, & both you and they will gain from the experience.

May 2, 2011

on academic honesty

I’m marking at the moment (essays & dissertations) and also (when I need a break) reading James Lang’s book On Course: a week-by-week guide to your first semester of college teaching. (Yes, I know I’ve been teaching for yonks, but I know there’s always something new for me to learn & also it’s nice to look at possible resources that I can recommend to others.) Today I read his chapter for week 9, Academic Honesty.

Now, marking first-year essays for a class of 200 takes rather a long time, not least because the tutor & I tend to write reasonably extensive commentaries on each one. We’ve already given feedback to the whole class on what you could regard as ‘general’ issues: following formatting rules, remembering to cite & reference properly, reminding them that the marking rubric is provided for a reason (sigh!)… This is easy to do because the same things tend to crop up each year, even though we take care to work through them in tutorials well ahead of submission date. But the students still need to know what’s good, & what’s not, about the content of their work; hence the individual comments.

However, it used to take us longer to mark, because as well as the outright marking we’d also be checking for evidence of plagiarism – that is, when someone presents the words and ideas of others as their own. It’s often not that hard to pick up (clues like changes in word pattern, accuracy of grammar or punctuation, or even changes in font, for goodness’ sake!), but we were then having to tediously google each suspect phrase in an attempt to confirm or deny our suspicions before raising them with the students concerned. And believe me, that takes time! Up to 30 minutes, for a particularly questionable piece of work.

What’s changed? Many things. First up, we use TurnItIn & electronic submission of essays. More as a teaching tool than a punitive one: the system generates a ‘similarity’ report that highlights phrases, sentences, or (regrettably) whole paragraphs that are not original but can be traced to a journal article, book chapter, or work previously submitted by another student. So we can sit down with a student & go through the report with them, & talk about what’s happened before making a call on whether it needs to be Taken Further. But I’ve also got some TII reports with all identifying details removed, that we can use in tuts at the start of the semester as the basis of discussions about what academic honesty is, & why it’s important. (It does seem to work, too – before we made the decision to use TII, between 10 & 20% of those first-year essays would show evidence of plagiarism, & in about 5% it would be on a seriously grand scale. These days – well, this year it would be about 5% all up – but the confounding factor there is of course that we’ve made a conscious effort to formalise a lot of other processes as well.)

And I do believe it’s really, really important to have that discussion with students. It’s all very well to stand up the front of a lecture class & say, ‘academic honesty, blah blah blah,’ before moving on to that day’s ‘real’ business, but it’s highly unlikely that many students will take much out of that. Too often, I think, teaching staff can assume that the students will pick all this up by osmosis, and  it just doesn’t happen that way.They need to talk about it, to fit the concept in to their existing framework of ideas about the purpose & function of their studies.

They also need to practice the relevant skills (something that comes through again & again in the AAAS’s Vision & change report). So we give practice (in tuts & lab classes) on paraphrasing, citing, and referencing sources of information. Sometimes this generates some really interesting & valuable discussions on quite different issues. And of course, they need to recognise just why the concept of academic honesty is so important – more interesting discussions can arise from this. Some of that discussion focuses on why internet plagiarism is just as serious as any other form – and lecturers have to give clear instructions that this is so; otherwise it’s a problem that will only get worse, given how easy it is to cut-n-paste a bit from here & a bit from there & weave it together into a whole. Lang notes that in 1999, 10% of US students surveyed admitted to this form of plagiarism, but by 2005 this was up to almost 40% – and “a majority of students (77%) believe[d] that such cheating is not a very serious issue” (Lang, 2008).

But there are other steps that lecturers can put in place to reduce the likelihood of students deliberately cheating with coursework – I’m focusing on plagiarism here, but of course taking notes into exams, or storing information in electronic devices also come under this heading – and I was reminded of some of these when reading Lang’s book.  (Incidentally, he gives some quite alarming statistics about the incidence of self-reported cheating by US students: some studies found up to 50% of students saying that they’d done this at least once in the previous year. And that includes Masters & PhD students.)

An obvious step is to use different assessment items each year. Sounds like a no-brainer, but I suspect that for many (all too many) papers the questions used in tests and exams don’t change much between years. But – especially if test papers are returned (& why shouldn’t they be? Don’t we want students to be able to see where they went wrong?) – word probably gets around fairly quickly. Lang tells the somewhat alarming tale of a college fraternity with a filing cabinet full of previous tests & assignments, for its members’ use… Which is why I write new questions for that essay assignment, every year, & try hard to vary test & exam questions as much as possible. It can be a bit fiddly but hey – at least I’m not reading the same answers to the same questions, over & over & over!

Lang also comments that having multiple assessment items can also work against the tendency to cheat. This is because it reduces the proportion of the grade hanging on any one assessment item, and hence the pressure to do really really well in that item by any means possible. Having different forms of assessment items also helps, as it gives students more than one means of demonstrating their skills & knowledge. (Hence these days we’re using theory tests, lab mastery tests, the essay, on-line self-paced tutorials, plus an exam.)

I found this comment interesting because I often hear that we ‘over-assess’ our students, & indeed, that may be so if we are simply assessing for assessment’s sake. But if – as it should be – the focus of assessment is guiding student learning, and students understand what we’re doing & why, then perhaps the ‘over-assessment’ argument loses some of its force.

James M. Lang (2008) On Course: a week-by-week guide to your first semester of college teaching. Harvard University Press. ISBN 978-0-674-02806-7

Blog at WordPress.com.