IDC04 - Project-based Assessment: Interview with Dr. Kristin Shingler - podcast episode cover

IDC04 - Project-based Assessment: Interview with Dr. Kristin Shingler

Oct 09, 201924 min
--:--
--:--
Download Metacast podcast app
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episode description

Episode 4 of the ID Corner podcast. Interview with Dr. Kristin Shingler about her project-based approach to assessment. Music created with Udio.

Transcript

Welcome to Episode four of the ID Corner podcast, where we talk about everything teaching and learning. Over the summer, I had the opportunity to attend the International Forum on Active Learning Classrooms held at the University of Minnesota as a first time attender. It was an enriching time, learning about current practice and an opportunity to meet others passionate about active learning. One of the contacts I made put me

in contact with my guest for today. Dr. Christian Schindler was a teaching specialist at the University of Minnesota School of Dentistry. So, Kristen, can you please share for our listeners a little bit about your role in the School of Dentistry? Sure. So I started in the School of Dentistry about three and a half years ago as a postdoc at first, and I was researching

bacteriophage. And through that, I had the opportunity to start teaching in the microbiology and immunology courses, specifically doing the component of the immunology then and from there, it just sort of grew. And I'm at the point where I'm directing the microbiology and immunology course for the dental students, a similar course for the dental hygiene students. And I also directed biochemistry course for the dental students. So I teach quite a bit. Awesome. Thank

you. Can you specifically describe the the course for which the this activity that we're going to talk about is for? Yeah. So this this activity is a final project for the microbiology and immunology course for the dental students. And so the way I inherited the course was that it had four fifty point multiple choice exams and that was the grading system for it. So there's about one in and students in the class. It's a really

big class for what I'm used to. And so getting those assessments graded quickly with feedback was a concern. I'm not the biggest fan of multiple choice exams, particularly basing an entire score off of that. So the first thing I did was to integrate some podcast assignments into it for a couple of years, where students listen to some Radiolab podcasts and talked about how scientific

communication happened relating to topics. And from there I decided that projects and different assignments like that, where students could really think about the content and apply it to different situations that could be relevant to their profession gave me the biggest understanding of their understanding of the material is presenting. So I moved the assessments for the course to one fifty point exam and everything else is project based assessment. Wow. Wow, that's awesome. So

you've mentioned the assignment a little bit. Can you can you give us some detail about it? Yeah. So I found this paper several years ago in the Journal of Microbiology and Bilel Biology Education and A.M. publication where a professor had started having his students create murder scenes from an infection with a microorganism. And so students worked in groups to create these these murder scenes, essentially these homicide scenes, and design different clues to point to the

identity of the microorganism responsible. And then they went through and sort of solved all of these crime scenes. And I thought, wow, what a great way for students to be exposed to a wider variety of microorganisms. Get some practice comparing and contrasting features of bacteria and viruses and fungal pathogens as well as parasites, and to really hone in on some differential diagnosis skills that they need as practicing

clinicians, since my students are dentists. So I took that paper and used it as sort of a foundation to to design the final project or my course. OK, so so this assignment, as you've described it, really meets some of the the important course objectives that you've got for for your students. Yeah. And I think it's a useful and sort of fun, low stress way to really get to those higher levels of doing taxonomy during

assessment without. Creating some really intricate problem for students to solve or some long essay to write or something like that, and there can be a group component and an individual component as well. Awesome. Yeah. So I have kind of the next question I had was why this type of assignment, which I think you've kind of been answering. I mean, any time, any time you can bring fun into it. I think it's a it's a great thing. How how have

students received this assignment? Does the group project and I know from my experience, group projects are kind of like, I don't want to do a group project. So. So what's been your experience? Yeah. So I've only done it one year so far. Full disclosure, but it was much more successful than I anticipated, so that was really, really great. I actually only had one student comment negatively on the group aspect. So one person said group

projects are never a good idea. But that was the only negative feedback I got, which I was shocked. I expected a lot more pushback. One thing I did, I let the students choose their own groups. So I presented 11 different microorganisms that they could choose from. And the class was divided into two groups, worked on the same micro-organism and they could sign up then based on the five of us want to work together or hey, I'm really interested in this microorganism, who else is

interested in it? So the groups formed in both of those ways, sort of organically. We just used a live Google doc to do that. That was kind of fun watching students edit. Sure, sure. There are groups and things in real time. Would you do it the same way again? Just kind of let it happen organically? You know, I think I would because it

seemed to work. I haven't asked students if they preferred forming their group first and then picking a microbe or just sort of signing up for a microbe and seeing who else was interested in that. But that would be some interesting sort of feedback to get. And then another thing I did to to really make sure that the groups were functioning well together for the group portion because the group grade was worth about half of the project, was I incorporated self-evaluation

and peer evaluation into it. And I was really careful with the peer evaluation chunk. And I said, you know, you can earn up to five points and it's going to be an average of the scores you get from your other group members. And if your average score from the peer evaluations is under two point five, so essentially 50 percent, you don't get peer evaluation points. So I made it sort of your group members have to be satisfied, reasonably satisfied with your contributions to earn those

points. And everyone did earn them. But there was that range of evaluation points. So it just sort of up the stakes on you need to be involved in this component. Sure. And so that was five points out of their total score. Yeah. And I think. I can't actually remember off the top of my head, I believe the group component was worth 50. Yes, five points and then I think, yes, a total of 50

for the group. Yep. And then the the individual component where they actually went through and solved crime scenes was also worth fifty points. So you could earn half of the points for the entire project on your own, which is another way to sort of alleviate those groupware concerns. Yes. Yes. So this is in the context of the course. This

is a final project. What kinds of support or scaffolding did you provide the students before they get here, both in terms of the the activity, the content itself, but then also the peer to peer and group kind of dynamics, things like was it just here you go? Or so I made a document that sort of broke down. Here's a group component of this, and you earn your points in these ways. So the main component of earning points in the group project or the clues that you provided in your

crime scene. So sort of building out the crime scene for your classmates to solve the self and peer evaluation. And then you also had to provide the rest of the class with the information to solve the crime scene. Right. So you made the groups made a little ID card that had things like symptomology of the organism, whether it's a bacteria or virus, it's gram positive, gram

negative. Those types of informations, epidemiology, any vector associated with it, the sort of critical pieces of knowledge and then a sort of a fun, creative bit, I had them create a mug shot for their their perpetrator, if you will, as well. So there was very clear point values associated with all of those. And I tried to provide a clear description about what you needed to do to get to those point values and have an independent part was a little easier because it's

it's solving the crime scene. Right. You identify what the microorganism is that caused that crime scene and then give me a treatment option that's available in one way that that could have been prevented. So to bring in the treatment and prevention and I also showed them an example. So when we talked about it in class, I went, for an example, crime scene with them so they could have a general idea of what other people had done. Awesome. Awesome. What have you learned about

student learning through this activity? So in general, I'm still working on that, I guess is the best answer. I've actually started to do some research on this. I just got the IRB approval for an exemption for education related material. And I'm looking at the way this can these sorts of projects can impact student retention of the

general principles of microbiology. So because I've taught this course before without the project, I have control groups sort of one year post class, two years post class, and I just give them a short term question, multiple choice quiz about what I think our main concepts that I would like them to know long term. And then I'll do that with the groups that have done the crime scene project as a final project as well to see if it is enhancing their retention of the material. That sounds

really exciting. Yeah, on a lesser scale, just sort of the comments from the course were pretty positive. A lot of students said that it was a fun way to learn. They said that they liked seeing how creative their classmates were, particularly when they're in other rigorous, structured science courses. That doesn't that maybe don't give the outlet for creativity as much. So it gives them more of a glimpse into their classmates,

personalities and interests. And I had a few comments that said you should keep this around this group. So that was nice. Very cool. And I guess the last question that I've got for you related to this is, is there anything that you would change? So you've done this once. Yeah. Is there anything that you would change about the assignment and why? Yeah, so I think I would shrink the group size No. One, so I had groups of four or five this time. And one comment that I got

from a student would kind of stuck with me. They said, you know, with a group of five, we each sort of picked a certain aspect of this microorganism to research and tackle. And I didn't really feel like I learned much about the microbe as a whole. And so I think that limiting the group size, you would get more of an overview because you'd be more in tune with different components of it. And it would also give me the opportunity to increase the number of microorganisms in the project itself.

So we had 11 last year, which was a decent number, but I'd like to get in more that have more closely related symptomology so it can be a little bit more difficult to discern them. You have to pay attention to a little bit more. And I also wish that students incorporated more sort of diagnostic tests into their clues. So I was hoping for here's a picture of a gel from a PCR reaction or something along those lines. So I was thinking

about scaffolding. I want this many clues about symptoms, a maximum of this, many clues about epidemiology to really make it have more aspects of the disease represented in the crime scenes. So those are the sort of two things that I am working on refining a little bit. That sounds very cool. And I think as you're describing it, the the

changes one will make the the exercise more. I mean, you mentioned more difficult, but at the same time hopefully provide a greater opportunity for the students to learn more detailed information. So thank you for sharing that. One thing that you mentioned earlier that kind of piqued my interest also is that you said you mentioned that you've done podcasting and I don't

have any scripted questions about that. But I would be interested to hear how when I think about biology, immunology and podcasts, that they're not two things that I would immediately put together. And so that that sounds very interesting to me. Can you share a little bit about that? Sure. So I have always been a fan of the Radiolab podcast. I think that they're very interesting and they're presented really well in an engaging way. And a lot of the topics of their podcasts have to do

with microorganisms. I talk about in microbiology concepts. I talk about in microbiology and immunology. So the way that those assignments work is I pick five different Radiolab podcasts that relate to content we're talking about in class, and students have to pick two out of the five to listen to throughout the semester. And so they have a little bit of control to pick information

that's most interesting to them. Or I think a lot of times it might boil down to I don't have a lot else going on this week because they can get sort of swamped with exams. But that's that's fine, too. And what they do is they listen to it. And then I ask them to write just a short one to two page response to me about how did this podcast relate to content we covered in class? What did you like about how these scientific concepts were presented?

Did you think that the podcast did a good job talking to a broad audience about these concepts? So so people who might not have a strong biology background or other type of scientific background, and how do you envision using these sorts of communication methods with your patients in the future? So how can you use this as a springboard for talking about scientific concepts with your patient? Was maybe an accountant or an electrician? OK, very cool. Have you ever so you're having the

students evaluate the podcasts? Yeah. OK, have you considered having them create podcasts? I have. Um, and so right now I don't have an assignment where students specifically have to create a podcast in the biochemistry course I direct their final project is to choose a disease that affects the sort of craniofacial region and explain the biological basis of that disease and its diagnosis

and treatment to. A patient in a way that most patients can understand, and I let the medium of that wide open, so I have had students submit podcasts to me through that assignment and they're just always really fantastic. They made them really quirky or sort of funny things. Some of them even pick their own introduction music. I had one student who interviewed his brother as a guest

on the podcast for his final assignment. So those are those go well, I just haven't dreamed up a project yet where the only podcast should be submitted. Sure, sure. How have you thought about and how do you go about assessing? So if there's if there's an option for a podcast or whatever, how does how does the assessment of that differ from an exam or a paper or how have you have you worked that into into that. Right. So for that particular project, everyone is submitting some

sort of information piece. So I have had everything from the podcast to children's books to pamphlets you would pick up at a doctor's office to a recorded PowerPoint presentation. Someone did a YouTube video. And so I try and take the creativity out of it as much as possible because those sorts of projects always intimidated me when I was in school. I don't think of myself as a particularly creative person. I have like zero

drawing abilities. So what I do is I make really detailed rubrics about this is what I want you to tell me about the biological basis of the disease. This is what I want you to tell me about the treatment of the disease. This is what I want you to tell me about the diagnosis. And so the point values are for the science itself, for people that like sound information and then appoint value for. Did you communicate this to a broad audience?

Right. So if you're trying to talk to a kid about cavities, is this accessible for someone who's 10 years old or if you're trying to talk about oropharyngeal cancer or are you talking to someone who's an electrician in a way that they understand and don't feel overwhelmed about it? So the medium is is left to the students to show their creativity and they're not judged or graded on

that component. Awesome. Thank you. You really highlighted how the objectives, the the things that you want the students to demonstrate really are key and that the the medium isn't as important in that in the or. Exactly. And that can, I think, increase the fun of the project and decrease the

stress as well. And that's a big thing that I want to do, is allow students to communicate to me how they've learned and progressed throughout the semester in a way that they're comfortable with because most people just aren't comfortable with exams. Right. They're high stress environments. So if you can do it in a fun way, why not? And there's one agreed. It is not a catalogue or a stack of. Yeah, just scantron sheets or whatever. Right. It's really get a sense of the personality

of each student. And I feel more connected to my classes after these projects. I think that would resonate with a lot of a lot of people. You know, we're we're always talking about sense of belonging and student engagement and retention and all of those things. But I think what it comes down to is that that connection between the instructor and the student, you hit the nail on the head. So thank you. Of course. Well, I really want to thank you for your time and your

willingness to be interviewed. And it was awesome to be able to talk with you today. So we're going to take a quick break and then I'll be right back to share some closing thoughts about the interview. Welcome back. I think that there are three key ideas that we can take away from Kristen's example. First, learning objectives are key. All of the work that students did was informed by the learning goals that Christine set for her class.

Christine had a clear idea about the skills she wanted the students to develop and then identified an activity to meet those goals. Second, the medium doesn't matter. The creative media forms that students use to complete projects were secondary to the objectives and skills that the students were working toward. Not requiring a specific format or medium provides choice for the students in representing what they know. Lastly, the option for creativity benefited both student

and teacher. The students were able to participate in a fun activity. They were able to bring more of their authentic selves into the project. The creativity also benefited the teacher in not having to grade lengthy papers or exams. I hope that this interview has inspired you to consider a project based approach in your teaching. I hope to have Christian back in the future to discuss the results of her research on the effects of her

project based approach. My guess is that her students will retain the information better through the project versus exams. Thank you for listening. If you do not already, please subscribe to the podcast. The Corner podcast is available on Apple podcast, Google Play podcast and Spotify notes. Resources and episode transcripts are also available on my blog at staff Lawrence Dunedoo. Rex Jay, have a great day.

Transcript source: Provided by creator in RSS feed: download file
For the best experience, listen in Metacast app for iOS or Android