{"id":676,"date":"2019-04-04T15:36:03","date_gmt":"2019-04-04T13:36:03","guid":{"rendered":"https:\/\/wpethzprd.ethz.ch\/letblog\/?p=676"},"modified":"2020-12-09T10:15:53","modified_gmt":"2020-12-09T09:15:53","slug":"case-study-peer-review-food-chemistry-laboratory-writing-reports","status":"publish","type":"post","link":"https:\/\/blogs.ethz.ch\/letblog\/2019\/04\/04\/case-study-peer-review-food-chemistry-laboratory-writing-reports\/","title":{"rendered":"Case study \u2013 Peer Review Food Chemistry Laboratory \u2013 Writing reports"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"> <br>As part of a series of case studies, staff at LET sat down to have a  conversation with Prof. Laura Nystr\u00f6m and Dr. Melanie Erzinger from the Department of Health Sciences and Technology to discuss their food chemistry laboratory project. <\/p>\n\n\n\n<figure class=\"wp-block-image is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/03\/image.png\" alt=\"\" class=\"wp-image-682\" width=\"477\" height=\"269\" srcset=\"https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/03\/image.png 1906w, https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/03\/image-768x433.png 768w, https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/03\/image-600x338.png 600w, https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/03\/image-1600x900.png 1600w\" sizes=\"auto, (max-width: 477px) 100vw, 477px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><br><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>What\nis the project about?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We introduced a new way to write lab reports,\ncombined with a peer review method to foster collaboration and critical\nthinking skills among students. In the past students did not have clear\ncriteria as to what makes a good report. Assistants also needed too much time\nto read the reports and give repeated feedback. Thus we looked for a way to\nhelp assistants spend less time on the review process.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We transformed the format of our Food\nChemistry Laboratory Course (Food Science, BSc level, 4<sup>th<\/sup> semester)\nfrom a classical lecture format with lab exercises to a blended learning\nformat. With new videos, we can achieve better coverage of basic knowledge\n(i.e. security, handling of equipment).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>What\nmotivated you to initiate the project?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Student numbers have increased over the\npast 10 years and we have been losing too much time in covering basic knowledge\nrepeatedly. Using concept videos, students will be able to review key topics on\ntheir own. Overall, we also wanted to make the entire course more attractive. A\nkey intention was to develop student skills in report writing and improve\nreport quality.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>How\ndid you do it?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We defined additional, clear quality\ncriteria for a good report. During a first round students give each other\nfeedback, such that final review by teaching assistants and lecturer approval involve\nless effort. For each experiment, every student has to review another student\u2019s\nreport. In total, each reviews four reports over the semester.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Students don&#8217;t get a grade for the peer review (semester performance in the lab course is also ungraded). They have one week for each of the four peer reviews, and must complete each by the respective set deadline. They answer various questions related to the quality of the respective report (these involve five aspects plus overall feedback; see the annex at the end of this case study). Students do not \u201egrade\u201c the reports, but give feedback in their own words.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Assistants are aware of what is asked in\nthe reports and are therefore able to provide targeted and helpful feedback in\nthe lab which addresses the quality criteria for reports.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We provide the students with online material on how to write reports (short videos, documents etc.). Previously we had a short lecture with examples. Until now, however, we did not train them in conducting proper peer reviews. We have now realised that we need to do this (especially for Bachelor\u2019s degree students), and will include peer review training with the short lecture next year.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Did\nyou have the support you needed for the project? Is there additional support\nyou wish you had had to help you to achieve your goals?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We learned about a module inside our LMS for\nadministering the peer-review process (\u201eworkshop module\u201c in Moodle). It would\nhave been helpful to have had practical tips from others, but apparently not\nmany lecturers have used this tool. Although the general instructions were\nuseful, it took quite some time to learn all the aspects of the tool.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Please\ndescribe some of the key outcomes of the project.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Various things changed for the better. Students learned a lot by reading and reviewing the reports of their peers. They gained important input for their own reports. For many it was the first time they had had to give feedback in such a structured way. They also had to find a way to critique something in a good, constructive manner. Overall, students were introduced to a new way of critical thinking and took important first steps in this skill, which is important for their later careers.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We can say clearly that through the new\nreview method we were able to improve the quality of reports and reduce the\ntime needed by lecturers to grade them.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>How\ndid the project impact learners or the way in which you teach?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In general the peer review method was well received in the BSc course, and we used the same approach in an MSc-level course. We therefore realised that Bachelor\u2019s degree students need more help and training in peer review than Master\u2019s students.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Overall we saw that the blended learning\napproach and the peer review methods work to improve our courses, addressing\nthe above-mentioned challenges of lack of student preparation and the need to\nconstantly repeat basic knowledge. Students themselves clearly realised the\nvalue and potential of better collaboration, peer feedback and critical\nthinking skills.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>What\nlessons learned do you want to share with your colleagues?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Not every cohort is the same. While things worked quite well in 2017, in 2018 fewer students adhered to the schedule and deadlines \u2013 even though everything was communicated and documented in the same way as in the previous year. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>What\nare your future plans for this work? How do you plan to sustain what you have\ncreated through the project?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">More and more assistants will become competent in providing full reviews of the already peer-reviewed reports. Currently lecturers still have to do this. Lecturers will thus gain more time to be present in the labs and to give 1:1 feedback to students in the lab and online. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We will definitely create some training\nmaterial for assistants for this purpose, but it is not available yet. We also want\nto create a short, ready-to-use document about giving feedback in our specific\ncontext: what is constructive feedback, what are the do\u2019s and don\u2019ts? Students,\nassistants and fellow instructors can use it.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We are interested in learning whether other\nlab courses at ETH do something similar, and how. We also need to improve the\nsupport situation with the Moodle review tool \u201eworkshop module\u201c. We will\ncontinue to work with it, but it is a bit tricky sometimes. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">One additional idea is to make the videos\ninteractive. Students will see in-built questions in the videos which they have\nto answer right away.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Additional\nnotes regarding resources and tools used.<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>We used a programme called Labster to create virtual labs in some cases to extend the experience to experiments which were not doable in reality in our labs. <\/li><li>We learned from other courses and departments regarding effective feedback (ETH \u201eFoundations of Teaching and Learning\u201c course).<\/li><li>To conduct the peer review we work with the \u201eworkshop module\u201c in Moodle.<\/li><li>To make the videos interactive we will work with the new Moodle \u201einteractive video suite\u201c plugin.<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Student voices: <\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>What is your opinion about this course and the peer review\nprocess (lab reports). How has it influenced your learning process?<\/strong><\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"alignleft is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/04\/robert-spiess.png\" alt=\"\" class=\"wp-image-688\" width=\"82\" height=\"106\" srcset=\"https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/04\/robert-spiess.png 681w, https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/04\/robert-spiess-600x775.png 600w\" sizes=\"auto, (max-width: 82px) 100vw, 82px\" \/><\/figure><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Robert Spiess<\/strong>: <em>I think peer-reviewing was a great way to see other students&#8217; work. It gave me the opportunity to experience and compare different ways of writing. I could always detect things that I wanted to include in my reports. At the same time, I could see in which points my reports were better, where my advantages were.<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>I think this procedure is particularly useful when writing.\nBut the reports should not be too long, because, otherwise, students have to\nspend too much time on their own report and neglect, as a consequence, the\npeer-reviewing of someone else&#8217;s report. Other courses usually required longer\nreports. But if the reports were shortened, the method could also be applied in\nother laboratory courses (such as in the food processing or in the\nbiotechnology lab course).<\/em><\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"alignleft is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/04\/ne_candrian.png\" alt=\"\" class=\"wp-image-689\" width=\"68\" height=\"88\" srcset=\"https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/04\/ne_candrian.png 1603w, https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/04\/ne_candrian-768x1002.png 768w, https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/04\/ne_candrian-600x783.png 600w\" sizes=\"auto, (max-width: 68px) 100vw, 68px\" \/><\/figure><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong><em>Aline Candrian: <\/em><\/strong><em>I&#8217;m glad I did the course, I think it gives students a first impression of laboratory work. The lab report writing is an essential part of the course to understand the experiment and the obtained data. The peer review approach was fine, even though nobody was eager to do them. VERY little time was invested into peer review by most groups, as far as I&#8217;m concerned. Of course, sometimes you could benefit from your peer&#8217;s feedback but most of the times we didn&#8217;t act on them. That&#8217;s probably because it was our first time writing (semi-) real reports. We didn&#8217;t really know what we were doing and you mostly think you know better than others, especially if someone reviewed your report who you rate less familiar with chemistry. <\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>At the same time you&#8217;re well aware that you know nothing\nabout report writing, so how can you evaluate someone else&#8217;s work? <\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Additionally, motivation was minimal since you were just\nglad to be done with writing your report. Having to assess another report and\nthen correct your own report again was just another &#8216;burden&#8217;. So, altogether, I\nwould say report-writing was a crucial part of the course but peer review not\nso much since we had no experience at all. I think peer review makes more sense\nin the courses in our last semester. <\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Making the students just do a peer review on the last report\nmight work. They&#8217;ll see how it works, they&#8217;ll have had written a few reports\n(and got more familiar with it) and might be more confident in providing\nfeedback. But I&#8217;m not an expert, it may not work the way I envision it, what do\nI know \ud83d\ude42<\/em><\/p>\n\n\n\n<figure class=\"wp-block-image is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/03\/peer-review-erzinger.png\" alt=\"\" class=\"wp-image-680\" width=\"619\" height=\"360\" srcset=\"https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/03\/peer-review-erzinger.png 1238w, https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/03\/peer-review-erzinger-768x447.png 768w, https:\/\/blogs.ethz.ch\/letblog\/files\/2019\/03\/peer-review-erzinger-600x349.png 600w\" sizes=\"auto, (max-width: 619px) 100vw, 619px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>As part of a series of case studies, staff at LET sat down to have a conversation with Prof. Laura Nystr\u00f6m and Dr. Melanie Erzinger from the Department of Health [&hellip;]<\/p>\n","protected":false},"author":43547,"featured_media":682,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_s2mail":"yes","footnotes":""},"categories":[249626],"tags":[250041,65543,250067],"class_list":["post-676","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-featuring-teaching","tag-case-studies","tag-innovative-teaching","tag-peer-review"],"_links":{"self":[{"href":"https:\/\/blogs.ethz.ch\/letblog\/wp-json\/wp\/v2\/posts\/676","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ethz.ch\/letblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ethz.ch\/letblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ethz.ch\/letblog\/wp-json\/wp\/v2\/users\/43547"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ethz.ch\/letblog\/wp-json\/wp\/v2\/comments?post=676"}],"version-history":[{"count":0,"href":"https:\/\/blogs.ethz.ch\/letblog\/wp-json\/wp\/v2\/posts\/676\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.ethz.ch\/letblog\/wp-json\/wp\/v2\/media\/682"}],"wp:attachment":[{"href":"https:\/\/blogs.ethz.ch\/letblog\/wp-json\/wp\/v2\/media?parent=676"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ethz.ch\/letblog\/wp-json\/wp\/v2\/categories?post=676"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ethz.ch\/letblog\/wp-json\/wp\/v2\/tags?post=676"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}