Recording of today’s webinar:
Recording of today’s webinar (mainly about rubrics in Moodle):
Recording of today’s webinar:
Can anyone help? I’m doing a little bit of research on the use of assessment exemplars in universities. I’ve found examples of students work (essays, assignments etc) and plenty of journal articles but I’m looking for examples of university guidelines or policy on how these exemplars should be used.
Can you anyone send me some examples from their own university or college? Leave a comment below or tweet me @chri5rowell…Thanks!
Useful site – universities using exemplars.
- Using example essays. Sussex University http://www.sussex.ac.uk/skillshub/?id=282
- Case Study: Using Exemplar Assignments to Enhance Student Feedback. Warwick University https://warwick.ac.uk/fac/cross_fac/heahistory/research/feedback_project/case_studies/examplar_assignments_case_study.pdf
- Student Exemplars. University of Leicester. https://www2.le.ac.uk/departments/beyond-distance-research-alliance/projects/moose/deliverables/user-exemplars-1
- Examples of Reflective Assignments. University of Wolverhampton. https://www.wlv.ac.uk/about-us/internal-departments/the-college-of-learning-and-teaching-colt/pedagogic-research/wolverhampton-learning-and-teaching-projects/historians-reflect/tutor-pathway/examples-of-reflective-assignments/
- Exemplar Research proposals and Theses. University of South Australia. https://guides.library.unisa.edu.au/c.php?g=169999&p=1516345
‘Open’ Journal articles:
- Learning About the Quality of Work that Teachers Expect: Students’ Perceptions of Exemplar Marking Versus Teacher Explanation http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.1003.8513&rep=rep1&type=pdf
- No longer exempt from good practice: using exemplars to close the feedback gap for exams (2013) Jenny Scolesa, Mark Huxhamb and Jan McArthurc https://www.plymouth.ac.uk/uploads/production/document/path/2/2726/Exams_and_Feedback_.pdf
- Improving Student Performance in Interdisciplinary Law Unit Assessment by Providing Annotated Exemplars. David Newlyn and Liedel Spencer http://classic.austlii.edu.au/au/journals/JlALawTA/2010/8.pdf
- Making productive use of exemplars: Peer discussion and teacher guidance for positive transfer of strategies. Jessica To and David Carless. https://www.tandfonline.com/doi/full/10.1080/0309877X.2015.1014317?src=recsys
- From copying to learning: using exemplars to engage students with assessment criteria and feedback (2009) Karen Handley & Lindsay Williams https://www.tandfonline.com/doi/abs/10.1080/02602938.2011.646236
- Feed-forward assessment, exemplars and peer marking: evidence of efficacy. Kerry Wimshurst & Matthew Manning (2012) https://www.tandfonline.com/doi/abs/10.1080/02602930903201669
- From copying to learning: using exemplars to engage students with assessment criteria and feedback (2009) Karen Handley & Lindsay Williams https://www.tandfonline.com/doi/abs/10.1080/02602930903201669
- Implementing standards-based assessment effectively: incorporating discussion of exemplars into classroom teaching. (2012) Graham D. Hendry , Susan Armstrong & Nikki Bromberger. https://www.tandfonline.com/doi/abs/10.1080/02602938.2010.515014
- Mind the gap! Students’ use of exemplars and detailed rubrics as formative assessment. (2014) Anastasiya A. Lipnevich, Leigh N. McCallen, Katharine Pace Miles, Jeffrey K. Smith https://www.jstor.org/stable/43575435?seq=1#page_scan_tab_contents
- Providing Exemplars in the Learning Environment: the Case for and against. (2013) David Newlyn https://files.eric.ed.gov/fulltext/EJ1053990.pdf
- Students use of exemplars to support academic writing in higher education: An integrative review (2018) Rebekah Cartera,, Yenna Salamonsonb , Lucie M. Ramjanc , Elizabeth Halcombd https://www.ncbi.nlm.nih.gov/pubmed/29547812
- The Use of Exemplars and Formative Feedback when Using Student Derived Marking Criteria in Peer and Self-assessment (2002) Paul Orsmond , Stephen Merry & Kevin Reiling https://www.tandfonline.com/doi/abs/10.1080/0260293022000001337
- Intuition in Nursing Practice: Sharing Graduate Students’ Exemplars with Undergraduate Students. Beck, Cheryl Tatano. Journal of Nursing Education, 1998, Vol.37(4), p.169-72
- Constructive Guidance and Feedback for Learning: The Usefulness of Exemplars, Marking Sheets and Different Types of Feedback in a First Year Law Susan, Hendry, Graham D. ; Bromberger, Nikki ; Armstrong, Susan Assessment & Evaluation in Higher Education, 2011, Vol.36(1), p.1-11
- Empowering Learning: Using Student Exemplars in Teaching. Ho, Kong. Teaching Artist Journal, 2015, Vol.13(4), p.193-203
- Helping students understand the standards of work expected in an essay: using exemplars in mathematics pre-service education classes. Hendry, Graham D. ; Anderson, Judy. Assessment & Evaluation in Higher Education, 01 September 2013, Vol.38(6), p.754-768
- No longer exempt from good practice: using exemplars to close the feedback gap for exams Scoles, Jenny ; Huxham, Mark ; Mcarthur, Jan. Assessment & Evaluation in Higher Education, 01 September 2013, Vol.38(6), p.631-645
This is blog post I should have published ages ago…I intended to up date it but never got round to it, so it’s a bit underdeveloped. Myself and Isobel Bowditch ran an ABC Design workshop for all staff in the School of Law and Social Science here at lSBU. Originally developed at UCL they have provided a variety of great resources (with a Creative Commons licence).
On your table you should l find a set of resources:
blue and red pen, module info and graph sheet, learning activity cards, storyboard sheet, dots/stars , blue tack and action plan
1. Module info and graphs sheet activity (15 mins)
Describe your module: tweet size description of your module
Module shape (Learning types activities graph): distribution of learning types.
Blend: (blended graph)
2. Storyboard part 1 (20 mins)
Storyboard – learning types sequences and activities
existing module design
Add/change any learning types to what you want
3. Storyboard part 2 (20 mins)
Digital: Flip activity cards over and suggest digital alternatives to ‘traditional’ methods.
Assessment: identify formative and summative activities using stars/dots
Finalise: stick all elements down with blue tack.
4. Break/ Circulate (10 mins)
Have a look at other storyboards.
How different are they from yours?
Are there any ideas you’d like to adopt?
5. Module info and graph sheet (15mins)
Review original graph– what has changed? Why?
6. Action plan (20mins)
what next for team?
Evaluation of ABC Design Workshop – 20.6.18
At the end of the workshop we asked participants to answer 4 questions about the session. We had 30 completed evaluation sheets. I have selected some of the comments and provided a brief summary of the responses for each question.
Q1. Which aspects of the workshop did you find particularly useful?
‘Opportunity to reflect and share’, ‘Stimulated discussion with colleagues on all modules’, ‘Opportunity to reflect on module delivery and share experiences’, ‘I found the cards very helpful and offered lots of interesting new suggestions for how I can deliver modules I the future’, ‘Time to plan with colleagues’., ‘A chance to talk about teaching with our colleagues’.
Summary: Overall what everyone appreciated was an opportunity to reflect on the modules that they teach on. They felt that the ABC Design tasks gave them the time and space to talk about the planning of their modules and their students learning activities.
Q2. Where there any aspects of the workshop that you did not find helpful or that we should change?
‘It was not very advanced and some academics are already doing these’, ‘Found it a bit long and low level’, ‘More specific focus on the needs of experienced teachers (Perhaps a bit low level for some staff?), ‘The structure/model did not work for us. The artificial divide into 6 ‘learning activities’ did not help us’., ‘It assumed that we were not already doing blended learning. No reflection on problems using DEL – not all DEL is good.’
Summary: Some of participants thought the session was not ‘advanced’ enough and that there should have been more discussion about the critical aspects of using DEL.
Q3. Is there anything we could include in a future workshop that was not covered in the session?
‘Pedagogy of blended learning – research to support this approach?’, ‘More on specific digital technology methods’ , ‘What and how can technology achieve desired outcomes’, ‘More innovative techniques’, ‘Needed to know how you put the techniques into moodle. How you actually use these techniques in practice’, ‘Input from student voice would enrich a future session’, ‘Digital tools that students actually might use’, ‘More examples of successful digital resources’, ‘Universal design for learning’.
Summary: The overwhelming response to this question was that lecturers wanted more input on how to use the different types of learning technologies that are available to them.
Q4. Do you have any recommendations for other Academic Development Workshops that would be helpful to you and your colleagues?
‘Programme development model’, ‘Assessment and feedback’ , ‘Need to see some student feedback on these techniques to see what they actually feel is useful rather than us just assuming all digital learning is good and useful’, ‘Perspectives on the student experience’, ‘The main focus for LSBU needs to be how to get students to engage with considerably more academic literature in the modules in general and in their assignments in particular – virtually everything needs to be geared towards that as at present that is a pressing issue’, ‘Making Moodle work better for us’, ‘More practiced engagement with teaching tools’, ‘Moodle quizzes, Nearpod, Padlet etc’, ‘More attendance to tackling attendance and, above all, engagement where there are large numbers’.
Summary: It’s hard to summarise this section as there were so many different responses. But one theme that emerged again was an interest in the digital tools that could help lecturers in their teaching and learning activities.
Update: Many thanks for your donations £368 raised (plus £67 gift aid) !
I’m walking at Shine Night Walk in the fight to beat ovarian cancer in memory of Abby Kerr.
Ovarian cancer is the fifth most common cancer in UK women, with more than 130 women every week told that they have the disease. It is often not diagnosed until it has spread, making it harder to treat. Help Cancer Research UK find new ways to detect ovarian cancer earlier and find better treatments.
Please sponsor me by donating to Cancer Research UK https://fundraise.cancerresearchuk.org/page/chriss-giving-page-259
Lawrie Phipps and Donna Lanclos have developed a new digital tool so that people can reflect on their digital identity. Here are some of my initial thoughts about it.
What is the Digital Perceptions tool?
Lawrie outlines how the tool is based on The Johari Window in a recent blog post :
“What is the tool for? The tool is for reflecting on your digital identity, or how you are perceived by others online. It is not a diagnostic tool! It will not tell you what to fix. However, it might help you in planning how you to develop your identity in the future.”
The Digital Perceptions tool is now live and open to anyone to use. The first task is to select 5 or 6 words that describe your own digital identity. These words/phrases are then put into the Johari Window labeled ‘Facade’, although this window is kept private. Next you then send the link to the Johari Window that you have created, to 4 or 5 people you know. They in turn select the words or phrases that best suits your digital identity. Words that match your own appear in the ‘Arena’ window, those that don’t match yours appear in the ‘Blind Spot’ window.
Here is my digital identity, as mapped out using the Digital Perceptions tool:
How useful was it for me?
I think so. All the words I selected were also chosen by my ‘reviewers’; collaborates, authentic online, shares ideas, digitally fluent, creative, engages. So I guess its good to know that my perception of myself is matched by others. They in turn, added another 10 words or phrases – again I would agree that I do all of these too, at some point online. So in total it pretty much confirms what I think anyway.
One area that is omitted is the word ‘political’, which is included in the ‘Unknown’ window above. I was a little surprised by this as I thought I did Tweet quite a lot of political stuff. However, I also know it can be a contentious area so maybe I’m a bit more cautious than I thought I was regarding my political exchanges. Is this something I want to change? Probably yes!
How useful is it?
Firstly, it gives us feedback on our digital identity. We don’t get this is normal life, we use various digital tools but at no point do we actually get any feedback on the type of persona we are creating. We think we know what our image is but how true is it? And the crucial point is, if we don’t get feedback there is no reason to change. Once we get that feedback we can decide on the things that are agreeable/disagreeable and do we want to change them?
Secondly, using this tool gets us away from using frameworks or models that interpret our behaviour as simple binary opposites. Models such as, the Prensky’s digital natives/immigrants or the more recent Visitors/residents framework set out to give us a better understanding of our digital presence but often ends up oversimplifying or even encouraging us to adopt an ‘ideal’ type of digital behaviour. The major advantage of the Digital Perception tool is that it is not prescriptive, it really is aiming to be a reflective tool that is trying to capture some of the complex and non-linear ways that we interact in the online environment. Once the Johari Window has been completed it really opens up the possibility to enable the participant to reflect on their own identity and how and if they want to do anything about it.
Using the Digital Perceptions tool does require an element of safety and trust and I suppose my question is can we do this online? Are those reviewing likely to pick some of the words that might have some negative conigtations like ‘argumenative’ or ‘judgemental’. Maybe yes, as its anonymous but i’m not so sure.
I think the tool probably works best for those with the established digital identity and maybe not so well for the new starters. Its probably hard for those to complete who are new or not working much in digital environments. So maybe its not aimed at them, but maybe with some new words or phrases it could incorporate them too.
Apologies if I missed these somewhere but I went into using the DP tool without much thought and might have missed some of the information that was provided.
- More guidance on selecting who you send the window to. I think the instructions asks you to send the link to 4 or 5 people that you know. Crucially these people will shape the whole exercise. The people I sent them to were people I knew and had established face2face relationships with…maybe it would have been more useful to send the link to people I hadn’t met in person and knew just in an online capacity?
- Why am I doing this? Again, probably because I didn’t give it much thought I sent the link to my reviewers without much of an explanation. Maybe there could be sentance or two that summarises the tool, so that it could be copied and sent on to the ‘reviewers’ when they aske to complete it?.
- Space for open feedback. I havent fully thought this through but maybe it would be useful for those giving the feedback to choose their own wording (in addition to the words/phrases supplied). Although I can see this will be more difficult to code in the tool.
- Maybe some guidance is needed to interpret the results. This could take the form of some open-ended questions, such as, what did your reviewers agree with? Did the reviewers suggests new traits you had not thought about? etc
Anyway its a great new tool and I would definitely recommend it anyone to try it out. I certainly learnt a thing or two and can see the potential of getting others to use it too. Check it out!