Reply To: Assessing the Assessors
I know it has been almost a year since your post, so I don’t even know if you still want a reply. If so, I would say that you should make them justify every rating/ranking they assign. That way you have clear evidence of their comprehension of the subject.
A Form & Analysis professor of mine in college “gave” me “F”s on, I think, 6 papers in a row. Perfect and always correct as I know I am, I approached her to inquire about this undoubted mistake. She said, “I understand what you are going for and I could possibly agree. However, you must justify your arguement. I shouldn’t have to guess. If you can justify your opinion, I know you understand the concepts I went over.”