How not to judge: Part 1

doorMascha Bloemer

How not to judge: Part 1

By Srdjan Miletic

Over the past six months I’ve heard regular complaints about the quality of judging on the Dutch circuit. This isn’t to say that the quality of judging is bad, just that it could be better.This article contains a few choice issues people have come to me with and how they should be resolved.

How to judge

http://e1o2.blogspot.nl/2015/01/how-to-judge-unpacking-persuasiveness.html

How not to judge
1.Judging based on “What’s left standing”

The Problem: Judging teams based on what arguments remain unrebutted at the end of a debate is unfair. The problem with this approach is that a team with stronger argumentation may lose to a weaker team due to their opponents choosing to focus on rebutting their arguments. For example, 1st Prop may lose to 2nd Prop despite bringing stronger argumentation simply because Opp chose to focus on rebutting closings arguments, leaving less of them standing at the end. This is arbitrary, unrelated to a team’s actions and hence unfair. Also, it is strange that a team which brings worse arguments can win over a team with better arguments.

The Solution: Judge by allocating credit for bringing and attacking arguments. Do not remove credit from a team if their argument happens to be rebutted

2: Giving imprecise feedback

The Problem: As a judge, your call should clearly explain which team won and why. Talking about this in terms of who brought more “analysis” or “engagement” is likely to be too abstract to be useful. It makes it difficult for teams to understand why they won or lost and hence how to improve. It also encourages sloppy thinking and bad calls as a poorly explained call is difficult for teams to scrutinize or argue against.

The Solution: When giving feedback go through the teams either chronologically or, preferably, from first to last. For each team clearly explain what arguments you believe they brought and which of their opponents arguments they successfully rebutted. Explain how persuasive you find each argument and rebuttal, justifying this from the perspective of the average informed voter, and hence how persuasive you find their team as a whole. Then explain why they were more or less persuasive than the team ahead of them by comparing arguments. For example:

Bad judge: Second proposition wins because their analysis and impacting was better than second oppositions.

Intermediate judge: Second proposition wins because their analysis shows that an invasion would lead to less atrocities than a bombing campaign and I care more about atrocities than the terrorist attacks second opposition talked about.

Good judge: Second proposition convinced me that an invasion of Syria would lead to a faster victory than a bombing campaign and hence a shorter war and less deaths from ISIS atrocities. That wins over second opposition whose point on another invasion hurting the image of the US and hence encouraging terrorist attacks, while plausible, seems to me to be less important than preventing atrocities which I, as the average voter, assume would kill a far greater number of people.

3: Judging extensively analyzed or sophisticated arguments as persuasive

The Problem: .Just because an argument has a great deal of analysis and that analysis is complex does not mean that it is persuasive. An argument is persuasive insofar as an average person would see it as true and important. If incredibly complex analysis does not make an argument very plausible or important, it is not a persuasive argument.

The Solution: The amount of analysis an argument has doesn’t matter! What matters is the extent to which that analysis would convince the average informed voter that the argument is true and important. Never be tempted to give an argument greater weight just because there was more reasoning or argumentation behind it.

4: Judging a team as off-clash because they choose a different burden from other teams

The Problem: Just because three teams in a debate choose to focus on one type of argumentation or one burden does not mean that a team which chooses a different burden or area is in any way doing something wrong or failing to engage. For example, in the debate “THW organize simultaneous in or out referenda in all EU member state”, say three teams in a debate have focused on why referendums and the EU are good or bad and the fourth chooses to focus on why, if held, referendum should not be simultaneous. As prop has to show that there should be referendums and that they should be simultaneous, this team is on-clash and should not be penalized in any way for choosing a different burden.

(Note: The above motion is taken from Rotterdam Open 2015 but the example itself, while somewhat based on, is not intended to represent the debate I was in. In that debate, while I do believe that the call could have been better explained, I do not believe that it was unfair or that it was necessarily based on the above reasoning. TL:DR: No offense intended, it’s just an example)

The Solution: A team is on clash as long as their arguments are both true and important as reasons for doing or not doing the motion. The fact that they choose a different direction from other teams in the debate does not make their reasoning and more or less persuasive.

Facebook Twitter Linkedin Email
No TweetBacks yet. (Be the first to Tweet this post)

Over de auteur

Mascha Bloemer subscriber