<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">On 7/16/2013 2:43 AM, Adam Kilgarriff
wrote:<br>
</div>
<blockquote
cite="mid:CAN8EOBqzLkwC+cZz=9ugsLxbcYUDhV+FkrR6dvBSoHhFEWeM6Q@mail.gmail.com"
type="cite">For either automatic WSD, or even for the gold
standard, I agree entirely with John:
<div><br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">Miss
Elliott, my high-school English teacher, wouldn't give<br>
anyone a gold star [for work like that]</blockquote>
<br>
</blockquote>
<br>
Well, now hang on a minute.<br>
<br>
First of all, how unambiguous were these, originally? Real
language is full of ambiguous uses. I'm surprised that the experts
can even agree 95% of the time, and I'd guess that part of their
expert training was aimed at exaggerating that agreement to satisfy
brittle models that weren't built to handle persistent ambiguity.<br>
<br>
Second, if the human experts didn't even agree, why would Miss
Elliott expect her students to do any better? What kind of a sadist
was she?<br>
<br>
<pre class="moz-signature" cols="72">--
-Angus B. Grieve-Smith
<a class="moz-txt-link-abbreviated" href="mailto:grvsmth@panix.com">grvsmth@panix.com</a>
</pre>
</body>
</html>