<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=ISO-8859-1">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space;
-webkit-line-break: after-white-space; " bgcolor="#FFFFFF"
text="#000000">
<br>
<div>
<div>
<div bgcolor="#FFFFFF" text="#000000">
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><big mce_style="margin: 0px; padding:
0px; border: 0px; vertical-align: baseline; color:
#222222; font-family: Arial, Helvetica, sans-serif;
line-height: normal;" style="border: 0px none ; margin:
0px; padding: 0px; vertical-align: baseline; color:
rgb(34, 34, 34); font-family: Arial,Helvetica,sans-serif;
line-height: normal;"><strong> </strong><strong>Call for
participation and trial data release</strong><strong><br>
</strong><strong><br>
</strong></big></p>
<div align="center"><span mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;"></span></div>
<div align="center"><big mce_style="margin: 0px; padding: 0px;
border: 0px; vertical-align: baseline;" style="border: 0px
none ; margin: 0px; padding: 0px; vertical-align:
baseline;"><strong>Semantic
Textual Similarity (STS)</strong><strong></strong></big><br>
<big mce_style="margin: 0px; padding: 0px; border: 0px;
vertical-align: baseline;" style="border: 0px none ;
margin: 0px; padding: 0px; vertical-align: baseline;"><strong></strong></big><strong><br>
NOW *SEM
2013 SHARED TASK</strong><br>
<b>TRIAL DATA JUST RELEASED</b><br>
<br>
<a href="http://ixa2.si.ehu.es/sts"
mce_href="../undefined/sts" target="_blank"
mce_style="margin: 0px; padding: 0px; border: 0px;
vertical-align: baseline; color: #6611cc; cursor:
pointer;" style="border: 0px none ; margin: 0px; padding:
0px; color: rgb(102, 17, 204); font-weight: normal;
vertical-align: baseline; cursor: pointer;">http://ixa2.si.ehu.es/sts</a><br>
<a href="http://groups.google.com/group/STS-semeval"
mce_href="http://groups.google.com/group/STS-semeval"
target="_blank" mce_style="margin: 0px; padding: 0px;
border: 0px; vertical-align: baseline; color: #6611cc;
cursor: pointer;" style="border: 0px none ; margin: 0px;
padding: 0px; color: rgb(102, 17, 204); font-weight:
normal; vertical-align: baseline; cursor: pointer;">http://groups.google.com/group/STS-semeval</a></div>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><br mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">
<span mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">We are delighted to announce that STS was
selected by the <b><a
href="http://clic2.cimec.unitn.it/starsem2013/">*SEM
conference</a></b> as the<b> <a
href="http://www.aclweb.org/portal/content/sem-shared-task-2013">2013
shared task</a></b>. <br>
</span></p>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><span mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">Following the success of the 2012
task on STS (</span><a
href="http://ixa2.si.ehu.es/starsem/proc/pdf/STARSEM-SEMEVAL051.pdf"
mce_href="../starsem/proc/pdf/STARSEM-SEMEVAL051.pdf"
target="_blank" mce_style="margin: 0px; padding: 0px;
border: 0px; vertical-align: baseline; color: #6611cc;
cursor: pointer; font-family: Arial, Helvetica,
sans-serif; font-size: 13px; line-height: normal;"
style="border: 0px none ; margin: 0px; padding: 0px;
color: rgb(102, 17, 204); font-weight: normal;
vertical-align: baseline; cursor: pointer; font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">Agirre et al. 2012</a><span mce_style="color:
#222222; font-family: Arial, Helvetica, sans-serif;
font-size: 13px; line-height: normal;" style="color:
rgb(34, 34, 34); font-family: Arial,Helvetica,sans-serif;
font-size: 13px; line-height: normal;">), with 35 teams
and 88 runs, we solicit participation in the second STS
task, which will held at *SEM 2013, co-located with <a
href="http://naacl2013.naacl.org/"
mce_href="http://naacl2013.naacl.org/" style="color:
rgb(27, 87, 177); font-weight: normal;">NAACL-2013</a><span
class="Apple-converted-space"> </span>conference in
Atlanta.</span></p>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><span mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">(Note that being selected as a
shared task caused some small changes in dates, see
below) </span></p>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><strong mce_style="margin: 0px; padding:
0px; border: 0px; vertical-align: baseline; color:
#222222; font-family: Arial, Helvetica, sans-serif;
font-size: 13px; line-height: normal;" style="border: 0px
none ; margin: 0px; padding: 0px; vertical-align:
baseline; color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">STS in 2013</strong><br mce_style="color:
#222222; font-family: Arial, Helvetica, sans-serif;
font-size: 13px; line-height: normal;" style="color:
rgb(34, 34, 34); font-family: Arial,Helvetica,sans-serif;
font-size: 13px; line-height: normal;">
<br mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">
<span mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">Participants will submit systems that examine the
degree of semantic equivalence between two sentences. The
goal of the STS task is to create a unified framework for
the evaluation of semantic textual similarity modules and
to characterize their impact on NLP applications. We
particularly encourage submissions from the lexical
semantics, summarization, machine translation evaluation
metric, and textual entailment communities.</span><br
mce_style="color: #222222; font-family: Arial, Helvetica,
sans-serif; font-size: 13px; line-height: normal;"
style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">
<br mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">
<span mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">The task will follow a similar design as the
SemEval pilot<span class="Apple-converted-space"> </span></span><a
href="http://www.cs.york.ac.uk/semeval-2012/task6/"
mce_href="http://www.cs.york.ac.uk/semeval-2012/task6/"
target="_blank" mce_style="margin: 0px; padding: 0px;
border: 0px; vertical-align: baseline; color: #6611cc;
cursor: pointer; font-family: Arial, Helvetica,
sans-serif; font-size: 13px; line-height: normal;"
style="border: 0px none ; margin: 0px; padding: 0px;
color: rgb(102, 17, 204); font-weight: normal;
vertical-align: baseline; cursor: pointer; font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">last year</a><span mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">, but instead of providing
train/test data from the same datasets, we will provide
all the 2012 data as training data, and the test data will
be drawn from related but different datasets. This setting
is more realistic, and the teams which prefer to
train/test on the same datasets can perform experiments
using the 2012 data.</span><br mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">
<br mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">
</p>
<p style="margin: 1em 0px; padding: 0px; color: rgb(51, 51,
51); font-family: Arial, Helvetica, sans-serif; font-size:
12px; font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height:
17.600000381469727px; orphans: 2; text-align: start;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 2; word-spacing: 0px; -webkit-text-size-adjust:
auto; -webkit-text-stroke-width: 0px; background-color:
rgb(242, 242, 242);"><span style="color: rgb(34, 34, 34);
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;">There will be two tasks this
year:</span></p>
<ul style="margin: 1em 0px; padding: 0px; list-style: none;
color: rgb(51, 51, 51); font-family: Arial, Helvetica,
sans-serif; font-size: 12px; font-style: normal;
font-variant: normal; font-weight: normal; letter-spacing:
normal; line-height: 17.600000381469727px; orphans: 2;
text-align: start; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
-webkit-text-size-adjust: auto; -webkit-text-stroke-width:
0px; background-color: rgb(242, 242, 242);">
<li style="padding-left: 30px; background-image:
url(http://ixa2.si.ehu.es/sts/templates/ja_purity/images/bullet.gif);
line-height: 21.600000381469727px; position: static;
z-index: auto; background-position: 18px 8px;
background-repeat: no-repeat no-repeat; "><span
style="font-family: Arial, Helvetica, sans-serif; color:
rgb(34, 34, 34);"><span style="font-size:
12.800000190734863px; line-height: normal;">The core
STS task</span></span></li>
<li style="padding-left: 30px; background-image:
url(http://ixa2.si.ehu.es/sts/templates/ja_purity/images/bullet.gif);
line-height: 21.600000381469727px; position: static;
z-index: auto; background-position: 18px 8px;
background-repeat: no-repeat no-repeat; "><span
style="font-family: Arial, Helvetica, sans-serif; color:
rgb(34, 34, 34);"><span style="font-size:
12.800000190734863px; line-height: normal;">A pilot
task on typed-similarity between semi-structured
records</span></span></li>
</ul>
<h2 style="font-family: 'Segoe UI', Arial, Helvetica,
sans-serif; font-size: 18.399999618530273px; margin: 1em
0px; padding: 0px; color: rgb(51, 51, 51); font-style:
normal; font-variant: normal; letter-spacing: normal;
line-height: 17.600000381469727px; orphans: 2; text-align:
start; text-indent: 0px; text-transform: none; white-space:
normal; widows: 2; word-spacing: 0px;
-webkit-text-size-adjust: auto; -webkit-text-stroke-width:
0px; background-color: rgb(242, 242, 242);"><span
style="color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;">Core task</span></h2>
<p style="margin: 1em 0px; padding: 0px; color: rgb(51, 51,
51); font-family: Arial, Helvetica, sans-serif; font-size:
12px; font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height:
17.600000381469727px; orphans: 2; text-align: start;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 2; word-spacing: 0px; -webkit-text-size-adjust:
auto; -webkit-text-stroke-width: 0px; background-color:
rgb(242, 242, 242); position: static; z-index: auto; "><span
style="color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;"></span><span style="color: rgb(34, 34, 34);
font-family: Arial, Helvetica, sans-serif; font-size:
12.800000190734863px; line-height: normal;">Given two
sentences, s1 and s2, participants will quantifiably
inform us on how similar s1 and s2 are, resulting in a
similarity score. Participants will also provide a
confidence score indicating their confidence level for the
result returned for each pair. The output of participant
systems will be compared to the manual scores, which range
from 5 (semantic equivalence) to 0 (no relation).</span></p>
<p style="margin: 1em 0px; padding: 0px; color: rgb(51, 51,
51); font-family: Arial, Helvetica, sans-serif; font-size:
12px; font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height:
17.600000381469727px; orphans: 2; text-align: start;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 2; word-spacing: 0px; -webkit-text-size-adjust:
auto; -webkit-text-stroke-width: 0px; background-color:
rgb(242, 242, 242);"><span style="font-family: Arial,
Helvetica, sans-serif; color: rgb(34, 34, 34);"><span
style="font-size: 12.800000190734863px; line-height:
normal;">The test data will include the following
datasets:</span></span></p>
<ul style="margin: 1em 0px; padding: 0px; list-style: none;
color: rgb(51, 51, 51); font-family: Arial, Helvetica,
sans-serif; font-size: 12px; font-style: normal;
font-variant: normal; font-weight: normal; letter-spacing:
normal; line-height: 17.600000381469727px; orphans: 2;
text-align: start; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
-webkit-text-size-adjust: auto; -webkit-text-stroke-width:
0px; background-color: rgb(242, 242, 242);">
<li style="padding-left: 30px; background-image:
url(http://ixa2.si.ehu.es/sts/templates/ja_purity/images/bullet.gif);
line-height: 21.600000381469727px; background-position:
18px 8px; background-repeat: no-repeat no-repeat;"><span
style="color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif; font-size: 12.800000190734863px;
line-height: normal;">Paraphrase sentence pairs</span></li>
<li style="padding-left: 30px; background-image:
url(http://ixa2.si.ehu.es/sts/templates/ja_purity/images/bullet.gif);
line-height: 21.600000381469727px; position: static;
z-index: auto; background-position: 18px 8px;
background-repeat: no-repeat no-repeat; "><span
style="font-size: 12.800000190734863px; line-height:
normal; color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif;">MT evaluation pairs including
those from HyTER graphs and GALE HTER data</span></li>
<li style="padding-left: 30px; background-image:
url(http://ixa2.si.ehu.es/sts/templates/ja_purity/images/bullet.gif);
line-height: 21.600000381469727px; position: static;
z-index: auto; background-position: 18px 8px;
background-repeat: no-repeat no-repeat; "><span
style="font-size: 12.800000190734863px; line-height:
normal; color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif;">Gloss pairs</span></li>
</ul>
<span style="font-size: 12.800000190734863px; line-height:
normal; color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif;">Please check <a
class="moz-txt-link-freetext"
href="http://ixa2.si.ehu.es/sts/data">http://ixa2.si.ehu.es/sts/data</a>
for the trial data and details on the core task.</span><br>
<span style="font-size: 12.800000190734863px; line-height:
normal; color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif;"> </span>
<h2 style="font-family: 'Segoe UI', Arial, Helvetica,
sans-serif; font-size: 18.399999618530273px; margin: 1em
0px; padding: 0px; color: rgb(51, 51, 51); font-style:
normal; font-variant: normal; letter-spacing: normal;
line-height: 17.600000381469727px; orphans: 2; text-align:
start; text-indent: 0px; text-transform: none; white-space:
normal; widows: 2; word-spacing: 0px;
-webkit-text-size-adjust: auto; -webkit-text-stroke-width:
0px; background-color: rgb(242, 242, 242);"><strong
style="color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif; font-size: 12.800000190734863px;
line-height: normal;">Pilot task on typed-similarity</strong></h2>
<p style="margin: 1em 0px; padding: 0px; color: rgb(51, 51,
51); font-family: Arial, Helvetica, sans-serif; font-size:
12px; font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height:
17.600000381469727px; orphans: 2; text-align: start;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 2; word-spacing: 0px; -webkit-text-size-adjust:
auto; -webkit-text-stroke-width: 0px; background-color:
rgb(242, 242, 242); position: static; z-index: auto; "><span
style="color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;">In addition we will hold a<span
class="Apple-converted-space"> </span><strong>pilot task
on typed-similarity</strong><span
class="Apple-converted-space"> </span>between
semi-structured records. The types of similarity to be
studied include location, author, people involved, time,
events or actions, subject, description.<span
class="Apple-converted-space"> </span></span><span
style="color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;">Please check<span class="Apple-converted-space"> </span></span><span
style="color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;"><a href="http://ixa2.si.ehu.es/sts/data"
target="_blank" style="color: rgb(102, 17, 204);
text-decoration: underline; margin: 0px; padding: 0px;
border: 0px; vertical-align: baseline; cursor: pointer;">http://ixa2.si.ehu.es/sts/data</a><span
class="Apple-converted-space"> </span>for the trial data
and details on this pilot task.</span></p>
<h2 style="font-family: 'Segoe UI', Arial, Helvetica,
sans-serif; font-size: 18.399999618530273px; margin: 1em
0px; padding: 0px; color: rgb(51, 51, 51); font-style:
normal; font-variant: normal; letter-spacing: normal;
line-height: 17.600000381469727px; orphans: 2; text-align:
start; text-indent: 0px; text-transform: none; white-space:
normal; widows: 2; word-spacing: 0px;
-webkit-text-size-adjust: auto; -webkit-text-stroke-width:
0px; background-color: rgb(242, 242, 242);"><strong
style="color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;">Evaluation</strong></h2>
<p style="margin: 1em 0px; padding: 0px; color: rgb(51, 51,
51); font-family: Arial, Helvetica, sans-serif; font-size:
12px; font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height:
17.600000381469727px; orphans: 2; text-align: start;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 2; word-spacing: 0px; -webkit-text-size-adjust:
auto; -webkit-text-stroke-width: 0px; background-color:
rgb(242, 242, 242); position: static; z-index: auto; "><span
style="color: rgb(34, 34, 34); font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;">After in-house theoretical and empirical
analysis, we have selected Pearson as the main evaluation
metric. The core task will be evaluated according to the
weighted mean across the evaluation datasets. The pilot
task will be evaluated according to the mean across the
several similarity types.</span></p>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><strong mce_style="margin: 0px; padding:
0px; border: 0px; vertical-align: baseline; color:
#222222; font-family: Arial, Helvetica, sans-serif;
font-size: 13px; line-height: normal;" style="border: 0px
none ; margin: 0px; padding: 0px; vertical-align:
baseline; color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">Open source pipeline for STS <br>
</strong></p>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><span style="border: 0px none ; margin:
0px; padding: 0px; vertical-align: baseline; color:
rgb(34, 34, 34); font-family: Arial,Helvetica,sans-serif;
font-size: 13px; line-height: normal;"><span style="color:
rgb(34, 34, 34); font-family: Arial, Helvetica,
sans-serif; font-size: 13px; line-height: normal;">An
open source pipeline for STS will be made available
shortly. Strong open-source baselines like DKPro can be
found in the STS wiki
<a class="moz-txt-link-freetext" href="http://www-nlp.stanford.edu/wiki/STS">http://www-nlp.stanford.edu/wiki/STS</a>.<br>
</span></span></p>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><span style="border: 0px none ; margin:
0px; padding: 0px; vertical-align: baseline; color:
rgb(34, 34, 34); font-family: Arial,Helvetica,sans-serif;
font-size: 13px; line-height: normal;"><span style="color:
rgb(34, 34, 34); font-family: Arial, Helvetica,
sans-serif; font-size: 13px; line-height: normal;"></span></span><strong
mce_style="margin: 0px; padding: 0px; border: 0px;
vertical-align: baseline; color: #222222; font-family:
Arial, Helvetica, sans-serif; font-size: 13px;
line-height: normal;" style="border: 0px none ; margin:
0px; padding: 0px; vertical-align: baseline; color:
rgb(34, 34, 34); font-family: Arial,Helvetica,sans-serif;
font-size: 13px; line-height: normal;">Important dates</strong></p>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><span mce_style="font-size:
12.800000190734863px; line-height: normal; color: #222222;
font-family: Arial, Helvetica, sans-serif;"
style="font-size: 12.8px; line-height: normal; color:
rgb(34, 34, 34); font-family: Arial,Helvetica,sans-serif;">Nov
11: Initial training dataset<br>
Jan 3: Trial dataset, with documentation and scorer<br>
</span><span mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 12.800000190734863px;
line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size:
12.8px; line-height: normal;">Jan 30: Training dataset for
typed similarity<br>
</span><span mce_style="font-family: Arial, Helvetica,
sans-serif; color: #222222;" style="font-family:
Arial,Helvetica,sans-serif; color: rgb(34, 34, 34);"><span
mce_style="font-size: 12.800000190734863px; line-height:
normal;" style="font-size: 12.8px; line-height: normal;">Feb
15: Registration for the task closes</span></span><br>
<span mce_style="font-size: 12.800000190734863px;
line-height: normal; color: #222222; font-family: Arial,
Helvetica, sans-serif;" style="font-size: 12.8px;
line-height: normal; color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif;">Mar 1: Start of evaluation
period<br>
Mar 15: End of evaluation period (23:59, UTC-11)</span></p>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><span mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">Apr 9: Paper due [TBC]<br>
</span><span mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">Apr 23: Reviews due [TBC]<br>
</span><span mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">May 4: Camera ready [TBC]</span></p>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"><strong mce_style="margin: 0px; padding:
0px; border: 0px; vertical-align: baseline; color:
#222222; font-family: Arial, Helvetica, sans-serif;
font-size: 13px; line-height: normal;" style="border: 0px
none ; margin: 0px; padding: 0px; vertical-align:
baseline; color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;"><br>
Contact</strong><br mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">
<br mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">
<span mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">Please use the following mailing list:<span
class="Apple-converted-space"> </span></span><strong
mce_style="margin: 0px; padding: 0px; border: 0px;
vertical-align: baseline; color: #222222; font-family:
Arial, Helvetica, sans-serif; font-size: 13px;
line-height: normal;" style="border: 0px none ; margin:
0px; padding: 0px; vertical-align: baseline; color:
rgb(34, 34, 34); font-family: Arial,Helvetica,sans-serif;
font-size: 13px; line-height: normal;">sts-semeval at
googlegroups com</strong><span mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">.<span class="Apple-converted-space"> </span></span><br
mce_style="color: #222222; font-family: Arial, Helvetica,
sans-serif; font-size: 13px; line-height: normal;"
style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">
</p>
<p style="color: rgb(51, 51, 51); font-family:
Tahoma,Helvetica,Arial,sans-serif; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: 15.8px;
orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px;"> <span mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">If interested in the task please
join the mailing list for updates<span
class="Apple-converted-space"> </span></span><a
href="http://groups.google.com/group/STS-semeval"
mce_href="http://groups.google.com/group/STS-semeval"
target="_blank" mce_style="margin: 0px; padding: 0px;
border: 0px; vertical-align: baseline; color: #6611cc;
cursor: pointer; font-family: Arial, Helvetica,
sans-serif; font-size: 13px; line-height: normal;"
style="border: 0px none ; margin: 0px; padding: 0px;
color: rgb(102, 17, 204); font-weight: normal;
vertical-align: baseline; cursor: pointer; font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">http://groups.google.com/group/STS-semeval</a><span
mce_style="color: #222222; font-family: Arial, Helvetica,
sans-serif; font-size: 13px; line-height: normal;"
style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">.</span><br mce_style="color: #222222;
font-family: Arial, Helvetica, sans-serif; font-size:
13px; line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">
<br mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">
<br mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">
<strong mce_style="margin: 0px; padding: 0px; border: 0px;
vertical-align: baseline; color: #222222; font-family:
Arial, Helvetica, sans-serif; font-size: 13px;
line-height: normal;" style="border: 0px none ; margin:
0px; padding: 0px; vertical-align: baseline; color:
rgb(34, 34, 34); font-family: Arial,Helvetica,sans-serif;
font-size: 13px; line-height: normal;">Organizers<br>
<br>
</strong><span mce_style="color: #222222; font-family:
Arial, Helvetica, sans-serif; font-size: 13px;
line-height: normal;" style="color: rgb(34, 34, 34);
font-family: Arial,Helvetica,sans-serif; font-size: 13px;
line-height: normal;">Eneko Agirre, University of the
Basque Country, Basque Country</span><br mce_style="color:
#222222; font-family: Arial, Helvetica, sans-serif;
font-size: 13px; line-height: normal;" style="color:
rgb(34, 34, 34); font-family: Arial,Helvetica,sans-serif;
font-size: 13px; line-height: normal;">
<span mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">Daniel Cer, Stanford University, USA</span><br
mce_style="color: #222222; font-family: Arial, Helvetica,
sans-serif; font-size: 13px; line-height: normal;"
style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">
<span mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">Mona Diab, Columbia University, USA</span><br
mce_style="color: #222222; font-family: Arial, Helvetica,
sans-serif; font-size: 13px; line-height: normal;"
style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">
<span mce_style="color: #222222; font-family: Arial,
Helvetica, sans-serif; font-size: 13px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 13px; line-height:
normal;">Aitor Gonzalez-Agirre, University of the Basque
Country, Basque Country<br>
Weiwei Guo,<span class="Apple-converted-space"> </span></span><span
mce_style="color: #222222; font-family: Arial, Helvetica,
sans-serif; font-size: 12.800000190734863px; line-height:
normal;" style="color: rgb(34, 34, 34); font-family:
Arial,Helvetica,sans-serif; font-size: 12.8px;
line-height: normal;">Columbia University, USA</span></p>
</div>
</div>
<br>
</div>
</body>
</html>