<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:10.0pt;
margin-left:.5in;
mso-add-space:auto;
line-height:115%;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
p.MsoListParagraphCxSpFirst, li.MsoListParagraphCxSpFirst, div.MsoListParagraphCxSpFirst
{mso-style-priority:34;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
line-height:115%;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
p.MsoListParagraphCxSpMiddle, li.MsoListParagraphCxSpMiddle, div.MsoListParagraphCxSpMiddle
{mso-style-priority:34;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
line-height:115%;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
p.MsoListParagraphCxSpLast, li.MsoListParagraphCxSpLast, div.MsoListParagraphCxSpLast
{mso-style-priority:34;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:10.0pt;
margin-left:.5in;
mso-add-space:auto;
line-height:115%;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle20
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1062409422;
mso-list-template-ids:-863339090;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:1.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:1.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:2.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:2.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:3.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:3.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:4.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:4.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal" align="center" style="text-align:center"><span style="font-size:16.0pt;font-family:"Calibri","sans-serif"">Call for Papers<o:p></o:p></span></p>
<p class="MsoNormal" align="center" style="text-align:center"><span style="font-family:"Calibri","sans-serif"">Spelling Alteration for Web Search Workshop<o:p></o:p></span></p>
<p class="MsoNormal" align="center" style="text-align:center"><span style="font-size:9.5pt;font-family:"Calibri","sans-serif"">July 19, 2011<o:p></o:p></span></p>
<p class="MsoNormal" align="center" style="text-align:center"><span style="font-size:9.5pt;font-family:"Calibri","sans-serif"">Bellevue, WA, USA</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p></o:p></span></p>
<p class="MsoNormal" align="center" style="text-align:center"><span style="font-size:9.0pt"><a href="http://spellerchallenge.com/Workshop.aspx">http://spellerchallenge.com/Workshop.aspx</a><span style="color:#1F497D"><o:p></o:p></span></span></p>
<p class="MsoNormal" align="center" style="text-align:center"><span style="font-size:9.0pt;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Calibri","sans-serif"">Paper Submission deadline: June 25, 2011</span><span style="font-size:16.0pt;font-family:"Calibri","sans-serif""><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoListParagraph" style="margin-left:0in;mso-add-space:auto"><span style="font-size:9.0pt;line-height:115%">In December 2010, Microsoft Research (MSR) and Bing jointly announced the first MSR-Bing challenge with the topic on web scale search query
spelling correction. The challenge required participants to submit their entries as publicly accessible web services that meet certain latency requirements so that all the participating systems can be studied and their effectiveness evaluated by any applicable
datasets. <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-bottom:13.5pt;background:white"><span style="font-size:9.0pt;font-family:"Calibri","sans-serif";color:#323223">We now invite the whole research community to submit papers to the upcoming Spelling Alteration for Web Search
Workshop, which will take place on July 19, in Bellevue, WA.<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-bottom:13.5pt;background:white"><span style="font-size:9.0pt;font-family:"Calibri","sans-serif";color:#323223">The Spelling Alteration for Web Search workshop addresses the challenges of web scale Natural Language Processing
with a focus on future research directions on spelling alteration for web search. The participants in the Speller Challenge (details at
</span><span style="font-family:"Calibri","sans-serif""><a href="http://www.spellerchallenge.com"><span style="font-size:9.0pt;color:#1166FF;text-decoration:none">http://www.spellerchallenge.com</span></a></span><span style="font-size:9.0pt;font-family:"Calibri","sans-serif";color:#323223">)
are also encouraged to participate to exchange ideas and share their experience with the rest of the research community.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Calibri","sans-serif";color:#323223">Although the workshop is not limited to the Speller Challenge participants, we encourage the on-demand evaluation web application and the referenced testing
dataset to be included in the system evaluation of the prospective workshop submissions so that different systems and approaches can be compared on the same benchmark. We also encourage the submitted systems be made publicly accessible throughout the workshop
to facilitate live demonstrations.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Calibri","sans-serif";color:#323223"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-bottom:13.5pt;background:white"><span style="font-size:9.5pt;font-family:"Calibri","sans-serif";color:#323223">Furthermore, the participants will be able to use the resources below to test new ideas against the published benchmarks
presented in the workshop. <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:44.25pt;text-indent:-.25in;line-height:115%;mso-list:l0 level1 lfo2;background:white">
<![if !supportLists]><span style="font-size:10.0pt;line-height:115%;font-family:Symbol;color:#323223"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><b><span style="font-size:9.5pt;line-height:115%;font-family:"Calibri","sans-serif";color:#323223">On-demand evaluation web application</span></b><span style="font-size:9.5pt;line-height:115%;font-family:"Calibri","sans-serif";color:#323223">:
The challenge makes available a web application that can be invoked on demand to evaluate a spelling correction system conforming to the web service interface defined by the challenge (published in
</span><span style="font-family:"Calibri","sans-serif""><a href="http://www.spellerchallenge.com"><span style="font-size:9.5pt;line-height:115%;color:#1166FF;text-decoration:none">http://www.spellerchallenge.com</span></a></span><span style="font-size:9.5pt;line-height:115%;font-family:"Calibri","sans-serif";color:#323223">).
The evaluation program utilizes a standard dataset comprised of search queries received by Bing in the EN-US market with manual annotation for typographical errors.<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:44.25pt;text-indent:-.25in;line-height:115%;mso-list:l0 level1 lfo2;background:white">
<![if !supportLists]><span style="font-size:10.0pt;line-height:115%;font-family:Symbol;color:#323223"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><b><span style="font-size:9.5pt;line-height:115%;font-family:"Calibri","sans-serif";color:#323223">Web scale multi-style language models and Contextual similarity dataset</span></b><span style="font-size:9.5pt;line-height:115%;font-family:"Calibri","sans-serif";color:#323223">:
two web services based on Bing’s web snapshots of June 2009 and April 2010 containing (1) the language models derived from web document body, the title, and the anchor text and (2) web document terms appearing in similar lexical contexts where many spelling
errors can be observed. <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:44.25pt;text-indent:-.25in;line-height:115%;mso-list:l0 level1 lfo2;background:white">
<![if !supportLists]><span style="font-size:10.0pt;line-height:115%;font-family:Symbol;color:#323223"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><b><span style="font-size:9.5pt;line-height:115%;font-family:"Calibri","sans-serif";color:#323223">Spelling correction development dataset</span></b><span style="font-size:9.5pt;line-height:115%;font-family:"Calibri","sans-serif";color:#323223">:
A query dataset based on TREC million-query track manually annotated with spelling corrections.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Calibri","sans-serif";color:#323223">If you are interested submit your paper here:
</span><span style="font-family:"Calibri","sans-serif""><a href="https://cmt.research.microsoft.com/SC2011/Default.aspx"><span style="font-size:9.0pt">https://cmt.research.microsoft.com/SC2011/Default.aspx</span></a></span><span style="font-size:9.0pt;font-family:"Calibri","sans-serif";color:#323223">
</span><span style="font-size:8.0pt;font-family:"Calibri","sans-serif""><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>