<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 12 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Verdana","sans-serif";
color:blue;
font-weight:normal;
font-style:normal;
text-decoration:none none;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 2.0cm 2.0cm 2.0cm;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=IT link=blue vlink=purple style='word-wrap: break-word;-webkit-nbsp-mode: space;-webkit-line-break: after-white-space'><div class=WordSection1><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>CALL FOR PAPERS</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>CLEF 2011 Conference on Multilingual and Multimodal Information Access Evaluation</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>EXTENDED DEADLINE: 8 MAY 2011</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>************************************************************************************************************</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>CLEF2011 is the second CLEF conference continuing the popular CLEF campaigns. It will cover a broad range of issues in the fields of multilingual and multimodal information access evaluation. It will consist of two main parts: a peer-reviewed conference on research papers, and a series of labs, which will continue the CLEF tradition of community-based evaluation and discussion on evaluation issues.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>AIMS AND SCOPE</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>The CLEF2011 conference aims at advancing the evaluation of complex multimodal and multilingual information systems in order to support individuals, organizations, and communities who design, develop, employ, and improve such systems. The growth of the Internet has been exponential with respect to the number of users, media, and languages used regularly for global information dissemination. Language and media barriers are no longer seen as inviolable and they are constantly crossed and mixed to provide content that can be accessed on a global scale within a multicultural and multilingual setting.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>Users need to be able to co-operate and communicate across language and media boundaries, going beyond separate search in diverse media/languages and exploiting interactions between different languages and media.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>Experimental evaluation — both laboratory and interactive — is a key to fostering the development of multilingual and multimodal information systems that address increasingly complex information needs.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>We invite submissions for presentation at the CLEF2011 conference. We welcome submissions on all aspects of multilingual and multimodal information access evaluation. All submissions will be reviewed on the basis of relevance, originality, importance, and clarity.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>FORMAT</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>The conference proceedings will be published in the Springer Lecture Notes in Computer Science (LNCS) series.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>Authors are invited to submit electronically original papers, which have not been published and are not under consideration elsewhere, using the LNCS proceedings format. <a href="http://www.springer.com/computer/lncs?SGWID=0-164-7-72376-0">http://www.springer.com/computer/lncs?SGWID=0-164-7-72376-0</a></span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>Two types of papers are solicited:</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • full papers: 12 pages max;<br> • short papers: 6 pages max.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>Papers will be peer-reviewed by at least 3 members of the program committee. Papers should be submitted in PDF format to the following address:</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'><a href="http://senldogo0039.springer-sbm.com/CLEF2011/servlet/Conference/">http://senldogo0039.springer-sbm.com/CLEF2011/servlet/Conference/</a></span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>IMPORTANT DATES</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • May 8th, 2011 Submission deadline<br> • June 10th, 2011 Notification of acceptance<br> • June 17th, 2011 Camera ready versions<br> • September 19th-22nd, 2011 CLEF Conference</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>TOPICS</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>Relevant topics for the CLEF2010 conference include but are not limited to:</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Novel methodologies for the design of evaluation tasks, especially user-centric ones;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Analysis of the impact of multilingual/multicultural/multimodal differences in interface and search design;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Assessing multilinguality and multimodality in relevant application communities, e.g. digital libraries, intellectual property, medical, music, video, and social media;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Testing and evaluation of translation and summaries over documents and of linked documents in multilingual information retrieval;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Benefits of multilingual information retrieval methods for different user groups or in different use cases, including those relevant to the developing world;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Alternative methods for improving and automating ground-truth creation, for example crowd-sourcing or log-based;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Alternatives and comparison of item-based, list-based, set-based, and session-based evaluation;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Prediction of success and satisfaction rate;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Task-oriented metrics of success and failure;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Simulation (of queries, sessions, users) and information retrieval;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Innovative and easy to communicate techniques for analysing the experimental results, including statistical analyses, data mining, and information visualization;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Infrastructures for bringing automation and collaboration in the evaluation process;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Living laboratories and evaluating live systems;</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'> • Economic impact/sustainability of multilingual and multimodal information approaches, evaluation methodologies, and deployed systems.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'>ORGANIZATION</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto'><span style='font-size:10.0pt'><a href="http://clef2011.org/index.php?page=pages/organizers.html">http://clef2011.org/index.php?page=pages/organizers.html</a></span><o:p></o:p></p><div><p class=MsoNormal><span lang=EN-GB> </span><o:p></o:p></p></div></div></body></html>