[Corpora-List] Alias Detection Dataset

Wed Oct 8 07:35:58 UTC 2014

Dear Ayah,

To my understanding, you are looking for a corpus that has been annotated for entity co-reference. We don’t have that, unfortunately. However, we hope that a future release of JRC-Names will include title information, which will allow you to recognise that ‘David Cameron’, ‘Conservative Party Leader’ and ‘British Prime Minister’ refer to the same entity. The type of data has been described in the following paper by my colleague Josef:

Steinberger Josef, Jenya Belyaeva, Jonathan Crawley, Leonida Della Rocca, Mohamed Ebrahim, Maud Ehrmann, Mijail Kabadjov, Ralf Steinberger & Erik van der Goot (2011).  <http://langtech.jrc.ec.europa.eu/Documents/11_RANLP_Coref-resolution_Steinberger-J-et-al.pdf> Highly Multilingual Coreference Resolution Exploiting a Mature Entity Repository. (RANLP'2011)

All the best,

Ralf 

From: Ayah Zirikly [mailto:aya.zerikly at gmail.com] 
Sent: 08 October 2014 04:43
To: Ralf Steinberger
Cc: corpora at uib.no
Subject: Re: [Corpora-List] Alias Detection Dataset

Dear Ralf,

Thank you very much for providing info regarding JRC-Named. It is actually very helpful in the Named Transliteration task and can be used as extra feature in my system. However what I am looking for is the following:

assuming we have:

John Smith went to school.

Peter loves school. 

We are trying to check if John Smith and Peter represent the same named entity or no. 

The idea dataset will be annotated the following:

<e1>John Smith</e1> went to school. 

<e1>Peter</e1> loves school.

<e2>Anna</e2> always comes late to classes unlike <e1>Peter</e1>.

Thanks again and I appreciate the help,

Ayah

On Tue, Oct 7, 2014 at 10:11 AM, Ralf Steinberger <ralf.steinberger at jrc.ec.europa.eu> wrote:

Dear Ayah,

I am not entirely sure what you mean when writing “without the use of external resources”, but you may find that JRC-Names <https://ec.europa.eu/jrc/en/language-technologies/jrc-names>  can be helpful for your task. You can download it and integrate it with your application. You find JRC-Names at:

                https://ec.europa.eu/jrc/en/language-technologies/jrc-names .

JRC-Names is a collection of several hundred thousand names and their variant spellings, including across scripts and languages. The name spellings were found by analysing almost 200,000 multilingual online news articles per day and by automatically merging spelling variants with previously known name spellings. For example, you will find 

Wladimir Putin, 

Vladimir Poutine, 

Vladímir Putin, 

Vlagyimir Putyin, 

فلاديمير بوتين 

and more as variant spellings of 

Владимир Путин.

JRC-Names is updated daily with new names and name variant spellings found. JRC-Names is a by-product of the  Europe Media Monitor <http://emm.newsbrief.eu/overview.html>  family of applications.

Of course you can take the full names apart in order to work with name parts only (e.g. Vladimir).

I hope you find this resource useful.

All the best,

Ralf

From: corpora-bounces at uib.no [mailto:corpora-bounces at uib.no] On Behalf Of Ayah Zirikly
Sent: 07 October 2014 15:48
To: corpora at uib.no
Subject: [Corpora-List] Alias Detection Dataset

Hi, 

I am trying to find datasets that handle alias detection (preferably in microblogs). The task I am interested in is given free text, find the aliases of a named entity without the use of external resources. It doesn't have to be person names, it can be organization or any type of a named entity.  

Thanks a lot,

Ayah

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/corpora/attachments/20141008/c748f89d/attachment.htm>
-------------- next part --------------
_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora