[Corpora-List] Constructing a parallel Arabic-English corpus that can be freely distributed without cost

[Alexander Yeh]

Kais Dukes wrote:
> I'm performing a small feasibility study to understand how expensive it would be to build a parallel Arabic-English corpus. I'm aware that such resources already exist (e.g. LDC), but these don't suit my purpose. I want to develop something free that can be easily downloaded and used without cost by the wider research community. e.g. under a creative commons or other open source license. With regards to Arabic genre/dialect, I'm only interested in MSA in its standard register (so not generally social media, blogs, etc.). Ideally, I'm looking for well-written news articles in Arabic by a prominent news agency, or something of comparable quality.
> Some options I could pursue, from most expensive to least expensive:
> 1. Collect some Arabic news articles online, and then pay to have these translated into English (either by a professional translation service or via crowdsourcing). Sources could include Al Jazeera, Associated Press, Arabic Wikinews etc.

One warning about online news articles. Even though you have free access 
to it, the publisher still owns the copyright to it (at least in many 
jurisdictions), and so you may need to get their permission to 
redistribute it (and also often true for their translations).
Depending on how much it costs for permission to redistribute, this may 
get a lot more expensive than just the cost of translation.

Thanks
-Alex Yeh

>
> 2. Use the United Nations as a source of parallel translated texts. My only concern with this option is that these texts sound quite specific in terms of genre compared to more general news articles, so might not be an ideal solution for what I want to achieve.
>
> 3. Use some other high-quality source of Arabic-English (free and easily available) parallel text that I've not thought of for Modern Standard Arabic.
> My aim is to work out whether or not option 1 is the only way to develop and publish (to the research community) a free high-quality Arabic-English parallel corpus, or if there is something I'm missing. I would also like to have the corpus sentence-aligned, although this is something I could do myself (semi-automatically with manual correction) if the two corpora form a good structural translation pair.
> In a nutshell my question is ... is my best option to pay for high-quality Arabic news articles to get translated into English, then distribute the resulting corpus as a free resource, or is there a better (high-quality) starting point for MSA news?
>
> Any advice is most welcome. For option 1, it would also be great to get a general feel for high-quality translation costs in terms of words/dollars.
> Also, if anyone is generally interested in helping with this effort, please do get in touch.
> Kind Regards,
> -- Kais Dukes
> School of Computing
> University of Leeds
>
> _______________________________________________
> UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
> Corpora mailing list
> Corpora at uib.no
> http://mailman.uib.no/listinfo/corpora
>



_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora