<div dir="ltr"><font size="4"><font face="tahoma,sans-serif"><font size="4">I have <font size="4">a related qu<font size="4">estion:<font size="4"> News websites (these days) a<font size="4">re using AJAX, this hides <font size="4">links while <font size="4">simultaneously generates them via javascript. See <a href="http://www.nation.com.pk/pakistan-news-newspaper-daily-english-online/opinions/editorials">this page</a> for example<font size="4">. <font size="4">Apparently th<font size="4">is is the archive page for all Editorials on the newspaper website, <font size="4">but only a few are <font size="4">shown, and user has to click on "</font></font></font></font></font></font></font></font></font></font></font></font></font></font><font size="4"><font face="tahoma,sans-serif"><font size="4"><font size="4"><font size="4"><font size="4"><font size="4"><font size="4"><font size="4"><font size="4"><font size="4"><font size="4"><font size="4"><font size="4"><a><span>Show more news<font size="4">" <font size="4">under the given stories to get a few more previous editori<font size="4">als. <font size="4">Would a<font size="4">n html crawler be able to bypass this and get all links hidden on this page?<br>
<font size="4">Regards</font><br></font></font></font></font></font></span></a></font></font></font></font></font></font></font></font></font></font></font></font></font></font><a> </a></div><div class="gmail_extra"><br><br>
<div class="gmail_quote">On Fri, Nov 30, 2012 at 8:35 AM, Angus Grieve-Smith <span dir="ltr"><<a href="mailto:grvsmth@panix.com" target="_blank">grvsmth@panix.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><div class="im">
<div>On 11/29/2012 4:28 PM, Linda Bawcom
wrote:<br>
</div>
<blockquote type="cite">
<div style="font-family:tahoma,new york,times,serif;font-size:12pt">
<div>Because so many newspapers get their information from the
same news services, I found a few articles that I had to
disgard because of an over 80% similarity ratio and of course
that skews statistics.<br>
</div>
</div>
</blockquote>
<br></div>
Good point! Some newspapers will abridge the wire stories more
than others, so it might be useful to find a way to choose the
longest version.<span class="HOEnZb"><font color="#888888"><br>
<pre cols="72">--
-Angus B. Grieve-Smith
<a href="mailto:grvsmth@panix.com" target="_blank">grvsmth@panix.com</a>
</pre>
</font></span></div>
<br>_______________________________________________<br>
UNSUBSCRIBE from this page: <a href="http://mailman.uib.no/options/corpora" target="_blank">http://mailman.uib.no/options/corpora</a><br>
Corpora mailing list<br>
<a href="mailto:Corpora@uib.no">Corpora@uib.no</a><br>
<a href="http://mailman.uib.no/listinfo/corpora" target="_blank">http://mailman.uib.no/listinfo/corpora</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div dir="ltr"><font style="color:rgb(51,102,255)" size="4"><b>Muhammad Shakir Aziz</b></font><span style="color:rgb(51,102,255)"> </span><font style="color:rgb(51,102,255)" size="4"><b><span style="font-family:tahoma,sans-serif">محمد شاکر عزیز</span></b></font><br style="color:rgb(51,102,255)">
<b><span style="color:rgb(51,102,255);font-family:comic sans ms,sans-serif">Master in Applied Linguistics</span><br style="color:rgb(51,102,255);font-family:comic sans ms,sans-serif"><span style="color:rgb(51,102,255);font-family:comic sans ms,sans-serif">Translator, Course Developer, Linguist for Urdu, Punjabi and English</span></b><br style="color:rgb(51,102,255)">
<span style="color:rgb(51,102,255);font-family:courier new,monospace">Urdu:- </span><a style="color:rgb(51,102,255);font-family:courier new,monospace" href="http://awaz-e-dost.blogspot.com/" target="_blank">http://awaz-e-dost.blogspot.com/</a><br style="color:rgb(51,102,255);font-family:courier new,monospace">
<span style="color:rgb(51,102,255);font-family:courier new,monospace">English:- </span><a style="color:rgb(51,102,255);font-family:courier new,monospace" href="http://linguisticslearner.blogspot.com/" target="_blank">http://linguisticslearner.blogspot.com/</a><br style="color:rgb(51,102,255);font-family:courier new,monospace">
<span style="color:rgb(51,102,255);font-family:courier new,monospace">Facebook:- </span><a style="color:rgb(51,102,255);font-family:courier new,monospace" href="http://www.facebook.com/truefriend2004" target="_blank">http://www.facebook.com/truefriend2004</a><br style="color:rgb(51,102,255);font-family:courier new,monospace">
<span style="color:rgb(51,102,255);font-family:courier new,monospace">Skype:- true_friend2004</span></div><br>
</div>