<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <div class="moz-cite-prefix">On 11/29/2012 10:52 PM, True Friend
      wrote:<br>
    </div>
    <blockquote
cite="mid:CAB6qTH8EfG6Y_XqzZb+UjGZKxBGW8F=mnd9wOP2CtWoH8Gt3Gw@mail.gmail.com"
      type="cite">
      <div dir="ltr"><font size="4"><font face="tahoma,sans-serif"><font
              size="4">I have <font size="4">a related qu<font size="4">estion:<font
                    size="4"> News websites (these days) a<font size="4">re
                      using AJAX, this hides <font size="4">links while
                        <font size="4">simultaneously generates them via
                          javascript. See <a moz-do-not-send="true"
href="http://www.nation.com.pk/pakistan-news-newspaper-daily-english-online/opinions/editorials">this
                            page</a> for example<font size="4">. <font
                              size="4">Apparently th<font size="4">is is
                                the archive page for all Editorials on
                                the newspaper website, <font size="4">but
                                  only a few are <font size="4">shown,
                                    and user has to click on "</font></font></font></font></font></font></font></font></font></font></font></font></font></font><font
          size="4"><font face="tahoma,sans-serif"><font size="4"><font
                size="4"><font size="4"><font size="4"><font size="4"><font
                        size="4"><font size="4"><font size="4"><font
                              size="4"><font size="4"><font size="4"><font
                                    size="4"><a moz-do-not-send="true"><span>Show
                                        more news<font size="4">" <font
                                            size="4">under the given
                                            stories to get a few more
                                            previous editori<font
                                              size="4">als. <font
                                                size="4">Would a<font
                                                  size="4">n html
                                                  crawler be able to
                                                  bypass this and get
                                                  all links hidden on
                                                  this page?<br>
                                                </font></font></font></font></font></span></a></font></font></font></font></font></font></font></font></font></font></font></font></font></font><br>
      </div>
    </blockquote>
    <br>
        It is possible.  Certainly, anyone with enough programming skill
    could write an HTML crawler that can give an AJAX website the
    information it's looking for.   In practice, it may be so obfuscated
    that it's not worth the time and effort.<br>
    <br>
    <pre class="moz-signature" cols="72">-- 
Angus B. Grieve-Smith
<a class="moz-txt-link-abbreviated" href="mailto:grvsmth@panix.com">grvsmth@panix.com</a></pre>
  </body>
</html>