<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Dear Karin,<div class=""> RELY was originally designed to check reliability of coding tiers, rather than the main line. For that, it does a great job, because the shape of coding tiers is so well defined. If that is what you are doing, then I would say that the decision about what percentage to check is really a function of your overall corpus. For example, if you only have two hours of recording and you check 10% of that, then that would seem incomplete. However, if you have 200 hours and you check a random 10% of that and show good reliability, then I would be pretty convinced that you are okay. So, percentage is a function of corpus size. </div><div class=""> I suppose a similar argument could be made regarding corpus or data type, but that argument would be a bit less convincing.</div><div class=""> Later on, Leonid expanded the function of RELY to include comparisons of the main line. This method just looks for overall match of words. Please just read the manual about these differences.</div><div class=""><br class=""></div><div class="">Best,</div><div class=""><br class=""></div><div class="">-- Brian MacWhinney</div><div class=""><br class=""></div><div class=""><div><blockquote type="cite" class=""><div class="">On Jun 1, 2020, at 4:09 AM, Karin Edlund <<a href="mailto:karin.eva.edlund@gmail.com" class="">karin.eva.edlund@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Hi,<div class=""><br class=""></div><div class="">I have a question about reliability test and deciding on a proper amount of my material to check reliability for. </div><div class=""><br class=""></div><div class="">I am planning to use the RELY function in CLAN to check for reliability and to do it on 10% of my data. </div><div class=""><br class=""></div><div class="">I know in some studies as much as 25% is checked for agreement. </div><div class=""><br class=""></div><div class="">What are your guidelines? is it depending on the collected data, how much it encompasses or the data's content? </div><div class="">If you have suggestions on references, I am grateful to take part of them.</div><div class=""><br class=""></div><div class="">Best Regards,</div><div class="">Karin Edlund,</div><div class="">PhD student in Special Education</div><div class="">Stockholm University</div></div><div class=""><br class="webkit-block-placeholder"></div>
-- <br class="">
You received this message because you are subscribed to the Google Groups "chibolts" group.<br class="">
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com" class="">chibolts+unsubscribe@googlegroups.com</a>.<br class="">
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/CANkUE2ze32zpkYg%2Bkw9TtH7YUfLe2-J8gzws1n%2Bq06He9-rmRw%40mail.gmail.com?utm_medium=email&utm_source=footer" class="">https://groups.google.com/d/msgid/chibolts/CANkUE2ze32zpkYg%2Bkw9TtH7YUfLe2-J8gzws1n%2Bq06He9-rmRw%40mail.gmail.com</a>.<br class="">
</div></blockquote></div><br class=""></div></body></html>
<p></p>
-- <br />
You received this message because you are subscribed to the Google Groups "chibolts" group.<br />
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com">chibolts+unsubscribe@googlegroups.com</a>.<br />
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/BDCEAD24-8DC5-456C-8C73-5D6CADAE86C7%40andrew.cmu.edu?utm_medium=email&utm_source=footer">https://groups.google.com/d/msgid/chibolts/BDCEAD24-8DC5-456C-8C73-5D6CADAE86C7%40andrew.cmu.edu</a>.<br />