<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Anya,<div class=""><br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>The command that you used before plus +t%dep_tiers that you want to compare is all that it should need. Perhaps I don't understand what exactly you want. Could you email to me directly two sample files you want to compare and tell me what words and on what tiers you want to check inter-rater agreement for.</div><div class=""><br class=""></div><div class="">Also, make sure you have newer CLAN version installed.<br class=""><div class="">
<br class=""><br class="">Leonid.
</div>
<div><br class=""><blockquote type="cite" class=""><div class="">On Aug 28, 2019, at 22:59, Anya Montgomery <<a href="mailto:amont165@fiu.edu" class="">amont165@fiu.edu</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Thank you so much, Leonid, for responding. We attempted to use the +t option and the +c option but we were unable to determine inter-rater agreement. What specific command should I run? <br class=""><br class="">On Wednesday, August 28, 2019 at 2:36:29 PM UTC-4, Leonid Spektor wrote:<blockquote class="gmail_quote" style="margin: 0;margin-left: 0.8ex;border-left: 1px #ccc solid;padding-left: 1ex;"><div style="word-wrap:break-word;line-break:after-white-space" class="">Anya,<div class=""><br class=""></div><div class=""><span style="white-space:pre" class=""> </span>If your students are coding on specific dependent tier only, then you can use +t option to tell RELY to look at that dependent tier only. You might try adding +c option too.<br class=""><div class="">
<br class=""><br class="">Leonid.
</div>
<div class=""><br class=""><blockquote type="cite" class=""><div class="">On Aug 28, 2019, at 14:25, Anya Montgomery <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="bZPjtumlEAAJ" rel="nofollow" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;" class="">amon...@fiu.edu</a>> wrote:</div><br class=""><div class=""><div dir="ltr" class=""><p class="MsoNormal" style="line-height:normal"><span style="font-size:10pt;font-family:Arial,sans-serif;background-image:initial;background-position:initial;background-repeat:initial" class="">Good
Afternoon, </span><span style="font-size:12.0pt;font-family:"Times New Roman",serif" class=""></span></p><p class="MsoNormal" style="margin:12pt 0in;line-height:normal;background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:10pt;font-family:Arial,sans-serif" class="">We are currently coding transcripts and there
are two<br class="">
different students coding these transcripts. We would like to achieve<br class="">
80% conformity by our transcripts. We previously running the RELY +d command,
however we realized that the program was accounting for all of the words in the
transcript as opposed to checking for conformity between only the words that we
coded for. Does anybody know of a way that we can run a test that tells use the
inter-rater agreement or percentage of reliability based on the words that are
coded for? </span></p><p class="MsoNormal" style="margin:12pt 0in;line-height:normal;background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:10pt;font-family:Arial,sans-serif" class="">thank you for your help,<br class="">
<br class="">
</span></p><p class="MsoNormal" style="margin:12pt 0in;line-height:normal;background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:10pt;font-family:Arial,sans-serif" class="">Anya Montgomery </span></p></div><div class=""><br class=""></div>
-- <br class="">
You received this message because you are subscribed to the Google Groups "chibolts" group.<br class="">
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="bZPjtumlEAAJ" rel="nofollow" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;" class="">chib...@<wbr class="">googlegroups.com</a>.<br class="">
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/f92bed6c-25fc-4075-ad56-b3890b4e17ea%40googlegroups.com?utm_medium=email&utm_source=footer" target="_blank" rel="nofollow" onmousedown="this.href='https://groups.google.com/d/msgid/chibolts/f92bed6c-25fc-4075-ad56-b3890b4e17ea%40googlegroups.com?utm_medium\x3demail\x26utm_source\x3dfooter';return true;" onclick="this.href='https://groups.google.com/d/msgid/chibolts/f92bed6c-25fc-4075-ad56-b3890b4e17ea%40googlegroups.com?utm_medium\x3demail\x26utm_source\x3dfooter';return true;" class="">https://groups.google.com/d/<wbr class="">msgid/chibolts/f92bed6c-25fc-<wbr class="">4075-ad56-b3890b4e17ea%<wbr class="">40googlegroups.com</a>.<br class="">
</div></blockquote></div><br class=""></div></div></blockquote></div><div class=""><br class="webkit-block-placeholder"></div>
-- <br class="">
You received this message because you are subscribed to the Google Groups "chibolts" group.<br class="">
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com" class="">chibolts+unsubscribe@googlegroups.com</a>.<br class="">
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/2ff0386e-a5a1-45cc-9a4a-6b263d0413ee%40googlegroups.com?utm_medium=email&utm_source=footer" class="">https://groups.google.com/d/msgid/chibolts/2ff0386e-a5a1-45cc-9a4a-6b263d0413ee%40googlegroups.com</a>.<br class="">
</div></blockquote></div><br class=""></div></body></html>
<p></p>
-- <br />
You received this message because you are subscribed to the Google Groups "chibolts" group.<br />
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com">chibolts+unsubscribe@googlegroups.com</a>.<br />
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/1EC87E9F-954B-4A4B-8BC5-8EDB1329947F%40andrew.cmu.edu?utm_medium=email&utm_source=footer">https://groups.google.com/d/msgid/chibolts/1EC87E9F-954B-4A4B-8BC5-8EDB1329947F%40andrew.cmu.edu</a>.<br />