[Rstlist] Exemplification - listed as a relation according to ChatGPT

[Amir Zeldes]

That’s funny! I’ve tried to prompt ChatGPT to do some RST analyses with a few examples, and it seems to me too that it’s seen some more information about RST during fine-tuning than just what might be gleaned from discussions about RST on the web. Then again, it has probably seen a lot of GitHub in the Pile, and you could find all sorts of RST-related data there.

 �

In fairness to ChatGPT, the RST Discourse Treebank does have a fine-grained “example” relation subtype in the coarse “elaboration” class, so it’s not totally off-base calling it an RST relation.

 �

Best,

Amir

------------

Dr. Amir Zeldes

Assoc. Prof. of Computational Linguistics

Department of Linguistics

Georgetown University

1437 37th St. NW

Washington, DC 20057

 �

https://gucorpling.org/amir 

 �

 �

From: Rstlist <rstlist-bounces at listserv.linguistlist.org> On Behalf Of Matt Chung
Sent: Tuesday, October 24, 2023 8:15 PM
To: rstlist at listserv.linguistlist.org
Subject: [Rstlist] Exemplification - listed as a relation according to ChatGPT

 �

I found it very interesting that ChatGPT listed “exemplification" as one of the �

relations in RST and made me wonder how they trained their model regarding RST �

...

 �

Just now, I asked ChatGPT to “describe all the relations in rhetorical �

structure theory” and the results it spat out made me raise my eyebrows. Not �

only did the number of relations (twenty three of them) stand out, but the �

results also included “Exemplification”, which I neither recalled (from the �

paper - Rhetorical Structure Theory: A theory of text organization) nor saw �

listed on the RST website[1]. Therefore, I followed up in ChatGPT with, “For �

your last message, provide me the source or reference for exemplification being �

one of the primary relations in RST”, to which it responded with:

 �

"I apologize for the oversight. As of my last training cut-off in January 2022, �

"Exemplification" is not one of the primary relations originally posited by �

Mann and Thompson in their foundational work on Rhetorical Structure Theory �

(RST). The relations I listed were meant to be an illustrative overview of RST, �

but my inclusion of "Exemplification" was an error on my part.

 �

For the most accurate and authoritative information on RST, you would typically �

refer to Mann and Thompson's seminal papers on the topic. Always refer to �

primary literature or trusted secondary sources for definitive lists or �

specific details.”

 �

 �

[1] - �http://www.sfu.ca/rst/01intro/intro.html

 �

Cheers,
Matt Chung
Founder | Crossbill LLC <https://tiny.crossbill.co/m/O5hkNb4Sg0o> 
"Helping companies design & deliver �robust software systems"
LinkedIn <https://tiny.crossbill.co/m/O5hk2zxmu68>  �| �Blog <https://tiny.crossbill.co/mblog/O5kQCX7C1pG>  �| �Digital Organization Dad <https://tiny.crossbill.co/mdod/O5k0MSa7F4B> 

 �

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/rstlist/attachments/20231026/10a87c7a/attachment.htm>