Publication details

Can we detect ChatGPT-generated texts in Czech and Slovak languages?

Authors

ŠIGUT Petr FOLTÝNEK Tomáš

Year of publication 2023
Type Article in Proceedings
Conference Proceedings of the Sixteenth Workshop on Recent Advances in Slavonic Natural Languages Processing, RASLAN 2023
MU Faculty or unit

Faculty of Informatics

Citation
Web http://nlp.fi.muni.cz/raslan/2023/paper10.pdf
Keywords ChatGPT; AI-detection; Czech; Slovak
Description The wide availability of generative AI exacerbates existing threats to society. It would not be easy even for linguists to tell whether the text we are reading was generated by a Large Language Model (LLM) or written by a human. Researchers have started developing tools that detect AI-generated content. This paper tested how two of these tools, Compilatio and GPT-2 Output Detector, performed with Czech, Slovak and English texts. There was only one tool somewhat capable of detecting AI-generated texts: Compilatio. Other tools were designed to work only with English texts. Hence, we also tested whether automatically translating the Czech and Slovak texts to English before uploading them to the detectors would have given any promising results. Ultimately, we showed that the texts generated by ChatGPT4 were less detectable than the texts generated by ChatGPT3.5.

You are running an old browser version. We recommend updating your browser to its latest version.

More info