GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human

Yuxia Wang; Artem Shelmanov; Jonibek Mansurov; Akim Tsvigun; Vladislav Mikhailov; Rui Xing; Zhuohan Xie; Jiahui Geng; Giovanni Puccetti; Ekaterina Artemova; Jinyan Su; Minh Ngoc Ta; Mervat Abassy; Kareem Elozeiri; Saad El Dine Ahmed; Maiya Goloburda; Tarek Mahmoud; Raj Vardhan Tomar; Alexander Aziz; Nurkhan Laiyk; Osama Mohammed Afzal; Ryuto Koike; Masahiro Kaneko; Alham Fikri Aji; Nizar Habash; Iryna Gurevych; Preslav Nakov

GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human

Yuxia Wang, Artem Shelmanov, Jonibek Mansurov, Akim Tsvigun, Vladislav Mikhailov, Rui Xing, Zhuohan Xie, Jiahui Geng, Giovanni Puccetti, Ekaterina Artemova, Jinyan Su, Minh Ngoc Ta, Mervat Abassy, Kareem Elozeiri, Saad El Dine Ahmed, Maiya Goloburda, Tarek Mahmoud, Raj Vardhan Tomar, Alexander Aziz, Nurkhan LaiykOsama Mohammed Afzal, Ryuto Koike, Masahiro Kaneko, Alham Fikri Aji, Nizar Habash, Iryna Gurevych, Preslav Nakov

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We present the GenAI Content Detection Task 1 - a shared task on binary machine generated text detection, conducted as a part of the GenAI workshop at COLING 2025. The task consists of two subtasks: Monolingual (English) and Multilingual. The shared task attracted many participants: 36 teams made official submissions to the Monolingual subtask during the test phase and 27 teams - to the Multilingual. We provide a comprehensive overview of the data, a summary of the results - including system rankings and performance scores - detailed descriptions of the participating systems, and an in-depth analysis of submissions.¹

Original language	English (US)
Title of host publication	GenAIDetect 2025 - Proceedings of the 1st Workshop on GenAI Content Detection, Proceedings of the Workshop - 31st International Conference on Computational Linguistics, COLING 2025
Editors	Firoj Alam, Preslav Nakov, Nizar Habash, Iryna Gurevych, Iryna Gurevych, Shammur Chowdhury, Artem Shelmanov, Yuxia Wang, Ekaterina Artemova, Mucahid Kutlu, George Mikros
Publisher	Association for Computational Linguistics (ACL)
Pages	244-261
Number of pages	18
ISBN (Electronic)	9798891762053
State	Published - 2025
Event	1st Workshop on GenAI Content Detection, GenAIDetect 2025 - Abu Dhabi, United Arab Emirates Duration: Jan 19 2025 → …

Publication series

Name	Proceedings - International Conference on Computational Linguistics, COLING
ISSN (Print)	2951-2093

Conference

Conference	1st Workshop on GenAI Content Detection, GenAIDetect 2025
Country/Territory	United Arab Emirates
City	Abu Dhabi
Period	1/19/25 → …

ASJC Scopus subject areas

Computational Theory and Mathematics
Computer Science Applications
Theoretical Computer Science

Cite this

Wang, Y., Shelmanov, A., Mansurov, J., Tsvigun, A., Mikhailov, V., Xing, R., Xie, Z., Geng, J., Puccetti, G., Artemova, E., Su, J., Ta, M. N., Abassy, M., Elozeiri, K., El Dine Ahmed, S., Goloburda, M., Mahmoud, T., Tomar, R. V., Aziz, A., ... Nakov, P. (2025). GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human. In F. Alam, P. Nakov, N. Habash, I. Gurevych, I. Gurevych, S. Chowdhury, A. Shelmanov, Y. Wang, E. Artemova, M. Kutlu, & G. Mikros (Eds.), GenAIDetect 2025 - Proceedings of the 1st Workshop on GenAI Content Detection, Proceedings of the Workshop - 31st International Conference on Computational Linguistics, COLING 2025 (pp. 244-261). (Proceedings - International Conference on Computational Linguistics, COLING). Association for Computational Linguistics (ACL).

GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human. / Wang, Yuxia; Shelmanov, Artem; Mansurov, Jonibek et al.
GenAIDetect 2025 - Proceedings of the 1st Workshop on GenAI Content Detection, Proceedings of the Workshop - 31st International Conference on Computational Linguistics, COLING 2025. ed. / Firoj Alam; Preslav Nakov; Nizar Habash; Iryna Gurevych; Iryna Gurevych; Shammur Chowdhury; Artem Shelmanov; Yuxia Wang; Ekaterina Artemova; Mucahid Kutlu; George Mikros. Association for Computational Linguistics (ACL), 2025. p. 244-261 (Proceedings - International Conference on Computational Linguistics, COLING).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Wang, Y, Shelmanov, A, Mansurov, J, Tsvigun, A, Mikhailov, V, Xing, R, Xie, Z, Geng, J, Puccetti, G, Artemova, E, Su, J, Ta, MN, Abassy, M, Elozeiri, K, El Dine Ahmed, S, Goloburda, M, Mahmoud, T, Tomar, RV, Aziz, A, Laiyk, N, Afzal, OM, Koike, R, Kaneko, M, Aji, AF, Habash, N, Gurevych, I & Nakov, P 2025, GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human. in F Alam, P Nakov, N Habash, I Gurevych, I Gurevych, S Chowdhury, A Shelmanov, Y Wang, E Artemova, M Kutlu & G Mikros (eds), GenAIDetect 2025 - Proceedings of the 1st Workshop on GenAI Content Detection, Proceedings of the Workshop - 31st International Conference on Computational Linguistics, COLING 2025. Proceedings - International Conference on Computational Linguistics, COLING, Association for Computational Linguistics (ACL), pp. 244-261, 1st Workshop on GenAI Content Detection, GenAIDetect 2025, Abu Dhabi, United Arab Emirates, 1/19/25.

Wang Y, Shelmanov A, Mansurov J, Tsvigun A, Mikhailov V, Xing R et al. GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human. In Alam F, Nakov P, Habash N, Gurevych I, Gurevych I, Chowdhury S, Shelmanov A, Wang Y, Artemova E, Kutlu M, Mikros G, editors, GenAIDetect 2025 - Proceedings of the 1st Workshop on GenAI Content Detection, Proceedings of the Workshop - 31st International Conference on Computational Linguistics, COLING 2025. Association for Computational Linguistics (ACL). 2025. p. 244-261. (Proceedings - International Conference on Computational Linguistics, COLING).

Wang, Yuxia ; Shelmanov, Artem ; Mansurov, Jonibek et al. / GenAI Content Detection Task 1 : English and Multilingual Machine-Generated Text Detection: AI vs. Human. GenAIDetect 2025 - Proceedings of the 1st Workshop on GenAI Content Detection, Proceedings of the Workshop - 31st International Conference on Computational Linguistics, COLING 2025. editor / Firoj Alam ; Preslav Nakov ; Nizar Habash ; Iryna Gurevych ; Iryna Gurevych ; Shammur Chowdhury ; Artem Shelmanov ; Yuxia Wang ; Ekaterina Artemova ; Mucahid Kutlu ; George Mikros. Association for Computational Linguistics (ACL), 2025. pp. 244-261 (Proceedings - International Conference on Computational Linguistics, COLING).

@inproceedings{61488ea6575247bca6d2d35af9101e2f,

title = "GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human",

abstract = "We present the GenAI Content Detection Task 1 - a shared task on binary machine generated text detection, conducted as a part of the GenAI workshop at COLING 2025. The task consists of two subtasks: Monolingual (English) and Multilingual. The shared task attracted many participants: 36 teams made official submissions to the Monolingual subtask during the test phase and 27 teams - to the Multilingual. We provide a comprehensive overview of the data, a summary of the results - including system rankings and performance scores - detailed descriptions of the participating systems, and an in-depth analysis of submissions.1",

author = "Yuxia Wang and Artem Shelmanov and Jonibek Mansurov and Akim Tsvigun and Vladislav Mikhailov and Rui Xing and Zhuohan Xie and Jiahui Geng and Giovanni Puccetti and Ekaterina Artemova and Jinyan Su and Ta, {Minh Ngoc} and Mervat Abassy and Kareem Elozeiri and {El Dine Ahmed}, Saad and Maiya Goloburda and Tarek Mahmoud and Tomar, {Raj Vardhan} and Alexander Aziz and Nurkhan Laiyk and Afzal, {Osama Mohammed} and Ryuto Koike and Masahiro Kaneko and Aji, {Alham Fikri} and Nizar Habash and Iryna Gurevych and Preslav Nakov",

note = "Publisher Copyright: {\textcopyright} 2025 International Conference on Computational Linguistics.; 1st Workshop on GenAI Content Detection, GenAIDetect 2025 ; Conference date: 19-01-2025",

year = "2025",

language = "English (US)",

series = "Proceedings - International Conference on Computational Linguistics, COLING",

publisher = "Association for Computational Linguistics (ACL)",

pages = "244--261",

editor = "Firoj Alam and Preslav Nakov and Nizar Habash and Iryna Gurevych and Iryna Gurevych and Shammur Chowdhury and Artem Shelmanov and Yuxia Wang and Ekaterina Artemova and Mucahid Kutlu and George Mikros",

booktitle = "GenAIDetect 2025 - Proceedings of the 1st Workshop on GenAI Content Detection, Proceedings of the Workshop - 31st International Conference on Computational Linguistics, COLING 2025",

}

TY - GEN

T1 - GenAI Content Detection Task 1

T2 - 1st Workshop on GenAI Content Detection, GenAIDetect 2025

AU - Wang, Yuxia

AU - Shelmanov, Artem

AU - Mansurov, Jonibek

AU - Tsvigun, Akim

AU - Mikhailov, Vladislav

AU - Xing, Rui

AU - Xie, Zhuohan

AU - Geng, Jiahui

AU - Puccetti, Giovanni

AU - Artemova, Ekaterina

AU - Su, Jinyan

AU - Ta, Minh Ngoc

AU - Abassy, Mervat

AU - Elozeiri, Kareem

AU - El Dine Ahmed, Saad

AU - Goloburda, Maiya

AU - Mahmoud, Tarek

AU - Tomar, Raj Vardhan

AU - Aziz, Alexander

AU - Laiyk, Nurkhan

AU - Afzal, Osama Mohammed

AU - Koike, Ryuto

AU - Kaneko, Masahiro

AU - Aji, Alham Fikri

AU - Habash, Nizar

AU - Gurevych, Iryna

AU - Nakov, Preslav

PY - 2025

Y1 - 2025

N2 - We present the GenAI Content Detection Task 1 - a shared task on binary machine generated text detection, conducted as a part of the GenAI workshop at COLING 2025. The task consists of two subtasks: Monolingual (English) and Multilingual. The shared task attracted many participants: 36 teams made official submissions to the Monolingual subtask during the test phase and 27 teams - to the Multilingual. We provide a comprehensive overview of the data, a summary of the results - including system rankings and performance scores - detailed descriptions of the participating systems, and an in-depth analysis of submissions.1

AB - We present the GenAI Content Detection Task 1 - a shared task on binary machine generated text detection, conducted as a part of the GenAI workshop at COLING 2025. The task consists of two subtasks: Monolingual (English) and Multilingual. The shared task attracted many participants: 36 teams made official submissions to the Monolingual subtask during the test phase and 27 teams - to the Multilingual. We provide a comprehensive overview of the data, a summary of the results - including system rankings and performance scores - detailed descriptions of the participating systems, and an in-depth analysis of submissions.1

UR - http://www.scopus.com/inward/record.url?scp=105000197187&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=105000197187&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:105000197187

T3 - Proceedings - International Conference on Computational Linguistics, COLING

SP - 244

EP - 261

BT - GenAIDetect 2025 - Proceedings of the 1st Workshop on GenAI Content Detection, Proceedings of the Workshop - 31st International Conference on Computational Linguistics, COLING 2025

A2 - Alam, Firoj

A2 - Nakov, Preslav

A2 - Habash, Nizar

A2 - Gurevych, Iryna

A2 - Chowdhury, Shammur

A2 - Shelmanov, Artem

A2 - Wang, Yuxia

A2 - Artemova, Ekaterina

A2 - Kutlu, Mucahid

A2 - Mikros, George

PB - Association for Computational Linguistics (ACL)

Y2 - 19 January 2025

ER -

GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human

Abstract

Publication series

Conference

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this