Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review
MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection. / Kotyushev, Mikhail; Glazkova, Anna; Morozov, Dmitry.
SemEval 2021 - 15th International Workshop on Semantic Evaluation, Proceedings of the Workshop. ed. / Alexis Palmer; Nathan Schneider; Natalie Schluter; Guy Emerson; Aurelie Herbelot; Xiaodan Zhu. Association for Computational Linguistics (ACL), 2021. p. 913-918 (SemEval 2021 - 15th International Workshop on Semantic Evaluation, Proceedings of the Workshop).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review
}
TY - GEN
T1 - MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection
AU - Kotyushev, Mikhail
AU - Glazkova, Anna
AU - Morozov, Dmitry
N1 - Publisher Copyright: © 2021 Association for Computational Linguistics.
PY - 2021
Y1 - 2021
N2 - This paper describes our system for SemEval-2021 Task 5 on Toxic Spans Detection. We developed ensemble models using BERT-based neural architectures and post-processing to combine tokens into spans. We evaluated several pre-trained language models using various ensemble techniques for toxic span identification and achieved sizable improvements over our baseline fine-tuned BERT models. Finally, our system obtained a F1-score of 67.55% on test data.
AB - This paper describes our system for SemEval-2021 Task 5 on Toxic Spans Detection. We developed ensemble models using BERT-based neural architectures and post-processing to combine tokens into spans. We evaluated several pre-trained language models using various ensemble techniques for toxic span identification and achieved sizable improvements over our baseline fine-tuned BERT models. Finally, our system obtained a F1-score of 67.55% on test data.
UR - http://www.scopus.com/inward/record.url?scp=85131403176&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85131403176
SN - 9781954085701
T3 - SemEval 2021 - 15th International Workshop on Semantic Evaluation, Proceedings of the Workshop
SP - 913
EP - 918
BT - SemEval 2021 - 15th International Workshop on Semantic Evaluation, Proceedings of the Workshop
A2 - Palmer, Alexis
A2 - Schneider, Nathan
A2 - Schluter, Natalie
A2 - Emerson, Guy
A2 - Herbelot, Aurelie
A2 - Zhu, Xiaodan
PB - Association for Computational Linguistics (ACL)
T2 - 15th International Workshop on Semantic Evaluation, SemEval 2021
Y2 - 5 August 2021 through 6 August 2021
ER -
ID: 38133115