CRAC 2022 Shared Task on Multilingual Coreference Resolution
CRAC-corefud 2022
- URL: https://ufal.mff.cuni.cz/corefud/crac22
- Event Date: 2022-10-16 ~ 2022-10-17
- Submission Date: 2022-07-08
- Location: Gyeongju, Republic of Korea
CALL FOR PARTICIPATION
We are excited to announce the CRAC 2022 Shared Task on Multilingual Coreference Resolution! The task will be held at COLING 2022 on October 16–17.
TASK DESCRIPTION
The focus of the task is learning models for prediction of coreference across a range of typologically different languages: Catalan, Czech, English, French, German, Hungarian, Lithuanian, Polish, Russian, and Spanish. Both identification of mentions and clustering of mentions that refer to the same entity are included. Only identity coreference is considered in this shared task, i.e., more complex coreference-related phenomena such as bridging anaphora are not considered. Submissions by participants will be ranked according to a scoring criterion based on standard coreference evaluation metrics.
BACKGROUND
Recently, inspired by the Universal Dependencies initiative (UD), the coreference community has started discussions on establishing a universal annotation scheme and using it to harmonize existing corpora. The discussions at the CRAC 2020 workshop led to proposing the Universal Anaphora initiative. One of the lines of effort related to Universal Anaphora resulted in CorefUD, which is a multilingual collection of coreference data resources harmonized under a common scheme. The public edition of CorefUD 1.0 contains 13 datasets for 10 languages, all of which are included in the CRAC 2022 shared task.
EXPECTED TIMELINE
Development Phase:
* March 3, 2022 – train+dev data release, start of the development phase
* March 17, 2022 – baseline system release, evaluation script release
Evaluation Phase:
* June 1, 2022 – start of evaluation phase, test evaluation via CodaLab
* June 8, 2022 (AoE) – end of evaluation phase
Presentation Phase:
* July 11, 2022 – submission of system description papers to CRAC 2022
* August 22, 2022 – notification of acceptance
* October 16-17, 2022 – the CRAC 2022 workshop at COLING 2022
Please visit the website for more details: https://ufal.mff.cuni.cz/corefud/crac22
We are excited to announce the CRAC 2022 Shared Task on Multilingual Coreference Resolution! The task will be held at COLING 2022 on October 16–17.
TASK DESCRIPTION
The focus of the task is learning models for prediction of coreference across a range of typologically different languages: Catalan, Czech, English, French, German, Hungarian, Lithuanian, Polish, Russian, and Spanish. Both identification of mentions and clustering of mentions that refer to the same entity are included. Only identity coreference is considered in this shared task, i.e., more complex coreference-related phenomena such as bridging anaphora are not considered. Submissions by participants will be ranked according to a scoring criterion based on standard coreference evaluation metrics.
BACKGROUND
Recently, inspired by the Universal Dependencies initiative (UD), the coreference community has started discussions on establishing a universal annotation scheme and using it to harmonize existing corpora. The discussions at the CRAC 2020 workshop led to proposing the Universal Anaphora initiative. One of the lines of effort related to Universal Anaphora resulted in CorefUD, which is a multilingual collection of coreference data resources harmonized under a common scheme. The public edition of CorefUD 1.0 contains 13 datasets for 10 languages, all of which are included in the CRAC 2022 shared task.
EXPECTED TIMELINE
Development Phase:
* March 3, 2022 – train+dev data release, start of the development phase
* March 17, 2022 – baseline system release, evaluation script release
Evaluation Phase:
* June 1, 2022 – start of evaluation phase, test evaluation via CodaLab
* June 8, 2022 (AoE) – end of evaluation phase
Presentation Phase:
* July 11, 2022 – submission of system description papers to CRAC 2022
* August 22, 2022 – notification of acceptance
* October 16-17, 2022 – the CRAC 2022 workshop at COLING 2022
Please visit the website for more details: https://ufal.mff.cuni.cz/corefud/crac22
Journal Promotion
|
| Acta Koreana (Acta Koreana) |
|
| Acta Via Serica (AVS) |
|
| Computers and Concrete (CAC) |
|
| Journal of Information Processing Systems (JIPS) |
|
| Journal of Internet Computing and Services (KSII - JICS) |
|
| Journal of Smart Tourism (Smart Tourism) |
|
| Membrane and Water Treatment (MWT) |
|
| Wind and Structures, An International Journal (Wind and Structures) |
MANUSCRIPTLINK © 2015 -
