Téléchargement | - Voir la version finale : Keyphrase generation: lessons from a reproducibility study (PDF, 799 Kio)
|
---|
Lien | https://aclanthology.org/people/e/edwin-thomas/ |
---|
Auteur | Rechercher : Thomas, Edwin1; Rechercher : Vajjala, Sowmya1 |
---|
Affiliation | - Conseil national de recherches du Canada. Technologies numériques
|
---|
Format | Texte, Article |
---|
Conférence | 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), May 20-25, 2024, Torino, Italia |
---|
Sujet | keyphrase generation; reproducibility; replicability; evaluation |
---|
Résumé | Reproducibility studies are treated as means to verify the validity of a scientific method, but what else can we learn from such experiments? We addressed this question taking Keyphrase Generation (KPG) as the use case in this paper, by studying three state-of-the-art KPG models in terms of reproducibility under either the same (same data/model/code) or varied (different training data/model, but same code) conditions, and exploring different ways of comparing KPG models beyond the most commonly used evaluation measures. We drew some conclusions on the state of the art in KPG based on these experiments, and provided guidelines for researchers working on the topic about reporting experimental results in a more comprehensive manner. |
---|
Date de publication | 2024-05-20 |
---|
Maison d’édition | ELRA and ICCL |
---|
Licence | |
---|
Dans | |
---|
Langue | anglais |
---|
Publications évaluées par des pairs | Oui |
---|
Exporter la notice | Exporter en format RIS |
---|
Signaler une correction | Signaler une correction (s'ouvre dans un nouvel onglet) |
---|
Identificateur de l’enregistrement | c69e5613-9ffc-4c0d-840c-9102b506acdc |
---|
Enregistrement créé | 2024-05-24 |
---|
Enregistrement modifié | 2024-05-27 |
---|