| Download | - View final version: Keyphrase generation: lessons from a reproducibility study (PDF, 799 KiB)
|
|---|
| Link | https://aclanthology.org/people/e/edwin-thomas/ |
|---|
| Author | Search for: Thomas, Edwin1; Search for: Vajjala, Sowmya1 |
|---|
| Affiliation | - National Research Council of Canada. Digital Technologies
|
|---|
| Format | Text, Article |
|---|
| Conference | 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), May 20-25, 2024, Torino, Italia |
|---|
| Subject | keyphrase generation; reproducibility; replicability; evaluation |
|---|
| Abstract | Reproducibility studies are treated as means to verify the validity of a scientific method, but what else can we learn from such experiments? We addressed this question taking Keyphrase Generation (KPG) as the use case in this paper, by studying three state-of-the-art KPG models in terms of reproducibility under either the same (same data/model/code) or varied (different training data/model, but same code) conditions, and exploring different ways of comparing KPG models beyond the most commonly used evaluation measures. We drew some conclusions on the state of the art in KPG based on these experiments, and provided guidelines for researchers working on the topic about reporting experimental results in a more comprehensive manner. |
|---|
| Publication date | 2024-05-20 |
|---|
| Publisher | ELRA and ICCL |
|---|
| Licence | |
|---|
| In | |
|---|
| Language | English |
|---|
| Peer reviewed | Yes |
|---|
| Export citation | Export as RIS |
|---|
| Report a correction | Report a correction (opens in a new tab) |
|---|
| Record identifier | c69e5613-9ffc-4c0d-840c-9102b506acdc |
|---|
| Record created | 2024-05-24 |
|---|
| Record modified | 2024-05-27 |
|---|
