| Download | - View final version: Evaluation briefs: drawing on translation studies for human evaluation of MT (PDF, 502 KiB)
|
|---|
| Link | https://aclanthology.org/2024.amta-research.17 |
|---|
| Author | Search for: Liu, Ting1; Search for: Lo, Chi-kiu1ORCID identifier: https://orcid.org/0000-0001-8714-7846; Search for: Marshman, Elizabeth; Search for: Knowles, Rebecca1ORCID identifier: https://orcid.org/0000-0002-1647-584X |
|---|
| Affiliation | - National Research Council Canada. Digital Technologies
|
|---|
| Format | Text, Article |
|---|
| Conference | 16th Conference of the Association for Machine Translation in the Americas (AMTA 2024), September 30 - October 2, 2024, Chicago, Illinois, United States |
|---|
| Abstract | In this position paper, we examine ways in which researchers in machine translation and translation studies have approached the problem of evaluating the output of machine translation systems and, more broadly, the questions of what it means to define translation quality. We explore their similarities and differences, highlighting the role that the purpose and context of translation plays in translation studies approaches. We argue that evaluation of machine translation (e.g., in shared tasks) would benefit from additional insights from translation studies, and we suggest the introduction of an ‘evaluation brief” (analogous to the ‘translation brief’) which could help set out useful context for annotators tasked with evaluating machine translation. |
|---|
| Publication date | 2024-09 |
|---|
| Publisher | Association for Machine Translation in the Americas |
|---|
| Licence | |
|---|
| In | |
|---|
| Language | English |
|---|
| Peer reviewed | Yes |
|---|
| Export citation | Export as RIS |
|---|
| Report a correction | Report a correction (opens in a new tab) |
|---|
| Record identifier | 043779e2-5b11-44de-9799-0d9fe334535f |
|---|
| Record created | 2024-10-22 |
|---|
| Record modified | 2024-10-24 |
|---|
