| Download | - View final version: A privacy-preserving approach to extraction of personal information through automatic annotation and federated learning (PDF, 803 KiB)
|
|---|
| DOI | Resolve DOI: https://doi.org/10.18653/v1/2021.privatenlp-1.5 |
|---|
| Author | Search for: Hathurusinghe, Rajitha; Search for: Nejadgholi, Isar1; Search for: Bolic, Miodrag |
|---|
| Affiliation | - National Research Council of Canada. Digital Technologies
|
|---|
| Format | Text, Article |
|---|
| Conference | PrivateNLP 2021 (Proceedings of the Third Workshop on Privacy in Natural Language Processing), June 11th, 2021, Held Online |
|---|
| Abstract | We curated WikiPII, an automatically labeled dataset composed of Wikipedia biography pages, annotated for personal information extraction. Although automatic annotation can lead to a high degree of label noise, it is an inexpensive process and can generate large volumes of annotated documents. We trained a BERT-based NER model with WikiPII and showed that with an adequately large training dataset, the model can significantly decrease the cost of manual information extraction, despite the high level of label noise. In a similar approach, organizations can leverage text mining techniques to create customized annotated datasets from their historical data without sharing the raw data for human annotation. Also, we explore collaborative training of NER models through federated learning when the annotation is noisy. Our results suggest that depending on the level of trust to the ML operator and the volume of the available data, distributed training can be an effective way of training a personal information identifier in a privacy-preserved manner. Research material is available at https://github.com/ratmcu/wikipiifed. |
|---|
| Publication date | 2021-06-11 |
|---|
| Publisher | Association for Computational Linguistics |
|---|
| Licence | |
|---|
| In | |
|---|
| Related data | |
|---|
| Language | English |
|---|
| Peer reviewed | Yes |
|---|
| Export citation | Export as RIS |
|---|
| Report a correction | Report a correction (opens in a new tab) |
|---|
| Record identifier | 797123e5-9124-4a7d-9bc2-4da13b8ff1f5 |
|---|
| Record created | 2021-08-03 |
|---|
| Record modified | 2021-08-04 |
|---|
