| Download | - View author's version: Learning to live with false alarms (PDF, 237 KiB)
|
|---|
| Author | Search for: Drummond, Chris1; Search for: Holte, Robert C. |
|---|
| Affiliation | - National Research Council of Canada. NRC Institute for Information Technology
|
|---|
| Format | Text, Article |
|---|
| Conference | Workshop on Dada Mining Methods for Anomaly Detection held in conjunction with the 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, August 21-24,2005, Chicago, IL, USA |
|---|
| Abstract | Anomalies are rare events. For anomaly detection, severe class imbalance is the norm. Although there has been much research into imbalanced classes, there are sur- prisingly few examples of dealing with severe imbalance. Alternative performance mea- sures have superseded error rate, or accuracy, for algorithm comparison. But whatever their other merits, they tend to obscure the severe imbalance problem. We use the relative cost reduction of a classifier over a trivial classifier that chooses the less costly class. We show that for applications that are inherently noisy there is a limit to the cost reduction achievable. Even a Bayes optimal classifier has a vanishingly small reduction in costs as imbalance increases. If events are rare and not too costly, the unpalatable conclusion is that our learning algorithms can do little. If the events have a higher cost then a large number of false alarms must be tolerated, even if the end user finds that undesirable. |
|---|
| Publication date | 2005 |
|---|
| Publisher | ACM Press |
|---|
| In | |
|---|
| Language | English |
|---|
| Peer reviewed | Yes |
|---|
| NPARC number | 23002095 |
|---|
| Export citation | Export as RIS |
|---|
| Report a correction | Report a correction (opens in a new tab) |
|---|
| Record identifier | 82fb56a0-7f3d-4b55-92d4-128f375aecb0 |
|---|
| Record created | 2017-08-14 |
|---|
| Record modified | 2020-04-07 |
|---|
