On outlier detection with the Chebyshev type inequalities
This work considers algorithms of outlier detection based on the Chebyshev inequality. It compares these algorithms with such classical methods as Tukey’s boxplot, the N-sigma rule and its robust modifications based on MAD and FQ scale estimates. To adjust the parameters of the algorithms, a selecti...
Gespeichert in:
Veröffentlicht in: | Z̆urnal Belorusskogo gosudarstvennogo universiteta. Matematika, informatika informatika, 2020-12 (3), p.28-35 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | bel ; eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | This work considers algorithms of outlier detection based on the Chebyshev inequality. It compares these algorithms with such classical methods as Tukey’s boxplot, the N-sigma rule and its robust modifications based on MAD and FQ scale estimates. To adjust the parameters of the algorithms, a selection procedure is proposed based on the complete knowledge of the data distribution model. Areas of suboptimal parameters are also determined in case of incomplete knowledge of the distribution model. It is concluded that the direct use of the Chebyshev inequality implies the classical N-sigma rule. With the non-classical Chebyshev inequality, a robust outlier detection method is obtained, which slightly outperforms other considered algorithms. |
---|---|
ISSN: | 2520-6508 2617-3956 |
DOI: | 10.33581/2520-6508-2020-3-28-35 |