Mean Imputation Techniques for Filling the Missing Observations in Air Pollution Dataset

Almost all real life datasets consist missing values. These are usually due to machine failure, routine maintenance, changes in siting monitors and human error. The occurence of missing values requires special attention on analysing the data. Incomplete datasets can cause bias due to systematic diff...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Key engineering materials 2013-12, Vol.594-595, p.902-908
Hauptverfasser: Ramli, N.A., Yahaya, A.S., Noor, M.N., Al Bakri, A.M. Mustafa
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Almost all real life datasets consist missing values. These are usually due to machine failure, routine maintenance, changes in siting monitors and human error. The occurence of missing values requires special attention on analysing the data. Incomplete datasets can cause bias due to systematic differences between observed and unobserved data. Therefore, the need to find the best way in estimating missing values is very important so that the data analysed is ensured of high quality. In this research, three types of mean imputation techniques that are mean, mean above and mean above below methods were used to replace the missing values. Annual hourly monitoring data for PM10 were used to generate missing values. Four randomly simulated missing data were evaluated in order to test the efficiency of the methods used. They are 5%, 10%, 15%, 25% and 40%. Three types of performance indicators that are mean absolute error (MAE), root mean square error (RMSE) and coefficient of determination (R2) were calculated to describe the goodness of fit for all the method. From all the method applied, it was found that mean above below method is the best method for estimating data for all percentages of simulated missing values.
ISSN:1013-9826
1662-9795
1662-9795
DOI:10.4028/www.scientific.net/KEM.594-595.902