From proof‐of‐concept to proof‐of‐value: Approaching third‐party data to operational workflows of national meteorological services

National meteorological services (NMS) are limited by practical and financial boundaries in the number of official meteorological measurements that it can collect. This means that large regions are often unobserved. These gaps can be filled by novel data sources, including measurements from personal...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:International journal of climatology 2023-01, Vol.43 (1), p.275-292
Hauptverfasser: Garcia‐Marti, Irene, Overeem, Aart, Noteboom, Jan Willem, de Vos, Lotte, de Haij, Marijn, Whan, Kirien
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:National meteorological services (NMS) are limited by practical and financial boundaries in the number of official meteorological measurements that it can collect. This means that large regions are often unobserved. These gaps can be filled by novel data sources, including measurements from personal weather stations that are owned and operated by amateur citizen scientists, or opportunistic sensing from devices that are not designed to measure meteorological variables, like commercial microwave links (radio connections between mobile phone towers). These types of data are known as “third‐party data” (3PD) as they are not owned or operated by NMS or research institutes (e.g., university, government department). Demonstration of the quality and value of these novel data sources is an active area of research. NMS, like the Royal Netherlands Meteorological Institute (KNMI), are faced with some unique challenges when it comes to transferring research to operations. KNMI is in the early stages of developing an operational pipeline for 3PD. We outline some use cases where we have demonstrated the quality of 3PD. We discuss our experiences with some of these challenges that can occur when transferring between proof‐of‐concepts on 3PD developed in research settings into real operational workflows providing valuable services. Hence, in this work we introduce our third‐party data life cycle, in which we provide an integral overview of this transitioning process considering business and social aspects, technical feasibility assessments, the importance of quality control, and aspects related to data integration and alignment with the existing official data sources. We also reflect on how these potential new applications could fit into KNMIs long‐term strategies and contribute to the high‐resolution weather forecast and early warning issuing. We hope that sharing these experiences will provide some general guidelines to organizations in need of providing new services stemming from 3PD and transform them into “daily business.” Third‐party data (3PD) collections like Weather Observations Website (WOW‐NL, available via http://wow.knmi.nl) have the potential of expanding well‐consolidated workflows in meteorology and climate sciences, hence we recommend that national meteorological services (NMS) should be open and well‐prepared for new big data engineering and data fusion challenges. Looking to the future, we think that quality‐controlled 3PD collections can substantially
ISSN:0899-8418
1097-0088
DOI:10.1002/joc.7757