How Hadoop Clusters Break

How Hadoop Clusters Break

This article describes an examination of a sample of several hundred support tickets for the Hadoop ecosystem, a widely used group of big data storage and processing systems; a taxonomy of errors and how they are addressed by supporters; and the misconfigurations that are the dominant cause of failu...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE software 2013-07, Vol.30 (4), p.88-94
Hauptverfasser: Rabkin, A., Katz, R. H.
Format: Artikel
Sprache:eng
Schlagworte:
Analytical models
Applied sciences
big data
cloud computing
Cluster approximation
Clusters
Computer programs
Computer science
control theory
systems
Construction
Data handling
Data storage
Data storage systems
Design engineering
distributed systems
Ecosystems
Exact sciences and technology
Information management
Information storage
Information systems. Data bases
Memory and file management (including protection and security)
Memory organisation. Data processing
Platforms
reliability
Software
Software development
Software engineering
Software reliability
Studies
system administration
Systems design
Systems development
Vocabularies & taxonomies
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:This article describes an examination of a sample of several hundred support tickets for the Hadoop ecosystem, a widely used group of big data storage and processing systems; a taxonomy of errors and how they are addressed by supporters; and the misconfigurations that are the dominant cause of failures. Some design "antipatterns" and missing platform features contribute to these problems. Developers can use various methods to build more robust distributed systems, thereby helping users and administrators prevent some of these rough edges.
ISSN:0740-7459
1937-4194
DOI:10.1109/MS.2012.73