On reliability assessment when a software-based system is replaced by a thought-to-be-better one

•Reliability of a system upgrade: replacing software with one thought-to-be better.•Guaranteed-to-be-conservative Bayesian assessment of a software-based system.•Using knowledge about an old system in the assessment of a similar, new system.•Bayesian assessment requiring minimal prior knowledge abou...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Reliability engineering & system safety 2020-05, Vol.197, p.106752-31, Article 106752
Hauptverfasser: Littlewood, Bev, Salako, Kizito, Strigini, Lorenzo, Zhao, Xingyu
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:•Reliability of a system upgrade: replacing software with one thought-to-be better.•Guaranteed-to-be-conservative Bayesian assessment of a software-based system.•Using knowledge about an old system in the assessment of a similar, new system.•Bayesian assessment requiring minimal prior knowledge about multiple systems.•Extending conservative Bayesian assessment beyond “single system” applications. The failure history of pre-existing systems can inform a reliability assessment of a new system. Such assessments – consisting of arguments based on evidence from older systems – are attractive and have been used for quite some time for, typically, mechanical/hardware-only systems. But their application to software-based systems brings some challenges. In this paper, we present a conservative, Bayesian approach to software reliability assessment – one that combines reliability evidence from an old system with an assessor’s confidence in a newer system being an improved replacement for the old one. We demonstrate, via different scenarios, what a thought-to-be-better replacement formally means in practice, and what it allows one to believe about actual reliability improvement. The results can be used directly in a reliability assessment, or to caution system stakeholders and industry regulators against using other models that give optimistic assessments. For instance, even if one is certain that some new software must be more reliable than an old product, using the reliability distribution for the old software as a prior distribution when assessing the new system gives optimistic, not conservative, predictions for the posterior reliability of the new system after seeing operational testing evidence.
ISSN:0951-8320
1879-0836
DOI:10.1016/j.ress.2019.106752