Knowledge Based and Expert Systems: System Safety and Legal Issues in A/I

While the issues of regulation and liability often are considered a burden, they are necessary in the avoidance of financial and legal consequences that may accrue from the use and marketing of a poorly designed expert system. Relative responsibilities of developer and purchaser must be defined to avoid subsequent disputes. In addition, specific legal and safety issues are inherent with respect to system development, marketing, and potential liability for losses that may be linked to actions taken on the advice of the expert system. It is inevitable that plaintiff actions based on defects in such software will occur as expert systems achieve increasing market penetration. Legal liabilities, such as manufacturing defects, design defects, and marketing defects, must be considered, and system safety should be addressed through the use of preliminary hazard analysis, failure modes and effects analysis, and systems modification. Dealing with these issues now can prevent potentially useful technological developments from being buried under the burden of poorly conceived, executed, and marketed products.