Benchmark and Acceptance Tests: Why and When to Use Them

Acceptance and benchmark tests will provide important assurances that an automation system will meet defined performance requirements. Three acceptance tests should be required by a library and performed by the vendor: 1) a system reliability acceptance test, 2) one or more functional performance acceptance test, and 3) a full load response time acceptance test. Additionally, a library may require that benchmark tests be conducted after a vendor has been selected, but before a computer is installed in the library, if the vendor does not have installed systems comparable to the library's requirements, or if other similar systems have not previously met the library's performance objectives.