Automatic testing method and device, electronic equipment and storage medium

The embodiment of the invention discloses an automatic testing method and device, electronic equipment and a storage medium, and relates to the technical field of software testing, a gateway program is operated within preset time, operation data of a related user is collected, the collected operation data is stored through a gateway program calling interface to serve as sample data for testing a new version, and the test efficiency is improved. The experimental group is the operating environment of the first version, the control group is the operating environment of the second version, a first execution report and a second execution report are correspondingly generated, and a comparison report is generated by comparing the first execution report with the second execution report; and obtaining a test result of the first version. Therefore, a tester does not need to learn related knowledge of the development platform, does not need to write or add a test case, and can realize comprehensive test with high accura