Data acquisition method and device based on web crawler

The invention provides a data acquisition method and device based on web crawlers. The method comprises the following steps: acquiring configuration information of a target server, and generating a login message according to the configuration information; wherein the configuration information comprises login information and request information; the login message is sent to the target server; receiving website information generated by the target server according to the login message; generating a manual operation request according to the website information and sending the manual operation request to the target server; receiving first operation information generated by the target server according to the manual operation request; and generating operation data of the target server according to the first operation information. By obtaining the data operation data, the data of the agent management station can be automatically obtained, the labor cost is reduced, and various data queries and complex data reports in