A large-scale network data sensing and acquiring method and system

The invention relates to a large-scale network data sensing and acquiring method, which comprises the following steps of: sensing an information source of network data, splitting the information source into information sources, and setting an acquisition strategy for the information sources; generating an acquisition task, registering an acquisition node, and pulling a collector by the registration node and configuring the collector; Executing the collection task through the collector according to the collection strategy, and obtaining structured data; And monitoring the execution state of thecollection task, counting the structured data, and sending a monitoring result and a counting result to a user. The invention discloses a large-scale network data sensing and acquiring system. According to different functional logic, the system is divided into an acquisition sub-platform, a scheduling sub-platform, an information source management and configuration sub-platform and a monitoring and statistics sub-platfor