Object Architected Design and Efficient Dynamic Adjustment Mechanism of Distributed Web Crawlers

As the global socialnomics rise, big data makes enterprises face the tremendous tide of data at any time. How to efficiently process, analyze these unstructured data and dig useful information from them has been an issue for every level of enterprises to face and settle. Gartner conducted a survey (Gartner CIO Agenda) over 2300 CIOs worldwide and found out that the business intelligence based on big data has been the primary issue (IBM, 2013). Hence, by understanding the above developing trend of social media, this research is mainly based on the authors' previously proposed paper in ises face the tremendous ti:Design and Implementation of a Web Crawlers Based in Social Networkst any time. How to efficiently process, analyze these unstructured data and dig useful infed architecture of web crawler. This new architecture is added with the concept of object structure for the design and implementation of the whole system. The authors will also investigate the improved object structure that brings the convenience of system maintenance.