Dynamic monitoring method of mutation event network public opinion based on topic crawler

Qianqian Li; Jing Li; Zhihang Wang; Wenjie Fan

doi:10.1117/12.2667861

8 March 2023 Dynamic monitoring method of mutation event network public opinion based on topic crawler

Qianqian Li, Jing Li, Zhihang Wang, Wenjie Fan

Proceedings Volume 12586, Second International Conference on Green Communication, Network, and Internet of Things (CNIoT 2022); 125860U (2023) https://doi.org/10.1117/12.2667861
Event: Second International Conference on Green Communication, Network, and Internet of Things (CNIoT 2022), 2022, Xiangtan, China

Abstract

With the rapid development of Internet and the increasing amount of information, it is necessary to use big data technology to solve the bottleneck of processing speed and storage of traditional public opinion monitoring in the era of big data. In this paper, Hadoop open source platform is used to build a big data foundation, realize distributed storage of data, use MapReduce and Spark to realize distributed computing and processing of data, and process the collected data in text. The algorithm model is used to classify and cluster the text information to complete the analysis of text emotional tendency, topic discovery and tracking, and innovatively grasp the public opinion information status of network emergencies. The experimental results from the acquisition rate and average correlation test prove that the algorithm in this paper has higher calculation accuracy. It can provide real-time and effective public opinion analysis service.

Citation Download Citation

Qianqian Li, Jing Li, Zhihang Wang, and Wenjie Fan "Dynamic monitoring method of mutation event network public opinion based on topic crawler", Proc. SPIE 12586, Second International Conference on Green Communication, Network, and Internet of Things (CNIoT 2022), 125860U (8 March 2023); https://doi.org/10.1117/12.2667861

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available