Research on Data Collection and Analysis of Second Hand House in China Based on Python

Publications

Share / Export Citation / Email / Print / Text size:

International Journal of Advanced Network, Monitoring and Controls

Xi'an Technological University

Subject: Computer Science, Software Engineering

GET ALERTS

eISSN: 2470-8038

DESCRIPTION

0
Reader(s)
0
Visit(s)

Comment(s)
0
Share(s)

SEARCH WITHIN CONTENT

FIND ARTICLE

Volume / Issue / page

Related articles

VOLUME 6 , ISSUE 2 (Jul 2021) > List of articles

Research on Data Collection and Analysis of Second Hand House in China Based on Python

Hejing Wu * / Ran Cui

Keywords : Python Crawler, Scrapy framework, Django Framework, HOME LINK

Citation Information : International Journal of Advanced Network, Monitoring and Controls. Volume 6, Issue 2, Pages 37-47, DOI: https://doi.org/10.21307/ijanmc-2021-015

License : (CC-BY-NC-ND 4.0)

Published Online: 12-July-2021

ARTICLE

ABSTRACT

Graphical ABSTRACT

Content not available Share

FIGURES & TABLES

Figure 1.

Basic principles of Scrapy frame

Figure 2.

Crawling process

Figure 3.

Full information display

Figure 4.

Pie Chart of rent per district

Figure 5.

Pie Chart of rental housing according to the ratio of each direction

Figure 6.

The broken line chart of the average rent price in Beijing

Figure 7.

The bar chat of Renting in Beijing

Figure 8.

Generating wordcloud presentation

Basic principles of Scrapy frame

Crawling process

Crawling process

Full information display

Full information display

Pie Chart of rental housing according to the ratio of each direction

Pie Chart of rental housing according to the ratio of each direction

The broken line chart of the average rent price in Beijing

The bar chat of Renting in Beijing

The bar chat of Renting in Beijing

REFERENCES

  1. Yuhao Fan. Design and implementation of distributed crawler system based on scrapy [J]. IOP Conference Series: Earth and Environmental Science, 2018, 108(4):2–8.
  2. Jing Wang, Yuchun Guo. Scrapy-based crawling and user-behavior characteristics analysis on taobao [P]. Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), 2012 International Conference on, 20120:1–5.
  3. Ryan Mitchell. Python web crawler authority Guide (Second Edition) [M]. Beijing: People’s post and Telecommunications Press, 2019:57–70.
  4. Wei Chengcheng. Data information crawler technology based on Python [J]. Electronic world, 2018 (11): 208–209.
  5. Mark. Lutz. Python learning manual (Fifth Edition, Volume I) [M]. Beijing: Mechanical Industry Press, 2019:1–2.

EXTRA FILES

COMMENTS