Process / pipelineData collection
Web Scraping — Automated Web Data Collection
Web scraping is a computational data collection technique in which software automatically retrieves and extracts structured or semi-structured content from websites. Widely used in social science, computational linguistics, economics, and information science, it enables researchers to assemble large datasets from publicly accessible web sources — such as news archives, social media platforms, government portals, and online marketplaces — that would be impractical to collect manually.
Find Topic with PaperMindSoonVideoSoon
Read the full method
Members only
Sign inSign in with a free account to read this section.
Sources
- Mitchell, R. (2018). Web Scraping with Python: Collecting More Data from the Modern Web (2nd ed.). O'Reilly Media. ISBN: 978-1491985571
- Web scraping. Wikipedia. link ↗
Related methods
Referenced by
API-based Data CollectionLongitudinal Web ScrapingMobile API-based Data CollectionMulti-source API-based Data CollectionOnline Document CollectionOnline Non-participant ObservationOnline Sensor Data CollectionPilot-tested API-based data collectionRemote Document CollectionRemote Sensor Data CollectionRemote Web ScrapingSensor Data Collection