Skip to contentScholarGate
LibraryBookshelfDeskReview StudioAssistant
Sign in
Longitudinal Web Scraping/Evidence
Method evidence record

Longitudinal Web Scraping

Longitudinal web scraping is a data collection technique that uses automated scripts to extract content from websites at multiple, predefined time points. By revisiting the same web sources repeatedly, researchers build a time-series dataset that captures how online content, prices, discourse, or behavior evolves. It is widely used in computational social science, economics, political science, health research, and digital humanities to study change without relying on retrospective self-report.

Sources recorded, not reviewed

Source record

Citations copied verbatim from the method’s source record. No claim-level verification is inferred from them.

Longitudinal Web Scraping for Research
Taxonomic method record · process-pipeline / survey-methodology
  • Salganik, M. J. (2018). Bit by Bit: Social Research in the Digital Age. Princeton University Press. · ISBN 978-0691158648
  • Luscombe, A., Dick, K., & Walby, K. (2022). Algorithmic thinking in the public interest: navigating technical, legal, and ethical challenges in government web scraping. Quality & Quantity, 56(3), 1781–1802. · DOI 10.1007/s11135-021-01164-0
Open full method

Curated claims

Claims persisted in the evidence ledger, each with its own assessment.

No curated claims yet

This view does not invent a claim assessment when the ledger has none.

Related methods

Generated from the method graph and shown as machine-suggested relations — no evidence claim is inferred.

Taxonomic bucketAPI-based Data Collectionmachine-suggested · Relational suggestion, not evidence.Same method familyContent Analysismachine-suggested · Relational suggestion, not evidence.Taxonomic bucketLongitudinal Surveymachine-suggested · Relational suggestion, not evidence.Taxonomic bucketSensor Data Collectionmachine-suggested · Relational suggestion, not evidence.Taxonomic bucketWeb Scrapingmachine-suggested · Relational suggestion, not evidence.

Evidence status

Sources recorded, not reviewed

Bibliographic sources are present. Claim-level evidence review has not been performed.

Sources

2 recorded citations, copied from the method source record.

Actions

Open method page
ScholarGate

A content-first reference library for research methods — what each one is, how it works, and where it comes from.

Open data (CC-BY)

Explore

  • Library
  • Search the library…
  • Browse by field
  • Fields
  • Journey
  • Compare
  • Which method?

Reference

  • Subjects
  • Atlas
  • Glossary
  • Methodology
  • Philosophy

Your tools

  • Bookshelf
  • Desk
  • Chat

Company

  • About
  • Pricing
  • Contact
  • Suggest a method

Entries are compiled from published sources for reference. Verifying the accuracy and suitability of any information for your own use remains your responsibility.

© 2026 ScholarGate · A research-method reference library
  • Privacy
  • Cookies
  • Terms
  • Delete account