ScholarGate
アシスタント

手法を比較

選択した手法を並べて確認できます。異なる行はハイライト表示されます。

Web Scraping×APIベースのデータ収集×
分野調査方法論調査方法論
系統Process / pipelineProcess / pipeline
提唱年Late 1990s–2000s2000s–2010s (formalized as a research method)
提唱者Early internet practitioners; systematised in research contexts from the late 1990s onwardEmerged from computational social science and web 2.0 platform practices
種類Automated digital data collection techniqueDigital data collection technique
原典Mitchell, R. (2018). Web Scraping with Python: Collecting More Data from the Modern Web (2nd ed.). O'Reilly Media. ISBN: 978-1491985571Salganik, M. J. (2018). Bit by Bit: Social Research in the Digital Age. Princeton University Press. ISBN: 9780691158648
別名web harvesting, screen scraping, web crawling, automated data extractionAPI data harvesting, API-driven data collection, programmatic data retrieval, API research data collection
関連55
概要Web scraping is a computational data collection technique in which software automatically retrieves and extracts structured or semi-structured content from websites. Widely used in social science, computational linguistics, economics, and information science, it enables researchers to assemble large datasets from publicly accessible web sources — such as news archives, social media platforms, government portals, and online marketplaces — that would be impractical to collect manually.API-based data collection is a systematic technique in which a researcher sends structured requests to an application programming interface to retrieve data automatically from digital platforms, databases, or services. It is the primary method used in computational social science to gather large-scale social media records, government open data, financial data streams, and scientific repository content in machine-readable formats such as JSON or XML, enabling reproducible and scalable data acquisition that manual collection cannot match.
ScholarGateデータセット
  1. v1
  2. 2 出典
  3. PUBLISHED
  1. v1
  2. 2 出典
  3. PUBLISHED

検索へ スライドをダウンロード

ScholarGate手法を比較: Web Scraping · API-based Data Collection. 2026-06-15に以下より取得 https://scholargate.app/ja/compare