ScholarGate
어시스턴트

방법 비교

선택한 방법을 나란히 검토하세요. 서로 다른 행은 강조 표시됩니다.

형태소 분석×언어 식별 (LID)×Text Segmentation×
분야텍스트 마이닝텍스트 마이닝텍스트 마이닝
계열Process / pipelineProcess / pipelineProcess / pipeline
기원 연도19801997
창시자M.F. Porter (Porter stemmer)Marti A. Hearst (TextTiling)
유형Text-normalisation preprocessing taskNLP text-classification taskNLP document-structure / topic-boundary detection
원전Porter, M.F. (1980). An Algorithm for Suffix Stripping. Program, 14(3), 130-137. DOI ↗Lui, M. & Baldwin, T. (2012). langid.py: An Off-the-shelf Language Identification Tool. Proceedings of the ACL 2012 System Demonstrations. link ↗Hearst, M.A. (1997). TextTiling: Segmenting Text into Multi-Paragraph Subtopic Passages. Computational Linguistics, 23(1), 33-64. link ↗
별칭stemming, lemmatization, Morfolojik Analiz ve Kök Bulmalanguage detection, LID, Dil Tanımlama (Language Identification)topic segmentation, discourse segmentation, linear text segmentation, Metin Bölümleme (Text Segmentation)
관련444
요약Morphological analysis splits words into their stems and affixes so that different surface forms of the same word can be treated as one. It covers two complementary approaches — rule-based stemming, such as the Porter (1980) and Snowball algorithms, and dictionary-aware lemmatization — and is a critical text-normalisation step for agglutinative languages such as Turkish and Arabic.Language identification is a natural-language-processing task that automatically detects which language a piece of text is written in. Building on off-the-shelf tools such as langid.py (Lui & Baldwin, 2012) and the efficient classifiers of Joulin et al. (2017), it is widely used to preprocess and filter multilingual data sets.Text segmentation divides a long document into meaningful sections (segments) along topic or discourse boundaries. Introduced for subtopic passages by Marti A. Hearst's TextTiling (1997), it supports document-structure analysis and the detection of topic transitions in continuous text.
ScholarGate데이터셋
  1. v1
  2. 2 출처
  3. PUBLISHED
  1. v1
  2. 2 출처
  3. PUBLISHED
  1. v1
  2. 2 출처
  3. PUBLISHED

검색으로 이동 슬라이드 다운로드

ScholarGate방법 비교: Morphological Analysis · Language Identification · Text Segmentation. 2026-06-18에 다음에서 검색함: https://scholargate.app/ko/compare