Method evidence record
Language Identification
Language identification is a natural-language-processing task that automatically detects which language a piece of text is written in. Building on off-the-shelf tools such as langid.py (Lui & Baldwin, 2012) and the efficient classifiers of Joulin et al. (2017), it is widely used to preprocess and filter multilingual data sets.
Source record
Citations copied verbatim from the method’s source record. No claim-level verification is inferred from them.
Language Identification (LID)
Taxonomic method record · process-pipeline / text-mining
- Lui, M. & Baldwin, T. (2012). langid.py: An Off-the-shelf Language Identification Tool. Proceedings of the ACL 2012 System Demonstrations. · URL
- Joulin, A., Grave, E., Bojanowski, P. & Mikolov, T. (2017). Bag of Tricks for Efficient Text Classification. Proceedings of the EACL 2017. · URL
Curated claims
Claims persisted in the evidence ledger, each with its own assessment.
No curated claims yet
This view does not invent a claim assessment when the ledger has none.
Related methods
Generated from the method graph and shown as machine-suggested relations — no evidence claim is inferred.