Collocation Analysis — Word Association
Collocation Analysis (Word Association) · Also known as: word association, collocation extraction, Birliktelik Analizi (Collocation Analysis)
Collocation analysis is a statistical text-mining technique that identifies word pairs or expressions that frequently occur together, using association measures rather than chance co-occurrence. Introduced in the lexicography work of Church and Hanks (1990), it is used for terminology extraction and language analysis, surfacing the multi-word units that carry meaning in a corpus.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
+3 more
When to use it
Collocation analysis fits when you have a reasonably sized text corpus (around 50 or more documents) and want to find meaningful multi-word units rather than single-word frequencies. It suits exploratory and descriptive work in terminology extraction and linguistic analysis. It assumes enough text for stable co-occurrence statistics and that stop-words have been cleaned first; with very little text the association scores become unreliable.
Strengths & limitations
- Surfaces meaningful multi-word expressions and fixed phrases that single-word frequency counts miss.
- Statistical association measures separate genuine word associations from chance adjacency.
- Conceptually simple and easy to apply for terminology extraction and language analysis.
- Needs a sufficiently large corpus for the co-occurrence statistics to be stable.
- Results depend heavily on preprocessing — leftover stop-words distort the associations.
- Measures like PMI can over-reward rare word pairs that happen to co-occur a few times.
Frequently asked
What exactly is a collocation?
A collocation is a pair or sequence of words that co-occurs more often than chance would predict — a habitual word association such as 'strong tea' or 'make a decision'. Collocation analysis finds these by scoring co-occurrence statistically rather than reading them off a frequency list.
How is collocation analysis different from frequency analysis?
Frequency analysis counts how often words or n-grams appear. Collocation analysis goes further: it asks whether two words appear together more than expected by chance, using an association measure, so it surfaces meaningful pairings rather than merely common ones.
What is PMI and why is it used?
Pointwise mutual information (PMI) compares how often two words occur together against how often they would be expected to co-occur independently. A high PMI flags a strong association. Because PMI can over-reward rare pairs, a minimum co-occurrence count is usually applied before ranking.
How much text do I need?
The technique expects a reasonably sized corpus — on the order of 50 or more documents — so that co-occurrence counts are stable. With too little text the association scores fluctuate and the extracted collocations become unreliable.
Sources
- Church, K.W. & Hanks, P. (1990). Word Association Norms, Mutual Information, and Lexicography. Computational Linguistics, 16(1), 22-29. link ↗
- Manning, C.D. & Schütze, H. (1999). Foundations of Statistical Natural Language Processing. MIT Press. ISBN: 9780262133609
How to cite this page
ScholarGate. (2026, June 1). Collocation Analysis (Word Association). ScholarGate. https://scholargate.app/en/text-mining/collocation-analysis
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Dependency ParsingText mining↔ compare
- Lexical DiversityText mining↔ compare
- Text Frequency AnalysisText mining↔ compare