방법 비교
선택한 방법을 나란히 검토하세요. 서로 다른 행은 강조 표시됩니다.
| 쿨백-라이블러 발산× | Jensen-Shannon 발산× | |
|---|---|---|
| 분야 | 의사결정 | 의사결정 |
| 계열 | MCDM | MCDM |
| 기원 연도≠ | 1951 | 1991 |
| 창시자≠ | Solomon Kullback and Richard Leibler | J. Lin |
| 유형≠ | Asymmetric probability distribution dissimilarity | Symmetric probability distribution dissimilarity |
| 원전≠ | Kullback, S., & Leibler, R. A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22(1), 79-86. DOI ↗ | Lin, J. (1991). Divergence measures based on the Shannon entropy. IEEE Transactions on Information Theory, 37(1), 145-151. DOI ↗ |
| 별칭 | KL divergence, relative entropy, information divergence | JS divergence, symmetric KL divergence, JS distance |
| 관련 | 2 | 2 |
| 요약≠ | Kullback-Leibler divergence, also called relative entropy or information divergence, measures the asymmetric difference between two probability distributions. Introduced by Solomon Kullback and Richard Leibler in 1951, this information-theoretic measure quantifies how one probability distribution diverges from a reference distribution, ranging from 0 (identical distributions) to infinity. It is foundational in information theory, machine learning, and decision-making with probabilistic frameworks. | Jensen-Shannon divergence is a symmetric information-theoretic measure of the difference between two probability distributions. Developed by Jian Lin in 1991 as a refinement to the asymmetric Kullback-Leibler divergence, it overcomes KL's directional limitation by averaging the divergences in both directions. The result is a true metric (satisfying triangle inequality) that ranges from 0 (identical distributions) to 1, making it suitable for symmetric comparison tasks. |
| ScholarGate데이터셋 ↗ |
|
|