विधियों की तुलना करें

	कुल्बैक-लीब्लर डाइवर्जेंस	जेन्सेन-शैनन डाइवर्जेंस
क्षेत्र	निर्णयन	निर्णयन
परिवार	MCDM	MCDM
उद्भव वर्ष	1951	1991
प्रवर्तक	Solomon Kullback and Richard Leibler	J. Lin
प्रकार	Asymmetric probability distribution dissimilarity	Symmetric probability distribution dissimilarity
मौलिक स्रोत	Kullback, S., & Leibler, R. A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22(1), 79-86.	Lin, J. (1991). Divergence measures based on the Shannon entropy. IEEE Transactions on Information Theory, 37(1), 145-151.
उपनाम	KL divergence, relative entropy, information divergence	JS divergence, symmetric KL divergence, JS distance
संबंधित	2	2
सारांश	Kullback-Leibler divergence, also called relative entropy or information divergence, measures the asymmetric difference between two probability distributions. Introduced by Solomon Kullback and Richard Leibler in 1951, this information-theoretic measure quantifies how one probability distribution diverges from a reference distribution, ranging from 0 (identical distributions) to infinity. It is foundational in information theory, machine learning, and decision-making with probabilistic frameworks.	Jensen-Shannon divergence is a symmetric information-theoretic measure of the difference between two probability distributions. Developed by Jian Lin in 1991 as a refinement to the asymmetric Kullback-Leibler divergence, it overcomes KL's directional limitation by averaging the divergences in both directions. The result is a true metric (satisfying triangle inequality) that ranges from 0 (identical distributions) to 1, making it suitable for symmetric comparison tasks.