ScholarGate
Trợ lý

So sánh phương pháp

Xem các phương pháp đã chọn cạnh nhau; những hàng khác biệt được làm nổi bật.

Phân kỳ Kullback-Leibler×Độ lệch Jensen-Shannon×
Lĩnh vựcRa quyết địnhRa quyết định
HọMCDMMCDM
Năm ra đời19511991
Người khởi xướngSolomon Kullback and Richard LeiblerJ. Lin
LoạiAsymmetric probability distribution dissimilaritySymmetric probability distribution dissimilarity
Công trình gốcKullback, S., & Leibler, R. A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22(1), 79-86. DOI ↗Lin, J. (1991). Divergence measures based on the Shannon entropy. IEEE Transactions on Information Theory, 37(1), 145-151. DOI ↗
Tên gọi khácKL divergence, relative entropy, information divergenceJS divergence, symmetric KL divergence, JS distance
Liên quan22
Tóm tắtKullback-Leibler divergence, also called relative entropy or information divergence, measures the asymmetric difference between two probability distributions. Introduced by Solomon Kullback and Richard Leibler in 1951, this information-theoretic measure quantifies how one probability distribution diverges from a reference distribution, ranging from 0 (identical distributions) to infinity. It is foundational in information theory, machine learning, and decision-making with probabilistic frameworks.Jensen-Shannon divergence is a symmetric information-theoretic measure of the difference between two probability distributions. Developed by Jian Lin in 1991 as a refinement to the asymmetric Kullback-Leibler divergence, it overcomes KL's directional limitation by averaging the divergences in both directions. The result is a true metric (satisfying triangle inequality) that ranges from 0 (identical distributions) to 1, making it suitable for symmetric comparison tasks.
ScholarGateBộ dữ liệu
  1. v1
  2. 2 Nguồn tài liệu
  3. PUBLISHED
  1. v1
  2. 2 Nguồn tài liệu
  3. PUBLISHED

Đến trang tìm kiếm Tải xuống bản trình chiếu

ScholarGateSo sánh phương pháp: Kullback-Leibler Divergence · Jensen-Shannon Divergence. Truy cập ngày 2026-06-19 từ https://scholargate.app/vi/compare