Soft Entropy Estimation

P(Z) — aggregate

P(Ẑ | z₁)

H(Z) aggregate

−

H(Z | z₁) selected

          I(Z ; z₁)
          
          mutual information

embeddings z anchors wᵢ

0.00

bits

H(Z) — entropy of aggregate distribution

ε 0.10

n(z) 6

z concentration 0.00