The Jensen-Shannon divergence is a principled divergence measure which is always finite.
The Jensen-Shannon Divergence: H(sum(w_i*P_i)) - sum(w_i*H(P_i)).
jsd (float) – The Jensen-Shannon Divergence