Cross Entropy in statistics

a measure of the difference between two probability distributions for a set of events.