Description:
Returns the Shannon entropy value of the data classified.
data : list of classes distribution (typically data from class-1;
res : absolute or relative;
OUT
Shannon entropie value
0 <= entropy <= (log n 2) if res = absolute;
0 <= entropy <= 1.0 if res = relative.
Cf. J. Wasemberg : L ‰me de la meduse, idees sur la complexite du monde,
Seuil, Paris, 1997.
|