zgong001 wrote:The attached is the detailed process of calculating the conditional entropy H( 4| (0,1) ), H( 4 | (2,3) ), H( 7| (0,1) ) and H( 7| (2,3) ).
Seems you did not include the variable score. Please double check whether the following are correct:
score(4|0,1) : -45.9502
Entropy( 4, | (0,1) ) = - ∑P(4,0,1)*LOG( P(4,0,1) / P(0,1) ) = 0.37
score(4|2,3) : -64.7611
Entropy( 4, | (2,3) ) = - ∑P(4,2,3)*LOG( P(4,2,3) / P(2,3) ) = 0.55
score(7|0,1) : -76.8047
Entropy( 7, | (0,1) ) = - ∑P(7,0,1)*LOG( P(7,0,1) / P(0,1) ) = 0.64
score(7|2,3) : -75.5604;
Entropy( 7, | (2,3) ) = - ∑P(7,2,3)*LOG( P(7,2,3) / P(2,3) ) = 0.58
Please check for all other pairs as well as different entropy, e,g, for variable 4, entropy (4), entropy (4|0), entropy (4|1), entropy (4|2), and entropy (4|3).