Supervised redundant feature detection for tumor classification

BMC Medical Genomics

Table 1 Related feature selection methods

Methods	Predictive power	Redundancy measure	Merit function of candidate feature	Ref
CFS	I(X_i; Y)	I(X_p; X_i)	$Δ (∑ i = 1 p I (X i; Y) p + ∑ i = 1 p ∑ j = 1 p I (X i; X j))$	[12]
MIFS	I(X_p; Y)	I(X_p; X_i)	$I (X p; Y) - β ∑ i = 1 p - 1 I (X p; X i)$	[13]
mRMR	I(X_p; Y)	I(X_p; X_i)	$I (X p; Y) - 1 p - 1 ∑ i = 1 p - 1 I (X p; X i)$	[16]
MIFS-U	I(X_p; Y)	$I X i; Y H X i I X p; X i$	$I (X p; Y) - β ∑ i = 1 p - 1 [I X i; Y H X i I X p; X i]$	[14]
mIMR, JMI	I(X_p; Y)	I(X_i; X_p; Y)	$I (X p; Y) - 1 p - 1 ∑ i = 1 p - 1 [I (X i; X p) - I (X i; X p \| Y)]$	[17],[24]
CMIM, IF	I(X_p; Y)	I(X_i; X_p; Y)	I(X_p; Y) − max_{i ∈[1:p−1]}[I(X_p; X_i) − I(X_p; X_i\|Y)]	[18],[25]