Table 1 Related feature selection methods

CFS

I(X _i ; Y)

I(X _p ; X _i )

$\text{Δ}\left(\frac{{\sum }_{i=1}^{p}I\left(X_i;Y\right)}{\sqrt{p+{\sum }_{i=1}^p{\sum }_{j=1}^{p}I\left(X_i;X_j\right)}}\right)$

[12]

MIFS

I(X _p ; Y)

I(X _p ; X _i )

$I\left(X_p;Y\right)-\beta {\sum }_{i=1}^{p-1}I\left(X_p;X_i\right)$

[13]

mRMR

I(X _p ; Y)

I(X _p ; X _i )

$I\left(X_p;Y\right)-\frac{1}{p-1}{\sum }_{i=1}^{p-1}I\left(X_p;X_i\right)$

[16]

MIFS-U

I(X _p ; Y)

$\frac{I\left(X_i;Y\right)}{H\left(X_i\right)}I\left(X_p;X_i\right)$

$I\left(X_p;Y\right)-\beta {\sum }_{i=1}^{p-1}\left[\frac{I\left(X_i;Y\right)}{H\left(X_i\right)}I\left(X_p;X_i\right)\right]$

[14]

mIMR, JMI

I(X _p ; Y)

I(X _i ; X _p ; Y)

$I\left(X_p;Y\right)-\frac{1}{p-1}{\sum }_{i=1}^{p-1}\left[I\left(X_i;X_p\right)-I\left(X_i;X_p|Y\right)\right]$

[17],[24]

CMIM, IF

I(X _p ; Y)

I(X _i ; X _p ; Y)

I(X _p ; Y) − max_{i ∈[1:p−1]}[I(X _p ; X _i ) − I(X _p ; X _i |Y)]

[18],[25]