Maintaining Consistent CNN Accuracy with Shuffled Features

I applied a Convolutional Neural Network (CNN) to a matrix with dimensions of 50,000 × 39 features, which yielded an accuracy of 90%. However, when I shuffled or disordered the 39 features, the accuracy dropped to 88%. It's worth noting that I used the same dataset for both scenarios. I'm looking for guidance on how to resolve this issue and maintain a consistent accuracy of 90%. PS: I have used the same data in both cases.

Answer 1

[Rishi]

Hi Hamza,

I understand from your query that you want to achieve the same accuracy when you change the order of your features. The drop in accuracy when shuffling or disordering the features suggests that the order of the features affects the performance of your CNN model. This can happen when the model relies on spatial or sequential information present in the original feature order.

You can try the following methods to maintain accuracy regardless of the feature order.

• Feature Normalization: This would ensure that the magnitude of the features is consistent and the impact of the difference in scales is reduced. You can use ‘zscore’ or ‘normalize’ in MATLAB to do this. You can learn more about them from the documentation linked below:

https://www.mathworks.com/help/stats/zscore.html

https://www.mathworks.com/help/matlab/ref/double.normalize.html

• Data Augmentation: Augment your dataset by creating additional samples with different feature orders. This can be done through ‘randomAffine2d’ or ‘imwarp’ function. You can learn more about them from the documentation:

https://www.mathworks.com/help/images/ref/randomaffine2d.html

https://www.mathworks.com/help/images/ref/imwarp.html

• Ensemble Method: It is used to train multiple CNN models with different feature orders and combine their predictions. You can use ‘fitcensemble’ function for this. You can find more information about this in the below documentation:

https://www.mathworks.com/help/stats/fitcensemble.html

Hope this helps.

[Hamza]

Hi @Rishi thanks a lot for your answer, I have tried all of them, the issue not resolved yet!