tool for performing data preprocessing

I want to perform data preprocessing operations such as handling missing data, outliers normalization of data etc.Is there any tool which can help me out.

[Bob Thompson]

What do you mean by 'tool?' Are you looking for complete programs outside of matlab, created scripts in matlab, or commands to make your own script in matlab?

As a general rule there are lots of ways to process data, especially within matlab. If you want something more specific than that you will need to expand on what exactly you're looking to do with your data, and especially include any portions of code you're having troubles with.

[sushma khatri]

As we have many tools for solving different problem similarly I want a tool in matlab that can help me out in preprocessing of the data.

Actually I am working on Software effort prediction where I have to preprocess the data before predicting the effort using the nftool available in matlab.

[Bob Thompson]

Ok, so you want to use matlab to preprocess your data.

What format is your data in? What type of file? How is it organized?

What type of 'preprocessing' are you looking to do? Do you just want to rearrange it? Fill in missing information? Filter out unwanted information?

What type of output format do you want?

[sushma khatri]

My data is in csv or excel format.

Row column way it is organized.

Handle missing values, Normalization, Outliers

[Bob Thompson]

Do you have any experience with matlab?

[sushma khatri]

yes

worked on NN toolbox

currentky working on nftool

[Bob Thompson]

Off the top of my head I can suggest xlsread, xlswrite, indexing for organization, normalize, std, mean, and maybe padarray.

That's about the best any of us can offer without a more detailed explanation of what you are trying to accomplish.

Answer 1

[Steven Lord]

MATLAB has a number of functions to perform various types of data preprocessing tasks. That page lists some of the functions for detecting and cleaning missing data, detecting and removing outliers, and normalizing data (which are the three tasks you described in your question) as well as data grouping / binning and data smoothing / detrending.

[sushma khatri]

Is there any tool which can help me

[Bob Thompson]

There are lots of tools available through the link.

We cannot tell you if there is a tool that can specifically help you because you haven't given us any details on what you're trying to do. All you've done is given us a general idea like, 'I want to build a house. What tools should I use?' The type of tools you need are highly dependant on what you are using to build the house. If you are using screws to build the house, then me giving you a hammer isn't going to help you very much. Because you haven't given us any details we've done the best we can, showing you where the tool box is, but we can't do any more until you give us more details on the specifics of what you're trying to accomplish.

[Steven Lord]

If by "tool" you mean a GUI or an app, the answer is partially yes. In the just-released release R2019b, we introduced Live Editor Tasks. Two of the Live Editor tasks we introduced deal with cleaning missing data and cleaning outliers.