- What type of answer do you expect?
- Did you read the documentation on textscan?
- "How do I properly use these parameters when calling the textscan function?" The answer is in the documentation.
- Did you experiment with reading a small text file with textscan?
- Did you search for textscan here at Answer?
Reading in ugly data files
4 ビュー (過去 30 日間)
古いコメントを表示
I created a simple data processing script using importdata. I am trying to process a new txt file using this script, but the structure of the data is very different, and importdata is getting tripped up somehow. I've decided to try and change the program a bit to use something more flexible, like textscan.
First, what do you recommend for reading in text file data that has both strings and numerical data? Is textscan really the best option?
Second, how do I deal with HUGE swaths of empty data cells in this particular text file?
edit: I know it says not to do this, but it has become obvious that I should say I am very new to matlab, so I don't really know what you mean when you say "EmptyValue" and "TreatAsEmpty." How do I properly use these parameters when calling the textscan function?
5 件のコメント
Matt Kindig
2012 年 10 月 29 日
Hi Ryan,
From this line, what data do you need to extract? I'm thinking that regular expressions (regexp() function) would be better for you. In my experience working with irregularly structured text files, regexp() is more flexible/efficient than textscan() or the like. From this line, what form of the output data do you expect?
採用された回答
Argon
2012 年 10 月 30 日
I don't know how efficient that is, but I would try something like this:
- preallocate your data variable
- open the text file with fopen
- start a loop
- read line by line with fgetl
- ignore the first 10 lines
- use something like regexp(line, ',', 'split')
- extract and the columns you need, apply trimming and type conversion, ignore a cell if it's empty, and any other post-processing of the cell values
- end loop
- call fclose
その他の回答 (2 件)
per isakson
2012 年 10 月 26 日
編集済み: per isakson
2012 年 10 月 26 日
- textscan is a good alternative for "... both strings and numerical data"
- with textscan all data rows need to have the same format otherwise it becomes a bit tricky.
- The options EmptyValue and TreatAsEmpty will take care of "empty data cells"
- HUGE means different things to different people. The amount of empty cells shouldn't be a problem.
0 件のコメント
Kevin
2012 年 10 月 30 日
編集済み: Kevin
2012 年 10 月 30 日
I have been doing something similar recently.
I think textscan should work,
% open the file (replace datapath with your file location)
fid = fopen(datapath);
% skip first ten lines (change the bufsize if it's not big enough) % raw will contain the first ten lines, pos is the current position in the file
[raw, pos] = textscan(fid, '%[^\n]',10, 'delimiter', ',', 'BufSize',100000);
% now you can use something like this to read in the first three columns % change the order of the %f %f %s to match your data types
data = textscan(fid, '%f %f %s %*[^\n]', 'delimiter', ',', 'BufSize',100000);
% close the file fclose(fid)
data should now contain the first three columns of your data.
Hopefully I have that correct!! No doubt there is a quicker way to do this.
0 件のコメント
参考
カテゴリ
Help Center および File Exchange で Text Data Preparation についてさらに検索
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!