textscan: skipping rows with missing data
조회 수: 5 (최근 30일)
이전 댓글 표시
I'm using textscan() to open large txt files. Every so often I get a line where the value in the third column is missing, so everything gets shifted and text scan stops reading the data and just returns everything up until this point. The data kind of looks like this, although really it's 5 string columns followed by 30 double columns. It doesn't seem to want to preserve my formatting which would make it easier to see but I think this is still helpful
string string double double double
string double double double
string string double double double
string string double double double
string string double double double
Does anyone know a way to deal with that other than going in and manually deleting those incomplete lines from the individual text files?
댓글 수: 4
Thorsten
2014년 12월 3일
It would be helpful if you post your file, or at least some of the lines with the different number of columns.
답변 (2개)
per isakson
2014년 12월 2일
편집: per isakson
2014년 12월 3일
"columns are separated by tabs"
textscan should take care of missing data automagically!  Replace 'Delimiter', ',' by 'Delimiter', ','\t' in these examples
>> cac = textscan( 'abc,,1,2,3', '%s%s%f%f%f', 'Delimiter', ',' )
cac =
{1x1 cell} {1x1 cell} [1] [2] [3]
>> cac{2}
ans =
{''}
>>
and
>> cac = textscan( 'abc,def,1,,3', '%s%s%f%f%f', 'Delimiter', ',' )
cac =
{1x1 cell} {1x1 cell} [1] [NaN] [3]
 
"Then when there is the bad line it has tab+ a few spaces in place of the missing strings"
>> cac = textscan( 'abc, ,1,2,3', '%s%s%f%f%f', 'Delimiter', ',' )
cac =
{1x1 cell} {1x1 cell} [1] [2] [3]
>> cac{2}
ans =
{''}
and
>> cac = textscan( 'abc,def,1, ,3', '%s%s%f%f%f', 'Delimiter', ',' )
cac =
{1x1 cell} {1x1 cell} [1] [NaN] [3]
 
@Star's proposal: MultipleDelimsAsOne
>> textscan( 'a b c,d e f,1,2,3', '%s%s%s%s%s%s%f%f%f' ...
, 'Delimiter', ', ', 'MultipleDelimsAsOne', true )
ans =
Columns 1 through 6
{1x1 cell} {1x1 cell} {1x1 cell} {1x1 cell} {1x1 cell} {1x1 cell}
Columns 7 through 9
[1] [2] [3]
So far so good. However, with "b" missing
textscan( 'a c,d e f,1,2,3', '%s%s%s%s%s%s%f%f%f' ...
, 'Delimiter', ', ', 'MultipleDelimsAsOne', true )
ans =
Columns 1 through 6
{1x1 cell} {1x1 cell} {1x1 cell} {1x1 cell} {1x1 cell} {1x1 cell}
Columns 7 through 9
[2] [3] [0x1 double]
it returns an erroneous result
댓글 수: 6
per isakson
2014년 12월 3일
편집: per isakson
2014년 12월 3일
Consider the strings containing space separated letters
'a b c'
' b c'
'a c'
one need additional information to be able to decide whether 'a' or 'b' is missing. That has little with limitations of Matlab to do.
Why don't you attach a small sample file.
Thorsten
2014년 12월 2일
I think that you have to read individual lines with fgets and then deal with the cases of missing values.
참고 항목
카테고리
Help Center 및 File Exchange에서 Text Files에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!