I am having trouble reading a txt file

I have txt file with data formated below but Im only get the first line .

index: 0 int_time: 1718984569904518 us int_diff: 0   us min: 167 us max: 167 us
index: 1 int_time: 1718984569904682 us int_diff: 164 us min: 164 us max: 167 us
index: 1 int_time: 1718984569904682 us int_diff: 164 us min: 164 us max: 167 us

here is the code im using utilising textscan

fid=fopen('Desktop\data.txt','rt');
data=textscan(fid,'%[index: 0 int_time:] %u64 %[us_int_diff: ] %s %s %s %s %s %s %s %s')
fclose(fid);

[Image Analyst]

Don't force us create data.txt just to help you. Make it easy for us to help you. If you have any more questions, then please attach your data with the paperclip icon after you read this:

TUTORIAL: How to ask a question (on Answers) and get a fast answer

Answer 1

[Star Strider]

You may need to specify the name-value pair:

'EndOfLine','\r\n'

That has usually been the solution when I have encountered similar problems.

That aside, it always helps to have the actual file to work with.

.

[dpb]

Well, let's see, SS... :)

txt=[
    'index: 0 int_time: 1718984569904518 us int_diff: 0   us min: 167 us max: 167 us';
    'index: 1 int_time: 1718984569904682 us int_diff: 164 us min: 164 us max: 167 us';
    'index: 1 int_time: 1718984569904682 us int_diff: 164 us min: 164 us max: 167 us'];
writematrix(txt,'data.txt')
type data.txt

index: 0 int_time: 1718984569904518 us int_diff: 0   us min: 167 us max: 167 us
index: 1 int_time: 1718984569904682 us int_diff: 164 us min: 164 us max: 167 us
index: 1 int_time: 1718984569904682 us int_diff: 164 us min: 164 us max: 167 us

fmt='%[index: ] %d %[int_time:] %u64 %[us_int_diff: ] %s %s %s %s %s %s %s %s';
fid=fopen('data.txt','rt');
data=textscan(fid,fmt);
fid=fclose(fid);
data{:}

ans = 3x1 cell array
    {'index: '}
    {'index: '}
    {'index: '}

ans = 3x1

0 1 1

<mw-icon class=""></mw-icon>

<mw-icon class=""></mw-icon>

ans = 3x1 cell array
    {'int_time:'}
    {'int_time:'}
    {'int_time:'}

ans = 3x1

1718984569904518 1718984569904682 1718984569904682

<mw-icon class=""></mw-icon>

<mw-icon class=""></mw-icon>

ans = 3x1 cell array
    {'us int_diff: '}
    {'us int_diff: '}
    {'us int_diff: '}

ans = 3x1 cell array
    {'0'  }
    {'164'}
    {'164'}

ans = 3x1 cell array
    {'us'}
    {'us'}
    {'us'}

ans = 3x1 cell array
    {'min:'}
    {'min:'}
    {'min:'}

ans = 3x1 cell array
    {'167'}
    {'164'}
    {'164'}

ans = 3x1 cell array
    {'us'}
    {'us'}
    {'us'}

ans = 3x1 cell array
    {'max:'}
    {'max:'}
    {'max:'}

ans = 3x1 cell array
    {'167'}
    {'167'}
    {'167'}

ans = 3x1 cell array
    {'us'}
    {'us'}
    {'us'}

Seems to have worked ok w/o explicit 'EndOfLine' indicator; the mismatch in the record content of the expression-matching format apears to have been the issue.

I'd still convert the numerics directly with the format expression, but other than that, seems ok...

fmt='%[index: ] %d %[int_time:] %u64 %[us_int_diff: ]%d %[us min: ]%d %[us max: ]%d %[us]';
fid=fopen('data.txt','rt');
data=textscan(fid,fmt);
fid=fclose(fid);
data{:}

ans = 3x1 cell array
    {'index: '}
    {'index: '}
    {'index: '}

ans = 3x1

0 1 1

<mw-icon class=""></mw-icon>

<mw-icon class=""></mw-icon>

ans = 3x1 cell array
    {'int_time:'}
    {'int_time:'}
    {'int_time:'}

ans = 3x1

1718984569904518 1718984569904682 1718984569904682

<mw-icon class=""></mw-icon>

<mw-icon class=""></mw-icon>

ans = 3x1 cell array
    {'us int_diff: '}
    {'us int_diff: '}
    {'us int_diff: '}

ans = 3x1

0 164 164

<mw-icon class=""></mw-icon>

<mw-icon class=""></mw-icon>

ans = 3x1 cell array
    {'us min: '}
    {'us min: '}
    {'us min: '}

ans = 3x1

167 164 164

<mw-icon class=""></mw-icon>

<mw-icon class=""></mw-icon>

ans = 3x1 cell array
    {'us max: '}
    {'us max: '}
    {'us max: '}

ans = 3x1

167 167 167

<mw-icon class=""></mw-icon>

<mw-icon class=""></mw-icon>

ans = 3x1 cell array
    {'us'}
    {'us'}
    {'us'}

Alternatively, skip the text fields and just return the data...

fmt='%*[index: ] %d %*[int_time:] %u64 %*[us_int_diff: ]%d %*[us min: ]%d %*[us max: ]%d %*[us]';
fid=fopen('data.txt','rt');
data=textscan(fid,fmt);
fid=fclose(fid);
data

data = 1x5 cell array
    {3x1 int32}    {3x1 uint64}    {3x1 int32}    {3x1 int32}    {3x1 int32}

and make a table...

tD=[table(data{1},'VariableNames',{'Index'}) ...
    table(data{2},'VariableNames',{'Time'}) ...
    table(data{3:5},'VariableNames',{'Diff','Min','Max'})]

tD = 3x5 table
    Index          Time          Diff    Min    Max
    _____    ________________    ____    ___    ___

      0      1718984569904518      0     167    167
      1      1718984569904682    164     164    167
      1      1718984569904682    164     164    167

[Star Strider]

We need the original file to check that..

Synthetic files or synthetic data don’t count.

[dpb]

For absolute certainty, yes, but given the symptoms, I'll wager the beer next time... :)

Answer 2

[dpb]

In

%data=textscan(fid,'%[index: 0 int_time:] %u64 %[us_int_diff: ] %s %s %s %s %s %s %s %s')

you're forcing a match on a 0 in "index: 0 int_time:" but only the first record matches that pattern; the remaining two records have a "1", not "0".

Try

fmt='%[index: ] %d %[int_time:] %u64 %[us_int_diff: ] %s %s %s %s %s %s %s %s';

Let's test...

txt=[
    'index: 0 int_time: 1718984569904518 us int_diff: 0   us min: 167 us max: 167 us';
    'index: 1 int_time: 1718984569904682 us int_diff: 164 us min: 164 us max: 167 us';
    'index: 1 int_time: 1718984569904682 us int_diff: 164 us min: 164 us max: 167 us'];
for i=1:size(txt,1)
  data{i,1}=textscan(txt(i,:),fmt);
end
data{:}

ans = 1x13 cell array
  Columns 1 through 12

    {1x1 cell}    {[0]}    {1x1 cell}    {[1718984569904518]}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}

  Column 13

    {1x1 cell}

ans = 1x13 cell array
  Columns 1 through 12

    {1x1 cell}    {[1]}    {1x1 cell}    {[1718984569904682]}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}

  Column 13

    {1x1 cell}

ans = 1x13 cell array
  Columns 1 through 12

    {1x1 cell}    {[1]}    {1x1 cell}    {[1718984569904682]}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}    {1x1 cell}

  Column 13

    {1x1 cell}

This is pretty messy mishmash of cells and nested cells; I'd probably at least convert the numeric fields all with %d for the time stamp data. It wouldn't be too hard then to turn the other nested cells into a cellstr containing the string for only one level of dereferencing.

The alternative you might explore would be readtable; your release won't have all the bells and whistles the current does, but it was several years past initial release by then so should be pretty robust. It is a handy container for mixed data types.

fmt='%*[index: ] %d %*[int_time:] %u64 %*[us_int_diff: ]%d %*[us min: ]%d %*[us max: ]%d %*[us]';
for i=1:size(txt,1)
  data{i,1}=textscan(txt(i,:),fmt,'collectoutput',0);
end
data=vertcat(data{:})

data = 3x5 cell array
    {[0]}    {[1718984569904518]}    {[  0]}    {[167]}    {[167]}
    {[1]}    {[1718984569904682]}    {[164]}    {[164]}    {[167]}
    {[1]}    {[1718984569904682]}    {[164]}    {[164]}    {[167]}

data{:,2}

ans = uint64 1718984569904518

ans = uint64 1718984569904682

ans = uint64 1718984569904682

whos ans

  Name      Size            Bytes  Class     Attributes

  ans       1x1                 8  uint64              

tD=cell2table(data,'VariableNames',{'Index','Time','Diff','Min','Max'})

tD = 3x5 table
    Index          Time          Diff    Min    Max
    _____    ________________    ____    ___    ___

      0      1718984569904518      0     167    167
      1      1718984569904682    164     164    167
      1      1718984569904682    164     164    167

[Garykalan]

fmt='%[index: ] %d %[int_time:] %u64 %[us_int_diff: ] %s %s %s %s %s %s %s %s';

this format actually worked out i was able to use the cell2mat function and everything is perfect thank you so much your a god

[dpb]

"...i was able to use the cell2mat function and everything is perfect..."

Are you sure? Be careful; I think you'll find that turned everything to double and you'll not have the correct value for the Time U64 field data. I got bit by that in one of my examples earlier...

However, if this did solve your problem, please go ahead and Accept the answer so it is apparent if nothing else.