Read several large csv and store as separate variables

I have 26 large .csv files that each take a while to load in to Matlab. I would like to be able to read them all in, using one for loop, so that I can leave the loop to run and work on something else while all of the files import. I would like each to be stored as a separate variable.

I have tried this, but the code fails on the last line where I try to read in the .csv using readmatrix() and store it with a name depending on the file that the loop is currently processing. In this example, I choose to start at the 17th .csv file in the folder as I have inspected the first 16 in a past life :-) The .csv files are 7GB otherwise I would attach an example.

directory=('Y:\SoundTrap\PSD Output');

d=dir(fullfile(directory, '*.csv')); %list all .wav files in path folder

files=length(d);  

for i=17:files
    disp(d(i).name);                    %display filename
    name=d(i).name;
    filename=fullfile(directory, d(i).name);
    file(i)=readmatrix(filename); 
end

There error I get is:

Unable to perform assignment because the indices on the left side are not compatible with the size of the right side.

Error in checkPSDoutput (line 14)

file(i)=readmatrix(filename);

Thanks for your help!

[Rik]

You will probably have to rethink your strategy. Loading several files that large will probably fill your ram before you can do something useful. You also shouldn't dynamically generate file names. You could use a cell array (assuming that fits in your memory).

[Stephen23]

"You also shouldn't dynamically generate file names"

Probably Rik meant to write that one should not dynamically generate variable names.

"I would like each to be stored as a separate variable."

That would would not be a good way to write your code. You should first read this:

https://www.mathworks.com/matlabcentral/answers/304528-tutorial-why-variables-should-not-be-named-dynamically-eval

and then use a cell array, just as Star Strider's answer and the MATLAB documentation shows:

https://www.mathworks.com/help/matlab/import_export/process-a-sequence-of-files.html

[Rik]

That was indeed was I meant. Can you still call it a typo if you're using the wrong word?

Answer 1

[Star Strider]

Perhaps saving it in a cell array would work:

file{i}=readmatrix(filename); 

Note the curly brackets {} denoting cell-array indexing.

See Access Data in Cell Array to help you work with the data later if you are not familiar with cell arrays.

Experiment to get the result you want.