Read several large csv and store as separate variables

11 views (last 30 days)
I have 26 large .csv files that each take a while to load in to Matlab. I would like to be able to read them all in, using one for loop, so that I can leave the loop to run and work on something else while all of the files import. I would like each to be stored as a separate variable.
I have tried this, but the code fails on the last line where I try to read in the .csv using readmatrix() and store it with a name depending on the file that the loop is currently processing. In this example, I choose to start at the 17th .csv file in the folder as I have inspected the first 16 in a past life :-) The .csv files are 7GB otherwise I would attach an example.
directory=('Y:\SoundTrap\PSD Output');
d=dir(fullfile(directory, '*.csv')); %list all .wav files in path folder
files=length(d);
for i=17:files
disp(d(i).name); %display filename
name=d(i).name;
filename=fullfile(directory, d(i).name);
file(i)=readmatrix(filename);
end
There error I get is:
Unable to perform assignment because the indices on the left side are not compatible with the size of the right side.
Error in checkPSDoutput (line 14)
file(i)=readmatrix(filename);
Thanks for your help!
  3 Comments
Stephen23
Stephen23 on 19 Nov 2019
Edited: Stephen23 on 19 Nov 2019
"You also shouldn't dynamically generate file names"
Probably Rik meant to write that one should not dynamically generate variable names.
"I would like each to be stored as a separate variable."
That would would not be a good way to write your code. You should first read this:
and then use a cell array, just as Star Strider's answer and the MATLAB documentation shows:
Rik
Rik on 19 Nov 2019
That was indeed was I meant. Can you still call it a typo if you're using the wrong word?

Sign in to comment.

Accepted Answer

Star Strider
Star Strider on 18 Nov 2019
Perhaps saving it in a cell array would work:
file{i}=readmatrix(filename);
Note the curly brackets {} denoting cell-array indexing.
See Access Data in Cell Array to help you work with the data later if you are not familiar with cell arrays.
Experiment to get the result you want.

More Answers (0)

Products


Release

R2019a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!