Matlab is not utilizing full Memory capacity in Windows server
2 views (last 30 days)
Show older comments
Hi,
I am trying to merge almost 510 .csv file (more than 40 GB of data) in a windows server. But it is utilizing only 7% of CPU and 17% of Memory. I have talked with the administrator, there is no user limitation in this case.
Server specification: Intel Xeon 2 GHz (16 Core) and 96 GB RAM capacity.
Any solution?
Thank you in advance.
/Kazi
5 Comments
Mohammad Sami
on 25 Jan 2020
If you want to load the data into Matlab, try using fread instead of readtable. you can then just concatenate the char arrays. use textscan for conversion.
Andrew Janke
on 31 Jan 2020
That sounds normal. Most Matlab stuff that doesn't call down into BLAS/LAPACK is single-threaded. And when you're reading CSV files, it'll do the reading incrementally. And as it reads the CSV data and converts the strings into numeric values, the in-memory representation of the data may be more compact than the size of those files on disk.
Is it not working? Are you trying to make it go faster?
Answers (0)
See Also
Categories
Find more on Java Client Programming in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!