Preventing Matlab/Simulink to Generate a Huge Temporary File

Hi,

I've written a script which is performing a Simulink simulation in a cascaded for-loop structure. In each iteration the Simulink model structure is the same, but some model parameters change (system sensitivity analysis). After one simulation run I'm doing a little bit of post-processing and then the relevant data is stored as a .mat file on my HDD. The work space variables are overwritten each iteration and they stay the same size. The simulink model runs in ‘accelerated’ mode.

Unfortunately, Matlab is generating a huge temp file in ‘C:\Users\XXX\AppData\Local\Temp’ which is growing over time and reaches up to 100 GB – this is also when Matlab crashes due to a storage shortage on the partition. The temp file is named ‘XXX_sdi_4.6__none_eventLogging_1.2_sl_artifacts__sta_1.2__none.dmr’. I’ve tried to delete it after a couple of simulations from using the ‘delete’ command, but it doesn’t work (no permission). I’m pretty confused right now because I’ve done similar things in the past without that kind of issue – however, now I’ using Matlab 2017a while in the past I’ve mainly used 2012b. Was there maybe a major revision of the storage management between that versions?

Does anyone have a good guess how to prevent Matlab/Simulink generating such a huge temp file? Any idea is highly appreciated.

Cheers, Oliver

[Daniel Tegnered]

Did you find a solution for this? I have the exact same issue, also moving from 2012b to 2017b.

Cheers, Daniel

Answer 1

[Daniel Tegnered]

I had the same issue when running many Simulink simulations in a loop. Calling

Simulink.sdi.clear

to clear Data Inspector between runs solved the issue.

[walli]

Yeah, it turned out that my version change from 2012b to 2017a was directly linked to the Data Inspector tool. Since in my original 2012b model some signals were logged, they were automatically enabled as signals for the Data Inspector which caused that huge temp file. However, it was somehow funny that the Data Inspector also wrote into the temp file after I've deactived the signal loggin within the tool. Hence, I had to remove all signal logs within my Simulink model.

[SREEJITH V S]

"Simulink.sdi.clear" is working for me in a '"for" loop.

[Sergey Kasyanov]

Also if you run simulation by parsim you can use CleanupFcn setting for delete .dmr files for each worker.

For example:

simout = parsim(simin, 'CleanupFcn', @Simulink.sdi.clear)

Answer 2

[Frank Zhou]

There is a related question with an answer on this thread:

https://www.mathworks.com/matlabcentral/answers/462334-simulation-data-inspector-unnecessarily-archives-data-and-overloads-filesystem

Hope this helps!

[Tobias Huelsing]

Thanks a lot for picking up the topic as this is still an issue with us.

If I understand the suggested solution correctly, this prevents SDI from archiving runs. In our case, we have one single HUGE simulation. Archive is empty because we see the problem already in the first simulation we are running.

I'll try:

Simulink.sdi.setAutoArchiveMode(false);
Simulink.sdi.setArchiveRunLimit(0);

I assume the solution is aimed at running numerous consecutive runs → Helps OP, but not us :-/ Any ideas on single runs?

Answer 3

[Andres]

I have written some shortcut code to view and clear the SDI repository files and added it as a favourite command to my Quick Access Toolbar:

% SDI Clear: code to view and clear SDI repository files

sdiClearSC.tFolder = getenv('TMP');

sdiClearSC.dmrFiles = dir(fullfile(sdiClearSC.tFolder,'*.dmr'));

if isempty(sdiClearSC.dmrFiles)

sdiClearSC.answer = questdlg(["No *.dmr files found in ";...

sdiClearSC.tFolder],...

"SDI Clear ShortCut",'Okay','Open folder anyway','Okay');

else

sdiClearSC.answer = questdlg(["*.dmr files found in ";

sdiClearSC.tFolder+ " :"; ...

" ";

string({sdiClearSC.dmrFiles.name}).' + ", " + ...

string(cat(1,sdiClearSC.dmrFiles.bytes)/pow2(20)) + " MiB";

" ";

"Clear SDI and repository files?"],...

"SDI Clear ShortCut",'Yes','No','No, open folder','Yes');

end

switch sdiClearSC.answer

case 'Yes'

disp('Clearing SDI, please wait...')

Simulink.sdi.clear

disp('... clearing SDI repository files, please wait...')

sdi.Repository.clearRepositoryFile

disp('... done.')

case {'Open folder anyway','No, open folder'}

winopen(sdiClearSC.tFolder)

end

clear sdiClearSC

[Eugene Paymurzov]

Hi. Good solution. But sometimes matlab hang on the line sdi.Repository.clearRepositoryFile.

I turn off the Simulation Data Inspector does not automatically archive simulation runs. But the command Simulink.sdi.clear take very long time than I close matlab and open again.

Answer 4

[Tobias Huelsing]

Hi, sorry for reopening the issue. I experience the same problem. But since I run a single simulation (10y sim time), I can't clear the SDI in between. Data logging is disabled and I cannot remove all log points as they are in 3rd party libraries. There has to be a solution since this is very annoying. At the moment, I have to fall back to older Matlab versions in which the models are not tested.

Answer 5

[walli]

I'm guessing if you're actively using data logging for such an elaborate and long simulation you will face a problem with the data size. Hence, maybe you’ve to use down sampling or stop and restart you simulation in between and save the log data on some other available hard disk.

Answer 6

[Tobias Huelsing]

Data logging is disabled (set_param(cfg.mdlName,'SignalLogging','off');) Data is stored via toWorkspace blocks with reduced decimation. It all works fine in Matlab 2013b. It is just the *.dmr file (see first post) from the data inspector.