Write gigantic output files in parloop

조회 수: 2 (최근 30일)
Homayoon
Homayoon 2016년 5월 9일
댓글: Titus Edelhofer 2016년 5월 9일
Dear All,
I am running a program using parallel toolbox. Each identifier in the parfor loop creates a matrix of 2,000,000 * 10 which of elements are 10 digit numbers. I am currently using dlmwrite to save and export the matrix output. It takes the code a way way long time to write one output file.
Previously, I was dealing with smaller output and the code worked perfectly but now it is really time consuming and expensive. Is there any efficient way to save the outputs (not in binary format)?
Thank you so much
  댓글 수: 2
Titus Edelhofer
Titus Edelhofer 2016년 5월 9일
How long does the export take? On my laptop it's 90s and produces a 250 MByte file. As I see it, if you need to have it in ascii format, it will be difficult to get this much faster. Binary output of course is a different question, this would take a fraction of that time ...
Titus
Titus Edelhofer
Titus Edelhofer 2016년 5월 9일
A (maybe trivial) comment: don't write the output to some (slow) network drive but to a local hard disk. Copy later to the network drive if needed ...
Titus

댓글을 달려면 로그인하십시오.

답변 (0개)

카테고리

Help CenterFile Exchange에서 Cell Arrays에 대해 자세히 알아보기

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by