Load and Save using PARFOR Loops

조회 수: 20 (최근 30일)
Anas Khan
Anas Khan 2022년 10월 25일
댓글: Anas Khan 2022년 10월 25일
I am using PARFOR loops on a cluster like so:
files = dir('*.mat'); % Get list of data files to load
subjectIDs = cell(1,length(files));
% Extract subject name from each filename (SUBJECTNAME.mat format for each file)
for file = 1:length(files)
subidsplit = strsplit(files(file).name,'.');
subjectIDs{file} = subidsplit{1};
end
clear file subidsplit
frex = 2.^([10:76]/10);
parpool(length(files),'AttachedFiles',"wilson_sf.m") % Initialize parpool,
% one worker for each iteration, attach helper function
parfor ii = length(files)
CheahaGGC(1000, frex, 0, 0, 6,files,ii,subjectIDs);
end
Inside the function CheahaGGC, I am loading one file, running analysis on it, and saving it. My script completed without errors in 7 hours, but only one of the iteration's results were saved (the last one, corresponding to ii = length(files)). Is there a problem with how I implemented the loop? Each worker gets its own workspace so calling LOAD inside my function should give each worker its own data to analyze right? Same thing with SAVE. Shown below is the load and save inside of the function
function CheahaGGC(fs, freq, pad0, flgCond, omega0,files,ii,subjectIDs)
load(files(ii).name) % Load one file for this iteration
%%%%%%%%%%%%%%%%%%%%%%%
%%%% Analysis Code %%%%
%%%%%%%%%%%%%%%%%%%%%%%
save(strcat(subjectIDs{ii},'GGC','.mat'),'causalityGO','causalityNG') % Save results to file with subject name + "GGC" added

채택된 답변

Bruno Luong
Bruno Luong 2022년 10월 25일
편집: Bruno Luong 2022년 10월 25일
Normal
parfor ii = length(files)
should be
parfor ii = 1:length(files)
  댓글 수: 1
Anas Khan
Anas Khan 2022년 10월 25일
Wow... thanks. Cannot believe the rabit holes I went down when it was that simple.

댓글을 달려면 로그인하십시오.

추가 답변 (0개)

카테고리

Help CenterFile Exchange에서 Parallel for-Loops (parfor)에 대해 자세히 알아보기

제품


릴리스

R2021b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by