Parallel Workers Aborting when using Matlab Compiler Runtime on AWS

I am running into an issue where I am trying to run a matlab simulation on AWS but the parallel workers keep crashing. My code runs fine in MATLAB itself on two separate machines but there seems to be an issue with running my compiled code.

The exact error I am getting is something like:

Warning: A worker aborted during execution of the parfor loop. The parfor loop will now run again on the remaining workers. 
> In parallel_function (line 596)
In score_function(line 45)
In FullRunLearner(line 190)
In FullRunManager(line 799) 
Error MATLAB:remoteparfor:AllParforWorkersAborted - All workers aborted during execution of the parfor loop.

Info that might be relevant: - My code was originally sending a configuration struct to each worker using a parallel.pool.constant but that was not working on the compiled code so I switched to just passing the data in directly. It is only about 20K so I don't think that is a huge deal. - Originally I was just using gcp() to launch the parpool but then when I started getting errors I switched to trying parpool('local',nWorkers) - I have been testing this on a micro instance (so I can fix all the bugs before paying for the large ones) which only has 1 core so I am only creating 1 worker. I have tested running 1 worker on my local machine and had no problems.

I had read about this issue occurring when using remote workers or trying to do certain gui operations but I'm not doing those things. I also haven't found much information about this error with the MATLAB compiler runtime.

Does anyone have any thoughts about what might be causing this or suggestions that I can try to fix the problem?