CVX Solver: Exceeding Maximum Array Size with Large Dataset

조회 수: 8 (최근 30일)
Marie
Marie 2025년 3월 18일
편집: Torsten 2025년 3월 18일
I am using the CVX solver to solve an optimisation problem with a dataset of input and output vectors of size 1400x1. When I take a subsample of 200 datapoints, this results in 40,002 equality constraints. Ideally I would use all 1400 datapoints for my problem, but I then receive the error:
Requested 1962801x1401 (20.5GB) array exceeds maximum array size preference (16.0GB). This might cause MATLAB to become unresponsive.
I've looked into "Preferences" > "Workspace" > "MatLab Array Size Limit" > checked off "Limit the maximum array size to a percentage of RAM" (already set to 100%).
However, I have seen other posts where people have worked with over 2 million equality constraints, albeit with a runtime of 40 minutes. Is this simply a problem where I need to use a computer with more memory and a better processor, or is there any way that I can modify the settings or the type of solver I use, even if the runtime may take longer?
  댓글 수: 1
Torsten
Torsten 2025년 3월 18일
편집: Torsten 2025년 3월 18일
It would help to know your optimization problem in a mathematical formulation and the usage of this 20.5 GB array in CVX.
Is your problem sparse ? If yes: can you exploit this sparsity in CVX ?
Maybe asking your question in the CVX forum has a better chance for getting a useful suggestion:

댓글을 달려면 로그인하십시오.

답변 (0개)

카테고리

Help CenterFile Exchange에서 Surrogate Optimization에 대해 자세히 알아보기

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by