CVX Solver: Exceeding Maximum Array Size with Large Dataset
조회 수: 8 (최근 30일)
이전 댓글 표시
I am using the CVX solver to solve an optimisation problem with a dataset of input and output vectors of size 1400x1. When I take a subsample of 200 datapoints, this results in 40,002 equality constraints. Ideally I would use all 1400 datapoints for my problem, but I then receive the error:
Requested 1962801x1401 (20.5GB) array exceeds maximum array size preference (16.0GB). This might cause MATLAB to become unresponsive.
I've looked into "Preferences" > "Workspace" > "MatLab Array Size Limit" > checked off "Limit the maximum array size to a percentage of RAM" (already set to 100%).
However, I have seen other posts where people have worked with over 2 million equality constraints, albeit with a runtime of 40 minutes. Is this simply a problem where I need to use a computer with more memory and a better processor, or is there any way that I can modify the settings or the type of solver I use, even if the runtime may take longer?
댓글 수: 1
Torsten
2025년 3월 18일
편집: Torsten
2025년 3월 18일
It would help to know your optimization problem in a mathematical formulation and the usage of this 20.5 GB array in CVX.
Is your problem sparse ? If yes: can you exploit this sparsity in CVX ?
Maybe asking your question in the CVX forum has a better chance for getting a useful suggestion:
답변 (0개)
참고 항목
카테고리
Help Center 및 File Exchange에서 Surrogate Optimization에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!