Reading uint8 from raw data takes much more RAM then expected
조회 수: 2 (최근 30일)
이전 댓글 표시
I am trying to read some MB of data from big files of several GB. I am using the follwing code:
fid=fopen(filename,'r');
fseek(fid,someStartValue,'bof');
raw = fread(fid, [3 ceil(numOfPixels/2)*numOfFrames],'uint8','b');
number of uint8 are
3*ceil(numOfPixels/2)*numOfFrames=184688640
so this is also the value in bytes, corresponding to about 185MB. But when calling the fread line, the taken RAM increases by 1.6 GB.
Any ideas?
Running the fread line mutiple times in a row gives the peaks shown in the attached image. I also don't understand, why there is more RAM available after the peak compared to before the peak. The image shows three calls of the line
댓글 수: 4
Les Beckham
2023년 1월 18일
편집: Les Beckham
2023년 1월 18일
That should fix your issue. If you specify the precision argument as 'uint8' as your initial post shows, it will take the uint8 source data and put it into doubles. Using 'uint8=>uint8' will keep the data as uint8, reducing the memory usage by a factor of 8. As Image Analyst suggests in his answer, use the whos command to check the data type and memory size of your raw array after you read it in .
답변 (1개)
Image Analyst
2023년 1월 18일
Put the memory command before and after your code. What do you see? Are you sure you're closing the file?
memory
fid=fopen(filename,'r');
fseek(fid,someStartValue,'bof');
raw = fread(fid, [3 ceil(numOfPixels/2)*numOfFrames],'uint8','b');
fclose(fid);
whos raw
memory
댓글 수: 0
참고 항목
카테고리
Help Center 및 File Exchange에서 Startup and Shutdown에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!