Extracting huge data from csv file
조회 수: 4 (최근 30일)
이전 댓글 표시
I am working on huge csv file of around 100-200 Mb's. I am trying to extract the data using COM server and activex application. But for the very first time when i fetch the data it is extracted without any problem but when I try to re extract I get an error stating that ' Not enough memory to complete this operation '. My C drive has around 5 Gb of free space. Do I have to clear the data from COM server first and then proceed. If it is then how do I do that
댓글 수: 0
답변 (2개)
Barry Greene
2012년 1월 23일
This is usually a problem with RAM rather than hardrive space. Suggest reading your file in chunks using fread within a for/while loop and concatenating the results.
Hope this helps
댓글 수: 0
owr
2012년 1월 23일
Agree on the RAM comment from Barry. If fread is too tedious, you can also try textscan. Specifying a format for each line of the csv file (which columns are numeric vs. string, ignoring columns that you may not need using something like %*f) has drastically increased the efficiency of textscan for me in the past.
댓글 수: 0
참고 항목
카테고리
Help Center 및 File Exchange에서 Use COM Objects in MATLAB에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!