edit large CSV file before reading it to a table

조회 수: 10 (최근 30일)
sani 2021년 5월 6일
댓글: sani 2021년 5월 6일
I have a very large (16Gb) CSV file that contains one column with data separated by semicolumn.
I only need 2 columns from this data, but I cannot read it first since the memory is running out (I have 16Gb ram).
Is it possible to somehow separate the semicolumn to a column and read only the data I need (which is 2/6 columns)?
  댓글 수: 2
Stephen23 2021년 5월 6일
편집: Stephen23 2021년 5월 6일
How do you expect to get "...2 columns from this data..." from a "...CSV file that contains one column with data..." ?
sani 2021년 5월 6일
It contain one column but the data is saperated in ';'.
basicly I needed to saperate it first and than to read only whats relevant for me.
see wallter solution, it was actually really halpful.

댓글을 달려면 로그인하십시오.

채택된 답변

Walter Roberson
Walter Roberson 2021년 5월 6일
Use 'delimiter', ';', and 'SelectedVariableNames' with a vector that is the two column numbers.
  댓글 수: 1
sani 2021년 5월 6일
thank you very much walter!
for some reason not only that it maneged to read the data, it also write it really fast in readtable() function. much faster than other smaller files I'm reading.

댓글을 달려면 로그인하십시오.

추가 답변 (0개)


Help CenterFile Exchange에서 Text Files에 대해 자세히 알아보기


Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by