How to work with big data?

Hi everyone!

Currently I am working using two big data sets. The first one is 6927 kb (already in .mat format) and the second is of size 897 621 KB (in format .csv). The problem is that when I tried to work with them the computer stops working. Does anybody know how to make them less heavy? otherwise (less preferable option) how to slipt it to be able to work with them?

I am working with Matlab R2012 b 64-bit

Thanks a lot for your help!

:)

[KSSV]

Dealing with the data depends on what you want to do with the data. What you want to do with the data?

[angelavtc]

My data contains stock prices for every minute since 1990 to 2016 and from 9:30 to 16:00 hours each day. I want to calculate its returns, variances and some statistical analysis.

[Walter Roberson]

Variances and statistics over what time scales?

[angelavtc]

each One minute, 5 minutes, 15 minutes 30 minutes

Answer 1

[Ahmet Cecen]

Use:

 M = dlmread(filename,delimiter,[R1 C1 R2 C2])

To access the file in chunks.