best way to store large time series data

I plan to collect intraday data (1 min) for several instruments. what is the best way to keep them for long term ?

should I keep appending in a mat file , with one mat file for each instrument or should I keep them as CSV in different text file for each instrument.

what would be more robust ?

[Jing]

What do you mean 'robust'? CSV is more compatible with other software, like Excel, and can open with plain text editor while mat-file can't. But mat-file can save all kinds of variables in MATLAB.

Answer 1

[Pedro Villena]

The EAS3 file format is used to store floating point data in IEEE format and to exchange the files between different computer architectures (little/big endian). The data is organized as parameters with one parameter being a one-, two- or three-dimensional floating point array. Several of these parameters may be combined to one time step. This allows to store five-dimensional arrays. Data can be written in single-precision (32 Bit), double-precision (64 Bit) or quadruple-precision (128 Bit). Geometry information for the different directions are saved in the header of the file. It is also possible to store additional information in user defined arrays there. With the file size being limited only by the computer itself (e.g. file system), EAS3 files are suitable for large simulations and thus for high-performance computing.