Q: Compare archiving data in text (CSV) vs HDF5 files

Posted on

 

A:  Advantages and Disadvantages of archiving text and HDF5 data formats.

 

HDF5 is a data storage format that can store a variety of datatypes and is designed for flexible and efficient I/O and for high volume and complex data. HDF5 is a standard format, that is portable and self describing. HDF5 stores data in binary format native to a computing platform but portable across platforms. The binary format native to computers makes the format the more efficient for computers than text formats (e.g., .txt or .csv) that is meant for humans to read.

Text file formats use ASCII data that is portable across different types of computing platforms but use more space to store numeric or boolean data.  In addition, computers require significant processing to convert their natural numeric and binary data into unnatural ASCII data formats. For high-performance or real-time systems this extra processing may be unavailable to too costly.

 

Related Information

Presentation Video – Liberate Real-Time Data Into HDF5

Presentation PDF- Liberate Your Real-Time Data Into HDF5

White Paper PDF – Liberate Real-Time Data into HDF5

Partner Page – FishEye.net/HDF

Product – The FishEye Real-Time Platform (RTTK)

Contact – Contact Us