MRCZ - A file format for cryo-TEM data with fast compression
The introduction of fast CMOS detectors is moving the field of transmission electron microscopy into the computer science field of big data. Automated data pipelines control the instrument and initial processing steps which imposes more onerous data transfer and archiving requirements. Here we conduct a technical demonstration whereby storage and read/write times are improved 10 x at a dose rate of 1 e(-)/pix/frame for data from a Gatan K2 direct-detection device by combination of integer decimation and lossless compression. The example project is hosted at github.com/em-MRCZ and released under the BSD license.
Stewart_2018_MRCZ.pdf
Publisher's version
openaccess
CC BY
634.4 KB
Adobe PDF
857c1f568d593d28da37273f87dbf2a4