cover of episode A Comparison of Lossless Compression Methods in Microscopy Data Storage Applications

A Comparison of Lossless Compression Methods in Microscopy Data Storage Applications

2023/1/25
logo of podcast PaperPlayer biorxiv bioinformatics

PaperPlayer biorxiv bioinformatics

Shownotes Transcript

Link to bioRxiv paper: http://biorxiv.org/cgi/content/short/2023.01.24.525380v1?rss=1

Authors: Walker, L. A., Li, Y., McGlothlin, M., Cai, D.

Abstract: Modern high-throughput microscopy methods, such as light-sheet imaging and electron microscopy, are capable of producing petabytes of data inside a single experiment. Storage of these large images, however, is challenging because of the difficulty of moving, storing, and analyzing such vast amounts of data, which is often collected at very high data rates ( greater than 1GBps). In this report, we provide a comparison of the performance of several compression algorithms using a collection of published and unpublished datasets, including confocal, fMOST, and pathology images. We also use simulated data to demonstrate the efficiency of each algorithm as image content or entropy increases. As a result of this work, we recommend the use of the BLOSC algorithm combined with ZSTD for various microscopy applications, as it produces the best compression ratio over a collection of conditions.

Copy rights belong to original authors. Visit the link for more info

Podcast created by Paper Player, LLC