ALP: Adaptive Lossless Floating-Point Compression

Summary

ALP: Adaptive Lossless Floating-Point Compression Authors: Azim Afroozeh, Leonardo Kuffó, Peter Boncz Conference: ACM SIGMOD 2024 What is this repo? This repository contains the source code and benchmarks for the paper ALP: Adaptive Lossless Floating-Point Compression, published at ACM SIGMOD 2024. ALP is a state-of-the-art lossless compression algorithm designed for IEEE 754 floating-point data. It encodes data by exploiting two common patterns found in real-world floating-point values: Decimal Floating-Point Numbers: A large portion of floats/doubles in real-world datasets are decimals. ALP maps these values into integers by multiplying the number by a power of 10 and then compressing the result using a FastLanes variant of Frame-of-Reference encoding1, which is SIMD-friendly. Example: the number 10.12 becomes 1012 and is then fed to the FastLanes encoder. High-Precision Floating-Point Numbers: The remaining values are typically high-precision floats/doubles. ALP targets compression opportunities in only the left part of these values, which it compresses using FastLanes dictionary encoding. The right part is left uncompressed, as it is required to preserve high precision and is often highly random and incompressible. These results highlight ALP’s superior performance across all three key metrics of a compression algorithm: Decoding Speed, Compression Ratio, and Compression Speed—outperforming other schemes in every category. 🧪 How to Reproduce Results Just run the following script: ./publication/script/master_script.sh For more information on reproducing our benchmarks, refer to our guide here, or read the official ACM reproducibility report: https://dl.acm.org/doi/10.1145/3687998.3717057 We are happy to share that we participated in the SIGMOD Availability & Reproducibility Initiative, and our paper earned all three badges: 🎉 We're also proud to share that ALP won the SIGMOD Best Artifact Award! ⏱️ Want to Benchmark Your Dataset? Check out our guide: How to Bench...