Jump to content

Draft:Pcodec

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by Scenichill (talk | contribs) at 03:30, 7 April 2025 (Submitting using AfC-submit-wizard). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.


Pcodec or Pco is a lossless compression format and algorithm for numerical data. Its is open sourced under Apache 2.0 License. Its stated goal is to compress with high compression ratio and moderately fast speed. [1]

Pco differs from LZ77 and LZ78 compression in that it applies "binning" to numerical values instead of matching exact sequences of bytes. These bins are then entropy coded. [1]

Pco is the remake of an earlier codec named Quantile Compression or q_compress. Work on q_compress began in mid 2021, and Pco's first stable version was released in November 2023. [2] [3] Pco is used in other wrapping data formats such as Zarr. [4]

References

  1. ^ a b "pcodec/pcodec: Lossless codec for numerical data". github.com. Retrieved 2025-04-06.
  2. ^ "basic algorithm - mwlon/pcodec". github.com. 2021-05-31. Retrieved 2025-04-06.
  3. ^ "crates.io: Rust Package Registry". crates.io. 2023-11-28. Retrieved 2025-04-06.
  4. ^ "API reference - numcodecs 0.15.1 documentation". readthedocs.io. Retrieved 2025-04-06.