Jump to content

Draft:Pcodec

From Wikipedia, the free encyclopedia
  • Comment: There is currently a redirect from the title of this draft. If this draft is accepted, the redirect should be deleted by an administrator when the draft is accepted, because the hatnote at the top of this page will take its place. AFC Reviewers: If you are accepting this draft, please tag the redirect as {{db-afc-move}} or with Twinkle as G6. AFC move. Please leave the redirect alone unless you are accepting the draft.
    You may ask about redirects and hatnotes at the Teahouse.
    Robert McClenon (talk) 14:53, 8 April 2025 (UTC)

Pcodec or Pco is a lossless compression format and algorithm for numerical data. Its is open sourced under Apache 2.0 License. Its stated goal is to compress with high compression ratio and moderately fast speed. [1]

Pco differs from LZ77 and LZ78 compression in that it applies "binning" to numerical values instead of matching exact sequences of bytes. These bins are then entropy coded. [1]

Pco is the remake of an earlier codec named Quantile Compression or q_compress. Work on q_compress began in mid 2021, and Pco's first stable version was released in November 2023. [2] [3] Pco is used in other wrapping data formats such as Zarr. [4]

References

[edit]
  1. ^ a b "pcodec/pcodec: Lossless codec for numerical data". github.com. Retrieved 2025-04-06.
  2. ^ "basic algorithm - mwlon/pcodec". github.com. 2021-05-31. Retrieved 2025-04-06.
  3. ^ "crates.io: Rust Package Registry". crates.io. 2023-11-28. Retrieved 2025-04-06.
  4. ^ "API reference - numcodecs 0.15.1 documentation". readthedocs.io. Retrieved 2025-04-06.