Data Version Control (software)
| Original author(s) | Dmitry Petrov |
|---|---|
| Developer(s) | Iterative.ai |
| Initial release | May 4, 2017; 5 years ago |
| Stable release | 2.24.0
/ September 19, 2022; 16 days ago |
| Repository | github.com/iterative/dvc |
| Available in | Python |
| License | Apache - 2.0 |
| Website | https://dvc.org/ |
DVC is a free and open-source, platform-agnostic version system for data, ML models, and experiments.[1] It is designed to make ML models shareable, experiments reproducible, and to track versions of models, data, and pipelines.[2][3][4]
[5] DVC works on top of Git repositories and cloud storage.[6][7]
The first (beta) version of DVC (DVC 0.6) was launched in May 2017. In May 2020, DVC 1.0 was publicly released by Iterative.ai.[8] [9]
Overview
DVC is designed to incorporate the best practices of software development into Machine Learning workflows. It does this by extending the traditional software tool Git by cloud storages for datasets and ML models.
Specifically, DVC makes Machine Learning operations:
- Codified: it codifies datasets and models by storing pointers to the data files in cloud storages.
- Reproducible: it makes it easy for users to reproduce experiments, and rebuild datasets from raw data. These features also allow to automate the construction of datasets, the training, evaluation, and deployment of ML models.
References
- ^ Hewage Nipuni, Meedeniya Dulani (February 2022). "Machine Learning Operations: A Survey on MLOps Tool Support". ResearchGate.
- ^ Barrak Amine, Eghan Ellis E., Adams Bram (March 2021). "On the Co-evolution of ML Pipelines and Source Code - Empirical Study of DVC Projects". IEEE Xplore.
- ^ Wiggers, Kyle. "MLOps startup Iterative.ai nabs $20M". VentureBeat.
- ^ Ivancic, Kristijan. "Data Version Control With Python and DVC". Real Python.
- ^ "MLOps Company Iterative Achieves Significant Customer and Company Growth in 2021". Business Wire.
- ^ Hall, Susan. "Iterative.ai: Git-Based Machine Learning Tools for ML Engineers". The New Stack.
- ^ "What is DVC?". MLOps Guide.
- ^ Petrov, Dmitry. "DVC 3 Years and 1.0 Pre-release". Iterative.ai.
- ^ Anadiotis, George. "Streamlining data science with open source: Data version control and continuous machine learning". ZDNET.