Open-source software assessment methodologies
Appearance
Introduction
Several methods have been created to define an assessment process for Free/Open Source software. Some focus on some aspects like the maturity, the durability and the strategy of the organisation around the Open Source project itself. Other methodologies add functional aspects to the assessment process.
Existing methodologies
- Open Source Maturity Model (OSMM) from Cap Gemini
- Open Source Maturity Model (OSMM®) from Navica
- Methodology of Qualification and Selection of Open Source software (QSOS)
- Open Business Readiness Rating (OpenBRR)
Comparison
Comparison criteria
- Seniority : the methodology birth date.
- Original authors/sponsors : original methodology authors and sponsoring entity (if any)
- License : Distribution and usage license for the methodology and the resulting assessments
- Assessment model :
- Detail levels : several levels of details or assessment granularity
- Predefined criteria : the methodology provides some predefined criteria
- Technical/functional criteria : the methodology permits the use of domain specific criteria based on technical information or features
- Scoring model :
- Scoring scale by criterion
- Iterative process : the assessment can be performed and refined using several steps improving the level of details
- Criteria weighting : it is possible to apply weigthing on the assessed criteria as part of the methodology scoring model
- Comparison : the comparison process is defined by the methodology
Tableau comparatif
Criteria | OSMM Cap Gemini | OSMM® Navica | QSOS | OpenBRR |
---|---|---|---|---|
Seniority | 2003 | 2004 | 2004 | 2005 |
Original authors/sponsors | Cap Gemini | Navicasoft | Atos Origin | Carnegie Mellon West, SpikeSource, O'Reilly, Intel |
License | Non-free license, but authorised distribution | Assessment models licensed under the Academic Free License | Methodology and assessments results licensed under the FDL | Assessments results licensed under a Creative Commons license |
Assessment model | Practical | Practical | Practical | Scientific |
Detail levels | 2 axes on 2 levels | 3 levels | 3 levels or more (functional grids) | 2 levels |
Predefined criteria | Yes | Yes | Yes | Yes |
Technical/functional criteria | No | No | Yes | Yes |
Scoring model | Flexible | Flexible | Flexible | Strict |
Scoring scale by criterion | 1 to 5 | 1 to 10 | 0 to 2 | 1 to 5 |
Iterative process | No | No | Yes | Yes |
Criteria weighting | Yes | Yes | Yes | Yes |
Comparison | Yes | No | Yes | No |
Liens internes
- Open source software assessment methodologies
- Free Software
- Open Source