Jump to content

Draft:Test Maturity Model integration

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by TMMi TC (talk | contribs) at 10:26, 18 July 2025 (→Test Maturity Model integration (TMMi)). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.


Test Maturity Model integration (TMMi)

Test Maturity Model integration (TMMi) [1]is a structured framework designed to help organizations evaluate and improve the maturity of their software testing processes. Developed and maintained by the TMMi Foundation, it provides comprehensive guidance, best practices, and assessment criteria focused exclusively on testing activities.  TMMi defines five maturity levels (1 to 5): Initial, Managed, Defined, Measured and Optimization. TMMi addresses all test levels, from static to dynamic, including component, integration, system, and acceptance tests. It covers the four key areas of structured testing: lifecycle, techniques, infrastructure and organization.

TMMi is designed to complement the broader Capability Maturity Model Integration (CMMI), offering dedicated support for software testing in a range of software development environments, including traditional, Agile, and DevOps. The framework adheres to current testing standards and incorporates terminology established by the International Software Testing Qualifications Board (ISTQB).

First released in 2010, the TMMi model is currently available as TMMi 1.3, which is compatible with the terminology of CMMI V2.

TMMi is a registered trademark[2] of TMMi Foundation Limited.

Overview

Maturity Levels of TMMi. [1]

The TMMi (Test Maturity Model integration) framework is organized into five distinct maturity levels, each representing a stage in the progression of organizational test process capability. Each maturity level is associated with a set of process areas that organizations should address to achieve higher testing process maturity. The progression through these levels provides a structured path for continuous test process improvement.

Organizations may adopt TMMi by participating in training programs, such as the TMMi Professional certification, and by conducting assessments[3] to identify areas of strength and opportunities for improvement. The global adoption of the model across various industries demonstrates its impact on software quality and operational efficiency See [4] [5].

The TMMi Foundation manages the ongoing development of the framework and provides resources to facilitate its implementation. By adhering to the TMMi model, organizations can systematically enhance their testing processes, resulting in improved software quality and more efficient development practices.

Background and History

Beginning in 2005, a collective of software testing professionals and organizations initiated the TMMi Foundation. The foundation was officially launched at the ICSTest-UK conference in 2005, during which a dedicated track focused on the original Test Maturity Model (TMM).

The TMMi model was first released in 2010. Currently (July 2025) available version is TMMi v1.3.

TMMi is intended as an objective, business-oriented model that recognizes testing as an integral component of software development. The framework is designed to introduce a systematic, staged approach for improving testing practices, offering detailed guidance on test processes, techniques, and management.

The TMMi model is freely available for download and use, serving as a public reference for organizations seeking to improve their software testing practices.

TMMi has since been translated into multiple languages and is utilized globally[4][5].

Topics

Key Components of TMMi

The model is composed of required, expected, and informative elements that guide organizations in assessing and improving their testing processes. These are the following:

  • Maturity Levels: A progressive framework defining the test process maturity of an organization.
  • Process Areas: Key focus areas for achieving maturity at different levels.
  • Specific and Generic Goals: Mandatory targets an organization must achieve to satisfy a process area
  • Specific and Generic Practices: Recommended activities to help organizations meet the associated goals
  • Supporting Informative Components: Guidance materials such as sub-practices, examples, and references

TMMi Maturity Levels

The Test Maturity Model Integration (TMMi) defines five maturity levels which represent evolutionary plateaus in the improvement of an organization’s testing processes. Each maturity level specifies both what is required to achieve it and the focus areas for process advancement.

At TMMi Level 1, Initial, testing is informal and unstructured, often regarded as part of debugging. Processes are ad hoc, developed after coding, and rely on individual effort rather than standardized practices. There are no defined process areas at this level; organizations typically lack resources, tools, and trained personnel, leading to inconsistent quality and unpredictable project outcomes. At TMMi Level 1 no specific Process Areas are in place.

At TMMi Level 2, Managed, testing shifts to a managed process, distinct from debugging. This discipline ensures best practices remain consistent, even under pressure, though many still view testing as a post-coding phase. The Process Areas at this level are:

  • Test Policy and Strategy
  • Test Planning
  • Test Monitoring and Control
  • Test Design and Execution
  • Test Environment

At TMMi Level 3, Defined, testing is integrated into the software development lifecycle, starting early during the requirements phase with a master test plan. Organizations standardize and refine test processes, establish a dedicated test organization, and implement specialized training. Testing is recognized as a profession, and process improvement is a standard practice. Formal review programs are conducted throughout the development lifecycle, with test professionals evaluating requirements specifications. Test design expands to include non-functional testing, such as usability and reliability, based on organizational objectives. The Process Areas at TMMi Level 3 are:

  • Test Organization
  • Test Training Program
  • Test Lifecycle and Integration
  • Non-functional Testing
  • Peer Reviews

At TMMi Maturity Level 4 (Measured), testing processes are well-defined, quantifiable, and integrated across the organization. A comprehensive test measurement program is implemented to evaluate testing quality, assess productivity, and monitor improvements. Quantitative product quality evaluation is performed throughout the lifecycle, using defined metrics for characteristics like reliability, usability, and maintainability. Peer reviews and inspections are systematically incorporated into testing, serving both as defect detection and as tools for measuring and managing product quality. At this stage, static and dynamic testing approaches are coordinated to enhance overall test effectiveness and efficiency.  The Process Areas at TMMi level 4 are:

  • Test Measurement
  • Product Quality Evaluation
  • Advanced Reviews

At TMMi Maturity Level 5 (Optimization), organizations achieve continuous improvement of their testing processes through quantitative analysis and innovation. Processes are statistically managed, with a permanent test process group overseeing ongoing enhancements, the reuse of test assets, and adoption of new technologies. The three key process areas at this level are Defect Prevention, Quality Control, and Test Process Optimization, each supporting ongoing improvement. Defect Prevention focuses on identifying and addressing root causes of defects, Quality Control introduces statistical sampling and reliability measurements, while Test Process Optimization aims to refine practices and implement new tools and techniques. These areas are highly interrelated and build upon practices established at lower maturity levels, with the overarching goal of preventing defects and optimizing testing effectiveness and efficiency. The process areas at TMMi level 5 are:

  • Defect Prevention
  • Quality Control
  • Test Process Optimization

Each maturity level, except for Level 1, consists of process areas that cluster related activities essential for advancing test maturity. Implementation guidance is provided through specific and generic practices, supporting organizations in systematically assessing, improving, and optimizing their testing processes as part of a broader approach to software quality assurance

TMMi relationship with CMMI

TMMi v1.3 shares a common structure with CMMI v2. [6]

The TMMi model has positioned itself as being complementary to CMMI  [7]. While TMMi concentrates on testing processes, CMMI was conceived to help improve the entire software development process. Practice areas from CMMI are generally not repeated within TMMi model description, but they are often referenced.

The world-wide surveys from 2021[4] and 2023[5] indicate that while initially positioned as a complementary model to CMMI, today TMMi is also widely used independently: around 40%. of its users do not use CMMI - taking the average of both user surveys.

TMMi in the Agile and DevOps environment

TMMi can be integrated with Agile and DevOps approaches, offering practical benefits when applied together. Rather than prescribing strict practices, TMMi serves as a flexible framework for identifying improvements in testing processes. In Agile environments, TMMi practices are often achieved through alternative, business-focused methods. The framework helps ensure important testing activities are maintained—especially those that might be overlooked in Agile or DevOps contexts—and provides guidance for risk reduction and process analysis. Official documents provide case studies on successful TMMi use in both Agile and DevOps settings.

Trainings

The TMMi Foundation oversees professional training and exams related to the TMMi model, accrediting a global network of training providers to ensure quality and consistency. The TMMi Professional qualification course, based on the official syllabus, is aimed at those involved in test process improvement and covers topics such as TMMi maturity levels, Agile integration, and assessment methods. Certification is granted upon passing a multiple-choice exam.

Following certification, individuals can pursue roles as TMMi Assessors, Lead Assessors, or Test Process Improvers. Training can be obtained through recognized providers or by self-study using official materials.

The TMMi (Lead) Assessor course prepares participants to become accredited Lead Assessors or Assessors, focusing on assessment principles, planning, evidence gathering, and reporting. Training is available through the TMMi Foundation’s accredited providers.

11. TMMi Assessment

Using TMMi model offers the possibility to a testing organization of obtaining a certification about organization’s maturity. Based on TMMi, organizations can have their test processes objectively evaluated by accredited Lead Assessors and Assessors, and improve their test processes based on the results. Having a certification, organizations can demonstrate to their customers that their testing processes reach a certain level of capability and maturity, thus ensuring that the testing organization will meet customer requirements. The framework of training, accreditation of assessors and assessment of organizations’ test processes is ensured and maintained by TMMi Foundation (see details at tmmi.org / Assessments).

There are 2 types of assessments defined by the TMMi Foundation: formal assessments and informal assessments[3].

A formal assessment is recommended if the organization requires a detailed assessment and / or a certification is desired. This type of assessment provides a gap analysis together with the improvements required to achieve the desired level of maturity. In this case the assessment team must be led by an Accredited Lead Assessor and must contain at least 2 people. The assessment will consist of document review and interviews, and corroboration of all evidence gathered must be verified. Each Process Area will be rated as Satisfied of Not satisfied, based on practice and goal characterization. The result is a Maturity Level.

An informal assessment can be considered if an organization wishes to have indicative results of its testing processes and organizational maturity. In this case the assessment team can consist of one Accredited Assessor, and one type of objective evidence is enough (interviews or documents). No formal rating will be generated, but a gap analysis will be done and a direction for improvement will be set.

TMMi Foundation ensures Lead Assessor and Assessor training, accreditation, and maintains the list of persons entitled by TMMi Foundation to conduct assessments  (https://www.tmmi.org/leadassessors/, https://www.tmmi.org/assessors/).

An organization can require TMMi assessment through the[8] accredited Assessment Service Providers or using independently accredited TMMi (lead) assessors. Any organization can apply to become an accredited Assessment Service Provider. TMMi Assessment Method Application Requirements (TAMAR) R1.2[9] defines the requirements for performing an informal or formal TMMi assessment and developing a TMMi assessment method. Anyone can develop their own assessment method based on these requirements. Requirements are conform to ISO 33002[10] . There are more assessment methods usable by the assessors.  The TMMi Assessment Method (TAM)[11] is TMMi Foundation's own accredited assessment method for conducting test process assessments against the TMMi Model. TAM is available for licensing. The supporting tool is available in multiple languages. The TMMi Lightning Scan Tool [12] has been developed to very quickly get a sense of ones test maturity compared to the TMMi. The tool is easy to use, and it currently supports the languages English, Chinese, French, Italian, Dutch, German, Japanese, Polish, Spanish and Turkish. Actually (July 2025) there are accredited TMMi (Lead) Assessors who are using the SCAMPI[13] or ASPICE[14] methods for assessments. Specific supporting guidelines document has been created for SCAMPI Appraisers that also perform TMMi assessments[15].

It is possible to do a Self Assessment using an accredited assessment method, and it involves having at least one TMMi accredited Assessor within the organization and using an accredited TMMi assessment method.

Self Assessment without an accredited assessment method means that TMMi model is freely available to download and to use as a guide for an informal assessment approach. The resulting assessment report and recommendations may not be as detailed or accurate as using an accredited TMMi assessment method.

When an assessment is done, a template can be used for submitting TMMi assessment results to the TMMi Foundation. This template, the Data Submission Form (DSF)[16], is available on TMMi web page. TMMi Foundation will be able to maintain only those data connected to TMMi assessment that were submitted to them via DSF.

The list of certified organization can be found at [17]. The world-wide surveys from 2021 and 2023  clearly indicate that there is a broad set of companies using TMMi concepts without being ever assessed, certified or undergoing an informal assessment (which does not appear with the previously referenced certifications).  Based on an extensive IEEE study[18] the estimated number of TMMi users world-wide is now around 9.000.

It is worth to note that TMMi can be used in conjunction with the CMMI (staged version) to do combined assessments (software development processes are addressed within CMMI, and testing processes are addressed in more detail using TMMi).

TMMi is needed to understand and assess testing processes, as CMMI addresses testing at a rather high level, having Verification, Validation and Product Integration Process Areas. 

In 2018 CMMI Version 2 (CMMI v2) was released by  ISACA, the new owner of CMMI. Together with CMMI v2 the new Appraisal Method Definition Document (further: MDD) with requirements for CMMI V2 appraisals was released. The question whether TMMi Assessment method(s) can make use of best practices from MDD is being an important subject of analysis to the TMMi community[19].

12. TMMi in the World

TMMi is used in many countries of the world. TMMi Foundation established the system of Local Chapters to ensure the uptake of TMMi in different regions. In the beginning of 2025, the 30th Local Chapter has started. These  local chapter cover more than 70 countries. The complete list of Local Chapters is available on the TMMi pages [20]. 

TMMi Foundation recently performed two world-wide surveys to understand who is using TMMi, the costs and benefits associated with applying TMMi.  It resulted that today, TMMi is world-leading model for test process improvement, as emphasized by scientific papers, see: [21] [18].

Among the advantages of TMMi model we can mention the possibility of obtaining a certification about test organization’s maturity. Based on this model organizations can have their test processes objectively evaluated by accredited assessors and improve their test processes based on the results.

There are more than 440 companies officially assessed to be compliant to a certain TMMi Maturity Level [22].  

However, the world-wide surveys from 2021[4] and 2023[5] clearly indicate that there is a broad set of companies using TMMi concepts without being ever assessed, certified or undergoing an informal assessment. Further information about TMMi cost, benefits and motivation to use TMMi can be found in [21] [18]. The scientific papers published in different journals [23][24] analyze the degree of TMMi adoption worldwide. Based on an extensive IEEE study[23] the estimated number of TMMi users world-wide is around 12.500 (last updated July 2025).

One reason for becoming a world-leading model can be the strength of the TMMi model that its terminology is synchronized with other test-related approaches and standards. TMMi is fully aligned with Glossary and Syllabi of International Software Testing Qualifications Board (ISTQB[25]), which is a leading organization in certifying testers world-wide. Besides ISTQB, TMMi is also aligned with a set of ISO standards connected to testing: ISO 20246, ISO 25010, ISO 25040, ISO 29119-1, ISO 29119-3 and ISO 33061[26]. TMMi follows the newest technology trends;  Agile  and DevOps principles are incorporated within the practices of the model. The document "TMMi in the Agile world"[27] describes how to apply and use TMMi in an Agile context .   

13. TMMi Foundation

TMMi Foundation[28] was established in 2005, with the goal to create an up-to-date Test Maturity Model, based on the previously existing approaches (see [29] [30]). TMMi Foundation has a well-defined organizational structure   and it operates based on a professionally developed Code of Conduct[31] .

TMMi Foundation maintains the TMMi model and it ensures that the model description is freely downloadable.   It also ensures model translations into a continuously growing number of other languages (for instance: Chinese, French, Spanish, Brazilian, Polish, Japanese…). 

The framework of training, accreditation of assessors and assessments of organizations’ test processes is also ensured and maintained by TMMi Foundation. Lists of Recognized Training providers, Accredited TMMi Service Providers, Accredited Lead Assessors and Accredited Assessors are displayed on TMMi Foundation webpage. 

TMMi Foundation has a strategic alliance with ISTQB[32], ensuring that the set of terms used in testing are common for the two world-wide organizations, forming the software testing community’s Body of Knowledge.

TMMi Foundation official page contains information about official TMMi certifications worldwide[33].

In July 2025, there were more than 440 companies officially assessed according to TMMi requirements. The majority of the companies are ML3 compliant, but a considerable number of ML5 certifications are also mentioned.   

See also

Test Maturity Model - Software Testing

CMMI - Capability Maturity Model Integration

TMMi in the Agile World

TMMi in the DevOps World

ISTQB Glossary of Terms

ISTQB® and TMMi® Renew Their Alliance Agreement to Advance Software Testing

References

  1. ^ a b van Veenendaal, Erik, ed. (2022). "(TMMi®) Guidelines for Test Process Improvement" (PDF). TMMi (1.3 ed.). https://www.tmmi.org/download/tmmi-framework-r1-3-pdf/?wpdmdl=6389&masterkey=6387a3132ef3b
  2. ^ https://tmsearch.uspto.gov/
  3. ^ a b "Assessment Types". TMMi. Retrieved 2025-07-09.
  4. ^ a b c d Word-wide user survey, 2020/ 2021. https://www.tmmi.org/tm6/wp-content/uploads/2021/07/TMMi-Survey-Report-v1.1.pdf
  5. ^ a b c d World Wide User Survey, 2022/2023
  6. ^ Balla, Katalin (2024). "TMMi Structure - to Change or not to Change". TMMi.
  7. ^ "CMMI Institute - Home". cmmiinstitute.com. Retrieved 2025-06-24.
  8. ^ https://www.tmmi.org/download/tmmi-assessor-accreditation/?wpdmdl=5775&masterkey=6202d0cdddadc
  9. ^ https://www.tmmi.org/download/tmmi-assessment-method-application-requirements/?wpdmdl=6846&masterkey=642b0f7944569
  10. ^ https://www.iso.org/standard/54176.html. ISO/IEC 33002 (2015), Information Technology – Process Assessment – Requirements for Performing Process Assessments, International Organization
  11. ^ "About TMMi Assessment Method (TAM)". TMMi. Retrieved 2025-07-09.
  12. ^ "TMMi Documents". TMMi. Retrieved 2025-07-09.
  13. ^ Standard CMMI Appraisal Method for Process Improvement
  14. ^ https://vda-qmc.de/wp-content/uploads/2023/12/Automotive-SPICE-PAM-v40.pdf
  15. ^ SCAMPI Appraiser Supporting Guidelines v1.0https://www.tmmi.org/download/scampi-appraiser-supporting-guidelines-v1-0/?wpdmdl=5303&masterkey=61a14c1d9c5e3.
  16. ^ https://www.tmmi.org/download/data-submission-form-assessments/?wpdmdl=6785&masterkey=6402ed3527b35
  17. ^ "Certified Organizations". TMMi. Retrieved 2025-07-09.
  18. ^ a b c Vahid Garousi, Michael Felderer, and Tuna Hacalo˘glu: What we know about software test maturity and test process improvement IEEE Software, January/ February 2018 (2018)
  19. ^ The new MDD and TAMAR. White paper TMMi Foundation, April 2023, (Katalin Balla, Jan Jaap Cannegieter and Erik van Veenendaal). https://www.tmmi.org/case-studies/
  20. ^ "TMMi Local Chapters". TMMi. Retrieved 2025-06-24.
  21. ^ a b Erik van Veenendaal, Vahid Garousi and Michael Felderer: Motivations for and Benefits of Adopting the Test Maturity Model integration (TMMi) Software Quality – The Next Big Thing in Software Engineering and Quality, May 2022, Springer Publishing (2022)
  22. ^ "Certified Organizations". TMMi. Retrieved 2025-07-09.
  23. ^ a b "Test Maturity Model integration (TMMi): Trends of Worldwide Test Maturity and Certifications" (pre-print) - IEEE Software, March/April 2022, (Vahid Garousi and Erik van Veenendaal). https://www.tmmi.org/case-studies/
  24. ^ Erik Van Veenendaal: Test Maturity Model integration (TMMi): Test Maturity in the Financial Domain. In: American Journal of Computer Science and Technology. Issue: Volume 7, Issue 2, June 2024, Pages: 43-50. DOI: 10.11648/j.ajcst.20240702.13. https://www.tmmi.org/case-studies/
  25. ^ "International Software Testing Qualifications Board". www.istqb.org. 2024-10-19. Retrieved 2025-06-24.
  26. ^ "ISO - International Organization for Standardization". ISO. Retrieved 2025-07-09.
  27. ^ TMMi in the Agile World. https://www.tmmi.org/download/tmmi-in-the-agile-world-english/?wpdmdl=8325&masterkey=E4EjJEGCX3yOtm7h7qnjO0vt0bsR95CW5u3zmKBREXO2nMALgKHgKemEuiXOtHWJ6igCLhicbK1bpowhgpUJEzm8UJatomiuuPtyNdv16KM
  28. ^ "Home". TMMi. Retrieved 2025-07-09.
  29. ^ webmaster@sqs.de. "Software & Systems Quality Conferences". www.icstest.com. Archived from the original on 2005-12-10. Retrieved 2025-06-24.
  30. ^ "CMMI Institute - Home". cmmiinstitute.com. Retrieved 2025-06-24.
  31. ^ "TMMi Foundation Code of Conduct". TMMi. Retrieved 2025-06-24.
  32. ^ "International Software Testing Qualifications Board". www.istqb.org. 2024-10-19. Retrieved 2025-06-24.
  33. ^ "Certified Organizations". TMMi. Retrieved 2025-06-24.

TMMi - Official Website

Retrieved from "https://en.wikipedia.org/w/index.php?title=Draft:Test_Maturity_Model_integration&oldid=1301156706"