Jump to content

Draft:Test Maturity Model integration

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by TMMi TC (talk | contribs) at 10:47, 17 July 2025 (Test Maturity Model integration (TMMi)). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.


Test Maturity Model integration (TMMi)

Test Maturity Model integration (TMMi) [1]is a structured framework designed to help organizations evaluate and improve the maturity of their software testing processes. Developed and maintained by the TMMi Foundation, it provides comprehensive guidance, best practices, and assessment criteria focused exclusively on testing activities.  TMMi defines five maturity levels (1 to 5): Initial, Managed, Defined, Measured and Optimization. Its scope covers a range of testing activities across the software lifecycle, including static and dynamic tests at all test levels.

TMMi is designed to complement the broader Capability Maturity Model Integration (CMMI), offering dedicated support for software testing in a range of software development environments, including traditional, Agile, and DevOps. The framework adheres to current testing standards and incorporates terminology established by the International Software Testing Qualifications Board (ISTQB).

First released in 2010, the TMMi model is currently available as TMMi 1.3, which is compatible with the terminology of CMMI V2.

TMMi is a registered trademark[2] of TMMi Foundation Limited.

Overview

Maturity Levels of TMMi. [1]

The TMMi (Test Maturity Model integration) framework is organized into five distinct maturity levels, each representing a stage in the progression of organizational test process capability. Each maturity level is associated with a set of process areas that organizations should address to achieve higher testing process maturity. The progression through these levels provides a structured path for continuous test process improvement.

Organizations may adopt TMMi by participating in training programs, such as the TMMi Professional certification, and by conducting assessments[3] to identify areas of strength and opportunities for improvement. The global adoption of the model across various industries demonstrates its impact on software quality and operational efficiency See [4] [5].

The TMMi Foundation manages the ongoing development of the framework and provides resources to facilitate its implementation. By adhering to the TMMi model, organizations can systematically enhance their testing processes, resulting in improved software quality and more efficient development practices.

Background and History

Beginning in 2005, a collective of software testing professionals and organizations initiated the TMMi Foundation. The foundation was officially launched at the ICSTest-UK conference in 2005, during which a dedicated track focused on the original Test Maturity Model (TMM).

The TMMi model was first released in 2010. Currently (July 2025) available version is TMMi v1.3.

TMMi is intended as an objective, business-oriented model that recognizes testing as an integral component of software development. The framework is designed to introduce a systematic, staged approach for improving testing practices, offering detailed guidance on test processes, techniques, and management.

The TMMi model is freely available for download and use, serving as a public reference for organizations seeking to improve their software testing practices.

TMMi has since been translated into multiple languages and is utilized globally.

Topics

TMMi Maturity Levels

A maturity level within the TMMi represents the degree of organizational test process quality. It is defined as an evolutionary plateau of test process improvement. Each level progressively develops a critical aspect of the organization’s test processes. TMMi framework has five Maturity Levels. Each maturity level defines what to implement to achieve the given level. Note that all organizations doing testing usually possess a minimum set of activities required by the model already on TMMi Level 1, even if this level does not contain any goals that must be satisfied. The higher the maturity level the organization achieves, the more test processes are in place and the more mature the organization’s test processes are.

The Process Areas associated to the maturity levels are the following:

Maturity Level 1 – Initial

Maturity Level 2 – Managed

  • 2.1 Test Policy and Strategy
  • 2.2 Test Planning
  • 2.3 Test Monitoring and Control
  • 2.4 Test Design and Execution
  • 2.5 Test Environment

Maturity Level 3 – Defined

  • 3.1 Test Organization
  • 3.2 Test Training Program
  • 3.3 Test Lifecycle and Integration
  • 3.4 Non-functional Testing
  • 3.5 Peer Reviews

Maturity Level 4 – Measured

  • 4.1 Test Measurement
  • 4.2 Product Quality Evaluation
  • 4.3 Advanced Reviews

Maturity Level 5 – Optimization

  • 5.1 Defect Prevention
  • 5.2 Quality Control
  • 5.3 Test Process Optimization

7. Structure of TMMi

The Test Maturity Model Integration (TMMi) is structured similarly to the Capability Maturity Model Integration (CMMI) v1.3, ensuring familiarity for organizations that have already adopted process improvement models. The model consists of multiple components categorized into required, expected, and informative elements, which guide organizations in improving their testing processes.[1]

Key Components

TMMi is composed of the following structured elements:[1]

  • Maturity Levels: A progressive framework defining the test process maturity of an organization
  • Process Areas: Key focus areas for achieving maturity at different levels.
  • Specific and Generic Goals: Mandatory targets an organization must achieve to satisfy a process area
  • Specific and Generic Practices: Recommended activities to help organizations meet the associated goals
  • Supporting Informative Components: Guidance materials such as sub-practices, examples, and references.

Process Areas and Practices

Each maturity level (except Level 1) contains process areas, which are clusters of related activities essential for improving test maturity. Specific and generic practices provide implementation guidance. Some key process areas include:[1]

  • Test Planning – Developing a structured approach to testing.
  • Test Monitoring & Control – Measuring and managing test execution.
  • Test Lifecycle & Integration – Aligning testing within the Software Development Lifecycle (SDLC).
  • Test Measurement – Establishing metrics for process evaluation.

Relationship with CMMI

Originally aligned with CMMI v1.3, TMMi has incorporated industry best practices while evolving independently. Despite structural similarities, TMMi focuses exclusively on software testing, complementing broader process improvement models like CMMI.[6]

Future Structural Considerations

With CMMI transitioning to newer versions (V2 and V3), discussions within the TMMi Foundation have explored whether to align future TMMi versions with updated CMMI structures. However, TMMi continues to maintain its independent identity while considering best practices from modern software engineering frameworks.[6]

This structured approach ensures that organizations can systematically assess, improve, and optimize their testing processes within the broader context of software quality assurance.[1]

8. TMMi and CMMi

The TMMi model has positioned itself as being complementary to CMMI (Capability Maturity Model Integration [7]). While TMMi concentrates on testing processes, CMMI was conceived to help improve the entire software development process.  

Testing within the SDLC (Software Development Life Cycle)  is an important activity, emphasized by CMMI as needed during the entire software development. However, testing appears explicitly in the CMMI model in few Practice Areas, and these provide a high-level guidance, without entering into details. Practice areas in CMMI connected to testing are: VER (Verification) and VAL (Validation). Elements of the integration testing can be found in PI (Product Integration).  Peer Reviews, being a separate Process Area previously, became a Specific Practice of the VER Process Area.  

As testing is addressed at a rather high level in CMMI, organizations that wish to concentrate on improving their testing processes will benefit from using TMMi.    

TMMi v1.3 shares a common structure with CMMI v1.3. [6]

The basic elements of the two  models are the same: Specific Goals and Generic Goals are required model components, Specific Practices and Generic Practices are expected components, and both models have informative components (sub-practices, example work products, notes, examples, and references).

Although declaring complementarity with CMMI (having both staged and continuous representations),  TMMi was developed basically as a staged model.

Practice areas from CMMI are generally not repeated within TMMi model description, but they are often referenced. Entire chapters from TMMi model description point out the interconnections between CMMI and TMMi practices. For details see TMMi model description, especially chapter 3.5 and 3.6[1].

The world-wide surveys from 2021[4] and 2023[5] indicate that while initially positioned as a complementary model to CMMI, today TMMi is also widely used independently: around 40%. of its users do not use CMMI - taking the average of both user surveys.

9. TMMi in the Agile and DevOps environment

The TMMi framework and Agile approaches can be used together and provide substantial benefits when integrated effectively[8]. TMMi emphasizes the integration of testing within the software development process rather than treating it as a separate activity.

TMMi should not be seen as a heavy set of practices to be followed, but rather as a flexible model that helps identify valuable changes in testing processes. Agile practices often achieve the intent of TMMi practices through alternative means, reflecting the importance of aligning practices with business needs rather than strict adherence to predefined standards or contract.

The Agile mindsets emphasize simplicity, which can be a challenge. TMMi implementation can support to analyse the process and reduce the overall risks. Agile improvements often occur through small, empowered teams that make quick decisions, offering further benefits to TMMi practices.

Using the TMMi model in an Agile context provides reminders of critical testing practices that are often “forgotten”. The document "TMMi in the Agile World"[8] provides detailed examples of how the TMMi framework and Agile methods can work together successfully.

TMMi is used with success in companies following DevOps approach. The document "TMMi® in the DevOps world" [9] provides detailed examples of how the TMMi framework can work successfully in a DevOps environment.

10. Trainings

One main mission of the TMMi Foundation  is to ensure professional training connected to the model and its assessment. Exams can certify the knowledge gained on the trainings.

TMMi Foundation has developed a network training providers[10] and  accredits them to ensure the uniform quality  of the trainings around the world. The training materials of these training providers are developed based on the actual Professional Training Syllabus[11] and is aided by sample exam papers freely downloadable.

TMMi Professional Training

The TMMi Professional qualification course is designed for individuals or groups who are involved in using the TMMi model for the test process improvement implementation. This includes people in roles such as test process improvers, test consultants, TMMi (lead-)assessors, business stakeholders, test managers, and members of a Test Process Group.

This TMMi Professional qualification is appropriate for anyone who is seeking an understanding of the TMMi model. Holders of the TMMi Professional Certificate will be able to demonstrate a level of knowledge required as a prerequisite to become an accredited TMMi Lead Assessor[12] or Assessor[13], or a test Process Improver[14].

The TMMi Professional training course has eight chapters.

  • Context of Test Improvement
  • Introduction to the TMMi Model
  • TMMi Maturity Levels
  • Structure of the TMMi
  • TMMi Model
  • TMMi in an Agile context
  • TMMi Assessments
  • Implementing TMMi

The training is typically run for two days. It will explain to management the business importance of test process improvement. It provides guidance and advice to an organization or a project when using the TMMi model as a basis for their test process improvement, both in traditional sequential lifecycle environment as Agile context. It is providing support in the interpretation and understanding of the TMMi model, including the relationship of the TMMi to the CMMI model.  A person completing the training can act as a co-assessor in informal TMMi assessments.

One can get certified according to TMMi Professional by achieving 65% on the one-hour, 40-question multiple-choice exam offered by the recognized exam providers.

After obtaining the TMMi Professional certification, the next  steps in the TMMi career path could be becoming  a TMMi Assessor, a TMMi Lead Assessor or a TMMi Test Process Improver.

Training can be completed by joining one of the TMMi Foundation’s recognized training providers[15], or professionals can prepare by themselves for the certification exam using the documents provided on the TMMi website.

TMMi (Lead) Assessor Training

The TMMi (Lead) Assessor course is designed for individuals who want to become an accredited TMMi Lead-Assessor or Assessor. It provides an overview and statement of what can be expected from a TMMi Assessor, in terms of the added value and skills they will bring to the business.

The TMMi (Lead) Assessor course has eight chapters.

  • TMMi Model
  • TMMi Documents and Processes
  • Introduction to TMMi Assessments
  • Assessment Planning and Preparation
  • Data Collection
  • Process Component Rating
  • Assessment Reporting
  • Assessment Closure

The training is typically a three-day one. It will teach the expected performance of the assessments, meeting the highest level of professional integrity.  One can join a training from one of the TMMi Foundation’s recognized TMMi Assessor training providers.

11. TMMi Assessment

Using TMMi model offers the possibility to a testing organization of obtaining a certification about organization’s maturity. Based on TMMi, organizations can have their test processes objectively evaluated by accredited Lead Assessors and Assessors, and improve their test processes based on the results. Having a certification, organizations can demonstrate to their customers that their testing processes reach a certain level of capability and maturity, thus ensuring that the testing organization will meet customer requirements. The framework of training, accreditation of assessors and assessment of organizations’ test processes is ensured and maintained by TMMi Foundation (see details at tmmi.org / Assessments).

There are 2 types of assessments defined by the TMMi Foundation: formal assessments and informal assessments[3].

A formal assessment is recommended if the organization requires a detailed assessment and / or a certification is desired. This type of assessment provides a gap analysis together with the improvements required to achieve the desired level of maturity. In this case the assessment team must be led by an Accredited Lead Assessor and must contain at least 2 people. The assessment will consist of document review and interviews, and corroboration of all evidence gathered must be verified. Each Process Area will be rated as Satisfied of Not satisfied, based on practice and goal characterization. The result is a Maturity Level.

An informal assessment can be considered if an organization wishes to have indicative results of its testing processes and organizational maturity. In this case the assessment team can consist of one Accredited Assessor, and one type of objective evidence is enough (interviews or documents). No formal rating will be generated, but a gap analysis will be done and a direction for improvement will be set.

TMMi Foundation ensures Lead Assessor and Assessor training, accreditation, and maintains the list of persons entitled by TMMi Foundation to conduct assessments  (https://www.tmmi.org/leadassessors/, https://www.tmmi.org/assessors/).

An organization can require TMMi assessment through the[16] accredited Assessment Service Providers or using independently accredited TMMi (lead) assessors. Any organization can apply to become an accredited Assessment Service Provider. TMMi Assessment Method Application Requirements (TAMAR) R1.2[17] defines the requirements for performing an informal or formal TMMi assessment and developing a TMMi assessment method. Anyone can develop their own assessment method based on these requirements. Requirements are conform to ISO 33002[18] . There are more assessment methods usable by the assessors.  The TMMi Assessment Method (TAM)[19] is TMMi Foundation's own accredited assessment method for conducting test process assessments against the TMMi Model. TAM is available for licensing. The supporting tool is available in multiple languages. The TMMi Lightning Scan Tool [20] has been developed to very quickly get a sense of ones test maturity compared to the TMMi. The tool is easy to use, and it currently supports the languages English, Chinese, French, Italian, Dutch, German, Japanese, Polish, Spanish and Turkish. Actually (July 2025) there are accredited TMMi (Lead) Assessors who are using the SCAMPI[21] or ASPICE[22] methods for assessments. Specific supporting guidelines document has been created for SCAMPI Appraisers that also perform TMMi assessments[23].

It is possible to do a Self Assessment using an accredited assessment method, and it involves having at least one TMMi accredited Assessor within the organization and using an accredited TMMi assessment method.

Self Assessment without an accredited assessment method means that TMMi model is freely available to download and to use as a guide for an informal assessment approach. The resulting assessment report and recommendations may not be as detailed or accurate as using an accredited TMMi assessment method.

When an assessment is done, a template can be used for submitting TMMi assessment results to the TMMi Foundation. This template, the Data Submission Form (DSF)[24], is available on TMMi web page. TMMi Foundation will be able to maintain only those data connected to TMMi assessment that were submitted to them via DSF.

The list of certified organization can be found at [25]. The world-wide surveys from 2021 and 2023  clearly indicate that there is a broad set of companies using TMMi concepts without being ever assessed, certified or undergoing an informal assessment (which does not appear with the previously referenced certifications).  Based on an extensive IEEE study[26] the estimated number of TMMi users world-wide is now around 9.000.

It is worth to note that TMMi can be used in conjunction with the CMMI (staged version) to do combined assessments (software development processes are addressed within CMMI, and testing processes are addressed in more detail using TMMi).

TMMi is needed to understand and assess testing processes, as CMMI addresses testing at a rather high level, having Verification, Validation and Product Integration Process Areas. 

In 2018 CMMI Version 2 (CMMI v2) was released by  ISACA, the new owner of CMMI. Together with CMMI v2 the new Appraisal Method Definition Document (further: MDD) with requirements for CMMI V2 appraisals was released. The question whether TMMi Assessment method(s) can make use of best practices from MDD is being an important subject of analysis to the TMMi community[27].

12. TMMi in the World

TMMi is used in many countries of the world. TMMi Foundation established the system of Local Chapters to ensure the uptake of TMMi in different regions. In the beginning of 2025, the 30th Local Chapter has started. These  local chapter cover more than 70 countries. The complete list of Local Chapters is available on the TMMi pages [28]

TMMi Foundation recently performed two world-wide surveys to understand who is using TMMi, the costs and benefits associated with applying TMMi.  It resulted that today, TMMi is world-leading model for test process improvement, as emphasized by scientific papers, see: [29] [26].

Among the advantages of TMMi model we can mention the possibility of obtaining a certification about test organization’s maturity. Based on this model organizations can have their test processes objectively evaluated by accredited assessors and improve their test processes based on the results.

There are more than 440 companies officially assessed to be compliant to a certain TMMi Maturity Level [30].  

However, the world-wide surveys from 2021[4] and 2023[5] clearly indicate that there is a broad set of companies using TMMi concepts without being ever assessed, certified or undergoing an informal assessment. Further information about TMMi cost, benefits and motivation to use TMMi can be found in [29] [26]. The scientific papers published in different journals [31][32] analyze the degree of TMMi adoption worldwide. Based on an extensive IEEE study[31] the estimated number of TMMi users world-wide is around 12.500 (last updated July 2025).

One reason for becoming a world-leading model can be the strength of the TMMi model that its terminology is synchronized with other test-related approaches and standards. TMMi is fully aligned with Glossary and Syllabi of International Software Testing Qualifications Board (ISTQB[33]), which is a leading organization in certifying testers world-wide. Besides ISTQB, TMMi is also aligned with a set of ISO standards connected to testing: ISO 20246, ISO 25010, ISO 25040, ISO 29119-1, ISO 29119-3 and ISO 33061[34]. TMMi follows the newest technology trends;  Agile  and DevOps principles are incorporated within the practices of the model. The document "TMMi in the Agile world"[8] describes how to apply and use TMMi in an Agile context .   

13. TMMi Foundation

TMMi Foundation[35] was established in 2005, with the goal to create an up-to-date Test Maturity Model, based on the previously existing approaches (see [36] [37]). TMMi Foundation has a well-defined organizational structure   and it operates based on a professionally developed Code of Conduct[38] .

TMMi Foundation maintains the TMMi model and it ensures that the model description is freely downloadable.   It also ensures model translations into a continuously growing number of other languages (for instance: Chinese, French, Spanish, Brazilian, Polish, Japanese…). 

The framework of training, accreditation of assessors and assessments of organizations’ test processes is also ensured and maintained by TMMi Foundation. Lists of Recognized Training providers, Accredited TMMi Service Providers, Accredited Lead Assessors and Accredited Assessors are displayed on TMMi Foundation webpage. 

TMMi Foundation has a strategic alliance with ISTQB[39], ensuring that the set of terms used in testing are common for the two world-wide organizations, forming the software testing community’s Body of Knowledge.

TMMi Foundation official page contains information about official TMMi certifications worldwide[40].

In July 2025, there were more than 440 companies officially assessed according to TMMi requirements. The majority of the companies are ML3 compliant, but a considerable number of ML5 certifications are also mentioned.   

See also

Test Maturity Model - Software Testing

TMMi in the Agile World

TMMi in teh DevOps World

ISTQB® and TMMi® Renew Their Alliance Agreement to Advance Software Testing

References

  1. ^ a b c d e f g van Veenendaal, Erik, ed. (2022). "(TMMi®) Guidelines for Test Process Improvement" (PDF). TMMi (1.3 ed.). https://www.tmmi.org/download/tmmi-framework-r1-3-pdf/?wpdmdl=6389&masterkey=6387a3132ef3b
  2. ^ https://tmsearch.uspto.gov/
  3. ^ a b "Assessment Types". TMMi. Retrieved 2025-07-09.
  4. ^ a b c Word-wide user survey, 2020/ 2021. https://www.tmmi.org/tm6/wp-content/uploads/2021/07/TMMi-Survey-Report-v1.1.pdf
  5. ^ a b c World Wide User Survey, 2022/2023
  6. ^ a b c Balla, Katalin. "TMMi Structure - to Change or not to Change". TMMi.
  7. ^ "CMMI Institute - Home". cmmiinstitute.com. Retrieved 2025-06-24.
  8. ^ a b c TMMi in the Agile World. https://www.tmmi.org/download/tmmi-in-the-agile-world-english/?wpdmdl=8325&masterkey=E4EjJEGCX3yOtm7h7qnjO0vt0bsR95CW5u3zmKBREXO2nMALgKHgKemEuiXOtHWJ6igCLhicbK1bpowhgpUJEzm8UJatomiuuPtyNdv16KM
  9. ^ TMMi® in the DevOps world. https://www.tmmi.org/download/tmmi-in-devops/?wpdmdl=8748&masterkey=YyMyYrEMnxyB4IHsoRhGU-7E3LFdjkZwj3IKtldzOZQUWUYZUA1_zue8GQvaUd68hVgS9VazI5n4WOTffsKI5GKBnuXH4V_cczFjJ9yQ7S0
  10. ^ "TMMi Professional Training Providers". TMMi. Retrieved 2025-06-24.
  11. ^ "TMMi Documents". TMMi. Retrieved 2025-06-24.
  12. ^ "Accredited Lead Assessors". TMMi. Retrieved 2025-06-24.
  13. ^ "Accredited Assessors". TMMi. Retrieved 2025-06-24.
  14. ^ "About TMMi Test Process Improver". TMMi. Retrieved 2025-06-24.
  15. ^ "TMMi Professional Training Providers". TMMi. Retrieved 2025-06-24.
  16. ^ https://www.tmmi.org/download/tmmi-assessor-accreditation/?wpdmdl=5775&masterkey=6202d0cdddadc
  17. ^ https://www.tmmi.org/download/tmmi-assessment-method-application-requirements/?wpdmdl=6846&masterkey=642b0f7944569
  18. ^ https://www.iso.org/standard/54176.html. ISO/IEC 33002 (2015), Information Technology – Process Assessment – Requirements for Performing Process Assessments, International Organization
  19. ^ "About TMMi Assessment Method (TAM)". TMMi. Retrieved 2025-07-09.
  20. ^ "TMMi Documents". TMMi. Retrieved 2025-07-09.
  21. ^ Standard CMMI Appraisal Method for Process Improvement
  22. ^ https://vda-qmc.de/wp-content/uploads/2023/12/Automotive-SPICE-PAM-v40.pdf
  23. ^ SCAMPI Appraiser Supporting Guidelines v1.0https://www.tmmi.org/download/scampi-appraiser-supporting-guidelines-v1-0/?wpdmdl=5303&masterkey=61a14c1d9c5e3.
  24. ^ https://www.tmmi.org/download/data-submission-form-assessments/?wpdmdl=6785&masterkey=6402ed3527b35
  25. ^ "Certified Organizations". TMMi. Retrieved 2025-07-09.
  26. ^ a b c Vahid Garousi, Michael Felderer, and Tuna Hacalo˘glu: What we know about software test maturity and test process improvement IEEE Software, January/ February 2018 (2018)
  27. ^ The new MDD and TAMAR. White paper TMMi Foundation, April 2023, (Katalin Balla, Jan Jaap Cannegieter and Erik van Veenendaal). https://www.tmmi.org/case-studies/
  28. ^ "TMMi Local Chapters". TMMi. Retrieved 2025-06-24.
  29. ^ a b Erik van Veenendaal, Vahid Garousi and Michael Felderer: Motivations for and Benefits of Adopting the Test Maturity Model integration (TMMi) Software Quality – The Next Big Thing in Software Engineering and Quality, May 2022, Springer Publishing (2022)
  30. ^ "Certified Organizations". TMMi. Retrieved 2025-07-09.
  31. ^ a b "Test Maturity Model integration (TMMi): Trends of Worldwide Test Maturity and Certifications" (pre-print) - IEEE Software, March/April 2022, (Vahid Garousi and Erik van Veenendaal). https://www.tmmi.org/case-studies/
  32. ^ Erik Van Veenendaal: Test Maturity Model integration (TMMi): Test Maturity in the Financial Domain. In: American Journal of Computer Science and Technology. Issue: Volume 7, Issue 2, June 2024, Pages: 43-50. DOI: 10.11648/j.ajcst.20240702.13. https://www.tmmi.org/case-studies/
  33. ^ "International Software Testing Qualifications Board". www.istqb.org. 2024-10-19. Retrieved 2025-06-24.
  34. ^ "ISO - International Organization for Standardization". ISO. Retrieved 2025-07-09.
  35. ^ "Home". TMMi. Retrieved 2025-07-09.
  36. ^ webmaster@sqs.de. "Software & Systems Quality Conferences". www.icstest.com. Archived from the original on 2005-12-10. Retrieved 2025-06-24.
  37. ^ "CMMI Institute - Home". cmmiinstitute.com. Retrieved 2025-06-24.
  38. ^ "TMMi Foundation Code of Conduct". TMMi. Retrieved 2025-06-24.
  39. ^ "International Software Testing Qualifications Board". www.istqb.org. 2024-10-19. Retrieved 2025-06-24.
  40. ^ "Certified Organizations". TMMi. Retrieved 2025-06-24.

TMMi - Official Website