Introduction

What is Benchmarking?

“Benchmarking: A continuous, systematic process of evaluating and comparing the capability of one organization with others normally recognized as industry leaders, for insights for optimizing the organizations processes.”

Performance analysis forms the basis for your current process improvement which enables you to make better software tomorrow. Performance benchmarking removes misconceptions, and lets us see the actual need for improvement.

Performance Benchmarking and Robust Design

Performance benchmarking and robust design of software is used to:

  • Create reliable performance baselines and quantitative models for bidding/creation of RFPs – including an estimate of the minimum development time possible given the historical performance
  • Assess the process level Before-After improvement linked to other initiatives such as CMMI L4/L5 or new technology deployment
  • Look at a credible alternative to Reassessment – addresses the question of “what after CMMI L5?”
  • De-risk the development process
    • Early Warning Systems: that create profiles of customers, employees, projects and products
    • Robust Design: Use innovation tools based on TRIZ Functional Modeling, AFD (Anticipatory Failure Determination)
    • Vendor capability assessment: Assess the ability of vendors/service providers to meet the requirements

QAI has partnered with QSM Inc. of USA to bring the Benchmarking Service, which is being used by organizations from across the world like Motorola, Samsung (SISO), Custom media (Malaysia), GE (China), T3G (China), NIIT, Datamatics, Birlasoft, Bamboo Networks, Techspan, Ericsson, Alcatel, EDS, Compaq, US DoD to steer their software process improvement projects.

QAI’s performance benchmarking brings you tools, techniques and access to a repository of over 6500 projects that will equip your business to leapfrog competition. The advisory services leverage QAI’s experience and expertise built over a decade of international consulting and the rich and varied experience of its international partners such as Quantitative Software Management (QSM), USA and Ideation International Inc.(III), USA.

The Benchmarking Service provides answers to questions like:

  • What is our current capability?
  • How do we compare in terms of speed, efficiency, and quality?
  • Is our productivity improving?

Projects that are included in the QSM database:

  • Have completed the development cycle and are successfully deployed.
  • Have measured as a minimum on the SEISM core measures: size, schedule and effort.

As on April 2003, the Benchmarking database contains metrics collected from 6,400 completed and validated projects from US, UK, Europe, India, China, Asia and Australia.

QAI Benchmarking Service has no prerequisites:

  • The service covers all types of project life cycles: waterfall, prototyping, RAD, maintenance, enhancements.
  • The service is independent of the size of the organization.
  • The service is independent of the quality model/framework adopted by the organization (ISO, CMM®, IEEE..).
  • The service is independent of the project sizing methodology: SLOC, FPA, Component, modules, system-subsystem etc.
  • At the minimum, the service requires tracking of SEISM defined core measures: Size, Effort, Time and Defects.

With internationally benchmarked projects, project planning and process improvement activities are informed and effective. Besides, you know where you stand. And this is how the Best get Better!

banner_bench

 

 

 

CMM® and Capability Maturity Model are registered in the US Patent and Trademark office.SEISM, CMMISM, Capability Maturity Model IntegrationSM, SEPGSM, PSPSM, SCAMPISM, TSPSM, are service marks of Carnegie Mellon University