Defining and collecting metrics should be a disciplined part of every project or deliverable as a feedback and evaluation mechanism. When unsure what to collect, organizations often collect everything and wind up with, well in many cases not much, just a bunch of numbers. A method that provides focus in determining what to collect is the Goal-Question-Metric (GQM) method. This top-down, goal-driven method was developed by Dr. Victor Basili during the 1980’s in conjunction with his work at NASA. GQM provides a framework for developing and maintaining a meaningful metrics program that supports metric alignment with organizational goals. GQM can be applied to all life-cycle products, processes, and resources.
GQM Basics –
- Develop corporate, organizational or project goals.
- Generate questions that define those goals in a quantifiable manner
- Define the metrics needed to answer those questions in conformance to the goals.
With each goal, question and metric a mechanism is required for data collection and validation. Analysis of the data is required to provide timely feedback for corrective actions. Analysis of the program itself is required to assess conformance to the goals and improvements.
Some best practices for implementing GQM across all levels (strategic, tactical and operational) include -
- Implement in a phased approach to ensure quality and focus.
- Get the right people involved at all levels, cross functionally.
- Secure management commitment.
- Set and communicate measurement goals.
- Do not reverse engineer goals based on available data.
- Plan, document and establish the infrastructure for the metrics program.
- Stay focused on goals when analyzing data.
- Ensure each metric has a goal, owner, target & corrective action plan.
- Metrics need to be ones that drive the right behavior.
- GQM is a tool, not the end goal.
GQM has long been in the industry. It is a large yet critical topic; this approach should be the cornerstone of any program.
hkelly says:
This is great information. The biggest challenge is understanding what management wants. There is a lot of reverse engineering of goals and metrics that go on to try to fit what the organization currently has into the strategy.
February 5, 2009, 9:56 AM