Metrics for Project Management: Formalized Approaches

Suite

Preface

Forward-looking organizations that are progressive in strategic planning will continually strive to improve performance by sustaining success in all business and operational areas, including project management. In organizations where upper management values improved efficiency, a metrics program will be an essential business practice, as metrics address the long-term implications of every project within the context of the long-term strategies of an organization. Typically, a metrics program is a natural fit within an organization’s Project Management Office (PMO).

A metrics program can help guide an organization toward informed decisions, as it provides indicators regarding the quality, adequacy, and progress of projects, processes, and products. Metrics can help the enterprise recognize the sum of its collective capabilities, ensuring that plans for producing and delivering products and services are consistently realistic, achievable, and attainable. Metrics also can link the efforts of individual team members with the overall success of the project, and ultimately with the success of the organization. Consequently, properly designed metrics can indirectly promote teamwork and improve team morale.

Metrics for Project Management: Formalized Approaches describes a comprehensive set of project management metrics. Recognizing that project metrics can involve multiple dimensions, it presents metrics in the categories of things, people, and enterprise.

Chapter 1 highlights the need for a methodical, logical approach to metrics, the various utilities of metrics, and their limitations. Chapter 2 describes tools that can be used to gauge the success of the project team in handling project issues such as cost, scope, duration, and performance. The chapter also highlights critical success factors.

Chapter 3 enumerates the instruments available for assessing the motivation, performance, and behavior of team members, based on the assumption that these attributes influence how team members perform their project-related functions. Chapter 4 discusses metrics that assess organizational capabilities and collective enterprise project management performance. Enterprise issues include project management maturity and project portfolio management. Chapter 4 also discusses the influence of the PMO on project performance.

Finally, Chapter 5 presents the considerations involved in establishing a metrics program. In particular, it describes a methodology for selecting the most appropriate suite of metrics and developing an implementation schedule.

Chapters 2 through 5 each closes with a unique set of instruments designed to help readers implement a metrics program within their own organization. These instruments are necessarily broad but are easily adaptable to any organization’s unique needs.

Parviz F. Rad

Ginger Levin

CHAPTER 1

Introduction

Organizations that follow a management-by-projects approach develop a performance-based style and continually grow in sophistication in the area of project management. Their project management philosophy is formalized, methodical, and dependent on practices that are objective and consistent. Project management metrics are key elements in this process, focusing on portfolio management, progress management, process improvement, and benchmarking. Organizational strategic objectives guide the selected focus of the metrics system, which in turn defines the structure of the measurement activities. In addition, metrics serve as historical benchmarks for purposes of future performance evaluation, with the expectation of facilitating continuous improvements.

Many organizations have used metrics for years, particularly in the areas of finance and manufacturing, but especially in those operations considered to be recurring in nature. These organizations know that metrics systems help improve the rate at which they achieve their business goals. Metrics also can identify important events and trends, helping guide these organizations toward informed decisions in all specialty areas, but particularly in project management.

Implementing a metrics system can help facilitate improvements in project success measures such as scope, quality, cost, schedule, and client satisfaction. Therefore, most project management professionals believe that enlightened organizations must implement a full complement of project life-cycle metrics in all branches of their organization where project accomplishment is part of the strategic mission.

In particular, sound metrics practices are essential to major project management activities such as project planning, monitoring, and control. Consistent tools and procedures, used by competent personnel, lead to lower overall project costs and increased corporate profits. Moreover, the span of the utility of metrics should go beyond scope-cost-schedule; metrics should be used in data collection as well as in predictive models. The scope-cost-schedule indices should always be addressed, however, as they represent the client’s vantage point.

Benchmarking is rapidly becoming a popular mechanism for process improvement within enlightened organizations. However, effective benchmarking requires a system for gathering and refining data on all facets of the organization, particularly on projects. If upper management is focused on achieving improved efficiency, a metrics program becomes a necessary business practice.

A good metrics system is one that contributes to the right decisions in a timely manner based on fact rather than feeling (Augustine and Schroeder 1999). The most effective metrics programs are those in which the metrics are tailored to the organization’s important issues and strategic objectives.

A well-planned set of metrics can help the enterprise recognize the level of sophistication of its collective capabilities, thus making organizational plans for producing and delivering products and services consistently realistic and achievable. It is paradoxical that the same financial considerations that might tempt organizations to abandon an extensive formalized metrics system are the very ones that help organizations realize cost-saving benefits through decreased expenses and increased profits.

Metrics can be collected and used throughout all phases and facets of project management. Metrics can measure the status, effectiveness, and progress of project activities to gauge the contribution of a project to the organization. Metrics also can serve as the basis for clear, objective communications with project stakeholders.

Ideally, and to offer more sophisticated capabilities for project tracking and control, project management tools should be integrated with business processes. In addition, metrics can promote teamwork and improve team morale by linking efforts of individual team members with the overall success of the project and, ultimately, the success of the organization.

Success in project management is contingent on an organization’s capacity to assess project status realistically and predict performance accurately. Accurate performance forecasts can, in turn, be used to meet commitments relative to products and services. Metrics also can be used to determine the health of organizational processes affecting the successful conduct of projects.

Finally, some metrics can serve as barometers of organizational project management maturity. To that end, groups of metrics can be used to show where an organization stands in terms of the sophistication with which the collective project teams handle any of the project management knowledge areas.

ADVANTAGES OF METRICS-BASED PROJECT MANAGEMENT

To support all project management functions, such as project selection and project portfolio management, metrics need to be integrated into project life-cycle processes. A properly designed metrics program can ensure that the organization continues to pursue the right projects, even when organizational and environmental changes occur on a day-to-day basis during the life of these projects. Admittedly, some of these unplanned, unexpected changes present new opportunities for efficiency and success; however, positive unexpected events are rare.

Ideally, the underlying objective of a project metrics system is to provide accurate, verifiable information that can be used for improved performance of the enterprise’s project management capability. One major advantage of a well-crafted, formalized metrics program is that its components provide unbiased testimony on the status of particular issues significant to the performance monitoring process. Such unbiased, objective data are necessary when dealing with divisional managers or clients who need to substantiate claims and requests. Probably the most significant advantage of a metrics system is that it makes explicit those items that are usually implicit in the decision-making process.

A good metrics system also can help formalize the rationale for making decisions by making available the expertise, knowledge, and wisdom of experienced project managers to all project management practitioners within the organization. This objective can be achieved through a metrics system that encompasses models and indices that, by design, provide accurate, unbiased information for project planning, execution, and monitoring. The availability of such data assists team members in minimizing project cost, shortening project duration, improving deliverable quality, and maximizing client satisfaction. Other goals of metrics system modules include refining the estimating processes for cost and duration, improving the project delivery process, handling unusual and unplanned project events better, enhancing communications, improving responsiveness, and achieving greater client satisfaction.

With the aid of an effective metrics system, each project can become an opportunity for learning that benefits the entire organization. Even failed projects hold potential for learning. There is no question that the cost of mistakes might be painfully high. However, if the circumstances and sequence of events are carefully documented, they constitute a rich data source of ways to avoid similar mistakes in future projects. Careful documentation also can provide insight into the current level of sophistication of the organization’s project management processes.

A well-crafted metrics program can help identify areas where processes and procedures are exemplary and should continue to be followed. Likewise, this same metrics system can identify those processes in which improvement is needed. Finally, the metrics system can highlight those areas in which new processes are required.

With projects increasingly becoming a way of life for many enterprises, the organizational benefits of logical project management achieved through metrics-based project management methodologies, tools, and techniques are easily demonstrated. To assist in identifying a guiding example for such a self-appraisal, the company should look to other organizations that have already implemented a sophisticated, successful metrics system and borrow and adapt from its components.

As this new metrics system is being developed, or as it is becoming more sophisticated, it is possible to provide definitive answers to questions that executives in organizations often ask, such as:

• Does the organization normally achieve the results planned?

• Does the organization regularly achieve the desired return on investment?

• Are the projects selected for implementation aligned with the organization’s strategic objectives?

• Do the selected projects support the organization’s business needs and objectives?

• Are project objectives being met?

• Are client success criteria being met?

• Are projects considered strategic assets?

The answers to the questions not only respond to management inquiries but also warn of forthcoming problems. This warning mechanism enables the organization to avoid, or at least manage, emerging problems. Early diagnosis affords the organization the chance to turn the problem into an opportunity, at least some of the time.

The optimum solution to emerging project challenges lies in the use of a metrics system that supports timely dissemination of project information and improved communication (Lucero and Hall 2001). In turn, improved communication leads to better performance by project teams. Ultimately, improved performance translates to more successful projects.

Notably, metrics by themselves do not impart any value to the organization, because they do little, if anything, to resolve the issue being monitored. Metrics do not make decisions, people do; metrics simply provide the foundation and rationale for decisions. Thus, the return on investment of a metrics system derives from the actions that project professionals take to manage the issue at hand.

It is a somewhat common practice, albeit a short-sighted one, that organizations experiencing poor cash flows or low profits will minimize expenditures for things perceived to be luxuries. For functional organizations, two activities that might appear to be luxuries—although in reality they are excellent investments—are research and training. Similarly, some project-oriented organizations will tend to minimize and discourage detailed project planning and comprehensive project closeout in the face of difficult economic times.

Again, such cost-cutting measures are often counterproductive, as the short-term benefit of conducting these two activities is the success of individual projects. The long-term impact relates to the overall project management maturity of the organization.

Although some metrics might seem inappropriate or superfluous in less mature organizations, metrics can provide benefits to all organizations independent of their level of sophistication in project management. Some organizations use formalized, detailed metrics only for major projects, even though metrics allow the execution details of all projects to be predicted. Ideally, metrics should be applied across multiple projects, all organizational divisions, and the entire span of the project life cycle to benefit the organization’s goals.

WHAT IS A METRIC?

In the context of project management activities, a suite of metrics can offer a glimpse into the full range of expectations of a particular deliverable item or the tasks that would produce that deliverable. Alternately, metrics can gauge the status of a deliverable item relative to expectations for scope, cost, and delivery date. In the latter case, metrics are aimed at small, measurable attributes that have a predictive or comparative capability.

The vast majority of project metrics focus on things attributes, which are quantitative and thus measurable. As people issues of projects move to the forefront of project management concerns, an increasing number of metrics deal with people attributes, which have behavioral characteristics such as morale, satisfaction, loyalty, trust, and leadership.

The assignment of ratings, numbers, and ranks for the latter category can be based on questionnaires or instruments that characterize and quantify selected attributes of team members, teams, or even the organization as a whole. Such quantification also can be based on the experience and judgment of a seasoned project manager entrusted to make such observations.

Metrics might measure particular attributes of the project team directly or indirectly. For example, a metric can measure Monday absenteeism, which, in turn, is an indirect metric for team morale (Neuendorf 2002).

When dealing with attributes that appear to defy measurement and ranking, it is important to use a binary metric for that attribute, one that signals the presence or absence of a project management feature or function. For example, one index of a metrics system could test the presence or absence of a formalized project estimating process using conceptual estimating techniques. Another index could measure the level of team