Escolar Documentos
Profissional Documentos
Cultura Documentos
August 2009
Copyright Standards
This document contains proprietary research, copyrighted materials, and literary property of Gallup, Inc. It is for the guidance
of your company only and is not to be copied, quoted, published, or divulged to others outside of your organization. Gallup®,
Q12®, Selection Research, Inc.®, and SRI® are trademarks of Gallup, Inc. All other trademarks are the property of their
respective owners.
This document is of great value to both your organization and Gallup, Inc. Accordingly, international and domestic laws
and penalties guaranteeing patent, copyright, trademark, and trade secret protection protect the ideas, concepts, and
recommendations related within this document.
No changes may be made to this document without the express written permission of Gallup, Inc.
Acknowledgments
The authors thank Jim Asplund, Nikki Blacksmith, James Court-Smith, Kirti Kanitkar, Mike Lemberger, Eric Olesen, and
Stephanie Plowman for contributing important research studies and database information to this meta-analysis update.
Contents
Executive Summary...........................................................................................................................................3
Objective.................................................................................................................................................3
Methods...................................................................................................................................................3
Results.....................................................................................................................................................3
Conclusion..............................................................................................................................................3
Introduction.........................................................................................................................................................4
Foreword.................................................................................................................................................4
Meta-Analysis......................................................................................................................................12
Results...................................................................................................................................................20
Utility Analysis.....................................................................................................................................25
Discussion..........................................................................................................................................................28
References.........................................................................................................................................................29
Appendix A.........................................................................................................................................................32
Appendix B.........................................................................................................................................................33
Objective
Results
Business and work units within the same organization vary
Employee engagement is related to each of the nine
substantially in their levels of engagement and performance.
performance outcomes studied. Results indicate high
The purpose of this study was to examine:
generalizability, which means the correlations were
1. The true relationship between employee engagement consistent across different organizations. The true score
and performance in 152 organizations. correlation between employee engagement and composite
performance is .48. Business/work units scoring in the
2. The consistency or generalizability of the relationship top half on employee engagement essentially double
between employee engagement and performance their odds of success in comparison to those in the
across organizations. bottom half. Those at the 99th percentile have nearly
3. The practical meaning of the findings for executives five times the success rate as those at the 1st percentile.
and managers. Median differences between top-quartile and bottom-
quartile units were: 12% in customer ratings, 16% in
profitability, 18% in productivity, 25% in turnover (high-
Methods
turnover organizations), 49% in turnover (low-turnover
We accumulated 199 research studies across 152 organizations), 49% in safety incidents, 27% in shrinkage,
organizations in 44 industries and 26 countries. Within 37% in absenteeism, 41% in patient safety incidents, and
each study, we statistically calculated the business/work 60% in quality (defects).
unit level relationship between employee engagement and
performance outcomes that the organizations supplied. In Conclusion
total, we were able to study 32,394 business/work units
including 955,905 employees. Nine outcomes were studied: The relationship between engagement and performance
customer loyalty/engagement, profitability, productivity, at the business/work unit level is substantial and highly
turnover, safety incidents, shrinkage, absenteeism, patient generalizable across organizations. Employee engagement
safety incidents, and quality (defects). is related to each of nine different performance outcomes.
This means that practitioners can apply the Q12 measure
Individual studies often contain small sample sizes and in a variety of situations with confidence that the measure
idiosyncrasies that distort the interpretation of results. captures important performance-related information.
Meta-analysis is a statistical technique that is useful in
combining results of studies with seemingly disparate
findings, correcting for sampling, measurement error, and
other study artifacts to understand the true relationship with
greater precision. Hunter-Schmidt meta-analysis methods
were applied to 199 research studies to estimate the true
relationship between engagement and each performance
measure and to test for generalizability. After conducting
Q09. My associates or fellow employees are committed to Q00. Overall satisfaction. The first item on the survey
doing quality work. measures affective satisfaction on a scale from
“extremely dissatisfied” to “extremely satisfied.”
Q10. I have a best friend at work. It is an attitudinal outcome or direct measure of
how people feel about their organization. Given it
Q11. In the last six months, someone at work has talked to
is a direct measure of affective satisfaction, on its
me about my progress.
own, it is difficult to act on the results of this item.
Q12. This last year, I have had opportunities at work to Other issues, like those measured in the following
learn and grow. 12 items, explain why people are satisfied and why
they become engaged and affect outcomes.
These statements (Q01-Q12) are proprietary and
copyrighted by Gallup, Inc. They cannot be reprinted or Q01. Expectations. Defining and clarifying the outcomes
reproduced in any manner without the written consent that are to be achieved is perhaps the most basic
of Gallup, Inc. Copyright © 1993-1998, Gallup, Inc. of all employee needs and manager responsibilities.
All rights reserved. How these outcomes are defined and acted on will
vary across business/work units, depending on the
The current standard is to ask each employee to rate the
goals of the business/work unit.
above statements (a census survey; median participation rate
is 86%) using six response options (from 5=strongly agree to Q02. Materials and equipment. Getting people what they
1=strongly disagree; the sixth response option — don’t know/ need to do their work is important in maximizing
does not apply — is unscored). Because it is a satisfaction efficiency, in demonstrating to employees that their
item, the first item (Q00) is scored on a satisfaction scale work is valued, and in showing that the company is
rather than on an agreement scale. Regression analyses supporting them in what they are asked to do. Great
(Harter, Schmidt, & Hayes, 2002) indicate that employee managers help employees see how their requests
engagement accounts for nearly all of the performance- for materials and equipment connect to important
related variance (composite performance) accounted for organizational outcomes.
More than 1,000 meta-analyses have been conducted in A total of 199 studies for 152 independent organizations
the psychological, educational, behavioral, medical, and are included in Gallup’s inferential database — studies
personnel selection fields. The research literature in the conducted as proprietary research for various organizations.
behavioral and social sciences fields includes a multitude of In each Q12, one or more of the Q12 items was used (as a part
individual studies with apparently conflicting conclusions. of standard policy starting in 1997, all items were included
Meta-analysis, however, allows the researcher to estimate the in all studies), and data were aggregated at the business unit
mean relationship between variables and make corrections level and correlated with the following aggregate business
for artifactual sources of variation in findings across studies. unit performance measures:
It provides a method by which researchers can determine
•• customer metrics (referred to as customer loyalty)
whether validities and relationships generalize across various
•• profitability
situations (e.g., across firms or geographical locations).
•• productivity
This paper will not provide a full review of meta-analysis.
•• turnover
Rather, the authors encourage readers to consult the following
•• safety incidents
sources for both background information and detailed
descriptions of the more recent meta-analytic methods: •• absenteeism
Schmidt (1992); Hunter and Schmidt (1990, 2004); Lipsey •• shrinkage
and Wilson (1993); Bangert-Drowns (1986); and Schmidt, •• patient safety incidents
Hunter, Pearlman, and Rothstein-Hirsh (1985). •• quality (defects)
That is, in these analyses, the unit of analysis was the business
or work unit, not the individual employee.
Number of
Number of Number of
Industry Type Business/Work
Organizations Respondents
Units
Services — Business 1 20 600
Services — Education 7 310 10,746
Services — Government 4 240 8,336
Services — Health 30 3,084 115,395
Services — Hospitality 1 30 2,612
Services — Hotels 6 426 86,703
Services — Nursing Home 2 398 27,591
Services — Recreation 1 14 288
Transportation/Public Utilities —
1 727 28,600
Non-Hazardous Waste Disposal
Transportation/Public Utilities — Trucking 1 96 6,213
Transportation/Public Utilities —
5 4,138 43,633
Communications
Transportation/Public Utilities — Electric 2 231 4,574
Table 2 provides a summary of organizations sorted by largest number of organizations had studies of workgroups,
business or work unit type. There is also considerable stores, or bank branches. Likewise, workgroups, stores, and
variation in the types of business/work units, ranging from bank branches have the highest proportional representation
stores to plants/mills to departments to schools. Overall, 21 of business/work units.
different types of business/work units are represented; the
Number of
Number of Number of
Business/Work Unit Type Business/Work
Organizations Respondents
Units
Bank Branch 15 6,929 78,328
Call Center 3 247 8,539
Call Center Department 4 120 2,409
Cost Center 2 68 10,597
Dealership 2 105 8,313
Department 5 306 9,468
Division 2 29 5,090
Facility 2 1,080 55,182
Hospital 4 248 31,167
Hotel 5 325 85,890
Location 9 3,265 51,259
Mall 2 185 3,790
Patient Care Unit 2 177 4,433
Plant/Mill 6 269 40,442
Region 1 96 6,213
Restaurant 5 369 21,183
Sales Division 4 53 1,418
Sales Team 5 365 19,936
School 6 296 10,496
Store 30 10,780 389,718
Workgroup 38 7,082 112,034
Total 152 32,394 955,905
Mean Observed r 0.18 0.10 0.15 -0.12 -0.14 -0.20 -0.10 -0.32 -0.18
Observed SD 0.11 0.08 0.09 0.06 0.11 0.13 0.07 0.21 0.10
True Validity1 0.23 0.11 0.16 -0.17 -0.17 -0.20 -0.10 -0.32 -0.19
True Validity SD1 0.07 0.04 0.00 0.00 0.05 0.08 0.03 0.16 0.00
True Validity2 0.30 0.14 0.22 -0.23 -0.22 -0.26 -0.13 -0.40 -0.25
True Validity SD2 0.08 0.05 0.00 0.00 0.06 0.10 0.05 0.18 0.00
% variance
accounted for — 49 64 73 87 74 43 53 28 107
sampling error
% variance
77 78 103 140 86 61 72 44 137
accounted for1
% variance
78 78 104 141 86 61 72 45 132
accounted for2
90% CV1 0.15 0.05 0.16 -0.17 -0.10 -0.09 -0.06 -0.12 -0.19
90% CV2 0.20 0.07 0.22 -0.23 -0.14 -0.13 -0.08 -0.17 -0.25
r = Correlation SD = Standard Deviation CV = Credibility Value
1
Includes correction for range variation within organizations and dependent-variable measurement error
2
Includes correction for range restriction across population of business/work units and dependent-variable
measurement error
In summary, for the composite measure of engagement shrinkage, patient safety, and quality. Remember, the
shown in Table 3, the strongest effects were found for productivity variable includes various measures of business/
customer loyalty metrics, productivity, employee turnover, work unit productivity, the majority of which are sales data.
safety, absenteeism, patient safety, and quality. Correlations Of the two financial variables included in the meta-analysis
were positive and generalizable relative to profitability (sales and profit), engagement is most highly correlated
criteria, but of slightly lower magnitude. This may be with sales. This is probably because day-to-day employee
because profitability is influenced indirectly by employee engagement has an impact on customer perceptions, turnover,
engagement and more directly by variables such as customer quality, and other variables that are in close proximity with
loyalty, productivity, employee turnover, safety, absenteeism, sales. In fact, this is what we have found empirically in our
Correlation of Engagement
Analysis
to Performance
Observed r 0.30
d 0.49
Observed r 0.28
d 0.46
BESDs can be applied to the results of this study. Table 6 % above Median % above Median
shows the percentage of business units above the median Composite Composite
Performance Performance
on composite performance for high- and low-scoring (Direct (Direct
business/work units on the employee engagement (Q12) Outcomes) Outcomes)
composite measure. True validity estimates (correcting for Top Half 65 69
measurement error only in the dependent variable) were Bottom Half 35 31
used for analysis of business/work units both within and
across organizations.
Other forms of expressing the practical meaning behind •• 41% in patient safety incidents
the effects from this study include utility analysis methods •• 60% in quality (defects)
(Schmidt & Rauschenberger, 1986). Formulas have been
The above differences and their utility in dollar terms should
derived for estimating the dollar-value increases in output
be calculated for each company, given the company’s unique
as a result of improved employee selection. These formulas
Bangert-Drowns, R. L. (1986). Review of developments Harter, J. K., & Creglow, A. (1997). A meta-analysis and
in meta-analytic method. Psychological Bulletin, 99(3), utility analysis of the relationship between core GWA
388-399. employee perceptions and business outcomes. Lincoln, NE:
The Gallup Organization.
Batt, R. (2002). Managing customer services: Human
resource practices, quit rates, and sales growth. Academy Harter, J. K., & Creglow, A. (1998, July). A meta-analysis
of Management Journal, 45(3), 587-597. and utility analysis of the relationship between core GWA
employee perceptions and business outcomes. Lincoln, NE:
Carver, R. P. (1975). The Coleman Report: Using The Gallup Organization.
inappropriately designed achievement tests. American
Educational Research Journal, 12(1), 77-86. Harter, J. K., Hayes, T. L., & Schmidt, F. L. (2004, January).
Meta-analytic predictive validity of Gallup Selection
Denison, D. R. (1990). Corporate culture and organizational Research Instruments (SRI). Omaha, NE: The Gallup
effectiveness. New York: John Wiley. Organization.
Fleming, J. H., Coffman, C., & Harter, J. K. (2005, July- Harter, J. K., & Schmidt, F. L. (2000, March). Validation
August). Manage your Human Sigma. Harvard Business of a performance-related and actionable management tool:
Review, 83(7), 106-114. A meta-analysis and utility analysis. Princeton, NJ: The
Gallup, G. H. (1976, Winter). Human needs and Gallup Organization.
satisfactions: A global survey. Public Opinion Quarterly, Harter, J. K., & Schmidt, F. L. (2002, March). Employee
40(4), 459-467. engagement, satisfaction, and business-unit-level
Gallup, G. H., & Hill, E. (1959). The secrets of long life. New outcomes: A meta-analysis. Lincoln, NE: The Gallup
York: Bernard Geis. Organization.
The Gallup Organization (1992-1999). Gallup Workplace Harter, J. K., & Schmidt, F. L. (2006). Connecting employee
Audit (Copyright Registration Certificate TX-5 080 satisfaction to business unit performance. In A. I. Kraut
066). Washington, D.C.: U.S. Copyright Office. (Ed.), Getting action from organizational surveys: New
concepts, technologies, and applications (pp. 33-52). San
Grissom, R. J. (1994). Probability of the superior outcome of Francisco: Jossey-Bass.
one treatment over another. Journal of Applied Psychology,
79(2), 314-316. Harter, J. K., & Schmidt, F. L. (2008). Conceptual versus
empirical distinctions among constructs: Implications
Harter, J. K., Asplund, J. W., & Fleming, J. H. (2004, August). for discriminant validity. Industrial and Organizational
HumanSigma: A meta-analysis of the relationship between Psychology, 1, 37–40.
employee engagement, customer engagement and financial
performance. Omaha, NE: The Gallup Organization. Harter, J. K., Schmidt, F. L., Asplund, J. W., & Killham,
E. A. (2005). Employee engagement and performance: A
meta-analytic study of causal direction. Omaha, NE: The
Gallup Organization.
Copyright © 2006, 2009 Gallup, Inc. All rights reserved. 29
Harter, J. K., Schmidt, F. L., & Hayes, T. L. (2002). Business- Judge, T. A., Thoresen, C. J., Bono, J. E., & Patton, G.
unit-level relationship between employee satisfaction, K. (2001). The job satisfaction-job performance
employee engagement, and business outcomes: A meta- relationship: A qualitative and quantitative review.
analysis. Journal of Applied Psychology, 87(2), 268-279. Psychological Bulletin, 127(3), 376-407.
Harter, J. K., Schmidt, F. L., & Killham, E. A. (2003, July). Lipsey, M. W. (1990). Design sensitivity: Statistical power for
Employee engagement, satisfaction, and business-unit- experimental research. Newbury Park, CA: Sage.
level outcomes: A meta-analysis. Omaha, NE: The Gallup
Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of
Organization.
psychological, educational, and behavioral treatment:
Harter, J. K., Schmidt, F. L., Killham, E. A., & Asplund, J. Confirmation from meta-analysis. American Psychologist,
W. (2006). Q12 Meta-Analysis. Gallup. Omaha, NE. 48(12), 1181-1209.
Hunter, J. E., & Schmidt, F. L. (1983). Quantifying the Mosier, C. I. (1943). On the reliability of a weighted
effects of psychological interventions on employee job composite. Psychometrika, 8, 161-168.
performance and work-force productivity. American
National Technical Information Services. (1987). Standard
Psychologist, 38(4), 473-478.
Industrial Classification manual. Washington, D.C.:
Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta- Executive Office of the President, Office of Management
analysis: Correcting error and bias in research findings. and Budget.
Newbury Park, CA: Sage.
Ostroff, C. (1992). The relationship between satisfaction,
Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta- attitudes, and performance: An organizational level
analysis: Correcting error and bias in research findings (2nd analysis. Journal of Applied Psychology, 77(6), 963-974.
ed.). Newbury Park, CA: Sage.
Reynierse, J. H., & Harker, J. B. (1992). Employee and
Hunter, J. E., Schmidt, F. L., & Le, H. A. (2006). customer perceptions of service in banks: Teller and
Implications of direct and indirect range restriction for customer service representative ratings. Human Resource
meta-analysis methods and findings. Journal of Applied Planning, 15(4), 31-46.
Psychology, 91, 594-612.
Rosenthal, R., & Rubin, D. B. (1982). A simple, general
Huselid, M. A. (1995). The impact of human resource purpose display of magnitude of experimental effect.
management practices on turnover, productivity Journal of Educational Psychology, 74, 166-169.
and corporate financial performance. Academy of
Schmidt, F. L. (1992). What do data really mean? Research
Management Journal, 38(3), 635-672.
findings, meta-analysis, and cumulative knowledge in
Iaffaldano, M. T., & Muchinsky, P. M. (1985). Job satisfaction psychology. American Psychologist, 47(10), 1173-1181.
and job performance: A meta-analysis. Psychological
Schmidt, F. L., & Hunter, J. E. (1977). Development of a
Bulletin, 97(2), 251-273.
general solution to the problem of validity generalization.
Johnson, J. W. (1996). Linking employee perceptions of Journal of Applied Psychology, 62, 529-540.
service climate to customer satisfaction. Personnel
Psychology, 49, 831–851.
Schmidt, F. L., Hunter, J. E., McKenzie, R. C., & Muldrow, Schneider, B., Parkington, J. J., & Buxton, V. M. (1980).
T. W. (1979). Impact of valid selection procedures on Employee and customer perceptions of service in banks.
work-force productivity. Journal of Applied Psychology, Administrative Science Quarterly, 25, 252-267.
64(6), 609-626.
Sechrest, L., & Yeaton, W. H. (1982). Magnitudes of
Schmidt, F. L., Hunter, J. E., Pearlman, K., & Rothstein- experimental effects in social science research. Evaluation
Hirsh, H. (1985). Forty questions about validity Review, 6(5), 579-600.
generalization and meta-analysis. Personnel Psychology,
Stone, A., & Harter, J. K. (2009). The experience of work: A
38, 697-798.
momentary perspective. Research report submitted for
Schmidt, F. L., & Le, H. A. (2004). Software for the Hunter- publication. Stony Brook, NY.
Schmidt meta-analysis methods. Iowa City, IA: Tippie
Ulrich, D., Halbrook, R., Meder, D., Stuchlik, M., &
College of Business, University of Iowa.
Thorpe, S. (1991). Employee and customer attachment:
Schmidt, F. L., & Rader, M. (1999). Exploring the boundary Synergies for competitive advantage. Human Resource
conditions for interview validity: Meta-analytic validity Planning, 14(2), 89-103.
findings for a new interview type. Personnel Psychology,
Wagner, R., & Harter, J. K. (2006). 12: The elements of great
52, 445-464.
managing. New York: Gallup Press.
Schmidt, F. L., & Rauschenberger, J. (1986, April). Utility
Wiley, J. W. (1991). Customer satisfaction: A supportive
analysis for practitioners. Paper presented at the First
work environment and its financial cost. Human Resource
Annual Conference of The Society for Industrial and
Planning, 14(2), 117-127.
Organizational Psychology, Chicago, IL.
Zohar, D. (1980). Safety climate in industrial organizations:
Schmit, M. J., & Allscheid, S. P. (1995). Employee attitudes
Theoretical and applied implications. Journal of Applied
and customer satisfaction: Making theoretical and
Psychology, 65(1), 96–102.
empirical connections. Personnel Psychology, 48, 521-536.
Zohar, D. (2000). A group-level model of safety climate:
Schneider, B. (1991). Service quality and profits: Can you
Testing the effect of group climate on microaccidents in
have your cake and eat it too? Human Resource Planning,
manufacturing jobs. Journal of Applied Psychology, 85(4),
14(2), 151-157.
587–596.
Schneider, B., Ashworth, S. D., Higgs, A. C., & Carr, L.
(1996). Design, validity, and use of strategically focused
employee attitude surveys. Personnel Psychology, 49(3),
695-705.
0.51 1 0.57 1
0.46 1 0.56 1
0.41 1
0.33 1
Engagement
Reliability Frequency
0.97 1
0.92 1
0.86 1
0.83 1
0.82 1
0.80 1
0.79 1
0.78 1
0.77 1
0.75 2
0.66 1
0.65 1
0.61 2
0.47 1
0.45 1