Harmony Consulting, LLC What Did Deming Really Say?

Page 1 of 5

Subscribe to Davis's free DATA SANITY newsletter:

Name:

Email:

Search
Submit Query

CLICK HERE to request a free copy of the preface and chapter summary of my book DATA SANITY: A Quantum Leap to Unprecedented Results

What theyre saying about Davis

"Thank you for a very informative and entertaining workshop today. I learned so much and also have direction for what I still need to learn!" "Thank you for your enthusiasm yesterday. You truly made the use of statistical knowledge exciting and useful! I am looking forward to putting your principles to good use." "First I would like to say thank you for being a great speaker this past Thursday. You opened my eyes to run charts and I am excited to start my new projects with new perspectives!"

What Did Deming Really Say?

By Davis Balestracci on Apr 20, 2011 | Categorized under: Deming I really didnt say everything I said. Yogi Berra

http://davisdatasanity.com/2011/04/20/what-did-deming-really-say/

12/20/2012

Harmony Consulting, LLC What Did Deming Really Say?

Page 2 of 5

My March 30, 2011 article ended with wisdom from Yogi Berra as a warning to the quality profession. Some prickly reactions to it got me thinking about the last 30 years or so of quality improvement. The 1980 NBC television show, If Japan Can, Why Cant We? introduced the teachings of W. Edwards Deming to U.S. viewers and caused a quantum leap in awareness of the potential for quality improvement in industry. During the late 1980s, the movement also caught fire in health care. Those of you familiar with Demings funnel rules (which shows that a process in control delivers the best results if left alone) will smile to realize that his rule No. 4making, doing, or basing your next iteration based on the previous onealso known as a random walk, has been in operation for the last 30 years. Jeff Liker, professor of industrial and operations engineering at the University of Michigan, beautifully describes the random walks that have taken place within the time spans of Six Sigma and lean. In a private correspondence with leadership expert Jim Clemmer, Liker writes: Originally Six Sigma was derived from Toyota Quality Management (TQM) by Motorola to achieve six sigma levels of quality, and then through Allied Signal and GE it morphed to projects by Black Belts based on statistics to become a cost-reduction programevery project needs a clear ROI. In other words, we denigrated the program from a leadership philosophy to a bunch of one-off projects to cut costs. It was a complete bastardization of the original, and it rarely led to lasting, sustainable change because the leadership and culture were missing. A similar thing happened to lean when it got reduced to a toolkit (e.g., valuestream mapping, KPI boards, cells, kanban). Lean and Six Sigma in no way reflect the original thinking of excellent Japanese companies or their teachers like Deming. Clemmer also cites multiple studies from 19962007 concluding that about 18 to 24 months after these various quality systems are launched, 5070 percent of them fail. Liker concurs and feels that the four key failure factors, in this order, are: Leadership lacking deep understanding and commitment Focus on tools and techniques without understanding the underlying cultural transformation required Superficial program instead of deep development of processes that surface problems solved by thinking people Isolated process improvements instead of creating integrated systems for exceptional customer value Virtually everyone agrees that the No. 1 barrier to improvement is still top managements inability to be visibly committed to quality. Is this the elephant in the living room or as Clemmer calls it, the moose on the table? The longer Im in improvement, the more I realize the wisdom of Demings statement, If I could reduce my message to management to just a few words, Id say it all has to do with reducing variation. Why reduce variation? Because it affords better prediction. He said it so often: Management is prediction! Deming also says in point No. 2 of his famous 14 Points: Adopt the new philosophy.

http://davisdatasanity.com/2011/04/20/what-did-deming-really-say/

12/20/2012

Harmony Consulting, LLC What Did Deming Really Say?

Page 3 of 5

Unfortunately, Demings philosophy seems to have morphed into a training mill turning out belts by the thousands with statistical training that makes my palms sweat. Ive said it before: People dont need statistics; they need to know how to solve their problems. All thats needed is a few simple tools and a working knowledge of variation to be able to distinguish between common and special causes. Only 12 percent of people need advanced statistical knowledge. Deming would roll over in his grave if he could see the statistical subculture of hacks (his term) that have been turned out in his name. In Demings words I think the best book on design of experiments (DOE) is Quality Improvement Through Planned Experimentation, by Ronald Moen, Thomas Nolan, and Lloyd Provost (McGraw-Hill Professional, 1999). It is the only book Ive seen that uses a process-oriented approach, which is so sorely needed in the real world. The foreword was written by none other than W. Edwards Deming, and in it he explains the approach to statistics needed: Prediction is the problem, whether we are talking about applied science, research and development, engineering, or management in industry, education, or government, he says. The question is, What do the data tell us? How do they help us to predict? Unfortunately, the statistical methods in textbooks and in the classroom do not tell the student that the problem in data use is prediction. What the student learns is how to calculate a variety of tests (t-test, F-test, chi-square, goodness of fit, etc.) in order to announce that the difference between the two methods or treatments is either significant or not significant. Unfortunately, such calculations are a mere formality. Significance or the lack of it provides no degree of beliefhigh, moderate, or lowabout prediction of performance in the future, which is the only reason to carry out the comparison, test, or experiment in the first place. [I]nterchange of any two numbers in the calculation of the mean of a set of numbers, their variance or their fourth moment does not change the mean, variance, or fourth moment. In contrast, interchange of two points in a plot of points may make a big difference in the message that the data are trying to convey for prediction. The plot of points conserves the information derived from the comparison or experiment. And, in addition to the process output being measured, determining the sample itself to be measured is its own separate process. The concepts of randomness and sample size for significance go out the window. Deming coined the term analytic to describe studies to improve a product or process in the future: Prediction is the aim. There is a need to conduct multiple plan-do-study-act (PDSA) cycles over a wide range of conditions.

http://davisdatasanity.com/2011/04/20/what-did-deming-really-say/

12/20/2012

Harmony Consulting, LLC What Did Deming Really Say?

Page 4 of 5

There are limitations of commonly used statistical methods such as analysis of variance to address the important sources of uncertainty in analytic studies. Graphical methods of analysis are primary. Confirmation of the results of exploratory analysis comes primarily from prediction rather than from using formal statistical methods such as confidence intervals. Satisfactory prediction of the results of future studies conducted over a wide range of conditions is the means to increase the degree of belief that the results provide a basis for action. When planning to test a change, people are making a prediction that the change will be beneficial in the future. What people dont realize is that a limited set of conditions will be present during the test; the conditions in the past, during the test, and in the future could all be different. Circumstances unforeseen or not present at the time of the test will arise in the future. Will the change still result in an improvement under these new, future conditions? Knowledge about the change is based on the specific subject matter on which the change itself is based, as well as knowledge about the environment in which the change will be implemented. Extrapolating the test results to the future is the primary source of uncertainty when a change is tested. The question then becomes, How does one randomly sample the future? Easy: One cant. The connection between knowledge of the subject matter from which the change is developed and analysis of the data from a test of the change is essential to effective improvement. This cannot happen in a statistical vacuum.

Integrating statistics role into leadership philosophy

The fact that most leadership is clueless to the power of statistical thinking in everyday management certainly doesnt help quality professionals efforts. That said, quality practitioners need to start by improving the process of teaching statistics, especially before they attempt to bring current seminars into the Csuite. Much of what is currently taught shouldnt be applied to daily managementor probably most anything else (except maybe manufacturing product quality). The wrong things continue to be taught: p-values, confidence intervals, normal distribution, sample size, and regression, to name a few. I once gave a talk following an ASQ Fellow who tried to make a case for bringing a quincunx into the board roomand passing out three pages of statistical definitions. I could feel the tension in the room rising. I then began my talk by saying, If I brought a quincunx into a board room, theyd throw me out on my ear, and the room erupted in laughter. Where to start? Here is a quote from Dr. Donald Berwick, a pioneer in health care improvement: Plotting measurements over time turns out, in my view, to be one of the most powerful devices we have for systemic learning. Several important things happen when you plot data over time. First, you have to ask what data to plot. In the exploration of the answer, you begin to clarify aims, and also to see the system from a wider viewpoint. Where are the data? What do they mean? To whom? Who should see them? Why? These are questions that integrate and clarify aims and systems all at once. If you follow only one piece of advice

http://davisdatasanity.com/2011/04/20/what-did-deming-really-say/

12/20/2012

Harmony Consulting, LLC What Did Deming Really Say?

Page 5 of 5

from this lecture when you get home, pick a measurement you care about and begin to plot it regularly over time, you wont be sorry. Until the culture at large appreciates the concept of process and eradicates blame, true improvement will not take place. To solve their problems everyone in a culture truly committed to improvement must work from perspectives of: Customer orientation Continuous improvement Elimination of waste Prevention, not detection Reduction of variation Statistical thinking and use of data Adherence to best-known methods Use of best available tools Respect for people and their knowledge Results-based personal feedback

Creating this culture is far, far more important than teaching a bunch of statistical techniques.

Latest article by Davis:

The Road to Health Care Reform Is Paved with Missed Opportunities
After reading Joe De Feos July 8, 2011, Quality Digest Daily article, A Positive Prognosis: Transforming Health Care in America, I took another look at the wonderful book, Escape Fire (Jossey-Bass, 2003), a compendium of Dr. Donald Berwicks inspiring plenary speeches at the Institute for Healthcare Improvements (IHI) 1992 2002 annual forum. Berwick is probably the leading health care-improvement thinker in the world. He is the former CEO of IHI and, as some of you know, a controversial Obama appointee as head of the Centers for Medicare and Medicaid Administration. In my opinion, he is most definitely the person for the job. As if it wasnt difficult enough to deal only with health care cultures, he now has the thankless job of integrating messy political agendas into the very serious business of health improvement. Read more... Copyright 2012 Harmony Consulting, LLC All rights reserved. | Phone: 207.899.0962 | Admin | Use & Privacy | Site Map Site design, development & hosting by Small Web Solutions

http://davisdatasanity.com/2011/04/20/what-did-deming-really-say/

12/20/2012