MSA Training1

Click to edit Master title style Click to edit Master title style
WELCOME TO ALL
TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification
PURPOSE To UNDERSTAND THE ROLE AND FUNCTION OF MSA IN PRODUCT DEVELOPMENT PREPARE THE TEAM FOR CONDUCTING THE MEASUREMENT SYSTEMS ANALYSIS
Introduction Objectives
Click to edit Master title style Contents Click to edit Master title style
QS9000/TS16949 Requirements Measurement System Analysis Selection of Instrument ( Discrimination ) Statistical Properties of Measurement System Bias , Linearity,Stability & Gauge Repeatability & Reproducibility Graphical Analysis Attribute data Study Short & Long Method, & Conclusion
Click to MEASUREMENT title style edit Master DEFINE Click to edit Master title style
Measurement is defined as " the assignment of numbers ( values ) to material things to represent the relations among them with respect to particular properties " The process of assigning a number is called measurement process the assigned number is called measurement value
Click to edit Master title QUALITY OF MEASUREMENT DATA
style Click to edit Master title style
The quality of measurement data is defined by the statistical properties of multiple measurements obtained from a measurement system operating under stable conditions If the measurements are close to the master value for the characteristic, then the quality of the data is said to be high If all or some of the measurements are far away from the master value, then the quality of the data is said to be low
IMORTANCE OF QUALITYMaster title style Click to edit OF MEASUREMENT

Production process is controlled using a measurement process. process.
Click to edit Master title style
A decision to adjust a manufacturing process or not is commonly based on measurement data Since measurement is a Process, variation do exist in the measurement process itself. If variation in measurement process is high, the quality itself. of measurement data will be Poor. Poor. Using this measurement process having high variation, the data obtained will not represent the actual variation present in the Manufacturing process This may lead to wrong decision which will in turn lead to high variation in the manufacturing process causing high rejection & rework. rework.
STANDARD: STANDARD:
Click to edit Master title style Accepted basis for comparison. Click to edit Master title style Criteria for acceptance
Known value, within stated limits of uncertainty,accepted as a true value A standard which will yield the same results when applied by supplier / customer with the same meaning yesterday, today, and tomorrow
Click to edit Master title style GAGE: Is any device used to obtain measurements frequently used to Click to edit Master title style refer specifically to the devices used on the shop floor
MEASUREMENT SYSTEM: Is the collection of instruments or gages, standards, operations, methods, fixtures, software personnel, environment and assumptions used to quantify a unit of measurement
BASIC edit Master Click toEQUIPMENT title style Click to edit Master title style DISCRIMINATION, READABILITY, RESOLUTION
Smallest readable unit, measurement resolution, scale limit, detection limit An inherent property fixed by design Always reported as a unit of measure 10 to 1 rule of thumb
10
BASIC edit Master Click toEQUIPMENT title style REFERENCEClick to edit Master title style VALUE
Accepted value of an artifact Determined by averaging several measurements with a higher level of measuring equipment Used as the surrogate for the true value. TRUE VALUE Actual value of an artifact Unknown and unknowable
11
Click to edit Master title style TYPES OF VARIATION edit Master title style Click to
Location variation Width variation
Location Accuracy Bias Stability Linearity
Width Repeatability Reproducibility GR & R Measurement system performance & capability
12
Click to edit Master title style Click to edit Masterantitle style Accuracy is closeness to the true value or to accepted reference
LOCATION VARIATION :
value Bias difference between the observed average of the measurements and the reference value
BIAS
1 2 3 4 5 6
6 LOCATION
MS AVERAGE
REF VALUE
13
Click to edit Master title style Stability Click to edit Master title style Change in bias over time
A stable measurement process is in statistical control w.r.t the location Alias drift
Time
Reference Value
14
Click to edit Master title style Linearity The change in bias over the normal operating range Click to edit Master title style
Bias
BIAS
Size 1
Size N
OPERATING RANGE
15
Click to edit Master title style Precision Click to edit Master title style
WIDTH VARIATION :
Closeness of repeated readings to each other Repeatability : Variation in measurement obtained with one measuring instrument when used several times by an appraiser while measuring the identical characteristics on the same part Commonly referred as Equipment Variation (EV) Instrument / gage capability or potential
APPRAISER SAME INSTRUMENT CHARACTERISTICS

BUT N TRIALS
1 2 3
Repeatability 16
Click to edit Master title style Click to edit Master title style Reproducibility: Reproducibility:
WIDTH VARIATION :
Variation in the average of the measurements made by different appraisers using the same gage when measuring a characteristic on one part Referred as appraiser variation
Reproducibility
Appraisers
1 2
A
2 3
17
GRR OR GAGE R & R: Gage Repeatability and Reproducibility : combined estimate of measurement system repeatability and reproducibility
system variation
MEASUREMENT SYSTEM CAPABILITY : Short term estimate of measurement Example : GRR
1 2
2 B3
GR&R
18
Measurement Process :
Click to edit Master title style Measurement is a process which measures the process quality and Click to edit Master process style provides feedback. Following is a typical measurementtitle model feedback.
Process to be managed Measurement Analysis Decision
Value
Measurement generally viewed as a black box. No real effort made to box. improve the quality of measurement. measurement. Calibration is performed to assess the Instrument alone. But Instrument is alone. only one part of the process. Other sources of variation are Appraiser, process. Part, Environment, Method. Method.
MSA supports in assessing the quality of measurement process. process.

19
Variation :
It is the difference between two things or an entity .
Measurement System Variation :
Variation present in the measurement system which affects the process results
Total variation :
It is the total variation observed in the process outputs A) There can be variation due to Process A) B) A) B) C) Part to Part Variation (PV) Within Part Variation (WPV) Variation due to Appraiser (AV) Variation due to Equipment (EV) Variation due to Interaction
B) There can be variation due to Measurement system
20
FUNDAMENTALS PROPERTIES THAT DEFINE A GOOD MS :

1. divide the tolerance into ten parts 2.
Click to edit Master title style Click to edit Master title style Adequate discrimination - The instrument discrimination should
For product control, variability of the MS must be small compared to the specification limits The MS ought to be in statistical control. This means the variations are all due to common cause and not due to special cause For process control, the variability of the MS ought to demonstrate effective resolution and be small compared to The manufacturing process variation assess the ms to the 6 Process &/or total variation from MSA Study
3.
4.
21
Objectives of MSA Study :

To Quantify the variation present in the measurement system Ensure the stability of the measurement system Initiate appropriate actions to minimize the contamination of measurement system variation in total process variation
22
Effects of Click to edit Master title Measurement System Variability

Effects on product decisions :
A wrong decision will sometimes be made whenever any part of the above measurement distribution overlaps a specification limit. For example a good part classified as bad this is type I error otherwise called as producers risk / false alarm A bad part will sometimes be called good type II error consumers risk or miss rate False rate + Miss rate = error rate
23
Effects of Click to edit Master title Measurement System Variability

Effects on product decisions :

LSL USL
I II
Where I - Bad parts will always be called bad II Potential wrong decisions can be made III Good parts will always be called good. good.
I II
24
Click to needs to be established title style edit Master With a process the following Click to edit Master title style Statistical control
Effects on process decisions :
On target Acceptable variability The impact of the process decisions would be Calling a common cause - a special cause Calling a special cause - a common cause
2 obs =observed process variance 2 actual =actual process variance 2 msa =variance of the measurement
system
Cp = TOLERANCE RANGE / 6 (Cp)2obs = (Cp)2actual + (Cp)2msa

25
Process setup / control - Tampering :

targeted
Click to editqualified - based on setup part Master title style Often manufacturing process at the Click of the day - Master title style is beginning to edit to verify whether that process
If the part measured is off the target, then the process is adjusted. Later in some cases another part is measured and again the process may be adjusted. Dr. Deming referred this phenomena of measurement and decision making as tampering
26
Click to edit Master title style Four rules for Process Control Click to edit Master title style
1. Make no adjustment or take no action unless the process is unstable Adjust the process in an equal amount and in an opposite direction from where the process was last measured to be Reset the process to the target. Then adjust the process in an equal amount and in an opposite direction from the target Adjust the process to the point of the last measurement 2.
3.
4.
Rule 2, 3 4 add progressively more variation

27
Click to edit Master title style DISCRIMINATION: Click to edit Master title style
Amount of change from the reference value that an instrument can detect and faithfully indicate.This is also referred to as the readability or resolution or Least Count The discrimination is unacceptable for analysis if it cannot detect the variation of the process , and unacceptable if it cannot detect the special cause variation
28
Click to edit Master title style # Of data Click to edit Master title style Control Analysis category
1 Can be used to control only if The process variation is small when compared to the specification Un acceptable for estimating process parameters and indices Only indicates whether the process is producing conforming or non conforming parts
1 Data Category
29
2-4 Can be used with semi variable control techniques based on the process distribution Can produce insensitive variable control charts Generally unacceptable for estimating process parameters and indices since it only provides coarse estimates
2-4 Data Category
30
5 or more data categories Can be used with variable control chart Recommended
5 Data Category
31
Click to edit Master title style ISO/TS 16949-2002 Requirements : 16949Click to edit Master title style
This is referred in the clause 7.6 of ISO/TS 16949:2002 Requirement : 1. 2. 3. Appropriate statistical studies to be conducted Applies to all measurement systems referred in Control plan Mandatory before conducting SPC Studies
32
Click to edit Master title style Click to edit Master title style Measurement System
It is the process by which we assign a number to a characteristics of a product/service.
Types of Measurement System

Attribute Variable
Measurement System Analysis

Is the process to identify, Quantify and analyze the variation present in the measurement system
33
Click to edit Master title style When MSA Studies to be conducted: Click to edit Master title style Introduction of a new MS
During selection of new instrument Before & After calibration Changes in the method or environment
Types of Studies
Variable R&R, Bias, Linearity, Stability, Attribute Hypothesis Test Analyses Cross Tab Method
34
35
Click to edit Master title style R&R Study:Click to edit Master title style
The variable gage study can be performed using a number of differing techniques . they are Range method Average and range method (including the control chart method) ANOVA method Except for the range method, the study data design is very similar for each of these methods. As presented , all methods ignore the within part variation example roundness, diametric taper, flatness.
36
Click -to edit METHOD title style GR&R RANGE Master Click to edit Master title variability. This will give a quick approximation of measurement style
This method will provide only the overall picture of the MS. It does not decompose the variability into repeatability & reproducibility
It typically uses 2 appraiser and five parts for the study In this study both appraisers measure each part once. The range for each part is the absolute difference between the measurement obtained by app A and the measurement obtained by app B The average of range is calculated (R)
37
The total measurement variability is calculated by multiplying the average range by 1 / d2* d2* is obtained from Appendix C with m = 2, g = Number of parts. Parts 1 2 3 4 5 Appraiser A 0.85 0.75 1.00 0.45 0.50 Appraiser A 0.80 0.70 0.95 0.55 0.60 Range ( A,B) 0.05 0.05 0.05 0.10 0.10
GR&RGR&R- RANGE METHOD
38
Click to edit Master title style AVERAGE Click ) = R = 0.35 RANGE ( R to edit Master title style
i
GR&RGR&R- RANGE METHOD
g 5 GRR = R = 0.07 = 0.0588 1.19 d2* Process standard deviation from previous study = 0.0777 % GRR = 100 * GRR / process standard deviation % GRR = 100 * 0.0588 / 0.0777 = 75.7 %
Conclusion the MS is in need of improvement
39
Click to edit Master title style This will Click to edit Master & reproducibility for give an estimate of both repeatability title style
a MS This method will allow the MS variations to be decomposed into 2 separate components repeatability & reproducibility , but not their interactions
GRR - AVERAGE & RANGE METHOD
Conducting the study

1. Obtain a sample of n > 5 that represent the actual or expected range of process variation 2. Refer to the Appraisers A,B,C etc., And number the parts 1 through n So that the numbers are not visible to the Appraiser.
40
Click to edit Master title style 3. Calibrate the gage if this is part of the normal ms procedure. Let Click to edit Master title style appraiser measure n parts in a random order and enter the
results in row 1. 4. Let appraiser B & C measure the same n parts without seeing each other reading, then enter the results in row 6 & 11, respectively. 5. Repeat the cycle using a different random order of measurement. Enter data in row 2, 7 and 12 . record the data in the appropriate column. For example if the 1st piece measured is part 7 then record the results in the column labeled 7. If three trials are needed repeat the cycle data in rows 3, 8 & 13. 6. Calculate using the Data analysis sheet AV, EV, PV, TV, R&R & R&R%
41
Click to edit Master title style Analysis of GRR studies Click to edit Master title style
If Repeatability is large compared to Reproducibility, the reasons may be : The instrument needs maintenance The gage may need to be redesigned to be more rigid The clamping or location for gaging needs to be improved There is excessive within part variation
42
Click to edit Master title style Analysis Click to edit Master title style of GRR studies
If reproducibility is large compared to reproducibility, the possible causes may be : The appraiser needs to be better trained in how to use and read the gage instrument Calibrations on the gage dial are not clear improved
43
Click to edit Master title style CONCLUSION Click 10 % -edit Master title style to acceptable, more than 10 % and less than GRR% < Less than
30 % conditionally accepted evaluate the economies of the measurement If it is more than 30 % reject - Analyze the causes of the high GRR. Ndc less than 5 Not acceptable Increase the discrimination of the instrument/gage. Ndc more than 5 Acceptable.
44
ClickGraphical Analysis to edit Master title style It is used Clickthe results of a measurement system. It provides to analyze to edit Master title style insight in to the variation model and inter- relationship.
Following charts are used to analyze the data.
Range chart : Assists in determining statistical control w.r.t

repeatability & consistency of measurement process between appraisers for each part.
Error chart : Assists in determining consistency of measurement process

between appraisers for each part.
Average chart : Assists in determining consistency between appraisers

and the usability of Measurement Process.
45
Graphical Analysis Click to edit Master title style Normalized Individuals Chart : Assists in determining Click to edit Master title style Reproducibility , consistency between appraisers , existence of
outliers( Abnormal reading ) & Part appraiser interaction Whiskers chart : Assists in determining consistency between appraisers , existence of outliers( Abnormal reading ) & Part appraiser interaction X-Y Plot : Assists in determining Linearity ( If reference value is used ), consistency in linearity between appraisers Scatter plot : Assists in determining consistency between appraisers , existence of outliers( Abnormal reading ) & Part appraiser interaction
46
47
Click Stability study: title style to editstudy: Master Stability Click tothe total Masterthe measurements edit variation in title style Stability (or drift) is
obtained with a measurement system on the same master or parts when measuring a single characteristic over an extended time period.
Procedure for Stability study:

Decide the part and characteristics for the study. Identify the location of measurement on the part. Make this part as a master part and ensure that the part is preserved till the study is completed. Decide the subgroup size (3 to 5), no. Of subgroup (20) & frequency (every day) of data collection. As per the frequency, measure the master part 3 to 5 times and record the details in the Xbar-R chart.
48
Procedure for Stability study ( Contd..) :
Click to edit Master title style After completion of data collection, calculate each Click to edit Master title style subgroup avg and range.
Calculate Xbar & Rbar. PLOT Xbar-R Control Chart Analyze the chart as per the normal interpretation of control chart. Calculate s = Rbar / d2 Calculate stability % as follows: Stability % = s/Tolerance Or Process Variation * 100.
49
Procedure for Stability study ( Contd..) : Interpret the results based on the acceptance criteria given below
Stability% below 10% Stability% between 10 & 30%
- M.S.Is acceptable. - M.S. Can be acceptable Under concession, based on the cost of repair, importance on Product quality, etc.. - Not acceptable. M.S. Needs improvement.
Stability% greater than 30%
50
51
Bias Study Click to edit Master title style Bias is the difference between the true value (ref value) and the Click to edit Master title style observed average of measurements on the same characteristics
Possible causes for excessive bias Instrument needs calibration Worn instrument, equipment or fixture Improper calibration or use of the setting standard Poor quality instrument Linearity error Wrong gage for application Different measurement method, setup loading, clamping, technique Measuring the wrong characteristic Distortion Environment Violation of an assumption Application error
52
Bias Study Click to edit Master title style Procedure for Bias Study Click to edit Master title style
Obtain a sample and establish its reference value relative to a traceable standard. If not select a production part that falls in the mid range of the production measurement and designate it as master sample for bias analysis Measure the Part n 10 times in the tool Room, and compute the average of the n Readings. Use this average as the reference value. Have a Single Appraiser measure the sample n 10 times in the normal manner. Plot the data as a histogram relative to the reference value review the histogram ( see if there are any special causes or any anomalies present
53
Bias Study Click to edit Master title style Analysis Click to edit Master title style of results
5. Compute the average of n readings N xi = i=1 N
6. Compute the repeatability standard deviation repeatability = max(xi) min(xi) d2* Where value of d2 is taken from Appendix C, with g=1 & m=n g = number of sub groups m = sub group size
54
7.
Bias Study Click to edit Master title style Determine the t estimate for the Bias. Click AVERAGE - REFERENCE VALUE title style to edit Master BIAS = OBSERVED
b= r/
t = bias/
8.
Bias is acceptable at the level if zero falls within the 1confidence bounds around the bias value.
BIAS - [
b(tv, 1- / 2)
] zero BIAS + [
b(tv, 1-
/ 2)]
Where the value of v is found from Appendix C with g=1, m=n & Tv, 1- /2 : is found using standard t table. : Customer agreement should be obtained if the confidence level is other than 95 %
55
Bias Study Click to edit Master title style Click to edit Master title style
TRIALS 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 REFERENCE VALUE 6.00 BIAS -0.2 -0.3 -0.1 -0.1 0.0 0.1 0.0 0.1 0.4 0.3 0.0 0.1 0.2 -0.4 0.0
5.8 5.7 5.9 5.9 6.0 6.1 6.0 6.1 6.4 6.3 6.0 6.1 6.2 5.6 6.0
56
Bias Study Click to edit Master title style Click to edit Master title style
n(m) MEAN STANDARD DEVIATION
r
STANDARD ERROR OF MEAN b 0.05813
MEASURED VALUE
15
6.0067
0.22514
t STATISTIC
REFERENCE VALUE = 6.00, = .05, g=1, d2* = 3.55 df SIGNNIFICANT BIAS 95 % CONFIDENCE LEVEL t VALUE (2 OF THE BIAS TAILED) 10.8 2.206 .0067 -.1215 LOWER .1349 HIGHER
MEASURE D VALUE
.1153
Conclusion: Conclusion:
Bias is acceptable at the level if zero falls within the 1confidence bounds around the bias value
57
58
Linearity can be calculated using the following procedure 1. Select g 5 parts whose measurements, due to process variation cover the operating range of the gage. 2. Have each part measured by the layout inspection to determine the ref value and confirm that the operating range of the subject gage is encompassed. 3. Have each part measured m 10 times on the subject gage by one operator. Select the parts at random to minimize appraiser recall in the measurement. 4. Calculate the part bias for each measurement and bias average for each part bias = X i,j- ( reference value) M bias i,j Bias = j=1 M
Linearity Study
59
5. 6. 7.
Click to edit Master title style Plot the individual biases and the bias averages w.r.t ref value on Click to edit Master title style a linear graph
Calculate and plot the best fit and the confidence band of the line. Use regression analysis method for best fit & Estimation method for arriving at the confidence band.
Linearity Study
60
.8 .6 . . Bias . - . - . - .6 - .8 Reference Values 6 8 1 Zero Bias Fitted Line 95% CI
Linearity Study
61
62
Attribute Gage Study :
Click to edit Master title style Miss: Miss: PartClick to given is good. is bad. Decision edit Master title style bad. good.
False Alarm: Part is good. Decision given is bad. Alarm: good. bad.
Procedure :
Decide the no. Parts to be selected (generally 50 parts), no. Of no. no. appraisers (3 appraisers) & no. Of trials(3 trials) for conducting the no. trials(3 study. study. Identify all parts by a unique number and inspect the part to decide the master value / reference value. This has to be approved by a value. expert. expert. Have each appraiser measure the parts randomly for the no. Of trials no. decided. decided. Record the results as good / bad or go/no go or accept / reject, 1 for ok, 0 for not ok. etc.. ok. etc..
63
Part 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50
A-1 P P
NEG NEG NEG P P P NEG P P NEG P P P P P P P P P NEG P P NEG NEG P P P NEG P P P NEG P P NEG P NEG P P NEG P P NEG P P NEG P NEG
A-2 P P A-3 P P B-1 P P B-2 P P B-3 P P C-1 P P C-2 P P C-3 P P Ref. P P Ref. value 0.476901 0.509015 0.576459 0.566152 0.570360 NEG NEG NEG P P P NEG P P NEG P P P P P P P P P NEG P P NEG P P P P NEG P P P NEG P P NEG P NEG P P NEG NEG P NEG P P NEG P NEG NEG NEG NEG P P NEG P P NEG P NEG P P P P P P NEG P P P NEG NEG P P P NEG P P P P P NEG NEG P NEG P P NEG P P NEG P P NEG P NEG NEG NEG NEG P P P NEG P P NEG P P P P P P P P P NEG P P NEG NEG P P P NEG P P P NEG P P NEG P NEG P P NEG P P NEG P P NEG P NEG NEG NEG NEG P P P NEG P P NEG P P P P P P P P NEG P P P NEG NEG P P P NEG P P P NEG P P NEG P NEG P P NEG P P NEG P P NEG P NEG NEG NEG NEG P P NEG P P NEG P P P P P P P P P NEG P P NEG NEG P P P P P P P P P P NEG P NEG P P NEG P P NEG P P NEG P NEG NEG NEG NEG P P P NEG P P NEG P P P P P P P P NEG P P P NEG NEG P P P NEG P P P NEG P P NEG P NEG P P NEG P P NEG P P NEG P NEG NEG NEG NEG NEG NEG NEG P NEG NEG NEG P P
Data Collection sheet
NEG
NEG
NEG P
NEG P
0.544951
NEG
0.465454
P NEG P P NEG P P P P P P P P P NEG P P NEG NEG P P P NEG P P P NEG P P NEG P NEG P P NEG P P NEG P P NEG P NEG
0.502295 0.437817 0.515573 0.488905 0.559918 0.542704 0.454518 0.517377 0.531939 0.519694 0.484167 0.520496 0.477236 0.452310 0.545604 0.529065 0.514192 0.599581 0.547204 0.502436 0.521642 0.523754 0.561457 0.503091 0.505850 0.487613 0.449696 0.498698 0.543077 0.409238 0.488184 0.427687 0.501132 0.513779 0.566575 0.462410 0.470832 0.412453 0.493441 0.486379 0.587893 0.483803 0.446697
NEG P P P P NEG P P P P P P P P P P NEG NEG P P P NEG P P P P P NEG NEG P NEG P P NEG P P NEG P P NEG P NEG
NEG P P NEG P NEG P P P P P P NEG NEG P P NEG P P P P NEG P P P P P P NEG P NEG P P NEG NEG P NEG P P NEG P NEG
Where, P pass NEG Not good
64
Click to edit Master title style Click to edit Master title style CROSS TABULATION BETWEEN APPRAISERS
Since reference decision is not know, develop cross tabulations comparing each appraisers to the other
A to REF crosstabulation RE F 0 A 0 Cu t on E e d co n xp cte u t 1 Cu t on E e d co n xp cte u t Cu t on E e d co n xp cte u t x e *c)/(1 0 =(a 5) p g=(b*c)/1 0 5 c=x+p m=e +g 1 y f=(a )/1 0 *d 5 q h=(b*d 5 )/1 0 d =y+q n =f+h T ta o l a =x+y j=e +f b=p +q k=g+h o= a +b r=j+k
T ta o l
A to B crosstabulation B 0 A 0 1 Total Count Expected count Count Expected count Count Expected count 44 15.7 3 31.3 47 47.0 1 6 34.3 97 68.7 103 103.0 Total 50 50.0 100 100.0 150 150.0
65
Similarly tabulate for A to C & B to C cross tabulations

B to C crosstabulation
C 0 B 0 1 Total Count Expected count Count Expected count Count Expected count 42 16.0 9 35.0 51 51.0 1 5 31.0 94 68.0 99 99.0 Total 47 47.0 103 103.0 150 150.0
A to C crosstabulation C 0 A 0 1 Total Count Expected count Count Expected count Count Expected count
1 43 17.0 8 34.0 51 51.0 7 33.0 92 66.0 99 99.0
Total 50 50.0 100 100.0 150 150.0

66
Click to edit Master title style Purpose Click to editto determine the extent of of these tables is Master title style
agreement among the appraisers To determine the level of this agreement, kappa which measures the agreement between the evaluation of two raters when both are rating the same object
Kappa is a measure of interrater agreement that tests if the counts in the diagonal cells (the parts that receive the same rating) differ from those expected by chance alone. A value of Kappa > 0.75 indicates good to excellent agreement A value of kappa < 0.45 indicates poor agreement
67
Click to edit Master title style Kappa = Click(1- P )edit Master title style (P P ) / to
o e e
Where Po = the sum of the observed proportions in the diagonal cells = (x+q ) / o for each Cross tabulation (A-B, A-C, B-C)
Pe = the sum of the expected proportions in the diagonal cells = (e+h )/r for each Cross tabulation (A-B, A-C, B-C)
68
Click to edit Master title style Prepare the Calculate Kappa for the appraisers title style Click to edit Master
Kappa
A B B A B C -0.86 0.78 0.86 -0.79 -0.78
This analysis indicates that all the appraisers show good agreement each other.
This analysis is necessary to determine if there are any differences

69
Click to edit Master title style Click to edit Master are any differences This analysis is necessary to determine if theretitle style
among the appraisers. But to understand the differences between the appraisers decision and the reference decision, a separate cross tabulation to be developed for appraiser and reference decision.
Cross Tabulation Appraiser Reference Decision
70
Click to edit Master title style Click to edit Master Cross Tabulation Appraiser Reference Decisiontitle style
A to REF crosstabulation R F y f=( * )/ q h=(b* )/ =y+q =f+h = +y j= +f b= +q k=g+h = +b r=j+k =( * )/( g=(b* )/ = + m= +g )
A to REF crosstabulation REF A
2 2 2
71
Click to edit Master title style Click to edit Master Cross Tabulation Appraiser Reference Decisiontitle style
B to EF o t b l tio EF 0 B 0 1 Total Count Expected co Count Expected co Count Expected co C to R F 45 15.0 3 33.0 48 48.0 1 2 32.0 100 70.0 102 102.0 Total 47 47.0 103 103.0 150 150.0
o t b l tio R F 0 1 42 16.3 6 31.7 48 48.0 9 34.7 93 67.3 102 102.0 Total 51 51.0 99 99.0 150 150.0
72
0 1
Total
Count Expected co Count Expected co Count Expected co
Click to edit Master title style Prepare Click to edit Master titleagreement of the Calculate Kappa measure to determine the style each appraiser to the reference decision.
A 0.88 B 0.92 C 0.77
Kappa
73
Click to edit Master title style Calculate the effectiveness of theMaster title style Click to edit measurement
Effectiveness = number of correct decision total opportunities for a decision
74
Appraiser A B C Number Good correct 7 1 Number bad correct 5 5 Number correct 1 1 5 1 5 Number false alarm 5 Number missed Number total 15 15 15
Appraiser A B C
Effectiveness 8 . . 8 .
Pf alse alarm . 1. 8.8
P missed . 5 . 5 1 .5
75
Click to edit Master title style Acceptance criteria toEffectiveness, False alarm rate & style Click for edit Master title Miss rate.
Decision on M nt system Acceptable for the appraiser Marginally acceptable for the appraiser - may need improvement ffective False ness alarm rate > >8 < % % < > <1 % >1 % < > % Miss rate < > % % %
Unacceptable for the appraiser needs improvement <8 %

76
MSA Planning
1.
Click to edit Master title style Include all measurement systems referred in Control plan. Click to edit Master title style
2. Prepare a MSA plan as per below 3. For all existing MS, conduct appropriate studies 4. Applicable study can be done. Min. R&R is must. Others optional.
lan o 1 a u ning ha ac e is ics hickness easu ing ns wi h Leas c un & ange O side ic me e 0 01 L 0 25 mm ake O ns umen i u yo Wo king ange 15 21 Bias a ia le Da a & Linea i y a ili y ibu e Da a
77
Conclusion :
MSA study has become important since it can be applied under the following areas Criterion to accept new instrument Comparison of one measuring device against another Basis for evaluating a gage suspected of being deficient Comparison of equipment before and after repair Required element for calculating process variation
Limitation of standard are it is Difficult to use in destructive testing , Some Processes ,Product Characteristics & Tests have no defined industry or National standards
78
THANK YOU
79

MSA Training1

Enviado por

Dados do documento

Descrição original:

Título original

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

MSA Training1

Enviado por

Direitos autorais:

Formatos disponíveis

Click to edit Master title style Click to edit Master title style

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

Click to edit Master title QUALITY OF MEASUREMENT DATA

style Click to edit Master title style

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

IMORTANCE OF QUALITYMaster title style Click to edit OF MEASUREMENT

Click to edit Master title style

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

Location  Accuracy  Bias  Stability  Linearity

Width  Repeatability  Reproducibility  GR & R  Measurement system performance & capability

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

APPRAISER SAME INSTRUMENT CHARACTERISTICS

MEASUREMENT SYSTEM CAPABILITY : Short term estimate of measurement Example : GRR

MSA supports in assessing the quality of measurement process. process.

It is the difference between two things or an entity .

Measurement System Variation :

B) There can be variation due to Measurement system

FUNDAMENTALS PROPERTIES THAT DEFINE A GOOD MS :

Objectives of MSA Study :

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

Effects of Click to edit Master title Measurement System Variability

style Click to edit Master title style

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

Effects of Click to edit Master title Measurement System Variability

style Click to edit Master title style

Cp = TOLERANCE RANGE / 6 (Cp)2obs = (Cp)2actual + (Cp)2msa

Process setup / control - Tampering :

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

Rule 2, 3 4 add progressively more variation

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

2-4 Data Category

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

Types of Measurement System

Measurement System Analysis

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

GR&RGR&R- RANGE METHOD

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

GR&RGR&R- RANGE METHOD

Conclusion the MS is in need of improvement

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

GRR - AVERAGE & RANGE METHOD

Conducting the study

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

GRR - AVERAGE & RANGE METHOD

GRR - AVERAGE & RANGE METHOD

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

GRR - AVERAGE & RANGE METHOD

TV Rheinland (India) Pvt. Ltd., BF 1.8 System Certification

Location Accuracy Bias Stability Linearity

Width Repeatability Reproducibility GR & R Measurement system performance & capability