GR&R and MSA Training

GR&R and MSA Training

Why GR&R or MSA? • Product Control: to prove a particular gage is capable of distinguishing good parts from bad parts and can do so accurately every time. • Ideal situation is to have a measurement system: • …that rejects ALL non-conforming parts • …that accepts ALL conforming parts • …that gets repeatable results for ALL operators • Process control: For variable gaging, the desire is also to ensure that the gage can resolve small enough changes to allow for process control initiatives.

GR&R • Gage Repeatability & Reproducibility • Repeatability: how consistently one person obtains the same measurement on a part • also known as Equipment Variability (EV) or within system variation • Reproducibility: how consistently multiple people obtain the same measurement on a part • also known as Appraiser Variability (AV) or between system variation

Repeatability (EV) Operator 1 has a repeatability issue. Range of 3 readings taken on each part. With perfect repeatability the range would be 0. How consistently can one person get the same measurement on a part?

Reproducibility (AV) Average of 3 readings taken on each part. With perfect reproducibility all lines would be exactly the same. Operator 3 has a reproducibility issue. How consistently can multiple people get the same measurement on a part?

MSA • Measurement System Analysis • 5 Components • Repeatability (EV) • Reproducibility (AV) • Bias • Linearity • Stability

MSA - Bias • Bias: The difference between the average of measurements and a standard value. Value of known standard Average of measured value Bias Measurement Scale

MSA - Linearity • Linearity: The difference in bias or repeatability at different points in the operating range of the gage. Measurement Scale Low End High End

MSA - Stability • Stability: Variation in measurements of a known master over an extended period of time. • Variation can be in the amount or direction of bias. • Variation can be in the repeatability of the measurement.

Performing a StudyBefore you get started… • Go watch the inspection • Look for potential issues with the gage • Look for potential issues with the method being used • ASK QUESTIONS!! • Make sure you understand what is being inspected and how it is being inspected • Validate the gage is calibrated • Understand it’s finest level of discrimination (.001, .0001, etc). Does it meet the 10:1 rule? • View more than one operator if you can • Look for differences in technique

Performing a StudyBefore you get started… • Ask to see specific instructions on the usage of the gage. (preferably written instructions) • If there are no formal instructions on the usage of the gage help the operators create some. • Include several of the usual inspectors in the creation of the instructions to make sure they are all on the same page. The key to a successful study is to reduce all possible variation. Eliminate as much variation as possible BEFORE getting started.

DMAIC • Define: The gage, the SOP, the desired outcome, etc. • Measure: Do the study • Analyze: Review the study and determine if it is acceptable or if it needs improvement • Improve: Determine any changes that can or should be made to improve the variation • Control: Lock in all changes and critical settings as part of the SOP

Performing a Study The next slides specifically apply to Variable Data studies. Attribute (Go/NoGo) studies will be covered later.

Performing a StudyPeople, Parts & the Gage • People • Preferably get 3 people that are familiar with the parts, the gage, and the feature. • If that is not possible, get people that have used the specific or similar gage on other parts. • If that is not possible, get people that have used a wide variety of gages and can be trained on the usage of the gage by an expert. The further you must go down this list the more variation is being brought into the study.

Performing a StudyPeople, Parts & the Gage • Parts • Find 10 parts that are representative of the real process, ideally using real parts. • Calibrated “masters” can be used if the part feature is similar to a master (Plug Gage, Jo Blocks, Ring Gage, etc) • If you can do this you get the advantage of seeing bias • If using “masters” ensure you are testing the finest discrimination of the gage. • Try to cover the full range of tolerance and if possible include parts slightly in and slightly out of tolerance. • Uniquely label each part so parts do not get mixed up.

Performing a StudyPeople, Parts & the Gage • Parts (cont.) • Variation between parts is the only variation in a study that is good. • Look for the “right” amount of variation • Enough spread to prove the gage can tell the difference between parts. • Not too much spread where the operator will start to remember specific readings. • Have several parts either “identical” or very close in size as part of the group. • Have sample parts at or very near each spec. limit.

Performing a StudyPeople, Parts & the Gage • Parts (cont.) Example: .495 - .505 OD with OD Mic. (w/ Vernier Scale) • BAD • WAY below & above Spec. • No usage of .0001’s • Even increments may be remembered by operators regardless of randomization. • No points @ Spec • So-So • Too tightly within spec limits • Ok usage of .0001’s • Fairly Even increments may be remembered by operators regardless of randomization. • No points @ Spec • Best • Good grouping at both limits (in and out) • Good usage of .0001’s • All but 2 points hard to “remember” due to similar parts. • Points at both specs & split

Performing a StudyPeople, Parts & the Gage • Gage • Does the gage have the right number of discriminations for the measurement? • Minimum of 5 • Prefer 10 or more • Verify calibration • Verify gage is functioning properly • Verify there is nothing with the gage that will obviously sink your study. • If it requires “zeroing” determine what that process will be for each inspector BEFORE starting.

Performing a StudyThe study itself… • BE PRESENT!!!! • Administer the study yourself. • Watch each operator closely • Document anything you notice (differences, similarities, special “tricks,” speed, anything the operator is doing that they may not even realize they are doing.) • When analyzing the study there is no substitute for personal observation. • Blind test randomization • Give the parts to the operators “randomly” • This ensures they don’t remember the “right” values • This also protects against error due to “slop” in the gage

Performing a StudyThe study itself… • Location • If possible, perform the study in the same type of environment as the actual inspections would occur • Document anything about the location or environment that may be affecting the study • Timing • If possible, perform the study in as tight of a time window as possible to minimize variation (unless you are doing a stability study)

Performing a StudyThe study itself… • Key Points to Remember: • BE PRESENT!! • Variation is the enemy • Observe & document everything you can The more thorough you are doing the study, the more likely it is to pass. and… If it does fail, the more ammunition you’ll have to fix it!

Data Analysis All within? All the same? Part-to-part much larger? At least 50% out?

What’s the GR&R? • Take the Std. Dev of the Total Measure and multiply by 5.15 (Some people will say 6) • 2.445 * 5.15 = 12.59 • (This gives 99% Confidence) • 2.445 * 6 = 14.67 • (This gives 99.73% Confidence)

Finishing Up… • Documentation is everything! • Add a “purpose” tab to your file that includes a detailed write up including at least: • The date, location, and person giving the study. • The people, parts, and gage used. • Detailed instructions on how the gage was used (attach electronic setup sheet, pictures, etc). • A write up of your final analysis along with the rationale used. • Include any other observation you may have had along the way that could be used to replicate or improve upon the study.

Finishing Up… • Study Complete! • Pass: Save a copy of your study into an appropriate folder within the GR&R reports area ~or~ • Fail: DMAIC!

Variable Gage R&R Class Example For Attribute data enter A for Accept and R for Reject Description: Perform in class exercise

FAIL: Now What? • Do nothing? • Find a new gage? • Do it over? • Change our tolerance? • Do something to improve it? Let’s try something unorthodox! D M A I C

Continuous Improvement • Define: • We have an unacceptable GR&R or MSA! • Measure: • We have a GR&R of .0376 and our tolerance is .5 • We have an EV of .0256 (8.8% of tolerance) • We have an AV of .0275 (9.48% of tolerance) • We are using 45.12% of tolerance and we know we need to be less than 30%, preferable 10%

Continuous Improvement • Analyze: • Software gave us some charts we could use • Start with the charts – See similar example on slide 22 – Do they all pass? • Improve • Once you know what does not pass, then PF/CE/CX/SOP • Utilize team members in this process • Treat it like a mini-Green Belt project with a scope of “fixing the measurement system”

Continuous Improvement • Control • Revise and add detail to the original SOP to reduce/eliminate variation identified by the team with the PF, CE, & CNX. • Officially re-perform the study and begin the DMAIC process over again as necessary until the study gets below 30% of tolerance, 10% preferred

Variable Study Questions?

Attribute Studies • Much of the setup and process is the same as with a variable study. • Go watch the inspection • Understand how it is being done and look for potential sources of variation • Make sure there are solid instructions in place for usage of the gage. The key to a successful study is to reduce all possible variation. Eliminate as much as possible BEFORE getting started.

Performing a StudyPeople, Parts & the Gage • People • This type of study uses 2 people instead of 3. • Parts • This type of study uses 20 parts vs. 10 parts. • Ideally, calibrated “masters” should be used. • It is as, or more, important to cover the entire range of tolerance in this type of study. • If possible, have parts that are barely “good” and barely “bad” for each potential failure mode. • Ideally, there should be parts that represent all types of failure modes within the sample of parts. • Gage • Verify calibration and proper function.

Performing a StudyThe study itself… • Just like variable study… • BE PRESENT & document everything • Use randomization when evaluating the parts • Do the study in the normal environment where parts will be checked in production • Try to get through all the checks in “one sitting” if at all possible

Attribute Gage R&R Example For Attribute data enter A for Accept and R for Reject Description: Perform in class exercise

Unacceptable Attribute Studies • Fixing an unacceptable attribute study is the same as a variable study. • Treat it like a mini-project • Create PF, CE, CNX and SOP • The disadvantage is that you may not have as clear of a direction to start from due to no EV, AV or charts/graphs. • Look at P(FR) and P(FA) for sources of error. • Attack any sources of variation!

Attribute Study Questions?

Final Thoughts… • Observe the entire process • Document everything you see • Reduce or eliminate any sources of variation • Lock down the final process with a detailed SOP

GR&R and MSA Training