Darren C. Olson, Ph.D. Assistant Professor, Bemidji State University John W. Sinn, Ph.D.

1. Correlations Between Quality Management Practices and Compliance with Quality System Requirements: Results of a study comparing implementation of ASQ CQM practices to success as measured by ISO 9001: 2000 and the MBNQA Criteria Darren C. Olson, Ph.D. Assistant Professor, Bemidji State University John W. Sinn, Ph.D. Professor, Bowling Green State University October 21, 2004

2. Problem Statement The problem for this study was to assess the status and effectiveness of current quality management practices, as stated by practitioners who are ASQ section officers.

3. Status of QM Practices What is the status of organizations in implementing practices from the following documents? • ASQ’s BOK for quality managers • ISO 9001:2000 Clauses • MBNQA Criteria categories

4. Effectiveness of QM Practices Gauge the effectiveness of using BOK principles and tools in meeting requirements of the ISO 9001:2000 clauses and MBNQA Criteria

5. Effectiveness of QM Practices • Dependent Variables: • 1st Set: ISO 9001:2000 Clauses • 2nd Set: BNQA Categories • Independent Variables: • BOK Categories See the accompanying handout for a complete list of variables

6. Data Collection • Used a 5-point Likert scale (see handout) • Rated performance of employers on implementing sub-categorical items within each category or clause. • Also answered a series of demographics items.

7. For Example • Category two of the BOK is Strategy Development and Deployment • Its elements are Environmental Analysis, Strategic Planning and Assessment, and Deployment • If a respondent rated these items at 3, 3, and 4, then his/her score for that variable would be a 3.67.

8. Population • Quality management leaders • Sampled one practicing quality manager from the executive committee of each North American ASQ section (252 total)

9. Survey Administration • Administered survey • Used both mail-based and electronic distribution • Began first round in April, 2003 • Third round ended in October, 2003 • Received 88 returns (35%)

10. Analysis • Used analysis of covariance (ANCOVA) to identify significant main effects and two-way interactions • Analyzed correlations between demographics items and variables responses

11. Demographics • 42% of respondents were certified quality managers (CQM) • Average QM experience was 14.6 years • Most respondents (68) worked in manufacturing (NAICS categories 32 & 33) • 84.6% of respondents were male

12. ASQ Certifications

13. Post-Secondary Education

14. Size of Organization

15. Descriptive Statistics: BOK Variables Mean s BOK1 Leadership 3.91 .83 BOK2 Strategy dev & depl 3.54 .81 BOK3 Quality mgmt tools 3.90 .87 BOK4 Customer-focused org 4.07 .91 BOK5 Supplier performance 3.33 .80 BOK6 Management 3.81 .79 BOK7 Training & dev 3.24 .90

16. Descriptive Statistics:ISO Variables Mean s ISO1 Quality mgmt system 4.20 .76 ISO2 Mgmt responsibility 3.93 .82 ISO3 Resource mgmt 3.72 .78 ISO4 Product realization 3.85 .68 ISO5 Meas, anal, & improv 3.89 .81

17. Descriptive Statistics:MB (BNQA) Variables Mean s MB1 Leadership 3.80 .91 MB2 Strategic planning 3.50 .93 MB3 Customer & market focus 4.09 .78 MB4 Meas, anal, & knowl mgmt 3.60 .93 MB5 Human resource focus 3.41 .87 MB6 Process mgmt 3.55 .88 MB7 Business results 3.69 .75

18. Significant Effects and Interactions See Handout

19. Significant Correlations with Demographics Items Certified quality managers rated their employers lower on customer focus (BOK4), customer and market focus (MB3)

20. Significant Correlations with Demographics Items Respondents holding more ASQ certifications rated their employers lower on customer and market focus (MB3)

21. Significant Correlations with Demographics Items Respondents with more years of post-secondary education, particularly beyond 2 years, rated their employers lower on leadership (BOK1) and product realization (ISO4)

22. Significant Correlations with Demographics Items Ratings on the majority of variables were positively correlated with organization size.