Newsletter Signup: Text HTML 
 

Nonparametric: Distribution-Free, Not Assumption-Free

 
 

By Robert Cardone

Nonparametric or distribution-free methods have several advantages or benefits. They may be used on all types of data including nominal, ordinal, interval and ratio scaled. They make fewer and less stringent assumptions than their parametric counterparts. Depending on the particular procedure, nonparametric methods may be almost as powerful as the corresponding parametric procedure when the assumptions of the latter are met. When this is not the case, they are generally more powerful.

A parametric method – Consider using when:

  • The assumptions for the population probability distribution hold true
  • The sample size is large enough for the central limit theorem to lead to normality of averages
  • The data is non-normal but can be transformed

A nonparametric method – Consider using if the data is:

  • Distinctly non-normal and cannot be transformed
  • From a sample that is too small for the central limit theorem to lead to normality of averages
  • From a distribution not covered by parametric methods
  • From an unknown distribution
  • Nominal or ordinal

A False Sense of Security

Black Belts may have a false sense of security when using nonparametric methods because it is generally believed that nonparametric tests are immune to data assumption violations and the presence of outliers. While nonparametric methods require no assumptions about the population probability distribution functions, they are based on some of the same assumptions as parametric methods, such as randomness and independence of the samples.

In addition, many nonparametric tests are sensitive to the shape of the populations from which the samples are drawn. For example, the 1-sample Wilcoxon test can be used when the team is unsure of the population's distribution but the distribution is assumed to be symmetrical. For the Kruskal-Wallis test, samples must be from populations with similar shapes and equal variances. The Kruskal-Wallis test is more powerful than the Mood's Median test for data from many distributions, but is less robust against outliers.

Table 1 contains the most commonly used parametric tests, their nonparametric equivalents and the assumptions that must be met before the nonparametric test can be used.

 Table 1: Parametric, Nonparametric Equivalents and Assumptions

Parametric Statistical Test
Nonparametic EquivalentsNonparametric
Data Assumptions
1-Sample
z-Test or
1-Sample
t-Test
1-Sample
Sign Test

1-Sample Wilcoxon Test
Bivariate random variables are mutually independent. The measurement scale is at least ordinal.

Random, independent sample is from a population with a symmetric distribution. 
2-Sample
t-Test
Mann-WhitneyMutually independent random samples from two populations that have the same shape, whose variances are equal and a scale that is ordinal.
Paired
t-Test
Paired Wilcoxon
Test
Random, independent samples are from populations with symmetric distributions.
One-Way ANOVAKruskal-Wallis
Test



Mood's Median Test
Random, mutually independent samples are from populations whose distribution functions have the same shape, equal variances. Each sample consists of five or more measures. Kruskal-Wallis is more powerful than Mood's for data from many distributions, but less robust against outliers.

Independent random samples from population distributions that have the same shape. Mood's Median test is robust against outliers.
Two-Way ANOVAFriedman TestResponses for each of the block-treatments are from populations whose distribution functions have the same shape and equal variances. Treatments must be randomly assigned within the blocks.

Figure 1 provides a roadmap for selecting the appropriate nonparametric method.Roadmap

 Figure 1: Nonparametric Roadmap

Conclusion: Can Be More Powerful...

Nonparametric methods are essential tools in the Black Belt's analytic toolbox. When appropriately applied, nonparametric methods are often more powerful than parametric methods if the assumptions for the parametric model cannot be met.

About the Author: Robert Cardone is a Six Sigma Master Black Belt with Merrill Lynch Global Private Client & Enterprise Technology. He can be reached at Robert_Cardone@ML.com.

 

Best Selling Products

  1. Certified Lean Six Sigma Green Belt Assessment Exam
    This assessment exam is useful for students interested in assessing their knowledge of Lean Six Sigma on the Green Belt ...
  2. Certified Lean Six Sigma Black Belt Assessment Exam
    Interested in assessing your knowledge of Lean Six Sigma? Preparing for certifications? Testing your students and traine...
  3. 5S Training Course
    One of the key fundamental tools of process improvement is 5S. 5S is a methodology for organizing and minimizing item...
  4. Six Sigma Black Belt (DMAIC) Training Slides
    The 2008 Six Sigma Black Belt course is comprised of: 1,176 PowerPoint slides, Instructor notes, Slide explanations, 37 ...
  5. Six Sigma DMAIC Training Slides
    The complete 2008 Lean Six Sigma DMAIC course prepares participants to perform the role of a LSS Black Belt; covering wh...
  6. Gage R&R Excel Template
    Gage Repeatability and Reproducibility (R&R) studies measure the amount of measurement variation that is attributabl...
  7. CSSBB Preparation Pack
    The CSSBB Preparation Pack includes materials for passing the Certified Six Sigma Black Belt (CSSBB) exam. This CSSBB Pr...

Premium Sponsor:

Accenture, Process & Improvement Performance, formerly George Group

Sponsors:

Achieve Operational Excellence: STAT-A-MATRIX

Advance your Military Career with Six Sigma Programs from Villanova University

MoreSteam: The Engine Room of Continuous Improvement

Novaces: Six Sigma for the Military

Sponsor iSixSigma Military



 

About iSixSigma Military

The purpose of this iSixSigma Military channel is to document the transformation of the United States Armed Services through the use of Lean Six Sigma and related process improvement methodologies.

Ronald E. Rezek, special assistant to the acting secretary of the Army, has said the goal of the Army's Lean Six Sigma deployment is to "make the business side of the Army as efficient as the war-fighting side is effective." Leaders of the other armed services echo that sentiment and transformation objective.

This portal will serve as a central community for everyone associated with the business transformation of the U.S. military. It will provide communication updates on deployments, the opportunity for military leaders at all levels to learn new skills, advance their careers and contribute to the success of their organizations.