<abstract xmlns="http://www.w3.org/1999/xhtml">An important step in the full definition of an analytical method is the characterization of the within and between laboratory variability. This is typically done through collaborative studies involving multiple laboratories. The statistical analysis of the results of collaborative studies is generally carried out using standardized protocols such as those given in ISO 5725-2 or ASTM E691-14.One aspect of the evaluation of collaborative studies is the identification of outlying laboratories which are then excluded from the variance calculation associated with the analytical method. Whether particular laboratories are identified as outliers can have a dramatic effect on the calculated variances.The generally recommended approach to identify laboratories with excessive within-laboratory variation is Cochran’s Test or something similar. However, Cochran’s Test is very sensitive to non-normality of the underlying statistical distribution. When the assumption of normality is violated, Cochran’s Test can wrongly identify laboratories as outliers at much greater than the nominally stated error rate, even for deviations from normality that are very difficult to detect analytically.In this paper, an alternative to Cochran’s Test, adapted from Levene’s Test, is proposed and shown to approximately maintain the stated error rate when the underlying distribution is not normal. This newly adapted test is recommended for future collaborative study analysis in place of Cochran’s Test.</abstract>

An important step in the full definition of an analytical method is the characterization of the within and between laboratory variability. This is typically done through collaborative studies involving multiple laboratories. The statistical analysis of the results of collaborative studies is generally carried out using standardized protocols such as those given in ISO 5725-2 or ASTM E691-14.One aspect of the evaluation of collaborative studies is the identification of outlying laboratories which are then excluded from the variance calculation associated with the analytical method. Whether particular laboratories are identified as outliers can have a dramatic effect on the calculated variances.The generally recommended approach to identify laboratories with excessive within-laboratory variation is Cochran’s Test or something similar. However, Cochran’s Test is very sensitive to non-normality of the underlying statistical distribution. When the assumption of normality is violated, Cochran’s Test can wrongly identify laboratories as outliers at much greater than the nominally stated error rate, even for deviations from normality that are very difficult to detect analytically.In this paper, an alternative to Cochran’s Test, adapted from Levene’s Test, is proposed and shown to approximately maintain the stated error rate when the underlying distribution is not normal. This newly adapted test is recommended for future collaborative study analysis in place of Cochran’s Test.

Within-Laboratory Variance Outlier Detection: An Alternative to Cochran’s Test

Contributions to Tobacco & Nicotine Research

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

An important step in the full definition of an analytical method is the characterization of the within and between laboratory variability. This is typically...

Within-Laboratory Variance Outlier Detection: An Alternative to Cochran’s Test

Published Online: Oct 04, 2017

Page range: 135 - 144

Received: Jan 31, 2017

Accepted: Jul 25, 2017

DOI: https://doi.org/10.1515/cttr-2017-0014

Keywords
Collaborative study, outlier identification, homogeneity of variance test, Cochran’s Test, Levene’s Test, Brown-Forsythe Test, k-statistic

© 2017 Michael J. Morton, published by De Gruyter Open

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Within-Laboratory Variance Outlier Detection: An Alternative to Cochran’s Test

Published Online: Oct 04, 2017

Page range: 135 - 144

Received: Jan 31, 2017

Accepted: Jul 25, 2017

DOI: https://doi.org/10.1515/cttr-2017-0014

KeywordsCollaborative study, outlier identification, homogeneity of variance test, Cochran’s Test, Levene’s Test, Brown-Forsythe Test, k-statistic

© 2017 Michael J. Morton, published by De Gruyter Open

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Keywords
Collaborative study, outlier identification, homogeneity of variance test, Cochran’s Test, Levene’s Test, Brown-Forsythe Test, k-statistic