Ferbat's test: A Monte Carlo multiple comparison procedure with a control
Main Article Content
Abstract
The present work presented an alternative MCC to the Dunnett's test, called Ferbat's test. The test replaced the root of the mean square of the residue used within Dunnett's test with another non-biased $\sigma$ estimator. The distribution of the test statistics was determined by simulation using the Monte Carlo method. Comparing the performance evaluation of these two tests, the Ferbat's test performed better in some scenarios, such as control of the experimentwise error rate for all simulated situations and higher power when the number of treatments was small and when the number of replications increases. In the other evaluation situations, the tests presented equivalent performance.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
Ahsumullah, M., Nevzorov, V. B. & Shakil, M. An introduction to order statistics 244 (Atlantis Press, Paris, 2013).
Benjamini, Y., Bretz, F. & Sarkar, S. Recent Developments in Multiple Comparison Procedures 156 (Institute of Mathematical Statistics, Ohio, 2004).
Bernhardson, C. S. 375: Type I Error Rates When Multiple Comparison Procedures Follow a Significant F Test of ANOVA. Biometrics 31, 229–232 (1975).
Boardman, T. J. & Moffitt, D. R. Graphical Monte Carlo Type I Error Rates for Multiple Comparison Procedures. Biometrics 27, 738–744 (1971).
Bretz, F., Hothorn, T. &Westfall, P. Multiple Comparisons using R 182 (Chapman & Hall/CRC, Boca Raton, 2011).
Broch, S. C. & Ferreira, D. F. Algorithm using Gaussian quadraturas to obtain probabilities of Dunnett two-sided test for balanced data. Tendências em Matemática Aplicada e Computacional (Tema) 14, 209–219 (2013).
Broch, S. C. & Ferreira, D. F. Multivariate distributions of non-central Dunnett test statistics. Revista Brasileira de Biometria 31, 501–515 (2013).
Broch, S. C. & Ferreira, D. F. nCDunnett: Noncentral Dunnett’s Test Distribution R Foundation for Statistical Computing (Vienna, Austria, 2015). https://CRAN.R- project.org/package=nCDunnett.
Carmer, S. G. & Swanson, M. R. An Evaluation of Ten Pairwise Multiple Comparison Procedures by Monte Carlo Methods. Journal of the American Statistical Association 68, 66–74 (1973).
Carmer, S. G. & Walker, W. M. Pairwise multiple comparisons of treatment means in agronomic research. Journal of Agronomic Education 14, 19–26 (1985).
Conagin, A. Discriminative power of the modified Bonferroni’s test under general and partial null hypotheses. Revista de Agricultura 73, 31–46 (1999).
Conagin, A., Barbin, D. & Demétrio, C. G. B. Modifications for the tukey test procedure and evaluation of the power and efficiency of multiple comparison procedures. Scientia Agricola 65, 428–432 (2008).
Daly, J. F. On the Use of the Sample Range in an Analogue of Student’s t-Test. The Annals of Mathematical Statistics 17, 71–74 (1946).
Davies, O. L. & Pearson, E. S. Methods of Estimating from Samples the Population Standard Deviation. Supplement to the Journal of the Royal Statistical Society 1, 76–93 (1934).
Dean, A., Voss, D. & Draguljić, D. Design and Analysis of Experiments 2nd ed., 840 (Springer International Publishing, Switzerland, 2017).
Dickhaus, T. Simultaneous Statistical Inference. with applications in the life sciences 180
Springer, New York, 2014).
Multiple testing problems in pharmaceutical statistics (eds Dmitrienko, A., Tamhane, A. C. & Bretz, F.) 289 (CRC Press, Boca Raton, 2010).
Duncan, D. B. Multiple range and multiple F tests. Biometrics 11, 1–42 (1955).
Dunnett, C. W. A multiple comparison procedure for comparing several treatments with a control. J. Amer. Statist. Ass. 50, 1096–1121 (1955).
Dunnett, C. W. New tables for multiple comparisons with a control. Biometrics, 482–491 (1964).
Dunnett, C. W. in Proceedings of the International Conference on Linear Statistical Inference LINSTAT ’93 35–46 (Springer Netherlands, Dordrecht, 1994).
Hochberg, Y. & Tamhane, A. C. Multiple Comparisons Procedures 450 (John Wiley & Sons, New York, 1987).
Hsu, J. C. Multple Comparison. Theory and methods 277 (Chapman and Hall, London, 1996).
Keuls, M. The use of the “studentized range” in connection with an analysis of variance. Euphytica 1, 112–122 (1952).
Leemis, L. M. & Trivedi, K. S. A Comparison of Approximate Interval Estimators for the Bernoulli Parameter. The American Statistician 50, 63–68 (1996).
Lord, E. Power of the Modified t-Test (u-Test) Based on Range. Biometrika 37, 64–77 (1950).
Lord, E. The Use of Range in Place of Standard Deviation in the t-Test. Biometrika 34, 41–67 (1947).
Miller, R. Simultaneous statistical inference 2nd ed., 299 (Springer-Verlag, New York, 1981).
Oliveira, I. R. C. & Ferreira, D. F. Multivariate extension of chi-squared univariate normality test. Journal of Statistical Computation and Simulation 80, 513–526 (2010).
Patnaik, P. B. TheUse of Mean Range as an Estimator ofVariance in StatisticalTests. Biometrika 37, 78–87 (1950).
Pearson, E. S. & Haines, J. The Use of Range in Place of Standard Deviation in Small Samples. Supplement to the Journal of the Royal Statistical Society 2, 83–98 (1935).
Perecin, D. & Malheiros, E. B. Uma avaliação de seis procedimentos para comparações múltiplas in 3o Simpósio de Estatística aplicada à Experimentação Agonômica (Lavras, Brazil, 1989), 66.
Shaffer, J. P. Multiple Comparisons Emphasizing Selected Contrasts: An Extension and Generalization of Dunnett’s Procedure. Biometrics 33, 293–303 (1977).
Silva, E. C. d., Ferreira, D. F. & Bearzoti, E. Avaliação do poder e taxas de erro tipo I do teste de Scott-Knott por meio do método de Monte Carlo. Ciência e Agrotecnologia 23, 687–696 (1999).
Sousa, C. A. d., Junior, M. A. L. & Ferreira, R. L. C. Evaluation of statistical tests of multiple comparisons for means. Revista Ceres 59, 350–354 (2012).
Tukey, J. W. The problem of multiple comparisons. Unpublished Dittoed Notes, Princeton University (1953).
Westfall, P. H., Tobias, R. D. & Wolfinger, R. D. Multiple comparisons and multiple tests using SAS 2nd ed., 625 (SAS institute, North Carolina, 2011).