Ferbat's test: A Monte Carlo multiple comparison procedure with a control

Main Article Content

Ben Dêivide de Oliveira Batista
Daniel Furtado Ferreira


The present work presented an alternative MCC to the Dunnett's test, called Ferbat's test. The test replaced the root of the mean square of the residue used within Dunnett's test with another non-biased $\sigma$ estimator. The distribution of the test statistics was determined by simulation using the Monte Carlo method. Comparing the performance evaluation of these two tests, the Ferbat's test performed better in some scenarios, such as control of the experimentwise error rate for all simulated situations and higher power when the number of treatments was small and when the number of replications increases. In the other evaluation situations, the tests presented equivalent performance.

Article Details

How to Cite
Batista, B. D. de O., & Ferreira, D. F. (2024). Ferbat’s test: A Monte Carlo multiple comparison procedure with a control. Brazilian Journal of Biometrics, 42(1), 20–49. https://doi.org/10.28951/bjb.v42i1.641


Ahsumullah, M., Nevzorov, V. B. & Shakil, M. An introduction to order statistics 244 (Atlantis Press, Paris, 2013).

Benjamini, Y., Bretz, F. & Sarkar, S. Recent Developments in Multiple Comparison Procedures 156 (Institute of Mathematical Statistics, Ohio, 2004).

Bernhardson, C. S. 375: Type I Error Rates When Multiple Comparison Procedures Follow a Significant F Test of ANOVA. Biometrics 31, 229–232 (1975).

Boardman, T. J. & Moffitt, D. R. Graphical Monte Carlo Type I Error Rates for Multiple Comparison Procedures. Biometrics 27, 738–744 (1971).

Bretz, F., Hothorn, T. &Westfall, P. Multiple Comparisons using R 182 (Chapman & Hall/CRC, Boca Raton, 2011).

Broch, S. C. & Ferreira, D. F. Algorithm using Gaussian quadraturas to obtain probabilities of Dunnett two-sided test for balanced data. Tendências em Matemática Aplicada e Computacional (Tema) 14, 209–219 (2013).

Broch, S. C. & Ferreira, D. F. Multivariate distributions of non-central Dunnett test statistics. Revista Brasileira de Biometria 31, 501–515 (2013).

Broch, S. C. & Ferreira, D. F. nCDunnett: Noncentral Dunnett’s Test Distribution R Foundation for Statistical Computing (Vienna, Austria, 2015). https://CRAN.R- project.org/package=nCDunnett.

Carmer, S. G. & Swanson, M. R. An Evaluation of Ten Pairwise Multiple Comparison Procedures by Monte Carlo Methods. Journal of the American Statistical Association 68, 66–74 (1973).

Carmer, S. G. & Walker, W. M. Pairwise multiple comparisons of treatment means in agronomic research. Journal of Agronomic Education 14, 19–26 (1985).

Conagin, A. Discriminative power of the modified Bonferroni’s test under general and partial null hypotheses. Revista de Agricultura 73, 31–46 (1999).

Conagin, A., Barbin, D. & Demétrio, C. G. B. Modifications for the tukey test procedure and evaluation of the power and efficiency of multiple comparison procedures. Scientia Agricola 65, 428–432 (2008).

Daly, J. F. On the Use of the Sample Range in an Analogue of Student’s t-Test. The Annals of Mathematical Statistics 17, 71–74 (1946).

Davies, O. L. & Pearson, E. S. Methods of Estimating from Samples the Population Standard Deviation. Supplement to the Journal of the Royal Statistical Society 1, 76–93 (1934).

Dean, A., Voss, D. & Draguljić, D. Design and Analysis of Experiments 2nd ed., 840 (Springer International Publishing, Switzerland, 2017).

Dickhaus, T. Simultaneous Statistical Inference. with applications in the life sciences 180

Springer, New York, 2014).

Multiple testing problems in pharmaceutical statistics (eds Dmitrienko, A., Tamhane, A. C. & Bretz, F.) 289 (CRC Press, Boca Raton, 2010).

Duncan, D. B. Multiple range and multiple F tests. Biometrics 11, 1–42 (1955).

Dunnett, C. W. A multiple comparison procedure for comparing several treatments with a control. J. Amer. Statist. Ass. 50, 1096–1121 (1955).

Dunnett, C. W. New tables for multiple comparisons with a control. Biometrics, 482–491 (1964).

Dunnett, C. W. in Proceedings of the International Conference on Linear Statistical Inference LINSTAT ’93 35–46 (Springer Netherlands, Dordrecht, 1994).

Hochberg, Y. & Tamhane, A. C. Multiple Comparisons Procedures 450 (John Wiley & Sons, New York, 1987).

Hsu, J. C. Multple Comparison. Theory and methods 277 (Chapman and Hall, London, 1996).

Keuls, M. The use of the “studentized range” in connection with an analysis of variance. Euphytica 1, 112–122 (1952).

Leemis, L. M. & Trivedi, K. S. A Comparison of Approximate Interval Estimators for the Bernoulli Parameter. The American Statistician 50, 63–68 (1996).

Lord, E. Power of the Modified t-Test (u-Test) Based on Range. Biometrika 37, 64–77 (1950).

Lord, E. The Use of Range in Place of Standard Deviation in the t-Test. Biometrika 34, 41–67 (1947).

Miller, R. Simultaneous statistical inference 2nd ed., 299 (Springer-Verlag, New York, 1981).

Oliveira, I. R. C. & Ferreira, D. F. Multivariate extension of chi-squared univariate normality test. Journal of Statistical Computation and Simulation 80, 513–526 (2010).

Patnaik, P. B. TheUse of Mean Range as an Estimator ofVariance in StatisticalTests. Biometrika 37, 78–87 (1950).

Pearson, E. S. & Haines, J. The Use of Range in Place of Standard Deviation in Small Samples. Supplement to the Journal of the Royal Statistical Society 2, 83–98 (1935).

Perecin, D. & Malheiros, E. B. Uma avaliação de seis procedimentos para comparações múltiplas in 3o Simpósio de Estatística aplicada à Experimentação Agonômica (Lavras, Brazil, 1989), 66.

Shaffer, J. P. Multiple Comparisons Emphasizing Selected Contrasts: An Extension and Generalization of Dunnett’s Procedure. Biometrics 33, 293–303 (1977).

Silva, E. C. d., Ferreira, D. F. & Bearzoti, E. Avaliação do poder e taxas de erro tipo I do teste de Scott-Knott por meio do método de Monte Carlo. Ciência e Agrotecnologia 23, 687–696 (1999).

Sousa, C. A. d., Junior, M. A. L. & Ferreira, R. L. C. Evaluation of statistical tests of multiple comparisons for means. Revista Ceres 59, 350–354 (2012).

Tukey, J. W. The problem of multiple comparisons. Unpublished Dittoed Notes, Princeton University (1953).

Westfall, P. H., Tobias, R. D. & Wolfinger, R. D. Multiple comparisons and multiple tests using SAS 2nd ed., 625 (SAS institute, North Carolina, 2011).

Most read articles by the same author(s)

1 2 > >> 

Similar Articles

You may also start an advanced similarity search for this article.