An Introductory Study on

Authors

  • Emre Demir
  • AKKU? Mu?la S?tk? Ko

Keywords:

Binary dependent variable, Genetic Algorithm, maximum likelihood estimator, Newton-Raphson algorithm.

Abstract

In this study, we mainly dealt with the introduction and comparison of two optimization techniques over the estimated parameters and model results of the Binary Logistic Regression (LR) model. These are the traditional Newton-Raphson (NR) algorithm which requires the differentiable objective function and appropriate starting values related to the parameters and Genetic Algorithm (GA) approach which does not need any strict assumptions as the algorithm NR. The results suggest that NR algorithm and GA give very similar results when the assumptions of NR are satisfied. This indicates that GA could successfully be used instead of the NR method considering its more flexible assumptions. Moreover, if the objective function does not satisfy the differentiability condition, NR could not be used in the optimization process and fails to find the optimum values. Therefore, this study actually reveals the success of GA in the parameter estimation of LR model. All the model outputs are compared in terms of the estimated parameter values, ease of application and convergence rates. Matlab commands are also given with their explanations for GA for researchers studying in this area.

Author Biography

AKKU?, Mu?la S?tk? Ko

Statistics

References

B. Altunkaynak, and A. Esin.

D.C. Sekhar, and R. Ganguli.

A. Agresti. Categorical Data Analysis. Canada: John Wiley & Sons, 2th edition, 2002.

D.W. Hosmer, and S. Lemeshow. Applied Logistic Regression. New York, USA: John Wiley & Sons Inc., 2th edition, 2000.

S. Menard. Applied Logistic Regression Analysis. USA: Sage Publications, 2th edition, 2002.

K. Matilainen, E. Mantysaari, M. Lidauer, I. Stranden, and R. Thompson.

M. Mitchell. An Introduction to Genetic Algorithms. England: MIT Press, 5th edition, 1999.

J.H. Holland, Adaptation in Natural and Artificial Systems. USA: University of Michigan Press, 1975.

D.E. Goldberg. Genetic Algorithms in Search, Optimization and Machine Learning, Addison. Massachusetts: Wesley Publishing, 1989.

D.E. Goldberg. Frontiers of Evolutionary Computation. New York: Kluwer Academic Publishers, 2004.

A. Pourrajabian, A. Ebrahimi, R.M. Mirzaei, and M. Shams.

J. Alcock and K. Burrage.

M. Thakur, S. Meghwani, and H. Jalota.

C. Reeves, and J.E. Rowe. Genetic Algorithms Principles and Perspectives. A Guide to GA Theory. USA: Kluwer Academic Press, 2002.

S. Chatterjee, M. Laudato, and L. Lynch.

C. Karr, and L.M. Freeman. Industrial Applications of Genetic Algorithms. USA: CRC Press, 1999

C.L. Karr, B. Weck, and L.M. Freeman,

J. Pasia, A. Hermosilla, and H. Ombao.

Z. Michalewicz, Genetic Algorithms+ Data Structures = Evolution Programs. USA: Springer, 3th edition, 1996.

Downloads

Published

2015-01-09

How to Cite

Demir, E., & AKKU?, . (2015). An Introductory Study on . International Journal of Sciences: Basic and Applied Research (IJSBAR), 19(2), 162–180. Retrieved from https://gssrr.org/index.php/JournalOfBasicAndApplied/article/view/3252

Issue

Section

Articles