Fisher information is of key importance in estimation theory. It is used as a tool for characterizing complex signals or systems, with applications, e.g. in biology, geophysics and signal processing. The problem of minimizing Fisher information in a set of distributions has been studied by many researchers. In this paper, based on some rather simple statistical reasoning, we provide an alternative proof for the fact that Gaussian distribution with finite variance minimizes the Fisher information over all distributions with the same variance.
Balasco, M., Lapenna, V., Lovallo, M., Romano, G., Siniscalchi, A. and Telesca, L. (2008). Fisher information measure analysis of earth’s apparent resistivity. International Journal of Nonlinear Science 5(3) 230-236.
Dulek, B. and Gezici, S. (2014). Average Fisher information maximisation in presence of cost-constrained measurements. Electronics Letters 47(11) 654-656.
Frieden, B.R. (2009). Fisher information, disorder, and the equilibrium distributions of physics. Physical Review A-41(8) 4265-4276.
Hussin, A.G., Abuzaid, A., Zulkifili, F. and Mohamed I. (2010). Asymptotic covariance and detection of influential observations in a linear functional relationship model for circular data with application to the measurements of wind directions. Science Asia, 36, 249-253.
Khoolenjani, N.B. and Alamatsaz, M.H. (2016). A De Bruijn’s identity for dependent random variables based on copula theory. Probability in the Engineering and Informational Sciences, 30(1), 125-140.
Lehmann, E.L. and Casella, G. (1998). Theory of Point Estimation, 2nd ed, New York: Springer.
Mamun, S.M.A., Hussin, G.A., Zubairi, Y.Z. and Imon, R.A.H.M. (2013). Maximum likelihood estimation of linear structural relationship model parameters assuming the slope is known. Science Asia, 39, 561-565.
Martin, M.T., Pennini, F. and Plastino, A. (2009). Fisher’s information and the analysis of complex signals. Physics Letters A-256(2-3) 173-180.
Nagy, A. (2003). Fisher information in density functional theory. The Journal of Chemical Physics 119(18) 9401-9405.
Neri, A., Carli, M. and Battisti, F. (2013). Maximum likelihood estimation of depth field for trinocular images. Electronics Letters 49(6) 394-396.
Park, S., Serpedin, E. and Qaraqe, K. (2013). Gaussian assumption: The least favorable but the most useful. IEEE Signal Processing Magazine 30 183-186.
Shao, J. (1999). Mathematical statistics, New York: Springer-Verlag.
Stoica, P. and Babu, P. (2011). The Gaussian data assumption leads to the largest Cramer-Rao bound. IEEE Signal Processing Magazine 28 132-133.
Vignat, C. and Bercher, J.F. (2003). On Fisher information inequalities and score functions in non-invertible linear systems. Journal of Inequalities in Pure and Applied Mathematics 4(4) 71.
Xu, B., Chen, Q., Wu, Z. and Wang, Z. (2008). Analysis and approximation of performance bound for two-observer bearings-only tracking. Information Sciences 178(8) 2059-2078.
Zivojnovic, V. and Noll, D. (1997). Minimum Fisher information spectral analysis. ICASSP-97, IEEE International Conference on Acoustics, Speech, and Signal Processing 5.