Institutional Repository
Technical University of Crete
Technical University of Crete
EN
|
EL
| URI | http://purl.tuc.gr/dl/dias/2CF83FF6-9A68-401D-A1E6-F0C3FF0CFCE0 | - |
| Identifier | https://doi.org/10.1109/78.934138 | - |
| Language | en | - |
| Extent | 7 pages | en |
| Title | On the behavior of information theoretic criteria for model order selection | en |
| Creator | Liavas Athanasios | en |
| Creator | Λιαβας Αθανασιος | el |
| Creator | Regalia, Phillip A., 1962- | en |
| Publisher | Institute of Electrical and Electronics Engineers | en |
| Content Summary | The Akaike (1974) information criterion (AIC) and the minimum description length (MDL) are two well-known criteria for model order selection in the additive white noise case. Our aim is to study the influence on their behavior of a large gap between the signal and the noise eigenvalues and of the noise eigenvalue dispersion. Our results are mostly qualitative and serve to explain the behavior of the AIC and the MDL in some cases of great practical importance. We show that when the noise eigenvalues are not clustered sufficiently closely, then the AIC and the MDL may lead to overmodeling by ignoring an arbitrarily large gap between the signal and the noise eigenvalues. For fixed number of data samples, overmodeling becomes more likely for increasing the dispersion of the noise eigenvalues. For fixed dispersion, overmodeling becomes more likely for increasing the number of data samples. Undermodeling may happen in the cases where the signal and the noise eigenvalues are not well separated and the noise eigenvalues are clustered sufficiently closely. We illustrate our results by using simulations from the effective channel order determination area | en |
| Type of Item | Peer-Reviewed Journal Publication | en |
| Type of Item | Δημοσίευση σε Περιοδικό με Κριτές | el |
| License | http://creativecommons.org/licenses/by/4.0/ | en |
| Date of Item | 2015-11-08 | - |
| Date of Publication | 2001 | - |
| Bibliographic Citation | A. P. Liavas ,P. A. Regalia, “On the behavior of information theoretic criteria for model order selection,” IEEE Trans. Signal Proc., vol. 49, no. 8, pp. 1689–1695, Aug. 2001.doi: 10.1109/78.934138 | en |
Copyright © DIAS 2013
