Model selection criteria are widely used to identify the model that best represents the data among a set of potential candidates. Amidst the different model selection criteria, the Bayesian information criterion (BIC) and the Akaike information criterion (AIC) are the most popular and better understood. In the derivation of these indicators, it was assumed that the model’s dependent variables have already been properly identified and that the entries are not affected by significant uncertainties. These are issues that can become quite serious when investigating complex systems, especially when variables are highly correlated and the measurement uncertainties associated with them are not negligible. More sophisticated versions of this criteria, capable of better detecting spurious relations between variables when non-negligible noise is present, are proposed in this paper. Their derivation is obtained starting from a Bayesian statistics framework and adding an a priori Chi-squared probability distribution function of the model, dependent on a specifically defined information theoretic quantity that takes into account the redundancy between the dependent variables. The performances of the proposed versions of these criteria are assessed through a series of systematic simulations, using synthetic data for various classes of functions and noise levels. The results show that the upgraded formulation of the criteria clearly outperforms the traditional ones in most of the cases reported.
Improved Treatment of the Independent Variables for the Deployment of Model Selection Criteria in the Analysis of Complex Systems
Spolladore Luca; Gelfusa Michela; Rossi Riccardo; Murari Andrea
Related products
-
Trends in Environmental Analytical Chemistry 30 pp. e00121-1 - e00121-12 Year: 2021 DOI: 10.1016/j.teac.2021.e00121
Laser-Induced Breakdown Spectroscopy applied to environmental systems and their potential contaminants. An overview of advances achieved in the last few years
Goncalves D.A.; Senesi G.S.; Nicolodelli G.
-
Applied geochemistry 128 pp. 104929-1 - 104929-55 Year: 2021 DOI: 10.1016/j.apgeochem.2021.104929
Laser-Induced Breakdown Spectroscopy – A geochemical tool for the 21st century
Harmon R.S.; Senesi G.S.
-
The astrophysical journal. Letters (Print) 912 (2), pp. L21-1 - L21-8 Year: 2021 DOI: 10.3847/2041-8213/abf7d1
Evolution of Solar Wind Turbulence from 0.1 to 1 au during the First Parker Solar Probe-Solar Orbiter Radial Alignment
Telloni, Daniele; Sorriso-Valvo, Luca; Woodham, Lloyd D.; Panasenco, Olga; Velli, Marco; Carbone, Francesco; Zank, Gary P.; Bruno, Roberto; Perrone, Denise; Nakanotani, Masaru; Shi, Chen; D’Amicis, Raffaella; De Marco, Rossana; Jagarlamudi, Vamsee K.; Steinvall, Konrad; Marino, Raffaele; Adhikari, Laxman; Zhao, Lingling; Liang, Haoming; Tenerani, Anna; Laker, Ronan; Horbury, Timothy S.; Bale, Stuart D.; Pulupa, Marc; Malaspina, David M.; Macdowall, Robert J.; Goetz, Keith; De Wit, Thierry Dudok; Harvey, Peter R.; Kasper, Justin C.; Korreck, Kelly E.; Larson, Davin; Case, Anthony W.; Stevens, Michael L.; Whittlesey, Phyllis; Livi, Roberto; Owen, Christopher J.; Livi, Stefano; Louarn, Philippe; Antonucci, Ester; Romoli, Marco; O’Brien, Helen; Evans, Vincent; Angelini, Virginia
English
Italiano