The increasingly sophisticated investigations of complex systems require more robust estimates of the correlations between the measured quantities. The traditional Pearson correlation coefficient is easy to calculate but sensitive only to linear correlations. The total influence between quantities is, therefore, often expressed in terms of the mutual information, which also takes into account the nonlinear effects but is not normalized. To compare data from different experiments, the information quality ratio is, therefore, in many cases, of easier interpretation. On the other hand, both mutual information and information quality ratio are always positive and, therefore, cannot provide information about the sign of the influence between quantities. Moreover, they require an accurate determination of the probability distribution functions of the variables involved. As the quality and amount of data available are not always sufficient to grant an accurate estimation of the probability distribution functions, it has been investigated whether neural computational tools can help and complement the aforementioned indicators. Specific encoders and autoencoders have been developed for the task of determining the total correlation between quantities related by a functional dependence, including information about the sign of their mutual influence. Both their accuracy and computational efficiencies have been addressed in detail, with extensive numerical tests using synthetic data. A careful analysis of the robustness against noise has also been performed. The neural computational tools typically outperform the traditional indicators in practically every respect.
Quantifying total influence between variables with information theoretic and machine learning techniques
Murari A.; Rossi R.; Lungaroni M.; Gaudio P.; Gelfusa M.
Journal:
Entropy (Basel, Online) 22 (2),
pp. 141-1 - 141-12
Year:
2020
ISTP Authors: Andrea Murari
Keywords: autoencoders, machine-learning tools, information theory, information quality ratio, total correlations, encoders
Research Activitie: JOURNAL ARTICLES
Related products
-
The astrophysical journal. Letters (Online) 919 (2), pp. L30-1 - L30-8 Year: 2021 DOI: 10.3847/2041-8213/ac26c5
Turbulent Cascade and Energy Transfer Rate in a Solar Coronal Mass Ejection
Sorriso-Valvo, Luca; Yordanova, Emiliya; Dimmock, Andrew P.; Telloni, Daniele
-
Plasma physics and controlled fusion (Print) 63 (12), pp. 125009-1 - 125009-11 Year: 2021 DOI: 10.1088/1361-6587/ac2eb2
First results from beam emission spectroscopy in SPIDER negative ion source
Barbisan M.; Zaniol B.; Pasqualotto R.; Serianni G.; Ugoletti M.
-
Nuclear fusion 61 (7), pp. 076013-1 - 076013-15 Year: 2021 DOI: 10.1088/1741-4326/abfcdf
Prediction of temperature barriers in weakly collisional plasmas by a Lagrangian coherent structures computational tool
Di Giannatale G.; Bonfiglio D.; Cappello S.; Chacon L.; Veranda M.
English
Italiano