Back
Texte intégral
Journal article

Block-enhanced precision matrix estimation for large-scale datasets

  • Eftekhari, Aryan Institute of Computing (CI), Facoltà di scienze informatiche, Università della Svizzera italiana, Svizzera
  • Pasadakis, Dimosthenis Institute of Computing (CI), Facoltà di scienze informatiche, Università della Svizzera italiana, Svizzera
  • Bollhöfer, Matthias Institute for Numerical Analysis, TU Braunschweig, Braunschweig, Germany
  • Scheidegger, Simon Department of Economics, University of Lausanne, Lausanne, Switzerland
  • Schenk, Olaf Institute of Computing (CI), Facoltà di scienze informatiche, Università della Svizzera italiana, Svizzera
Show more…
    12.05.2021
Published in:
  • Journal of computational science. - Elsevier. - 2021, vol. 53, p. 13
Covariance matrices
Graphical model
Optimization
Gaussian Markov random field
Machine learning application
English The ℓ1-regularized Gaussian maximum likelihood method is a common approach for sparse precision matrix estimation, but one that poses a computational challenge for high-dimensional datasets. We present a novel ℓ1- regularized maximum likelihood method for performant large-scale sparse precision matrix estimation utilizing the block structures in the underlying computations. We identify the computational bottlenecks and contribute a block coordinate descent update as well as a block approximate matrix inversion routine, which is then parallelized using a shared-memory scheme. We demonstrate the effectiveness, accuracy, and performance of these algorithms. Our numerical examples and comparative results with various modern open-source packages reveal that these precision matrix estimation methods can accelerate the computation of covariance matrices by two to three orders of magnitude, while keeping memory requirements modest. Furthermore, we conduct large-scale case studies for applications from finance and medicine with several thousand random variables to demonstrate applicability for real-world datasets.
Language
  • English
Classification
Computer science and technology
License
CC BY-NC
Open access status
hybrid
Identifiers
Persistent URL
https://n2t.net/ark:/12658/srd1319335
Statistics
Document views: 139 File downloads:
  • Schenk_jocs_2021.pdf: 263