Numerical Analysis

The group of Numerical Analysis covers research topics from Numerical Linear Algebra, such as low-rank approximation of matrices and tensors, the numerical solution of matrix equations, the computation of matrix functions, polynomial root-finding, and the theory of circuits. Details on these topics can be found below.

The group runs a Seminar Series: further information can be found at this link.

The group works in close collaboration with the Numerical Analysis group at the Department of Computer Science of the University of Pisa (G. Del Corso, L. Gemignani, F. Poloni), and at Scuola Normale Superiore (M. Benzi).

Research Topics

Low-rank Approximation and Structured Matrices

This research area deal with the problem of efficiently finding low-rank factorization of matrices $A$ in the form $$A \approx UV^T,$$ where $U,V$ are tall and skinny matrices. In most cases of interest, one assumes to either be able to evaluate $X \mapsto AX$ and $Y \mapsto A^T Y$ or to sample selected entries of $A$ at a reduced cost. Several strategies may be adopted for retrieving matrices $U,V$ such as randomized linear algebra methods, or cross-approximation techniques.

A natural evolution of this idea is to consider structured matrices, which are – in general – not low-rank, but may have low-rank blocks, or obtained as low-rank perturbations of particularly structured matrices. The aim is to represent such matrices using $\mathcal O(n)$ or even $O(1)$ storage and perform operations with a similar complexity (up to logarithmic factors in the dimension).

In particular, the following structures are considered:

  • Rank-structured matrices: Matrices with off-diagonal blocks of low-rank (HODLR), which may be efficiently representable using hierarchically structured bases (HSS).
  • Low-rank perturbations of Toeplitz matrices: matrices with this structure form an algebra, which has important applications in the study of queues and Markov chains. See also the section on the numerical solution of Markov chains below. Matrices in this class can often be represented with a storage that is independent of the dimensions, enabling the numerical study of infinite and semi-infinite matrices.

For matrices in this form, efficient arithmetic operations are available. MATLAB toolboxes for handling such matrices are available (see hm-toolbox for rank-structured matrices and cqt-toolbox for quasi-Toeplitz ones).

Members: 
  • Dario Andrea Bini
  • Stefano Massei
  • Beatrice Meini
  • Leonardo Robol
Collaborators:
Numerical Methods for Polynomial Root-Finding

This research area concerns the design, analysis, and implementation of numerical algorithms for the guaranteed approximation of the roots of a polynomial up to any number of digits. The motivation for this kind of numerical tool comes mainly from computer algebra systems where the symbolic treatment of polynomial systems leads to solving polynomials with very large degrees and with huge coefficients (exact or approximate). Other motivations come from problems in combinatorics, problems in dynamics of holomorphic functions, and problems in celestial mechanics.

Various numerical methods and tools are available to solve this problem and a huge literature exists. Among the classical choices, there are matrix methods, like the QR iteration applied to companion matrices, and functional iteration techniques (often based on the Newton method). In the latter class, an important method is Aberth’s iteration, a global version of the Newton iteration, that allows approximating all the roots of $p(x)$ simultaneously.

In the year 2000, we have produced the package MPSolve in the framework of the European project FRISCO. This package has been improved recently and is the fastest available software for polynomial root-finding available so far. Just to give an example, the software can solve the Mandelbrot polynomials of degree $2^{20}$ in a few hours over a dual Xeon server. Polynomials of degree $2^{21}$ and $2^{22}$ can be solved in a few days and in a few weeks, respectively. Mandelbrot polynomials have zeros that coincide with the cycles of a given length in the Mandelbrot iteration. These zeros are severely ill-conditioned.

Members: 
  • Dario Andrea Bini
  • Leonardo Robol
Collaborators: 
  • G. Fiorentino
Matrix Polynomials, Companion Linearizations, and Quasiseparable Matrices

An $m \times m$ matrix polynomial $A(x)$ is a polynomial in the variable $x$ whose coefficients are matrices. Matrix polynomials are encountered in many applications; an important computational problem is to compute the values of $x$ such that $\det(A(x)) = 0$. This problem, which is related to the analysis of eigenfrequencies of complex dynamical systems, is customarily reduced to solving a generalized linear eigenvalue problem of the kind $Hv = \lambda Kv$ where the $nm \times nm$ pencil $H -\lambda K$ provides a linearization of $A(x)$.

Here, the research concerns the design and analysis of linearizations that have nice computational properties and keep the condition number of the eigenvalues as small as possible. The literature in this area is very rich with many theoretical and computational results.

One nice feature is that the known linearization shares the quasiseparable property. That is, for any, $\lambda$ the submatrices of $H – \lambda K$ which are contained in the upper or in the lower triangular part of the matrix have a low rank. This property has been investigated in a different context and is exploitable to a certain extent for designing highly efficient algorithms.

In this research, we aim both to determine new and more effective linearizations and to design efficient algorithms for solving the linear pencil by relying on the quasiseparable structure. We also aim to combine analytic techniques, like the Aberth iteration, and matrix techniques to improve the efficiency of solution algorithms. Other related researches concern the localization of the eigenvalues of matrix polynomials.

Members: 
  • Dario Andrea Bini
  • Paola Boito
  • Leonardo Robol
Collaborators: 
  • G. Del Corso (Department of Computer Science, University of Pisa)
  • L. Gemignani (Department of Computer Science, University of Pisa)
  • F. Poloni (Department of Computer Science, University of Pisa)
  • Yuli Eidelman (Tel Aviv)
  • Israel Gohberg (Tel Aviv)
  • Vanni Noferini (Manchester)
  • V. Pan (New York)
  • Meisam Sharify (Manchester)
  • Francoise Tisseur (Manchester)
  • Raf Vandebril (Leuven)
Matrix Equations and Matrix Functions

Many problems from the real world and from Scientific Computing are modeled by matrix equations or by matrix functions. For instance, the celebrated algebraic Riccati equation which in the continuous-time models takes the form $XBX+AX+XD+C=0$, is related to the analysis of the stability of dynamical systems. Here, $A,B,C,D$ are given matrices of compatible sizes and $X$ is the unknown matrix. Quadratic equations like $AX^2+BX+C=0$ model damped vibration problems as well as stochastic models encountered in the analysis of queues. In the case of queues of the M/G/1 type the equations take the form $\sum_{i={-1}}^\infty A_i X^{i+1} = 0$ where a matrix analytic function over a suitable domain is involved.

The goal of the research in this area is to develop tools for designing fast and effective algorithms to solve this kind of equation. These equations, as well as similar ones, can be recast as generalized eigenvalue problems; for instance, the latter is related to finding $\lambda\in\mathbb C$ and $x\in \mathbb{C}^n$ such that $(\lambda^2 P+\lambda Q+R)x=0$ (quadratic eigenvalue problem). The techniques needed to combine the ones used for general nonlinear equations (multivariate Newton methods, fixed-point iterations) and eigenvalue problems (Schur decompositions, orthogonal reductions, rational approximations).

Matrix structures (such as entrywise nonnegativitysymmetry, and symplecticity) play a crucial role in all of this; they are needed for defining the solutions of these equations in the first place, and to ensure feasibility, accuracy, and computational efficiency of the numerical algorithms.

Applications of these equations include control and system theory, queuing theory and structured Markov chain modeling in applied probability, and time series estimation in statistics. It is useful to interface directly with researchers working in these application fields: the different points of view provide useful insight, and the algorithms can be better tailored to the needs of the practitioners.

Members: 
  • Dario Andrea Bini
  • Fabio Durastante
  • Beatrice Meini
Collaborators: 
  • Sophie Hautphenne (Melbourne)
  • C.-H. Guo (Regina)
  • B. Iannazzo (Perugia)
  • Guy Latouche (Bruxelles)
  • S. Massei (TU Eindhoven)
  • V. Mehrmann (Berlin)
  • G.T. Nguyen (Adelaide)
  • Federico Poloni (Department of Computer Science, Università di Pisa)
  • V. Ramaswami (AT&T Labs, New York)
  • G. Sbrana (Rouen)
  • C. Schroeder (Berlin)
  • T. Reis (Hamburg)
Matrix Geometric Means

In several applications, different sets of measurements produce different symmetric positive-definite matrices as a result; a natural problem is finding the most plausible correct value for the desired matrix. This corresponds to a form of averaging. The plain arithmetic mean $\frac{1}{n} (X_1 + X_2 + \ldots + X_n)$ is not always the best choice from this point of view.

The concept of the geometric mean of a set of positive numbers can be extended to the case of a set of positive definite matrices. However, this extension is not so trivial and, while for the case of two matrices there is a unique definition, in the case of several matrices there exists an infinite number of valid definitions.

The most general setting under which to study this problem is the one of Riemannian geometry: one gives a Riemannian scalar product on the manifold of symmetric positive-definite matrices and studies the point which minimizes the sum of squared distances from the given matrices (Cartan mean). This gives rise to a mean which is compatible in some sense with matrix inversions, much like the geometric mean in the scalar case.

In addition to the theoretical aspects, practical computation of these means is an interesting problem, a special case of optimization on manifolds. The classical multivariate methods from optimization need to be adapted to work on a generic manifold; one needs to consider the role of its tangent space and construct suitable maps to and from it.

This kind of mean is of great importance in applications, especially in engineering and in problems of radar detection.

Our goal is to provide a better understanding of the different concepts involved in this research, new definitions of mean which are better suited for the applicative models, and faster and more reliable algorithms for their computation.

Members: 
  • Dario Andrea Bini
  • Beatrice Meini
Collaborators: 
  • F. Poloni (Department of Computer Science, University of Pisa)
  • B. Jeuris (Leuven)
  • R. Vandebril (Leuven)
  • B. Iannazzo (UniPG)
Numerical Solution of Markov Chains

Many problems from the applications are modeled by Markov chains. Very often the set of the states is huge or even infinite. In these cases, customary techniques are not suited to solve this kind of problems.

The goal of this research area is the design and analysis of effective solution algorithms for infinite Markov chains, with special attention to the ones coming from queuing models. This goal is reached by developing theoretical tools relying on complex analysis, numerical analysis, and structured matrix computations.

Members: 
  • Dario Andrea Bini
  • Stefano Massei
  • Beatrice Meini
Collaborators: 
  • F. Poloni (Department of Computer Science, University of Pisa)
  • P. Favati (CNR Pisa)
  • C. H. Foh (Surrey)
  • G. Latouche (Bruxelles)
  • V. Ramaswami (AT&T Labs, New York)
  • B. Van Houdt (Antwerp)
  • M. Zukerman (Hong Kong)
Theory of Circuits

The aim is to analyze the dynamic behavior of linear networks containing models which depend polynomially on a set of parameters. The existence and uniqueness of the solution of such networks are investigated in the case of op-ampDistributional methods for the analysis of continuous-time and time-invariant linear systems are considered.

Members: 
  • Maurizio Ciampa
  • Marco Franciosi
Collaborators: 
  • M. Poletti

Members

Staff
NameSurname Links Personal Card
PaolaBoito[Google Scholar] [Mathscinet] [Orcid]
MaurizioCiampa[Mathscinet] [Orcid]
FabioDurastante[arXiv] [Google Scholar] [Mathscinet] [Orcid]
StefanoMassei[Google Scholar] [Mathscinet] [Orcid]
BeatriceMeini[Google Scholar] [Mathscinet] [Orcid]
LeonardoRobol[Google Scholar] [Mathscinet] [Orcid]
Postdoctoral Fellows

Presently, there are no postdoctoral fellows.

Ph.D. Students
NameSurname Links Personal Card
AlbertoBucci
External Collaborators
NameSurname Links Personal Card
Dario AndreaBini[Google Scholar] [Mathscinet] [Orcid]

Grants

Current
  • Analisi di reti complesse: dalla teoria alle applicazioni (Progetti di Ricerca di Ateneo (PRA) 2020 - 2021)

    Coordinator of the Research Unit: Federico Giovanni Poloni

    Members of the Research Unit: Leonardo Robol, Beatrice Meini, Paola Boito

    Project period: 07/07/2020 - 31/12/2022

Past
  • Project Metodi low-rank per problemi di algebra lineare con struttura data-sparse (INdAM/GNCS Project)

    Coordinator of the Research Unit: Leonardo Robol

    Members of the Research Unit: Dario A. Bini, Beatrice Meini, Fabio Durastante, Paola Boito

    Project period: 01/01/2021 - 31/12/2021

Visitors

Current
First Name Last Name Affiliation Building Office
Mariarosa Mazza Università dell'Insubria Ex-Albergo Piano 2, 21
Past
2022
First Name Last Name Affiliation
Mariarosa Mazza Università dell'Insubria
Aaron Melman Santa Clara University
Back to top