TransWikia.com

Least Square fit of a system of equations

Computational Science Asked by sbp on February 10, 2021

I’ve a matrix equation $bar z^{(r)}(k + 1) = bar{DF} ~ bar z^{(r)}(k)$. Now the $bar z$‘s and $bar{DF}$ are $d times d$ matrices. Now $bar{DF} = begin{pmatrix}
0 & 1 & 0 & 0 & cdots & 0
0 & 0 & 1 & 0 & cdots & 0
vdots & & & &
0 & 0 & 0 & 0 & cdots & 1
DF_{d1} & DF_{d2} & DF_{d3} & DF_{d4} & cdots & DF_{dd}
end{pmatrix}$
.

So my matrix equation boils down to, $$bar z^{(r)}_{dj}(k+1) = bar{DF}_{dk}bar{z}^{(r)}_{kj}(k)$$.

There are $d$ unknowns and $d$ equations to solve them, and hence the problem can be solved. I know the $bar{z}$ matrices.

My question is how can I evaluate this $bar{DF}$ using least-square fit? My language of interest is Python, so pointers using numpy/scipy would be highly appreciated.

One Answer

Ok, now it's too long for a comment, so I can try to answer your question right away. Let's write your matrix $DF$ as $D+F$ where $D$ is a matrix with only the last row filled with unknowns and $F$ has as only non-zero entries ones on the first subdiagonal. Then your equation becomes

$$ z^{k+1} = (D + F) z^{k} rightarrow z^{k+1} - F z^{k} = D z^{k} $$ Writing it out element-wise leads to $$ (z^{k+1} - F z^{k})_{ij} = sum_{l=1}^d D_{il} z^{k}_{lj} $$ and due to the fact that only the last row of $D$ is nonzero this becomes (using the Kronecker-Delta) $$ (z^{k+1} - F z^{k})_{ij} = delta_{id} sum_{l=1}^d D_{dl} z^{k}_{lj} $$

You see that a solution can only exists if the first $(d-1)$ rows of $(z^{k+1} - F z^{k})_{ij}$ are zero anyways. Moreover, with your choice of $D$, you have no effect in these dimensions. This means that when you want to find a least-squares solution, you are basically minimizing in the last dimension only. I'm not sure whether this is what you want.

But let's asusme it is intended. Then, for the last row, as $(Fz^{k})_{dj} = 0$, one gets $$ z^{k+1}_{dj} = sum_{l=1}^d D_{dl} z^{k}_{lj} rightarrow sum_{l=1}^d (z^{k})^T_{jl} D_{dl} = z^{k+1}_{dj} $$ which is a linear equation for the unknown coefficients $D_{dl}$ with coefficient matrix $(z^{k})^T$, where $T$ means transpose, and right-hand side $z^{k+1}_{dj}$. And this you can solve with SciPy and whatever.

And again, what you get is a form of least square solution, but quite a special one where you solve in only one dimension exactly (at least if a solution exists), and do nothing in the all the other dimensions. (Put in geometrical terms: there is only one non-vanishing singular value of the matrix $DF$)

Answered by davidhigh on February 10, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP