Quantum tensor product closer to Kronecker product?

Question

Coming more from a computer science background, I never really studied tensor products, covariant/contravariant tensors etc. So until now, I was seeing the "tensor product" operation mostly as (what appears to be) a Kronecker product between the matrix representation (in some fixed basis) of my vector/linear operator, i.e. if I have two vectors/matrices
$$A = begin{pmatrix}a_{11} & a_{12} & cdots  a_{21} & a_{22} & cdots  vdotsend{pmatrix}$$
$$B = begin{pmatrix}b_{11} & b_{12} & cdots  b_{21} & b_{22} & cdots  vdotsend{pmatrix}$$
Then:
$$A otimes B = begin{pmatrix}a_{11}B & a_{12}B & cdots  a_{21}B & a_{22}B & cdots  vdotsend{pmatrix} $$
i.e.
$$A otimes B = begin{pmatrix}
a_{11}b_{11} & a_{11} b_{12} & cdots & a_{12}b_{11} & a_{12}b_{12} & cdots  a_{11} b_{21} & a_{11} b_{22} & cdots  & a_{12}b_{21} & a_{12}b_{22} & cdots 
vdots & vdots & & vdots & vdots 
a_{21}b_{11} & a_{21} b_{12} & cdots & a_{22}b_{11} & a_{22}b_{12} & cdots  a_{21} b_{21} & a_{21} b_{22} & cdots  & a_{22}b_{21} & a_{22}b_{22} & cdots 
vdots & vdots & & vdots & vdots end{pmatrix}
$$
In particular, if we consider $|0rangle = begin{pmatrix}1end{pmatrix}$ and $|1rangle = begin{pmatrix}01end{pmatrix}$, then $|0rangle otimes |1rangle = begin{pmatrix}01end{pmatrix}$, i.e. $|0rangle otimes |1rangle$ is a vector.
Now, if I look at the tensor product webpage of wikipedia, they seem to define $v otimes w colon= v w^T$, i.e. $v otimes w$ is a matrix (ok, the matrix is just a reshape of the vector obtained by the Kronecher product so both of them are isomorphic, but in term of "type" isn't it a bit strange to define it like that?). But on the other hand, when $v$ and $w$ are matrices, we are back to the Kronecher product.
So here is my question: why do they define the tensor product like that for vector? Is there different "kinds" of tensors? How are they linked with tensors used in physics?

benrg · Accepted Answer

The tensor product of two objects with $m$ and $n$ components is an object with $mn$ components that consists of the pairwise products of the components of the inputs. The Kronecker product and the $v w^T$ product (vector outer product) are both tensor products by that definition.
The reason for first defining a tensor product by matrix multiplication in the Wikipedia article is probably pedagogical: most readers will be familiar with matrix multiplication, and with that example under their belt they might have an easier time with the Kronecker product.
The tensor product of objects with $k$ and $ell$ indices should naturally have $k+ell$ indices. The vector outer product combines two 1-index vectors into a 2-index matrix, but the Kronecker product has to encode its 2+2 input indices into 2 output indices because matrices only support two indices. For that reason I'd say that the outer product is the more natural tensor product on vectors.
In the explicit-index tensor notation used in general relativity and particle physics, there is no operation of "matrix multiplication" and you instead always write it out explicitly. Instead of $M=NP$ you write $M_{ac} = sum_b N_{ab} P_{bc}$, or just $M_{ac} = N_{ab} P_{bc}$ where the doubling of $b$ signals that it should be summed over. There's also no Kronecker product; you instead just generalize the outer product and use $k+ell$ indices. Instead of $|ψ'rangle = (Iotimes Hotimes I)|ψrangle$ you'd write $ψ'_{ab'c} = H_{b'b} ψ_{abc}$. Of course, the disadvantage of this system is you have to write out a lot of indices. (And, in quantum computing, the fact that you'd be the only one using it.)

DaftWullie · Answer

In quantum computing, we compute the tensor product exactly as you specify. This includes the case of taking a tensor product with two vectors.
Now, it is also true that $|psiranglelanglephi|$ can be thought of as a tensor product between $|psirangle$ and $langlephi|$. But in QC we would never define the tensor product between $|psirangle$ and $|phirangle$ to be that.

Quantum tensor product closer to Kronecker product?

2 Answers

Add your own answers!

Ask a Question