Matrices
The purpose of this post is to explain matrix multiplication, the trace and the transpose in terms of duality and tensor products.
Let
be a finite dimensional vector space, and let
be its dual. We are interested in the two vector spaces
and
. On account of the duality we have a map:

with the property that for any basis
of
there exists a unique dual basis
of
such that:
![\mathrm{ev} [ e^j \otimes e_i ] = \begin{cases}<br />
1 & \text{if i = j} \\<br />
0 & \text{otherwise}<br />
\end{cases}](http://analogical-engine.com/wordpress/wp-content/cache/tex_e185912b214dc8fd6c80da37ccb53717.png)
We also have a map:

As vector spaces
and
are naturally isomorphic:

Now, given a matrix:

We can either think of it as a vector in
and write it as:

or we can think of it as a vector in
and write it as:

Here we are making use of the physicists summation convention. In the first interpretation the usual trace operator is given by
while in the second it is given by
.
It is possible to define a multiplication on
via:
![A . B = (1 \otimes \mathrm{ev} \otimes 1) [ A \otimes B ]](http://analogical-engine.com/wordpress/wp-content/cache/tex_b64044d8aa1a634e625ac3c491c3da07.png)
Similarly, it is also possible to define a multiplication on
via:

Making use of the notation
, we have:
![<br />
\begin{align*}<br />
E_i^{\;j} . E_k^{\;l} & = (1 \otimes \mathrm{ev} \otimes 1)[ e_i \otimes e^j \otimes e_k \otimes e^l ] \\<br />
& = \mathrm{ev}[ e^j \otimes e_k] e_i \otimes e^l \\<br />
& = \begin{cases}<br />
E_i^{\;l} & \text{ if j = k } \\<br />
0 & \text{ otherwise}<br />
\end{cases}<br />
\end{align*}<br />](http://analogical-engine.com/wordpress/wp-content/cache/tex_3c81cecc28f6fa05660465ff8249622d.png)
Similarly, making use of the notation
, we have:
![<br />
\begin{align*}<br />
E_{\;i}^j . E_{\;k}^l & = (1 \otimes \mathrm{ev}^* \otimes 1)[ e^j \otimes e_i \otimes e^l \otimes e_k ] \\<br />
& = \mathrm{ev}^*[ e_i \otimes e^l] e^j \otimes e_k \\<br />
& = \begin{cases}<br />
E_{\;k}^j & \text{ if i = l } \\<br />
0 & \text{ otherwise}<br />
\end{cases}<br />
\end{align*}<br />](http://analogical-engine.com/wordpress/wp-content/cache/tex_37a3656c8a75fb94bf88a62f7602f4b8.png)
From this we observe the following:

In conclusion, a matrix may be thought of as either as an element of
or as an element from
. It is a question of interpretation.
The spaces
and
are isomorphic as vector spaces but anti-isomorphic as rings.