>>11118010You're pretty much right that it's not very complicated, but I think only a rank (0,2) tensor can be represented as a matrix.
A tensor is a machine that eats vectors and returns tensors of lower rank, and if you feed it enough vectors (or dual vectors) then it will return a scalar, which is a rank-0 tensor.
