Because the summation operator without indices is designed to work only with vectors and ranges, not with matrices.
It's been that way in Mathcad also:

It also doesn't accept pure numbers:

But I would fully agree with you that there is no compelling reason to limit the summation operator in this way. Especially because the mean function accepts all:

Luc