Can a basis for a vector space be made up of matrices instead of vectors? I'm sorry if this is a silly question. I'm new to the notion of bases and all the examples I've dealt with before have involved sets of vectors containing real numbers. This has led me to assume that bases, by definition, are made up of a number of $n$-tuples.
However, now I've been thinking about a basis for all $n\times n$ matrices and I keep coming back to the idea that the simplest basis would be $n^2$ matrices, each with a single $1$ in a unique position.
Is this a valid basis? Or should I be trying to get column vectors on their own somehow?

Yes, you are right. A vector space of matrices of size $n$ is actually, a vector space of dimension $n^2$. In fact, just to spice things up: The vector space of all


*

*diagonal, 

*symmetric and 

*triangular matrices of dimension $n\times n$


is actually a subspace of the space of matrices of that size. 
As with all subspaces, you can take any linear combination and stay within the space. (Also, null matrix is in all the above three).
Try to calculate the basis for the above 3 special cases: For the diagonal matrix, the basis is a set of $n$ matrices such that the $i^{th}$ basis matrix has $1$ in the $(i,i)$ and $0$ everywhere else.
Try to figure out the basis vectors/matrices for symmetric and triangular matrices.
