I've always wondered why processors stopped at 32 registers. It's by far the fastest piece of the machine, why not just make bigger processors with more registers? Wouldn't that mean less going to the RAM?
Why does a processor have 32 registers?
computer architecture
First, not all processor architectures stopped at 32 registers. Almost all the RISC architectures that have 32 registers exposed in the instruction set actually have 32 integer registers and 32 more floating point registers (so 64).  (Floating point add uses different registers than integer add.)  The SPARC architecture has register windows.  On the SPARC you can only access 32 integer registers at a time, but the registers act like a stack and you can push and pop new registers 16 at a time.  The Itanium architecture from HP/Intel had 128 integer and 128 floating point registers exposed in the instruction set.  Modern GPUs from NVidia, AMD, Intel, ARM and Imagination Technologies, all expose massive numbers of registers in their register files.  (I know this to be true of the NVidia and Intel architectures, I am not very familiar with the AMD, ARM and Imagination instruction sets, but I think the register files are large there too.)Second, most modern microprocessors implement register renaming to eliminate unnecessary serialization caused by needing to reuse resources, so the underlying physical register files can be larger (96, 128 or 192 registers on some machines.)  This (and dynamic scheduling) eliminates some of the need for the compiler to generate so many unique register names, while still providing a larger register file to the scheduler.There are two reasons why it might be difficult to further increase the number of registers exposed in the instruction set.  First, you need to be able to specify the register identifiers in each instruction.  32 registers requires a 5 bit register specifier, so 3-address instructions (common on RISC architectures) spend 15 of the 32 instruction bits just to specify the registers.  If you increased that to 6 or 7 bits, then you would have less space to specify opcodes and constants.  GPUs and Itanium have much larger instructions.  Larger instructions comes at a cost: you need to use more instruction memory, so your instruction cache behavior is less ideal.The second reason is access time.  The larger you make a memory the slower it is to access data from it.  (Just in terms of basic physics: the data is stored in 2-dimensional space, so if you are storing $n$ bits, the average distance to a specific bit is $O(\sqrt{n})$.)  A register file is just a small multi-ported memory, and one of the constraints on making it larger is that eventually you would need to start clocking your machine slower to accommodate the larger register file.  Usually in terms of total performance this is a lose.  