mod_proxy for Apache?
brk: When I was involved in a project that had a similar requirement, haproxy is what I used.  It was a simple, lightweight, flexible daemon that could run on a mid-grade box quite happily.  I looked at mod_proxy at the time,but this was almost 2 years ago, so a lot has changed since then, I'm sure.