please review our online load testing service - loadimpact.com
jrockway: Very nice.  Are you guys using any off-the-shelf tools for the load testing, or is it all custom? (and if so, what language?  Erlang?)Also, is there a way to simulate more than 5000 users?