PMT replacement (again)

TrueSpeed is the best choice for performance metrics. But if for some reason you can't use it, here are a couple of options that I've personally used:

 

HP LoadRunner (formerly Mercury). It's great tool, very expensive but you can download a eval version that will simulate 10 concurrent users and will simulate full user experiences.

 

Curl-Loader : Free, opensource and very extensible. It can also simulate real user experience. The configuration and setup demands some unix and programming knowhow and the reporting isn't nearly as pretty or functional as TrueSpeed.

 

Borland Silk Performer: Also very pricey. I've used this for sustained developement cycles and is probably my favorite. It's different from the others in that you place a Silk Server(s), in your data center or staging environment and control it from desktop clients. This doesn't *exactly* meet your needs though, as it is more designed for load testing web servers, applications, databases, etc, and doesn't focus as much as full user experience.

 

 

Here's a decent list of performance testing tools, most of which I've never used:

 

http://en.wikipedia.org/wiki/Category:Load_testing_tools