Most high scale performance engagements require a blend of sound project management processes and deep analytical profiling of system logs. Many customers do not anticipate the level of preparation and tuning required to reach their desired throughput and latency goals. Even after an engagement, most customers cannot recall the history of the engagement and level of detail that went into planning, deploying, debugging, tuning and profiling the system.
One tool that I have found useful is a visualization of combined project data and performance test outcomes into a single summary view of the scope of the project. A sample graphic is embedded to the right. Click on the graphic, and zoom in to full size on your browser.