Trail: PerformanceBenchmark

Performance Testing : PerformanceBenchmark

KnowledgeBase :: Categories :: PageIndex :: RecentChanges :: RecentlyCommented :: Login/Register

Performance Benchmark

Metrics gathered about system hardware, and supporting software, but NOT application code. For instance, Web server throughput and hits per second when accessing a large graphic can be determined through benchmark testing.

Compares the performance of new or unknown target-of-test to a known reference standard such as existing software or measurement(s) and industry standards.

A benchmark, or light load, scenario is generally a small community of users compared to the target load. This community of users much be large enough to approximate a reasonable sample of the entire user community model while still being significantly smaller than the expected system capacity, 15% of total expected user load is generally a good Benchmark volume. Executing Benchmark tests ensures that the testing environment behaves as expected under light load as well as validates that the scripts have been developed correctly.

Benchmarking compares the performance of a target product to a known reference standard such as software in production in the shop or industry standards. It is also possible to define a standard for
performance with early testing of a new product and then compare all further test results to this standard.

Benchmarking is useful in aiding us deploying applications which are up to their task, but there are many opportunities for benchmarking to go wrong. Here are some common 'gotchas' to watch out for when benchmarking:

A standard against which measurements or comparisons can be made. Benchmarks can include work loads, baseline systems, and system support environments.

A test in which a benchmark mix of demands in run against the system being tested.

Testing a system by comparing its behavior to another system (the benchmark).

There are no comments on this page. [Add comment]

Page History :: 2004-02-01 12:47:33 XML :: Owner: Roland Stens :: Search:
Valid XHTML 1.0 Transitional :: Valid CSS :: Powered by Wikka Wakka Wiki
Page was generated in 0.0120 seconds