Book contents
- Frontmatter
- Contents
- Preface
- Acknowledgements
- 1 Introduction
- 2 Metrics of performance
- 3 Average performance and variability
- 4 Errors in experimental measurements
- 5 Comparing alternatives
- 6 Measurement tools and techniques
- 7 Benchmark programs
- 8 Linear-regression models
- 9 The design of experiments
- 10 Simulation and random-number generation
- 11 Queueing analysis
- Appendix A Glossary
- Appendix B Some useful probability distributions
- Appendix C Selected statistical tables
- Index
6 - Measurement tools and techniques
Published online by Cambridge University Press: 15 December 2009
- Frontmatter
- Contents
- Preface
- Acknowledgements
- 1 Introduction
- 2 Metrics of performance
- 3 Average performance and variability
- 4 Errors in experimental measurements
- 5 Comparing alternatives
- 6 Measurement tools and techniques
- 7 Benchmark programs
- 8 Linear-regression models
- 9 The design of experiments
- 10 Simulation and random-number generation
- 11 Queueing analysis
- Appendix A Glossary
- Appendix B Some useful probability distributions
- Appendix C Selected statistical tables
- Index
Summary
‘When the only tool you have is a hammer, every problem begins to resemble a nail.’
Abraham MaslowThe previous chapters have discussed what performance metrics may be useful for the performance analyst, how to summarize measured data, and how to understand and quantify the systematic and random errors that affect our measurements. Now that we know what to do with our measured values, this chapter presents several tools and techniques for actually measuring the values we desire.
The focus of this chapter is on fundamental measurement concepts. The goal is not to teach you how to use specific measurement tools, but, rather, to help you understand the strengths and limitations of the various measurement techniques. By the end of this chapter, you should be able to select an appropriate measurement technique to determine the value of a desired performance metric. You also should have developed some understanding of the trade-offs involved in using the various types of tools and techniques.
Events and measurement strategies
There are many different types of performance metrics that we may wish to measure. The different strategies for measuring the values of these metrics are typically based around the idea of an event, where an event is some predefined change in the system state. The precise definition of a specific event is up to the performance analyst and depends on the metric being measured. For instance, an event may be defined to be a memory reference, a disk access, a network communication operation, a change in a processor's internal state, or some pattern or combination of other subevents.
- Type
- Chapter
- Information
- Measuring Computer PerformanceA Practitioner's Guide, pp. 82 - 110Publisher: Cambridge University PressPrint publication year: 2000