Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-mlc7c Total loading time: 0 Render date: 2024-11-19T06:46:31.708Z Has data issue: false hasContentIssue false

3 - All measures of performance are subjective: More evidence on US federal agencies

Published online by Cambridge University Press:  22 September 2009

Gene A. Brewer
Affiliation:
Associate Professor of Public Administration and Policy University of Georgia School of Public and International Affairs
George A. Boyne
Affiliation:
Cardiff University
Kenneth J. Meier
Affiliation:
Texas A & M University
Laurence J. O'Toole, Jr.
Affiliation:
University of Georgia
Richard M. Walker
Affiliation:
The University of Hong Kong
Get access

Summary

Introduction

This chapter has twin aims. First, I address the important matter of measuring organizational performance and argue that it is a socially-constructed concept; thus, all measures of performance are subjective. I then propose a framework to evaluate such measures. This framework consists of three criteria: validity, reliability, and sensitivity. A perceptual measure of organizational performance is introduced, and this measure is shown to satisfy these criteria as well or better than most measures. However, perceptual measures are vulnerable to common source and related bias. Two ways to assess the viability of this threat are suggested and demonstrated.

Second, this perceptual measure of organizational performance is utilized in an empirical analysis. I test a hybrid model that predicts organizational performance in the twenty-two largest federal agencies using data from the 2000 Merit Principles Survey, US Merit Systems Protection Board. This model features supervisory management and several related constructs as prominent variables. The findings show that management matters a great deal. Frontline supervisors play an important role in organizational performance, and supervisory management is an important determinant of high performance in federal agencies. High performing agencies also tend to have skillful upper-level managers, strong cultures that value employees and emphasize the importance and meaningfulness of the agency's work, and policies that empower those employees. These agencies also tend to have a strong performance orientation, and they strive for workforce diversity.

Type
Chapter
Information
Public Service Performance
Perspectives on Measurement and Management
, pp. 35 - 54
Publisher: Cambridge University Press
Print publication year: 2006

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Boyne, G. A. (2003) ‘Sources of public service improvement: A critical review and research agenda’, Journal of Public Administration Research and Theory, 13: 367–394.CrossRefGoogle Scholar
Boyne, G. A. and Walker, R. M. (2002) ‘Total quality management and performance: An evaluation of the evidence and lessons for research on public organizations’, Public Performance and Management Review, 26: 111–131.CrossRefGoogle Scholar
Bozeman, B. (2000) Bureaucracy and red tape. Upper Saddle River, NJ: Prentice Hall.Google Scholar
Brewer, G. A. (2003) ‘When core values and missions collide: Gut-wrenching change in the US Department of Agriculture’. Paper presented at the Seventh Public Management Research Conference, Georgetown University, 9–11 October.
Brewer, G. A. (2005) ‘In the eye of the storm: Frontline supervisors and federal agency performance’, Journal of Public Administration Research and Theory, 15: 505–527.CrossRefGoogle Scholar
Brewer, G. A. and Lee, S. Y. (2005) ‘Federal agencies in transition: Assessing the impact on federal employee job satisfaction and performance’. Paper presented at the Eighth Public Management Research Conference, University of Southern California – Los Angeles, 29 September–1 October.
Brewer, G. A. and Selden, S. C. (2000) ‘Why elephants gallop: Assessing and predicting organizational performance in federal agencies’, Journal of Public Administration Research and Theory, 10: 685–711.CrossRefGoogle Scholar
Coggburn, J. D. and Schneider, S. K. (2003) ‘The quality of management and government performance: An empirical analysis of the American states’, Public Administration Review, 63: 206–213.CrossRefGoogle Scholar
Gore, A. (1993) Creating a government that works better and costs less: The report of the National Performance Review. Washington, DC: US Government Printing Office.Google Scholar
Hale, J. (2003) Performance-based management: What every manager should do to get results. San Francisco: Jossey-Bass.Google Scholar
Harman, H. H. (1967) Modern factor analysis. Chicago: The University of Chicago Press.Google Scholar
Kim, S. (2005) ‘Individual-level factors and organizational performance in government organizations’, Journal of Public Administration Research and Theory, 15: 245–261.CrossRefGoogle Scholar
Kurland, N. B. and Egan, T. D. (1999) ‘Public v private perceptions of formalization, outcomes, and justice’, Journal of Public Administration Research and Theory, 9: 437–458.CrossRefGoogle Scholar
Light, P. C. (1995) Thickening government: Federal hierarchy and the diffusion of accountability. Washington, DC: The Brookings Institution.Google Scholar
Light, P. C. (2002) The troubled state of the federal public service. Washington, DC: The Brookings Institution.Google Scholar
Lynn, L. E. Jr., Heinrich, C. J. and Hill, C. J. (2000) Governance and performance: New perspectives. Washington, DC: Georgetown University Press.Google Scholar
Meier, K. J. and Brudney, J. L. (1993) Applied statistics for public administration, 3rd edn. Belmont, CA: Wadsworth Publishing Co.Google Scholar
Meier, K. J. and O'Toole, L. J. Jr. (2002) ‘Public management and organizational performance: The effect of managerial quality’, Journal of Policy Analysis and Management, 21: 629–643.CrossRefGoogle Scholar
Meier, K. J. and O'Toole, L. J. Jr. (2004) ‘Unsung impossible jobs: The politics of public management’. Paper presented at the Annual Meeting of the American Political Science Association, Chicago, IL.
National Academy of Public Administration (1997) Managing succession and developing leadership: Growing the next generation of public service leaders. Washington, DC: National Academy of Public Administration.
National Academy of Public Administration (2002) The 21st century federal manager: A study of changing roles and competencies: Preliminary research findings, Report 1 of the 21st Century Federal Manager Series, Washington, DC: National Academy of Public Administration.
National Academy of Public Administration (2003) First-line supervisors in the federal service: Their selection, development, and management, Report 2 of the 21st Century Federal Manager Series, Washington, DC: National Academy of Public Administration.
National Academy of Public Administration (2004) Final report and recommendations: The 21st Century Federal Manager Series. Washington, DC: National Academy of Public Administration.
National Commission on Terrorist Attacks Upon the United States (2004) The 9/11 Commission report: Final report of the National Commission on Terrorist Attacks Upon the United States. New York: Norton.
National Commission on the Public Service (2003) Urgent business for America: Revitalizing the federal government for the 21 st Century. Washington, DC: National Commission on the Public Service.
National Partnership for Reinventing Government and the US Office of Personnel Management (2000) Government-wide employee survey. Washington, DC: National Partnership for Reinventing Government and the US Office of Personnel Management.
Partnership for Public Service (2002) Mid-career hiring in the federal government: A strategy for change. A Report by The Partnership for Public Service, Washington DC: The Partnership for Public Service.
Podsakoff, P. M. and Organ, D. W. (1986) ‘Self-reports in organizational research: Problems and prospects’, Journal of Management, 12: 531–544.CrossRefGoogle Scholar
Podsakoff, P. M., Todor, W. D., Grover, R. A. and Huber, V. L. (1984) ‘Situational moderators and leader reward and punishment behaviors: Fact or fiction?’, Organizational Behavior and Human Performance, 34: 21–63.CrossRefGoogle ScholarPubMed
Quinn, R. E. and Rohrbaugh, J. (1983) ‘A spatial model of effectiveness criteria: Towards a competing values approach to organizational analysis.’ Management Science, 29: 363–377.CrossRefGoogle Scholar
Rainey, H. G. (2003) Understanding and managing public organizations. 3rd edn. San Francisco: Jossey-Bass.Google Scholar
Rainey, H. G. and Steinbauer, P. (1999) ‘Galloping elephants: Developing elements of a theory of effective government organizations’, Journal of Public Administration Research and Theory, 9: 1–32.CrossRefGoogle Scholar
Rucci, A. J., Kirn, S. P. and Quinn, R. T. (1998) ‘The employee-customer profit chain at Sears’, Harvard Business Review, 76 (1): 83–97.Google Scholar
Selden, S. C. and Sowa, J. E. (2004) ‘Testing a multi-dimensional model of organizational performance: Prospects and problems’, Journal of Public Administration Research and Theory, 14: 395–416.CrossRefGoogle Scholar
US Department of Labor (1992) Government as a high performance employer: A SCANS report for America 2000. Report of The Secretary's Commission on Achieving Necessary Skills. Available at: www.ttrc.doleta.gov/SCANS/Govhpe.htm
US General Accounting Office (2000). Human capital: Managing human capital in the 21st century, GAO/T-GGD-00-77. Washington, DC: U.S. General Accounting Office.
US Merit Systems Protection Board (1992) Federal first-line supervisors: How good are they?Washington, DC: USMerit Systems Protection Board.
US Merit Systems Protection Board (1998) Federal supervisors and strategic human resources management. Washington, DC: US Merit Systems Protection Board.
US Merit Systems Protection Board (1999) Federal supervisors and poor performers. Washington, DC: US Merit Systems Protection Board.
US Merit Systems Protection Board (2001) Merit principles survey 2000. Washington, DC: US Merit Systems Protection Board.
US Merit Systems Protection Board (2003) The federal workforce for the 21st century: Results of the merit principles survey 2000. Washington, DC: US Merit Systems Protection Board.
US Office of Management and Budget (2001) The President's management agenda FY 2002. Available at: www.whitehouse.gov/omb/budget/fy2002/mgmt.pdf
US Office of Personnel Management (2001) Supervisors in the federal government: A wake-up call. Washington, DC: US Office of Personnel Management.
Walker, R. M. and Boyne, G. A. (2006) ‘Public management reform and organizational performance: An empirical assessment of the UK Labour Government's public service improvement strategy’, Journal of Policy Analysis and Management, 25: 371–394.CrossRefGoogle Scholar
Wall, T. B, Michie, J., Patterson, M., Wood, S. J., Sheehan, M., Clegg, C. W. and West, M. (2004) ‘On the validity of subjective measures of company performance’, Personnel Psychology, 57: 95–118.CrossRefGoogle Scholar
Wilson, J. Q. (1989) Bureaucracy: What government agencies do and why they do it. New York: Basic Books.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×