Hostname: page-component-745bb68f8f-5r2nc Total loading time: 0 Render date: 2025-01-27T19:29:30.609Z Has data issue: false hasContentIssue false
  • English
  • Français

The measurement of process and the role of information technology

Published online by Cambridge University Press:  05 December 2011

M. P. Ryan  and
W. Dodd
M. P. Ryan
Affiliation:
Directorate of Information Services (Health Systems Division), Edinburgh
W. Dodd
Affiliation:
Scottish Office Home and Health Department, Edinburgh
Get access

Synopsis

Process of care is the most immediate, relevant and susceptible to improvement of Donabedian's three elements of quality assurance. To place the study of process in context, the history of quality assurance in English-speaking countries is reviewed, with particular emphasis on the U.S.A. A range of methods are examined in detail and examples are provided to illustrate their strengths and weaknesses. Particular attention is paid to the use of explicit and implicit criteria. The importance of information technology in monitoring the process of care cannot be over-stated. Limited audit is possible with manual records but all substantial projects require computer support. The value of capturing data from operational systems rather than from dedicated projects is emphasised. Attention is drawn to the key importance of structured records and minimum data sets; these allow information to be pooled and process studies to be generalised. Examples are given of quality assurance projects which have used information technology. Finally potential future developments are reviewed with particular reference to clinical guidelines and computer-based clinical decision support systems.

Type
Research Article
Information
Proceedings of the Royal Society of Edinburgh, Section B: Biological Sciences , Volume 101: Quality Assurance in Medical Care , 1993 , pp. 31 - 53
Copyright
Copyright © Royal Society of Edinburgh 1993

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Allen, D. 1990. The acceptable face of audit. British Journal of Health Care Computing 7(10), 33–4.Google Scholar
Amini, A. 1991. Mixed results. British Journal of Health Care Computing 8(5), 30–1.Google Scholar
Aukett, J., Bennett, J. & Stevens, G. 1989. Quality assurance programme in a community dental service. International Journal of Healthcare Quality Assurance 2(2), 23–8.CrossRefGoogle Scholar
Baker, R. 1988. Practice Assessment and Quality of Care. Royal College of General Practitioners Occasional Paper 39. London: RCGPGoogle ScholarPubMed
Baker, R. 1991. Audit and standards in new general practice. British Medical Journal 303, 32–4.CrossRefGoogle ScholarPubMed
Ball, J. R. 1990. Practice guidelines and their role in quality assurance and cost effectiveness. Quality Assurance in Health Care 2, 31–6.Google Scholar
Bennett, J. & Stevens, G. 1987. A preliminary report on the introduction of clinician centred district wide approach to quality assurance in Brighton Health District, UK. In Berman, P. C. (Ed.) Conference on Management of patient care: professionals and managers in search of new alliances, pp. 178–92. Utrecht: National Hospital Institute of the Netherlands.Google Scholar
Bennett, J. & Walshe, K. 1990. Occurrence screening as a method of audit. British Medical Journal 300, 1248–51.CrossRefGoogle ScholarPubMed
Berwick, D. M. 1989. Continuous improvement as an ideal in healthcare. New England Journal of Medicine 320, 53–7.CrossRefGoogle Scholar
Berwick, D. M. 1992a. Quality management in the NHS: The doctor's role – I. British Medical Journal 304, 235–9.CrossRefGoogle ScholarPubMed
Berwick, D. M. 1992b. Quality management in the NHS: The doctor's role – II. British Medical Journal 304, 304–8.Google Scholar
Bjorn, J. C. & Cross, H. D. 1972. The problem-oriented private practice of medicine. Chicago: Modern Hospital Press.Google Scholar
Black, N. 1990a. Quality assurance of Medical Care. Journal of Public Health Medicine 12, 97–104.Google Scholar
Black, N. 1990b. A regional computerised surgical audit project. Quality Assurance in Health Care 2, 263–70.CrossRefGoogle ScholarPubMed
Borgiel, A. E. M., Williams, J. I., Anderson, G. M. et al. 1985. Assessing the quality of care in family physicians' offices. Canadian Family Physician 31, 853–62.Google Scholar
Bowden, D. & Walshe, K. 1991. When medical audit starts to count. British Medical Journal 303, 101–3.Google Scholar
British Standards Institution, BS5750. 1987. Part 1: Quality Stystems: Specification for Design/Development Production, Installation and Servicing, 1987.Google Scholar
Brook, R. H. 1973a. Quality of care assessment: a comparison of five methods of peer review. National Centre for Health Services Research and Development 1973. DHEW Publication No. HRA-74-3100.Google Scholar
Brook, R. H. 1973b. Critical issues in the assessment of quality of care and their relationship to HMOS. Journal of Medical Education 48, 183–210.Google Scholar
Brown, W. 1960. Exploration in management. London. William Heineman Ltd.Google Scholar
Callopy, B. T. 1990. Developing clinical indicators. The ACHS Care Evaluation Program. Australian Clinical Reviews 10, 83–5.Google Scholar
Callopy, B. T. 1991. Audit activities in Australia. British Medical Journal 303, 1523–5.Google Scholar
Chisholm, J. 1990. The Read Clinical Classification. British Medical Journal 300, 1092.Google Scholar
Clarkson, D. 1991. Working to rule. The British Journal of Healthcare Computing 8, 30–2.Google Scholar
Clinical Resource and Audit Group Medical Audit and Information Technology. 1990. Report of Working Group of the Clinical Resource and Audit Group (Chairman Dodd, W.). Edinburgh.Google Scholar
Clute, K. F. 1963. The general practitioner: a study of medical education and practice in Ontario and Nova Scotia. Toronto: University of Toronto Press.CrossRefGoogle Scholar
Codman, E. A. 1914. The product of a hospital. Journal of Surgery, Gynaecology and Obstetrics 18, 491–6.Google Scholar
Confidential Enquiry into Maternal Deaths in the United Kingdom 1985–7. Report. London: HMSO.Google Scholar
Crombie, I. K. & Davies, H. T. O. 1991. Computers in audit: servants or sirens? British Medical Journal 303, 403–4.CrossRefGoogle ScholarPubMed
Crosby, P. B. 1979. Quality is free: the art of making quality certain. New York: McGraw Hill.Google Scholar
Deming, W. E. 1986. Out of the crisis. Massachusetts Institute of Technology Centre for advanced Engineering Study.Google Scholar
Department of Health. 1989. Working for patients. London: HMSO.Google Scholar
Department of Health. 1993. Computerisation in GP practices. London: NHS Management Executive.Google Scholar
Department of Health and Social Security. 1983. National Health Service Management Enquiry (Chairman Griffiths, R.). London: HMSO.Google Scholar
Derry, J., Lawrence, M. & Griew, K. 1991. Auditing audits: the method of Oxfordshire Medical Advisory Group. British Medical Journal 303, 1247–9.CrossRefGoogle Scholar
Difford, F. 1990. Defining essential data for audit in general practice. British Medical Journal 300, 92–4.CrossRefGoogle ScholarPubMed
Donabedian, A. 1966. Evaluating the quality of medical care. Millbank Quarterly 44, 167–203.Google ScholarPubMed
Donabedian, A. 1980. Exploration in quality assessment and monitoring vol I. The definition of quality and approaches to its assessment. Ann Arbor, Michigan: Health Administration Press.Google Scholar
Donabedian, A. 1982. The criteria and standards for quality assessment and monitoring vol II. Ann Arbor, Michigan: Health Administration Press.Google Scholar
Donabedian, A. 1988. The quality of care – how can it be assessed? Journal of the American Medical Association, 260, 1743–8.CrossRefGoogle ScholarPubMed
Donabedian, A. 1989. Institutional and professional responsibilities in quality assurance. Health Care 1, 3–11.Google ScholarPubMed
Eddy, D. M. 1990. Clinical decision making: from theory to practice. The challenge. Journal of the American Medical Association 263, 287–90.CrossRefGoogle Scholar
Eraker, S. A. & Polister, P. 1982. How decisions are reached : physician and patient. Annals of Internal Medicine 97, 262–8.Google Scholar
Evans, E. 1991. Standard issue. British Journal of Health Care Computing 8, 20–1.Google Scholar
Fitzpatrick, R. 1991a. Surveys of patient satisfaction : I – Important general considerations. British Medical Journal 302, 887–9.Google Scholar
Fitzpatrick, R. 1991b. Surveys of patient satisfaction: II – Designing a questionnaire and conducting a survey. British Medical Journal 302, 1129–32.CrossRefGoogle ScholarPubMed
Fitzpatrick, T. B., Riedel, D. & Payne, B. C. 1962. Character and effectiveness of hospital use. Project 2. In McNerney, W. J. (Ed.) Hospital and medical economics, pp. 361–592. Chicago: Chicago Hospital Research and Educational Trust.Google Scholar
Fox, J., Glowinski, A. & O'Neil, M. 1987. The Oxford System of Medicine: A prototype system for primary care, pp. 213–6. Proceedings of European conference on Artificial Intelligence in Medicine, Marseille. Berlin: Springer Verlag.Google Scholar
Freeling, P. & Burton, R. H. 1982. General practitioners and learning by audit. Journal of the Royal College of General Practitioners 32, 231–7.Google ScholarPubMed
Fry, D. 1990. Systems of standards for community health services. Quality Assurance in Health Care 2, 59–67.CrossRefGoogle ScholarPubMed
Giraud, A. 1987. Financial constraints and information systems. In Shanahan, M. (Ed.) Proceedings of an International Symposium on Health Care, Paris 1986. p. 137. Chicago: Joint Commission on Accreditation of Hospitals.Google Scholar
Gottlieb, L. K., Margolis, C. Z. & Schoenbaum, S. C. 1990. Clinical practice guidelines at an HMO: development and implementation in a quality improvement model. Quality Review Bulletin 16, 80–6.Google Scholar
Greenfield, S., Lewis, C. E., Kaplan, S. H. & Davidson, M. B. 1975. Peer review by criteria mapping: for diabetes mellitus. Annals of Internal Medicine 83, 761–70.Google Scholar
Gruer, R., Gordon, D. S., Gunn, A. A. & Ruckley, C. V. 1986. Audit of surgical audit. Lancet i, 23–5.Google Scholar
Gumpert, R. & Lyons, C. 1990. Setting up a district audit programme. British Medical Journal 301: 162–5.CrossRefGoogle Scholar
Heath, D. A. 1990. Random review of hospital patient records. British Medical Journal 300, 651–2.Google Scholar
Imai, M. 1986. Kaizen: the key to Japanese competitive success. New York: McGraw Hill.Google Scholar
Irvine, D. H. 1990. Standards in general practice: the quality initiative revisited. British Journal of General Practice 40, 75–7.Google ScholarPubMed
Jesse, W. F. 1981. Approaches to improving the quality of care: organisational change. Quality Review Bulletin 1, 13–18.Google Scholar
Joint Commission on Accreditation of Healthcare Organisations. 1988. Accreditation manuals for hospitals. Chicago. JCAHO.Google Scholar
Jones, R. 1990. How do clinical systems measure up? British Journal of Health Care Computing 7, 28–30.Google Scholar
Juran, J. M. 1983. Managerial breakthrough. New York: McGraw Hill.Google Scholar
Kemple, T. J. & Hayter, S. R. 1991. Audit of diabetes in general practice. British Medical Journal 302, 451–3.CrossRefGoogle ScholarPubMed
Kessner, D. M., Kalk, C. E. & James, S. 1973. Assessing health quality – the case for tracers. New England Journal of Medicine 288, 189–94.CrossRefGoogle ScholarPubMed
Laffel, G. & Blumenthal, D. 1989. The case for using industrial quality management science in health care organisations. Journal of the American Medical Association, 262, 2869–73.CrossRefGoogle Scholar
Lee, R. I. & Jones, L. W. 1933. The Fundamentals of Good Medical Care. Committee on the Costs of Medical Care, Publication 22. Chicago: University of Chicago Press.Google Scholar
Lembcke, P. A. 1956. Medical auditing by scientific methods. Journal of the American Medical Association 162, 645–55.CrossRefGoogle ScholarPubMed
Lothian Hypertension Group. 1986. Guidelines in the management of hypertension in general practice. Working group of the Joint Committee on Integration in Patient Care (Royal College of Physicians of Edinburgh, Royal College of General Practitioners and the Faculty of Community Medicine) 2nd Edition, Edinburgh.Google Scholar
Lunn, J. N. & Mushlin, W. W. 1982. Mortality associated with anaesthesia. London: Nuffield Provincial Hospitals Trust.Google Scholar
Lyons, F. T. & Payne, B. C. 1975. The use of item importance weights in assessing physician performance with predetermined criteria indices. Medical Care 13, 432–9.CrossRefGoogle ScholarPubMed
Moores, B. 1988–1989. The need for medical audit. Journal of Management in Medicine 3, 323–9.CrossRefGoogle Scholar
Moss, F. & Smith, R. 1991. From audit to quality and beyond. British Medical Journal 303, 199–200.CrossRefGoogle ScholarPubMed
Mumford, E. 1991. Need for relevance in management information systems: what the NHS can learn from industry. British Medical Journal 302, 1587–90.CrossRefGoogle ScholarPubMed
Musen, M. A. & Van Der Lei, J. 1989. Knowledge engineering for clinical consultation programs: modeling the application area. Methods of Information in Medicine 28, 28–35.Google ScholarPubMed
NHS Management Executive Local voices. 1992. The views of local people in purchasing for health. London.Google Scholar
Nightingale, F. 1860. Proposals for a uniform plan of hospital statistics. London: International Statistics Congress.Google Scholar
North of England Study of Standards and Performance in General Practice. 1992. Medical audit in general practice: effects on doctors' clinical behaviour and the health of patients with common childhood conditions. British Medical Journal 304, 1480–8.Google Scholar
O'Dwyer, F. G., D'Alton, A. & Pearce, J. B. 1991. Adolescent self harm patients; audit of assessment in an accident and emergency department. British Medical Journal 303, 629–30.CrossRefGoogle Scholar
Payne, B. C. 1966. Hospital utilisation review manual. Ann Arbor: University of Michigan.Google Scholar
Pendleton, D., Schofield, T. & Marinker, M. (Eds.) 1986. In pursuit of quality. London: Royal College of General Practitioners.Google Scholar
Peterson, O. L., Andrews, L. P., Spain, R. S. et al. 1956. An analytical study of North Carolina general practice 1953–54. The Journal of Medical Education 31, 1–165.Google Scholar
Petrie, J. C. & McIntyre, N. 1979. The Problem Oriented Medical Record. Edinburgh: Churchill Livingstone.Google Scholar
Petrie, J. C., Webster, J., Jeffer, T. A. et al. 1989. Computer-assisted shared care: the Aberdeen Blood Pressure Clinic. Journal of Hypertension (Suppl.) 7, S 103–8.Google ScholarPubMed
Pringle, M., Robins, S. & Brown, G. 1985. Topic analysis: an objective measure of the consultation. British Medical Journal 290, 1789–91.CrossRefGoogle ScholarPubMed
Quam, L. 1989. Improving clinical effectiveness in the NHS: an alternative to the White Paper. British Medical Journal 299, 448–50.Google Scholar
Read, J. D. & Benson, T. J. R. 1986. Comprehensive coding. British Journal of Health Care Computing 3, 22–5.Google Scholar
Reerink, E. 1990a. Improving the quality of hospital services in the Netherlands. Quality Assurance in Health Care 2, 13–19.CrossRefGoogle ScholarPubMed
Reerink, E. 1990b. Defining quality of care: mission impossible? Quality Assurance in Health Care 2, 197–202.Google Scholar
Reerink, E. 1991. Arcadia revisited: quality assurance in hospital in The Netherlands. British Medical Journal 302, 1443–5.Google Scholar
Renwick, M. & Harvey, R. 1989. Quality assurance in hospitals: a digest. Australian Institute of Health.Google Scholar
Richards, J. 1991. Doctoring the system. The British Journal of Health Care Computing 8, 54–5.Google Scholar
Romm, F. J. & Putnam, S. M. 1981. The validity of the medical record. Medical Care 19, 310–5.CrossRefGoogle ScholarPubMed
Rooney, E. M. & Wilson, R. S. E. 1988. A quality management system for an outpatient clinic and service departments. International Journal of Health Care Quality Assurance 1, 13–28.Google Scholar
Rosenfeld, L. S. 1957. Quality of medical care in hospitals. American Journal of Public Health 47, 856–65.CrossRefGoogle ScholarPubMed
Royal College of General Practitioners. 1985a. Quality in General Practice. Policy Statement 2. London: RCGP.Google Scholar
Royal College of General Practitioners. 1985b. What sort of doctor? Assessing quality of care in general practice. London: RCGP.Google Scholar
Royal College of Physicians. 1989. Medical audit: a first report – what why and howl London: RCP.Google Scholar
Royal College of Surgeons. 1989. Guidelines to clinical audit in surgical practice. London: RCS.Google Scholar
Royce, R. & Sait, J. 1993. DRGs and the internal market. The British Journal of Health Care Computing 10 32–4.Google Scholar
Ryan, M. P., Buchan, I. C. & Buckley, E. G. 1979. Medical audit – a preliminary report from general practice. Journal of the Royal College of General Practitioners 29, 711–22.Google ScholarPubMed
Ryan, M. P. 1989. A system for general practice computing in Scotland. Health Bulletin 47, 110–19.Google ScholarPubMed
Selbmann, H. K. & Peitsch-Breitfeld, B. 1990. Hospital information systems and quality assurance. Quality Assurance in Health Care 2, 335–44.Google Scholar
Sheldon, M. G. 1982. Medical audit in general practice. Occasional Paper 20. London: Royal College of General Practitioners.Google ScholarPubMed
Smith, R. 1990. Medicines need for Kaizen. British Medical Journal 301, 679–80.CrossRefGoogle ScholarPubMed
Sunol, R., Delgado, R., Pacheco, M. V. & Baires, N. 1986. Methods to evaluate patient satisfaction. In Shanahan, M. (Ed.) Proceedings of an International Symposium on Health Care, pp. 83–6. Chicago: Joint Commission on Accreditation of Hospitals.Google Scholar
Taylor, M. W., Ritchie, L. D. & Taylor, R. J. 1990. General practice computing in Scotland. British Medical Journal 300, 170–2.Google Scholar
University of Aberdeen. 1992. Computing in general practice. Scottish Survey – 1992. Department of General Practice.Google Scholar
Van Der Lei, J. & Musen, M. A. 1990. A model for critiquing based on automated medical records. Erasmus University, Department of Medical Informatics Rotterdam. Technical Report MIEUR- 90–6.Google Scholar
Van Der Lei, J., Van Der Heijden, P. & Boon, W. M. 1989. Critiquing expert critiques. Issues for the development of computer based monitoring in Primary Care. In: Proceedings of Sixth World Conference on Medical Information, Singapore, pp. 106–10. Amsterdam: North Holland Publishing Company.Google Scholar
Verma, R. & Mann, M. 1990. Auditing numbers. British Journal of Health Care Computing 7, 18.Google Scholar
Verby, J. E., Holden, P. & Davis, R. H. 1979. Peer review of consultations in primary care: the use of audio visual recordings. British Medical Journal 1, 1686–8.CrossRefGoogle Scholar
Vuori, H. 1986. Patient satisfaction: attribute or indicator? In Shanahan, M. Proceedings of an International Symposium on Health Care, pp. 70–3. Chicago: Joint Commission on Accreditation of Hospitals.Google Scholar
Vuori, H. 1989. Implementation of a quality assurance in Europe. Journal of Management in Medicine 4, 119–25.CrossRefGoogle Scholar
Watkins, C. J. 1981. The measurement of the quality of general practitioner care. Occasional Paper 15. London: Royal College of General Practitioners.Google ScholarPubMed
Weed, L. L. 1971. Medical records, medical education and patient: the Problem Oriented Record as a basic tool. Case Western Reserve Press.Google ScholarPubMed
WHO Working Group. 1989. The principles of quality assurance. Quality Assurance in Health Care 1, 79–95.CrossRefGoogle Scholar
Williams, J. G., Kingham, M. J., Morgan, J. M. & Davies, A. B. 1990. Retrospective review of hospital patient records. British Medical Journal 300, 991–3.CrossRefGoogle ScholarPubMed
Williamson, J. 1991. Providing quality care. Health Services Management (FEB) 18–23.Google Scholar
Williamson, J. W. 1978. Formulating priorities for quality assurance activity and its application. Journal of the American Medical Association 239, 631–7.CrossRefGoogle ScholarPubMed
Working for Patients – Scotland. 1989. Medical audit. Scottish Working Paper 2. Edinburgh: HMSO.Google Scholar
Yoong, A. F. E., Lim, J., Hudson, C. N. & Chard, T. 1992. Audit of compliance with antenatal protocol. British Medical Journal 305, 1184–6.CrossRefGoogle Scholar
Young, D., Chapman, T. & Poile, C. 1990. Physician reveal thyself. British Journal of Health Care Computing 7, 16–2.Google Scholar