Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-4rdpn Total loading time: 0 Render date: 2024-11-06T03:54:59.896Z Has data issue: false hasContentIssue false

1 - Medical Image Perception

Published online by Cambridge University Press:  20 December 2018

Ehsan Samei
Affiliation:
Duke University Medical Center, Durham
Elizabeth A. Krupinski
Affiliation:
Emory University, Atlanta

Summary

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2018

1.1 Prominence of Medical Image Perception in Medicine

Medical images form a core portion of all the information a clinician utilizes to render diagnostic, treatment, and management decisions while a patient is under her/his care. The goal of this chapter is to provide a broad picture of the importance of medical image perception from a general healthcare enterprise perspective. Here we treat perception not only in terms of visual perception, though that is currently by far the most prominent method to interpret medical images, but also computational perception, where images are “read” and “understood” by computational algorithms.

Medical imaging has been primarily ascribed to the subspecialty of radiology, with about two billion radiological imaging exams performed worldwide every year. The images include a variety of exam types such as single-projection X-ray projections used in musculoskeletal, chest, and mammography applications; dynamic X-ray exams such as fluoroscopy, three-dimensional computed tomography (CT) and magnetic resonance imaging (MRI) exams; nuclear medicine emission images, and ultrasound. With the advent of digital imaging, multidetector CT, and protocol diversification in MRI, the number of radiology examinations has been increasing. The range of image types is also expanding rapidly with newer modalities of tomosynthesis (Dobbins et al., Reference Dobbins, McAdams, Sabol, Chakraborty, Kazerooni, Reddy, Vikgren and Bath2017; Gilbert et al., Reference Gilbert, Tucker and Young2016), hyperspectral (Guolan and Fei, Reference Guolan and Fei2014) and molecular imaging (Fei and Schuster, Reference Fei and Schuster2017; Liang et al., Reference Liang, Vo and Nguyen2017) all being used for numerous applications from identifying lesion margins during surgical removal to identifying cancer cells in the blood.

While imaging is the central technology behind the subspecialty of radiology, imaging today is playing an expanding and changing role beyond radiology and embraces other subspecialties including cardiology, radiation oncology, pathology, and ophthalmology, to name a few. Pathology used to be limited to the glass slide specimen “images” rendered by the microscope for the pathologist to view. With the advent of digital slide scanners in recent years and the preponderance of evidence supporting its feasibility, acceptance, equivalence to light microscopy, and cost efficiency (Bashshur et al., Reference Bashshur, Krupinski, Weinstein, Dunn and Bashshur2017), virtual slides are becoming more prevalent not only in telepathology applications but in everyday reading (Kaplan and Rao, Reference Kaplan and Rao2016; Weinstein et al., Reference Weinstein, Descour, Liang and Bhattacharyya2001). Clinical use is likely to accelerate with the recent approval by the US Food and Drug Administration (FDA) for marketing of whole slide imaging for review and interpretation of digital surgical pathology slides prepared from biopsied tissue (FDA, 2017). In many medical school and pathology residency programs (Christensen et al., Reference Christensen, Lee, Thrall, Powell, Chevez-Barrios and Long2017; Wilbur, Reference Wilbur2016), students are no longer required to purchase a microscope and box of glass specimen slides. They are simply purchasing a CD with directories of virtual slides to view as soft-copy images and learn from.

Ophthalmology has relied on images for years (mainly as 35-mm film prints or slides) for evaluating conditions such as diabetic retinopathy. With the advent of digital images and high-performance color displays, screening raters are increasingly using soft-copy images (Tan et al., Reference Tan, Dobson, Bartnik, Muir and Turner2017). Although most of the original applications were in diabetic retinopathy detection, teleophthalmology has expanded to include glaucoma, emergency eye care, and numerous other retinal diseases (Sim et al., Reference Sim, Mitry, Alexander, Mapani, Goverdhan, Aslam, Tufail, Egan and Keane2016). Telemedicine in general has opened up an entirely new area in which medical images are being acquired, transferred, and stored to diagnose and treat patients (Krupinski et al., Reference Krupinski, Nypaver and Poropatich2002). Specialties such as teledermatology, teleophthalmology, telewound/burn care, and telepodiatry are all using images on a regular basis for store-and-forward telemedicine applications. Real-time applications such as telepsychiatry, teleneurology, and telerheumatology similarly rely on video images for diagnostic and treatment decisions. In every case, issues that digital radiology has addressed for years are being addressed in these newer image-based clinical scenarios. For example, the development of standards for image acquisition and presentation (American Telemedicine Association Ocular Telehealth Special Interest Group, 2004; Badano et al., Reference Badano, Revie, Casertano, Cheng, Green, Kimpe, Krupinski, Susson, Skrovseth, Treanor, Boynton, Clunie, Flynn, Heki and Hewitt2015; McKoy et al., Reference McKoy, Antoniotti, Armstrong, Bashshur, Bernard, Bernstein, Burdick, Edison, Goldyne, Kovarik, Krupinski, Kvedar, Larkey, Lee-Keltner, Lipoff, Oh, Pak, Seraly, Siegel, Tejasvi and Whited2016; Pantanowitz et al., Reference Pantanowitz, Dickinson, Evans, Hassell, Henricks, Lennerz, Lowe, Parwani, Riben, Smith, Tuthill, Weinstein, Wilbur, Krupinski and Bernard2014; Theurer et al., Reference Theurer, Bashshur, Bernard, Brewer, Busch, Caruso, Coccaro-Word, Kemalyan, Leenknecht, McMillan, Pham, Saffle and Krupinski2017) and the impact of image quality on diagnostic decisions are key research and clinical implementation topics.

There are a number of ways to examine the pervasiveness of medical imaging. One approach used a few years ago is to examine the amount of money spent each year on healthcare and then portion out the amount devoted to medical imaging (Beam et al., Reference Beam, Krupinski, Kundel, Sickles and Wagner2006). Relying on 2004 data from the Centers for Medicare and Medicaid Services, approximately 16% of the gross domestic product (GDP) or $1.6T is allotted to national healthcare expenditures (www.cms.hhs.gov/home/rsds.asp). Medicare expenditures represent 17% of national healthcare expenditures, of which Part B (43%) accounts for the nonfacility or physician-related expenditures. Approximately 8% of Part B (or nearly $10B) constitutes physician-based imaging procedures. Imaging also accounts for over 40% of all hospital procedures reported in the discharge report, according to the Agency for Healthcare Research and Quality (www.ahrq.gov/data/hcup/). If, based on Medicaid Part B spending, one conservatively assumes that imaging procedures comprise only 8% of non-Medicaid Part B health spending, medical imaging in the USA is estimated to amount to $56B ($10B/17%/43%) or 0.5% of GDP. More recent studies (America’s Health Insurance Plans (AHIP), 2008; Glabman, Reference Glabman2005; Medicare Payment Advisory Commission (MEDPAC), 2014) place the cost of imaging in the USA at over $100B annually, despite recent trends toward stabilization of utilization (Dodoo et al., Reference Dodoo, Duszak and Hughes2013; Lee et al., Reference Lee, Duszak and Hughes2013).

Imaging technologies are extremely varied. Medical images can be grayscale or color, high-resolution and low-resolution, two-dimensional or multidimensional, hard-copy or soft-copy, uncompressed or compressed (lossy or lossless), acquired with everything from sophisticated dedicated imaging devices to off-the-shelf digital cameras. With the pervasiveness of imaging in modern medicine, there has been significant attention and interest in the technological aspects of imaging operations ranging from hardware features to software functionalities. What is less appreciated is the perceptual act underlying the interpretation of these images (Krupinski, Reference Krupinski2016; Manning et al., Reference Manning, Gale and Krupinski2005; Wolfe, Reference Wolfe2016). In order to impact patient care, an image must be perceived and interpreted (i.e., understood in the context of patient care) (Figure 1.1). If one assumes each of the one billion imaging examinations performed worldwide annually involves an average of four individual images per exam, one could compute, that on the average, 120 medical image perception events take place every second! This astounding frequency speaks further of the pervasiveness of medical image perception in healthcare enterprise.

Figure 1.1 As a fundamentally visual discipline, medical imaging requires psychophysical interpretation of the images to draw “meaning” from the viewing information and understand their clinical relevance.

The need for interpretation of medical images comes from the fact that medical images are not self-explanatory. In popular culture, a picture is “worth a thousand words,” reflecting the power and utility of images. Ironically, however, the interpretation of a medical image involves summarizing a multidimensional image into a few words, which is not necessarily an easy task (Bracamonte et al., Reference Bracamonte, Gibson, Klein, Krupinski and Weinstein2017; Ware et al., Reference Ware, Jha, Hoang, Baker and Wruble2017). That is necessary because medical images, like other complex and sometimes ambiguous images (Figure 1.2), by themselves do not deliver the certainty that they promise. This lack of certainty, which necessitates interpretation, stems from the nature of medical imaging. Visual interpretation is impacted by psychophysical processes involved, while computational interpretation is likewise impacted by image-processing methods. Medical images involve variety, where anatomical structures can camouflage a feature of clinical interest. That feature can have very low prevalence (in the case of screening), which impacts the psychology and processes of interpretation (Fanshawe et al., Reference Fanshawe, Phillips, Plumb, Helbren, Halligan, Taylor, Gale and Mallett2016; Littlefair et al., Reference Littlefair, Mello-Thoms, Reed, Pietryzk, Lewis, McEntee and Brennan2016). Added to those complexities, there are notable variations from case to case and a multiplicity of compounding abnormalities and related factors that the interpreter or the computational operator needs to accommodate for.

Figure 1.2 Detecting a subtle abnormality is somewhat similar in difficulty to identifying the dog in a popular visual illusion.

There are clearly a significant number of images interpreted in a variety of clinical specialties. As such, diagnostic accuracy cannot be defined independently of the interpretation, and any limitations or suboptimality in terms of how images are used can have a measurable impact on the diagnostic and therapeutic clinical decisions that they enable. Given a one-to-one link between an image and its interpretation, imaging technology alone can offer little in terms of patient care if the image is misinterpreted. The complexities of image interpretation can lead to interpretation errors. Clinicians do make mistakes in the interpretation of image data (Berlin, Reference Berlin2005, Reference Berlin2007; Waite et al., Reference Waite, Scott, Gale, Fuchs, Kolla and Reede2017a, Reference Waite, Kolla, Jeudy, Legasto, Macknik, Martinez-Conde, Krupinski and Reede2017b). Estimates in radiology alone suggest that in some areas there may be up to a 30% miss rate (omission errors) and an equally high false-positive rate. Errors can also occur in the recognition of an abnormality (e.g., whether a lesion is benign or malignant). Such errors can have significant impact on patient care due to delays or misdiagnoses. Other sources of error include satisfaction of search, cognitive bias, prevalence effects, presence of and information in a clinical history, fatigue, workload, level of training or experience, distractions and interruptions, and even ergonomic considerations (Waite et al., Reference Waite, Scott, Gale, Fuchs, Kolla and Reede2017a, Reference Waite, Kolla, Jeudy, Legasto, Macknik, Martinez-Conde, Krupinski and Reede2017b). What is less well appreciated is the prominent contribution of the inherent limitations of human perception to these errors. Image perception is the most prominent yet least appreciated source of error in diagnostic imaging. The prominence of imaging reading errors in malpractice litigation is an example of this ignorance.

The likelihood of error in the interpretation of those images emphasizes the need to understand how the clinician interacts with the information in an image during the interpretation process. Such an understanding enables us to determine how we can further improve decision making. That brings us to the science of medical image perception. Error is one reason to study medical image perception.

1.2 The Science of Medical Image Visual Perception

First and foremost, it is important to understand the nature and causes of interpretation error. For that objective, one needs to distinguish between errors that are visual in nature (estimated to amount to about 55% of the errors) because the clinician does an incomplete search of the image data (Giger et al., Reference Giger, Doi and MacMahon1988; Waite et al., Reference Waite, Scott, Gale, Fuchs, Kolla and Reede2017a, Reference Waite, Kolla, Jeudy, Legasto, Macknik, Martinez-Conde, Krupinski and Reede2017b) and those of a cognitive nature (45%), where an abnormality is recognized but the clinician makes a decision-making error in calling the case negative (Kundel et al., Reference Kundel, Nodine and Carmody1978). Visual errors are further subdivided into error where the clinician fails to look at the territory of the lesion (30%) (Kundel, Reference Kundel1975; Kundel et al., Reference Kundel, Nodine and Carmody1978) and those when he/she does not fixate on the territory for an adequate amount of time to extract the relevant lesion features (25%) (Carmody et al., Reference Carmody, Nodine and Kundel1980).

Contributing to interpretation errors are a host of psychophysical processes. Camouflaging of the abnormality by normal body features (so-called anatomical noise) is one of the main contributors to interpretation error. Masking of subtle lesions by normal anatomical structure is estimated to affect lesion detection threshold by an order of magnitude (Samei et al., Reference Samei, Flynn and Kearfott1997). Visual search is another important process, necessitated by the limited angular extent of the high-fidelity foveal vision of the human eye (Van der Gijp et al., Reference Van der Gijp, Ravensloot, Jarodzka, van der Schaaf, van der Schaaf, van Schaik and ten Cate2017; Wolfe et al., Reference Wolfe, Evans, Drew, Aizenman and Josephs2016). Preceded by a global impression or gist, visual search involves moving the eye around the image scene to closely examine the image details (Nodine and Kundel, Reference Nodine and Kundel1987). Studies on visual search have highlighted the prominent role of peripheral vision during the interpretation where there is an interplay between foveal and peripheral vision as the observer scans the scene (Kundel, Reference Kundel1975). As a result there are characteristic dwell times associated with correct and incorrect decisions that are influenced by the task and idiosyncratic observer search patterns (Kundel et al., Reference Kundel, Nodine and Krupinski1989). Satisfaction of search is yet another contributing factor to errors where, once an abnormal pattern is recognized, it takes additional diligence on the part of the clinician to look for other possible abnormalities within an image (Berbaum et al., Reference Berbaum, Franken and Dorfman1989; Smith, Reference Smith1967; Tuddenham, Reference Tuddenham1962, Reference Tuddenham1963). Studies have explored the impact of expertise and prior knowledge in that behavior, as well as the use of tools such as systematic search patterns and checklists to alleviate (Berbaum et al., Reference Berbaum, Krupinski, Schartz, Caldwell, Madsen, Hur, Laroia, Thompson, Mullan and Franken2016; Kok, Reference Kok, Jarodzka, de Bruin, BinAmir, Robben and van Merrienboer2016).

Image quality is yet another topic of interest. While intuitively recognized, image quality has been more elusive to characterize in such a way that it would directly relate to diagnostic accuracy (or its converse, diagnostic error). In that regard, it is important to understand how best to assess image quality and its impact on perception in order to optimize it and minimize error (Krupinski and Jiang, Reference Krupinski and Jiang2008). Studies have focused on the impact of image acquisition, imaging hardware, image processing, image display, and reading environment on image quality and diagnostic accuracy.

Ergonomic aspects of interpreting medical images also play a role in the perception process. There is a need to understand the impact of ergonomic and presentation factors to minimize error (Krupinski and Kallergi, Reference Krupinski and Kallergi2007; Krupinski et al., Reference Krupinski, Berbaum, Schartz, Caldwell and Madsen2017; Ratwani et al., Reference Ratwani, wang, Fong and Cooper2016). Topics include determining the causes of fatigue and how that can be minimized, the contribution of fatigue to error (Krupinski et al., Reference Bashshur, Krupinski, Weinstein, Dunn and Bashshur2017; Rohatgi et al., Reference Rohatgi, Hanna, Sliker, Abbott and Nicola2015; Waite et al., Reference Waite, Scott, Gale, Fuchs, Kolla and Reede2017a, Reference Waite, Kolla, Jeudy, Legasto, Macknik, Martinez-Conde, Krupinski and Reede2017b), the environmental distractions (Balint et al., Reference Balint, Steenburg, Lin, Shen, Steele and Gunderman2014; Williams and Drew, Reference Williams and Drew2017), the impact of viewing interface, especially with soft-copy images, and the impact of the color tint of the image.

Though we hope and aim for consistent and correct clinical decisions on every case, that aim is hard to achieve. The likelihood of two clinicians rendering two different interpretation of an image is unsettlingly high. The expertise of the clinician plays an important role in that respect (Van der Gijp et al., Reference Van der Gijp, Ravensloot, Jarodzka, van der Schaaf, van der Schaaf, van Schaik and ten Cate2017). Medical expertise is the ability to efficiently use contextual medical knowledge toward accurate and consistent diagnosis. Medical imaging expertise further involves perceptual and cognitive analysis of image features and manifests itself in a rich structured knowledge of normalcy and “perturbations” from the normal, an efficient hypothesis-driven search strategy, and an ability to generalize visual findings to idealized patterns. Achieving such expertise requires talent further honed by motivated effortful study, preferably supervised, and dedicated work, where accuracy is roughly proportional to the logarithm of number of cases read annually (Nodine and Mello-Thoms, Reference Nodine, Mello-Thoms, Beutel, Van Metter and Kundel2000). Topics of interest in that line of investigation include the impact of clinician’s experience, age, and visual acuity on accuracy, toward better training and utilization of medical imaging clinicians.

Considering the impact of image perception on diagnostic accuracy, it is often necessary to test various imaging technologies and methods in terms of the associated impact on image perception. Such studies require the use of experienced clinicians, which is an expensive undertaking. Thus, there is a great need for accurate computational models/programs that could model visual perception and predict human performance. A host of such perception models have been developed over years, including the ideal human observer model, nonprewhitening models, channelized models, and visual discrimination models (Abbey and Bochud, Reference Abbey, Bochud, Beutel, Van Metter and Kundel2000). These models naturally require a reasonably accurate understanding of the image interpretation process. As our knowledge in that regard is limited, so is the accuracy of these models. As such, their use often requires certain assumptions, verifications of their accuracy and relevance in pilot experimentations, and certain calibrations (e.g., adding internal noise to make the model predictions fit the human results). Nonetheless, these models have demonstrated valuable, though limited, utility in many applications, and their advancement continues to shed light on the image interpretation process.

Surprisingly, mathematical models are not the only ones being used to try to understand how humans visually process medical images. Key insights into this human behavioral tasks were reported using pigeons (Columba livia), which share many visual system properties with humans. The birds had a remarkable ability to distinguish benign from malignant human breast histopathology and, even more importantly, were able to generalize what they had learned when confronted with novel image sets. Their accuracy, like that of humans, was affected by the presence or absence of color as well as by degrees of image compression, but could be ameliorated with further training. In radiology, the birds were quite capable of detecting cancer-relevant microcalcifications on mammogram images. However, when given the more difficult task with mammographic masses the pigeons proved to be capable only of image memorization and were unable to successfully generalize when shown novel examples. The birds’ successes and difficulties suggested that pigeons are well suited to help understand human medical image perception (Levenson et al., Reference Levenson, Krupinski, Navarro and Wasserman2015).

By and large, image interpretation is currently a human task. However, increasingly, artificial intelligence tools are being used to aid the human in the interpretation process or all together replace the human (Brink et al., Reference Brink, Arenson, Grist, Lewin and Enzmann2017; Jha and Topol, Reference Jha and Topol2016). The most common technology currently used is computer-aided diagnosis (CAD), computer algorithms that examine the image content for certain abnormal features of clinical interest and then prompt the clinician for a closer examination of those features (Al Mohammad et al., Reference Al Mohammad, Brennan and Mello-Thoms2017; Doi, Reference Doi2007; Pande et al., Reference Pande, Cohen, Pai and Ahmed Khan2016). CAD is becoming an important tool for interpreting medical images considering the exponential growth of imaging and shortage of specialized expertise. There is currently a need to understand the impact of CAD on accuracy. Issues in that regard include how best to integrate the human and the machine in such a way that the strength of both can be fully utilized toward improved diagnosis. An experienced clinician might ignore the CAD prompts or be distracted by them if the system indicates too many false positives. However, an inexperienced clinician might overly depend on CAD, initiating unnecessary follow-up procedures or dismissing an abnormality that might not have been picked up by the CAD algorithm. Such patterns might also change over time as a clinician gets used to a system, and such “getting used to” might not necessarily lead to improved diagnosis or efficiency. Thus, there is a need to understand the impact of CAD on the clinician’s psychology, expertise, efficiency, and specialization paradigms.

Fundamental to most topics noted above is a need to measure diagnostic accuracy (Metz, Reference Metz2006; Obuchowski, Reference Obuchowski2005; Wagner et al., Reference Wagner, Metz and Campbell2007). There are a number of simple measures of performance such as fraction correct, sensitivity, or specificity. However, such simple measures do not adequately reflect accuracy as they can be dependent on disease prevalence or the criterion level applied by the clinician (e.g., a clinician who calls all cases abnormal will have a perfect sensitivity but poor specificity, and vice versa). Seeking an overall performance measure independent of disease prevalence and criterion, receiver operating characteristic (ROC) analysis has served as the current gold standard for measuring diagnostic accuracy. However, ROC analysis has a number of limitations, including being primarily limited to single tasks, nonbinary confidence ratings, and location-independent decisions. In recent years, a number of variants and advancements of the ROC methodology have been developed, a welcome expansion which has shown continued advancement.

1.3 Why a Clinician Should Care About Medical Image Perception

Medical image perception is a mature science which continues to be advanced by expert scientists. In this age of overspecialization in which specialized “territories” are left to the experts, one may ask why a clinician involved with medical images needs to care about medical image perception. It is needless to say that no one expects a clinician to also be a medical perception scientist. However, knowledge of perception issues and concerns can provide vital advantages in the work of a clinician involved with medical images. Those advantages can be grouped into five categories.

  1. 1. Patient care: Understanding perceptual issues could help a clinician to improve his/her performance. Knowledge of key perceptual factors such as satisfaction of search, the relevance of prolonged dwell time, search strategies, and psychological impacts of decision aids (such as CAD) can directly impact the way he/she interprets medical images. It further enforces a greater care about the way the images are created, a greater appreciation for image quality and its relevance in terms of accuracy and efficiency, an appreciation for proper ergonomic design of working environment and fatigue factors, and higher confidence in the use of new display technologies.

  2. 2. Science: Being better informed about key perceptual factors enables proper design of projects involving medical images, ability to better answer perceptual questions that inevitably arise in the review of imaging-related papers and grant applications, and proficiency to review such papers and grants.

  3. 3. Teaching and learning: Knowledge of perceptual factors can help a clinician be a better teacher in communicating his/her expertise to trainees. Similarly he/she would be able to better hone in his/her perceptual skills.

  4. 4. Consumer: Understanding the importance of perceptual factors enables a clinician to be a better shopper of medical image-related products and services. For example, he/she will be more mindful of image quality performance aspects of acquisition and display devices, and the importance of graphical user interface of the picture archiving and communications system (PACS) workstations.

  5. 5. Profession: Awareness of image perception issues enables a clinician to better educate patients, other medical professionals, and the public about the statistical nature of medical image interpretation, and to play a more effective role in related malpractice litigations.

1.4 About This Book

As outlined above, medical image perception is a frequent clinical task and a notable component of modern medicine. With perceptual error as one of the major sources of medical decision errors, our knowledge of perceptual issues gives us resources to better control and minimize these errors and to educate future medical imaging clinicians and scientists. This book aims to provide a comprehensive reflection of medical perception issues and concepts within one single volume. Chapters in this text deal with a variety of perceptual issues in great detail.

In this second edition, we have retained the core chapters that summarize the history of medical image perception, as well as those that cover foundational methodologies for image perception research. Most chapters have been updated by the original authors to reflect advances in their specific topic areas. Some of the more outdated chapters have been replaced by new ones that better reflect either state-of-the-art technologies being used today in clinical settings, and/or newer assessment methods, tools, and techniques. A number of new chapters have also been added that address new topics in medical imaging that have either developed or matured since the first edition, thus warranting inclusion.

The first part of the book retains chapters by four prominent scientists (Harold Kundel, MD, Calvin F. Nodine, PhD, Arthur Burgess, PhD, Robert Wagner, PhD), reflecting on historical developments of the field and its theoretical foundations. Each of these authors is considered today a “father” of medical image perception, from different but related perspectives. Their pioneering research has been paramount in shaping the field of medical image perception as we know it today. A new chapter has been added discussing the overall context of medical image perception.

The second part of the book includes chapters discussing the science of medical image perception. Main topics include visual and cognitive factors, satisfaction of search, and the role of expertise. A new chapter on the role of subsecond and peripheral vision/perception in image interpretation has been added.

Part III focuses on perception metrology with chapters focused on the logistical aspects of designing perception experiments, ROC methodology, and its variants. A new chapter has been added on the impact of memory effects for images in the context of running observer studies and another on three- and four-dimensional models. The part includes discussion of perceptual observer models and their implementation as well as an assessment of the overall value and limitations of such models.

A new part (IV) has been added describing perception in the context of multisource imaging and data and two international programs designed to assess clinical performance of mammographers over time and in comparison to their peers for overall quality assessment.

Part V focuses on computational perception and CAD issues with topics ranging from the design of CAD studies and perceptual impact of CAD to perceptual factors associated with the use of CAD in interpreting chest, breast, and volumetric images. A new chapter has been added on the evaluation of CAD, and another one on the overall process of images as a source of quantitative information.

The final part (VI) on applied perception offers chapters dealing with specific optimization and use considerations from a perceptual standpoint. New and revised chapters offer topics on display optimization, reading environment and ergonomic design of workplaces for radiologists, image perception in pathology, and perceptual basis for developing human search-based training and computer-based training methods. The book ends with a chapter summarizing image perception from the perspective of a practicing radiologist and a final chapter outlining future possible directions for medical image perception science.

We hope readers benefit from this new edition, to learn from its content and to find inspiration from its diverse topics that still need more comprehension, innovation, and application to advance the value and utility of medical images in medicine. We eagerly anticipate that the insights and methods described in these pages can lead to a positive impact on patient care and human health, which shall remain the main objective of health science and healthcare.

References

Abbey, C.K., Bochud, F.O. (2000). Modeling visual detection tasks in correlated image noise with linear model observers. In: Beutel, J., Van Metter, R., Kundel, H. (eds.) Handbook of Medical Imaging. Vol. 1: Physics and Psychophysics. Bellingham, WA: SPIE Press, pp. 655682.Google Scholar
Al Mohammad, B., Brennan, P.C., Mello-Thoms, C. (2017). A review of lung cancer screening and the role of computer-aided detection. Clin Radiol, 72, 433442.Google Scholar
American Telemedicine Association Ocular Telehealth Special Interest Group. (2004). Telehealth practice recommendations for diabetic retinopathy. Telemed J eHealth, 10, 469482.Google Scholar
America’s Health Insurance Plans (AHIP). (2008). Ensuring quality through appropriate use of diagnostic imaging. www.medsolutions.com/clinical_quality/facts/AHIP%202008%20Imaging%20Stats.pdf (last accessed June 15, 2017).Google Scholar
Badano, A., Revie, C., Casertano, A., Cheng, W.C., Green, P., Kimpe, T., Krupinski, E., Susson, C., Skrovseth, S., Treanor, D., Boynton, P., Clunie, D., Flynn, M.J., Heki, T., Hewitt, S., et al. (2015). Consistency and standardization of color in medical imaging: a consensus report. J Digit Imag, 28, 4152.CrossRefGoogle ScholarPubMed
Balint, B.J., Steenburg, S.D., Lin, H., Shen, C., Steele, J.L., Gunderman, R.B. (2014). Do telephone call interruptions have an impact on radiology resident diagnostic accuracy? Acad Radiol, 21, 16231628.Google Scholar
Bashshur, R.L., Krupinski, E.A., Weinstein, R.S., Dunn, M.R., Bashshur, N. (2017). The empirical foundations of telepathology: evidence of feasibility and intermediate effects. Telemed eHealth, 23, 155191.Google Scholar
Beam, C.A., Krupinski, E.A., Kundel, H.L., Sickles, E.A., Wagner, R.F. (2006). The place of medical image perception in 21st-dentury health care. J Am Coll Radiol, 3, 409412.Google Scholar
Berbaum, K.S., Franken, E.A., Dorfman, D.D., et al. (1989). Satisfaction of search in diagnostic radiology. Invest Radiol, 25, 133140.Google Scholar
Berbaum, K.S., Krupinski, E.A., Schartz, K.M., Caldwell, R.T., Madsen, M.T., Hur, S., Laroia, A.T., Thompson, B.H., Mullan, B.F., Franken, E.A. (2016). The influence of a vocalized checklist on detection of multiple abnormalities in chest radiography. Acad Radiol, 23, 413420.Google Scholar
Berlin, L. (2005). Errors of omission. AJR, 185, 14161421.Google Scholar
Berlin, L. (2007). Accuracy of diagnostic procedures: has it improved over the past five decades? AJR, 188, 11731178.CrossRefGoogle ScholarPubMed
Bracamonte, E., Gibson, B.A., Klein, R., Krupinski, E.A., Weinstein, R.S. (2017). Communicating uncertainly in surgical pathology reports: a survey of staff physicians and residents at an academic medical center. Acad Pathol, 3, 17.Google Scholar
Brink, J.A., Arenson, R.L., Grist, T.M., Lewin, J.S., Enzmann, D. (2017). Bits and bytes: the future of radiology lies in informatics and information technology. Eur Radiol, 27, 36473651.Google Scholar
Carmody, D.P., Nodine, C.F., Kundel, H.L. (1980). An analysis of perceptual and cognitive factors in radiographic interpretation. Perception, 9, 339344.CrossRefGoogle ScholarPubMed
Christensen, P.A., Lee, L.E., Thrall, M.J., Powell, S.Z., Chevez-Barrios, P., Long, S.W. (2017). RecutClub.com: an open source, whole slide image-based pathology education system. J Pathol Inform, 8, 10.Google Scholar
Dobbins, J.T., McAdams, P., Sabol, J.M., Chakraborty, D.P., Kazerooni, E.A., Reddy, G.P., Vikgren, J., Bath, M. (2017). Multi-institutional evaluation of digital tomosynthesis, dual-energy radiography, and conventional chest radiography for the detection and management of pulmonary nodules. Radiology, 282, 236250.Google Scholar
Dodoo, M.S., Duszak, R., Hughes, D.R. (2013). Trends in utilization of medical imaging from 2003 to 2011: clinical encounters offer a complementary patient-centered focus. J Am Coll Radiol, 10, 507512.Google Scholar
Doi, K. (2007). Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph, 31, 198211.CrossRefGoogle ScholarPubMed
Fanshawe, T.R., Phillips, P., Plumb, A., Helbren, E., Halligan, S., Taylor, S.A., Gale, A., Mallett, S. (2016). Do prevalence expectations affect patterns of visual search and decision-making in interpreting CT colonography endoluminal videos? Br J Radiol, 89, 2010842.CrossRefGoogle ScholarPubMed
Fei, B., Schuster, D.M. (2017). PET molecular imaging-directed biopsy: a review. Am J Roentgenol, 209, 115.Google Scholar
Food and Drug Administration (FDA). (2017). www.fda.gov/newsevents/newsroom/pressannouncements/ucm552742.htm (accessed June 15, 2017).Google Scholar
Giger, M.S., Doi, K., MacMahon, H. (1988). Image feature analysis and computer-aided diagnosis in digital radiography. 3. Automated detection of nodules in peripheral lung fields. Med Phys, 15, 158166.CrossRefGoogle ScholarPubMed
Gilbert, F.J., Tucker, L., Young, K.C. (2016). Digital breast tomosynthesis (DBT): a review of the evidence for use as a screening tool. Clin Radiol, 71, 141150.CrossRefGoogle ScholarPubMed
Glabman, H. (2005). Health plans strain to contain rapidly rising costs of imaging. Managed Care magazine. www.managedcaremag.com/archives/0501/0501.imaging.html (accessed June 15, 2017).Google Scholar
Guolan, L., Fei, B. (2014). Medical hyperspectral imaging: a review. J Biomed Opt, 19, 10901.Google Scholar
Jha, S., Topol, E.J. (2016). Adapting to artificial intelligence: radiologists and pathologists as information specialists. JAMA, 316, 23532354.CrossRefGoogle ScholarPubMed
Kaplan, K.J., Rao, K.F. (2016). Digital Pathology: Historical Perspectives, Current Concepts and Future Applications, New York: Springer International Publishing.CrossRefGoogle Scholar
Kok, E. M., Jarodzka, H., de Bruin, A.B.H., BinAmir, H.A.N., Robben, S.G.F., van Merrienboer, J.J.G. (2016). Systematic viewing in radiology: seeing more, missing more? Adv Health Sci Educ Theory Pract, 21, 189205.Google Scholar
Krupinski, E.A. (2016). Special section guest editorial: medical image perception: understanding how radiologists understand images. J Med Imag, 3, 011001.CrossRefGoogle ScholarPubMed
Krupinski, E.A., Jiang, Y. (2008). Evaluation of medical imaging systems. Med Phys, 35, 645659.Google Scholar
Krupinski, E.A., Kallergi, M. (2007). Choosing a radiology workstation: technical and clinical considerations. Radiology, 242, 671682.Google Scholar
Krupinski, E.A., Nypaver, M., Poropatich, R., et al. (2002). Clinical applications in telemedicine/telehealth. Telemed J e-Health, 8, 1334.Google Scholar
Krupinski, E.A., Berbaum, K.S., Schartz, K.M., Caldwell, R.T., Madsen, M.T. (2017). The impact of fatigue on satisfaction of search in chest radiography. Acad Radiol, 24, 10581063.CrossRefGoogle ScholarPubMed
Kundel, H.L. (1975). Peripheral vision, structured noise and film reader error. Radiology, 114, 269273.Google Scholar
Kundel, H.L., Nodine, C.F., Carmody, D. (1978). Visual scanning, pattern recognition and decision-making in pulmonary nodule detection. Invest Radiol, 13, 175181.CrossRefGoogle ScholarPubMed
Kundel, H.L., Nodine, C.F., Krupinski, E.A. (1989). Searching for lung nodules: visual dwell indicates locations of false-positive and false-negative decisions. Invest Radiol, 24, 472478.Google Scholar
Lee, D.W., Duszak, R., Hughes, D.R. (2013). Comparative analysis of Medicare spending for medical imaging: sustained dramatic slowdown compared with other services. Am J Roentgenol, 201, 12771282.CrossRefGoogle ScholarPubMed
Levenson, R.M., Krupinski, E.A., Navarro, V.M., Wasserman, E.A. (2015). Pigeons (Columba livia) as trainable observers of pathology and radiology breast cancer images. PLoS One, 10, e0141357.CrossRefGoogle ScholarPubMed
Liang, G., Vo, D., Nguyen, P.K. (2017). Fundamentals of cardiovascular molecular imaging: a review of concepts and strategies. Curr Cardiovasc Imag Rep, 10, 8.Google Scholar
Littlefair, S., Mello-Thoms, C., Reed, W., Pietryzk, M., Lewis, S., McEntee, M., Brennan, P. (2016). Increasing prevalence expectation in thoracic radiology leads to overcall. Acad Radiol, 23, 284289.Google Scholar
Manning, D.J., Gale, A., Krupinski, E.A. (2005). Perception research in medical imaging. Br J Radiol, 78, 683685.Google Scholar
McKoy, K., Antoniotti, N.M., Armstrong, A., Bashshur, R., Bernard, J., Bernstein, D., Burdick, A., Edison, K., Goldyne, M., Kovarik, C., Krupinski, E.A., Kvedar, J., Larkey, J., Lee-Keltner, I., Lipoff, J.B., Oh, D.H., Pak, H., Seraly, M.P., Siegel, D., Tejasvi, T., Whited, J. (2016). Practice guidelines for teledermatology. Telemed eHealth, 22, 981990.Google Scholar
Medicare Payment Advisory Commission (MEDPAC). (2014) Health Care Spending and the Medicare Program June 2016: a data book: healthcare spending and the Medicare Program. www.medpac.gov/docs/default-source/data-book/june-2016-data-book-health-care-spending-and-the-medicare-program.pdf?sfvrsn=0 (accessed June 15, 2017).Google Scholar
Metz, C.E. (2006). Receiver operating characteristic analysis: a tool for the quantitative evaluation of observer performance and imaging systems. J Am Coll Radiol, 3, 413442.CrossRefGoogle ScholarPubMed
Nodine, C.F., Kundel, H.L. (1987). Using eye movements to study visual search and to improve tumor detection. RadioGraphics, 7, 12411250.Google Scholar
Nodine, C.F., Mello-Thoms, C. (2000). The nature of expertise in radiology. In Beutel, J., Van Metter, R., Kundel, H. (eds.) Handbook of Medical Imaging. Vol. 1: Physics and Psychophysics. Bellingham, WA: SPIE Press, pp. 859894.CrossRefGoogle Scholar
Obuchowski, N.A. (2005). ROC analysis. Am J Roentgenol, 184, 364372.Google Scholar
Pande, T., Cohen, C., Pai, M., Ahmed Khan, F. (2016). Computer-aided detection of pulmonary tuberculosis on digital chest radiographs: a systematic review. Int J Tuberc Lung Dis, 20, 12261230.Google Scholar
Pantanowitz, L., Dickinson, K., Evans, A.J., Hassell, L.A., Henricks, W.H., Lennerz, J.K., Lowe, A., Parwani, A.V., Riben, M., Smith, D., Tuthill, J.M., Weinstein, R.S., Wilbur, D.C., Krupinski, E.A., Bernard, J. (2014). American Telemedicine Association clinical guidelines for telepathology. Telemed e-Health, 20, 10491056.Google Scholar
Ratwani, R.M., wang, E., Fong, A., Cooper, C.J. (2016). A human factors approach to understanding the types and sources of interruptions in radiology reading rooms. J Am Coll Radiol, 13, 11021105.Google Scholar
Rohatgi, S., Hanna, T.N., Sliker, C.W., Abbott, R.M., Nicola, R. (2015). After-hours radiology: challenges and strategies for the radiologist. Am J Roentgenol, 205, 956961.Google Scholar
Samei, E., Flynn, M.J., Kearfott, K.J. (1997). Patient dose and detectability of subtle lung nodules in digital chest radiographs. Health Physics, 72(6S).Google Scholar
Sim, D.A., Mitry, D., Alexander, P., Mapani, A., Goverdhan, S., Aslam, T., Tufail, A., Egan, C.A., Keane, P.A. (2016). The evolution of teleophthalmology programs in the United Kingdom: beyond diabetic retinopathy. J Diabetes Sci Technol, 10, 308317.CrossRefGoogle ScholarPubMed
Smith, M.J. (1967). Error and Variation in Diagnostic Radiology. Springfield, IL: Charles C. Thomas.Google Scholar
Tan, I.J., Dobson, L.P., Bartnik, S., Muir, J., Turner, A.W. (2017). Real-time teleophthalmology versus face-to-face consultation: a systematic review. J Telemed Telecare, 23, 629638.Google Scholar
Theurer, L., Bashshur, R., Bernard, J., Brewer, T., Busch, J., Caruso, D., Coccaro-Word, B., Kemalyan, N., Leenknecht, C., McMillan, L.R., Pham, T., Saffle, J.R., Krupinski, E.A. (2017). American Telemedicine guidelines for teleburn. Telemed eHealth, 23, 365375.CrossRefGoogle ScholarPubMed
Tuddenham, W.J. (1962). Visual search, image organization, and reader error in roentgen diagnosis: studies of psychophysiology of roentgen image perception. Radiology, 78, 694704.Google Scholar
Tuddenham, W.J. (1963). Problems of perception in chest roentgenology: facts and fallacies. Radiol Clin North Am, 1, 227289.Google Scholar
Van der Gijp, A., Ravensloot, C.J., Jarodzka, H., van der Schaaf, M.F., van der Schaaf, I.C., van Schaik, J.P.J., ten Cate, T.J. (2017). How visual search relates to visual diagnostic performance: a narrative systematic review of eye-tracking research in radiology. Adv Health Sci Educ Theory Pract, 22, 765767.CrossRefGoogle ScholarPubMed
Wagner, R.F., Metz, C.E., Campbell, G. (2007). Assessment of medical imaging systems and computer aids: a tutorial review. Acad Radiol, 14, 723748.Google Scholar
Waite, S., Scott, J., Gale, B., Fuchs, T., Kolla, S., Reede, D. (2017a). Interpretative error in radiology. Am J Roentgenol, 208, 739749.Google Scholar
Waite, S., Kolla, S., Jeudy, J., Legasto, A., Macknik, S.L., Martinez-Conde, S., Krupinski, E.A., Reede, D.L. (2017b). Tired in the reading room: the influence of fatigue in radiology. J Am Coll Radiol, 14, 191197.Google Scholar
Ware, J.B., Jha, S., Hoang, J.K., Baker, S., Wruble, J. (2017). Effective radiology reporting. J Am Coll Radiol, 14, 838839.Google Scholar
Weinstein, R.S., Descour, M.R., Liang, C., Bhattacharyya, A.K., et al. (2001). Telepathology overview: from concept to implementation. Human Pathol, 32, 12831299.Google Scholar
Wilbur, D.C. (2016). Digital pathology and its role in cytology education. Cytopathology, 27, 325330.Google Scholar
Williams, L.H., Drew, T. (2017). Distraction in diagnostic radiology: how is search through volumetric medical images affected by interruptions? Cogn Res Princ Implic, 2, 12Google Scholar
Wolfe, J.M. (2016). Use-inspired basic research in medical image perception. Cogn Res, 1, 17.Google Scholar
Wolfe, J.M., Evans, K.K., Drew, T., Aizenman, A., Josephs, E. (2016). How do radiologists use the human search engine? Radiat Prot Dosimetry, 169, 2431.Google Scholar
Figure 0

Figure 1.1 As a fundamentally visual discipline, medical imaging requires psychophysical interpretation of the images to draw “meaning” from the viewing information and understand their clinical relevance.

Figure 1

Figure 1.2 Detecting a subtle abnormality is somewhat similar in difficulty to identifying the dog in a popular visual illusion.

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×