ORIGINAL ARTICLES
|
|
Proposal for computer-aided diagnosis based on ultrasound images of the kidney: is it possible to compare shades of gray among such images? |
|
Autho(rs): Gustavo Lopes Gomes de Siqueira1,a; Robson Pequeno de Sousa2,b; Ricardo Alves de Olinda2,c; Carlos Alberto Engelhorn3,d; André Luiz Siqueira da Silva1,e; Juliana Gonçalves Almeida1,f |
|
Keywords: Diagnosis, computer-assisted; Kidney/diagnostic imaging; Ultrasonography/methods; Ultrasonography, interventional/methods; Image processing, computer-assisted/methods. |
|
Abstract: INTRODUCTION
The evaluation of the renal parenchyma remains subjective to the comparison of its echotexture in relation to the liver, without specific parameters in relation to factors such as the percentage of pixels(1). Human vision can perceive only 16–32 shades of gray. Ultrasound generates up to 256 shades of gray, 16 times more than the human eye can perceive(2). The computerized analysis of shades of gray can reveal subtle changes in a given structure over time, changes that are initially imperceptible to the human visual system but become visible after computerized gray-scale mapping(3), transforming the image into a three-dimensional digital file, brightness being the third dimension(4). Ultrasound tissue characterization is based on two parameters(5): quantification of specific percentages of shades of gray at pre-established ranges (specific brightness ranges; Figure 1); and color mapping of the image (Figure 2), which improves the level of perception by the human visual system. An important part of this evaluation is determination of the gray-scale median (GSM), which marks the division between the pixels with greater and those with lesser brightness in the selected area. The GSM thus divides a sample in half, being different than the mean and not affected by the values to the right or left of it. Because it is not so influenced, the median is more important than the mean in some statistical studies. Figure 1. Pixel brightness ranges and the probable corresponding tissues on ultrasound. Figure 2. Software (CAD) prototype. Image showing manual segmentation of the renal contour (A) and the pseudocolor version of the image (B). The computerized assessment of shades of gray in ultrasound images has been widely used in the evaluation of atherosclerotic carotid plaque(6,7), in which a GSM < 25 indicates a greater risk of stroke. To make the images more uniform and less dependent on tissue attenuation(4,5,7), we resized the gray-scale ranges (Figure 1). The proportional distribution of shades of gray within the selected region of the kidney was studied in 14 brightness ranges, and the GSM was determined. The benefit of this evaluation would be, for example, in the ultrasound monitoring of kidney transplant recipients, in which spectral parameters are used, although potentially only after the parenchyma and its echotexture have changed, as can happen in cases of graft rejection. Given the limits of the human visual system, such changes can go unnoticed without the aid of a computerized system. The gray-scale and GSM ranges have already been described in normal patients by investigators using the parameters previously cited in studies analyzing shades of gray of atherosclerotic carotid plaque(2,4,7–9). In such studies, the image is “standardized” with respect to two points: the adventitia is assigned a pixel value of 200 and the lumen is assigned a pixel value of 0, which effects a linear change in all other values, in order to standardize images obtained by different examiners with different devices. In previous studies evaluating renal conditions, the posterior muscular fascia was assigned a pixel value of 200 and the darkest part of the image was assigned a pixel value of 0(4,5,10). In one of those studies, in which a kidney transplant recipient was evaluated, changes in the GSM and gray-scale ranges facilitated the early identification of acute graft rejection(10). The main problematic aspect of ultrasound is that the use of different devices by different examiners can generate totally different shades of gray. To compensate for that, we used the “standardization” method mentioned above(2,4,5,7–9), although it must be taken into account that evaluation of the kidney is very different from evaluation of the carotid artery, in which the target has a superficial presentation and is easily visualized. Then leaves us with the question of whether we can evaluate shades of gray in renal images acquired with different devices and by different examiners. MATERIALS AND METHODS Cross-sectional, observational, descriptive study with an analytical component. The study was approved by the Research Ethics Committee of Paraíba State University, in the city of Campina Grande, Brazil (Reference no. 86802617.5.0000.5187; opinion no. 2,954,650), and all participants gave written informed consent. In collaboration with a computer engineering team, we developed a software prototype using the C++ language. The prototype was created in the Microsoft Visual Studio Community 2015 integrated development environment for Windows (version 14.0). With our software, it is possible to “standardize” an image in an adapted manner(4,5,10), stabilizing the pixels in relation to a single point (although other studies have used two points), which will be the posterior renal fascia. After the use of the zoom command and manual segmentation of the fascia, the operator clicks on the normalization (standardization) command and the GSM of the segmented area automatically changes to 200. The mathematical change occurs not only in the segmented area of the renal fascia but also throughout the image, changing all pixels in the image in accordance with the change in the segmented fascia. The mathematical change around the pixel variation will occur due to a normalization factor. The normalization factor (Fn) is defined as in Eq. 1: where medF0 is the original GSM of the selected fascia. After calculating this factor, we used the transfer function defined in Eq. 2 to normalize the image to the GSM of the fascia of the selected region. To apply Eq. 2, the following criteria must be observed: where f is a given pixel and r is the pixel intensity level in the image. The use of image normalization can be exemplified as follows: If the medF0 is 220, the normalization factor will be calculated as in Eq. 1: To normalize the original image, Eq. 3 is used. Assuming that the intensity of a given pixel in the original image is 50, according to Eq. 3 the normalized pixel will assume the following value: f(50) = 50(1 − 0.09) = 46. In addition to making it possible to normalize the image, the software applies the current gold standard for renal segmentation in ultrasound imaging, which continues to be the manual method(11,12). The computer-aided diagnosis (CAD) prototype reads the proportional distribution of pixels within the segmented image and uses 14 brightness ranges to create a pseudocolor image (Figures 1 and 2). Twenty-four volunteers were included in the study. All of the volunteers underwent ultrasound of the right and left kidney by five specialist sonographers, designated physicians 1 through 5. Physicians 1, 2, and 3 used the same system, a Philips HD11 XE (Philips Healthcare, Eindhoven, The Netherlands) with a 3–7 MHz convex transducer. Physician 4 used a GE Logiq S7 system (GE Healthcare, Chicago, IL, USA) that had been in use for three years, with a 6–9 MHz convex transducer. Physician 5 used another GE Logiq S7 system (GE Healthcare) that had been in use for two years, also with a 6–9 MHz convex transducer. In the renal examination, performed with the volunteer in the lateral position, two methods were employed. The first was designated the random method, in which the usual preset for renal examination was employed and the physician manipulated the gain, the time gain control (TGC), and all other factors. The image thus obtained was designated the sample image. The second method, designated the standardized method, employed a “control” image, in which we created a preset with a dynamic range fixed at 70–80 dB and the gain fixed at 100 dB, not being able to modify the parameters described, stabilizing the vertical TGC in the renal area in order to generate the best possible image(4,6–10). The image thus obtained was designated the control image. After a total of 480 images, 240 of each (sample and control images), had been saved to the ultrasound system, the images were transferred to a computer, with the file extension .bmp, at a resolution of 800 × 600 pixels. Each sample or control image, of the right or left kidney, was subjected to analysis in the software created, finally producing what we call a random image and a standardized image, according to the following procedure: – Manual segmentation of the renal contour – Analysis with acquisition of the GSM and the shades of gray – Acquisition of the 14 brightness ranges described in Figure 1 – Creation of a pseudocolor version of the selected image (Figure 2). Subsequently, the random and standardized images were submitted to a procedure for creating the “standardized/normalized” images, as follows: – Preprocessing with standardization/normalization of images after choosing a fixed point that serves as a reference for the number 200 on the gray scale, using the renal fascia(4,5,10) – Manual segmentation of the renal contour – Analysis with acquisition of the GSM and the shades of gray in the selected image, together with acquisition of the 14 brightness ranges (Figure 1) – Creation of a pseudocolor version of the selected image (Figure 2) The images thus created were called random-normalized (n = 240) and standardized-normalized (n = 240). Images in which it was difficult to visualize the renal fascia or renal alterations were excluded. A total of 41 images were thus excluded: 20 from a patient who had an extensive staghorn kidney stone in the left kidney; and 21, from three patients, that were not perfect candidates for the standardization procedure. After excluding the cited images, 919 images resulted for the study: 231 random images, 229 standardized images, 230 random-normalized images, and 229 standardized-normalized images. Statistical analysis The data were entered into a Microsoft Excel 2016 spreadsheet. After being organized, the main descriptive statistics were presented. The GSM was calculated and analyzed specifically. Percentages were interpreted as continuous variables. Mean, standard deviation, minimum and maximum values were calculated on the basis of the descriptive statistics analyzed with the statistical software R (The R Foundation, Vienna, Austria). To assess the adequacy of the proposed statistical modeling to describe the observations, the normality and independence of the variables were verified with the Anderson–Darling normality test. With this procedure, we sought to create the theoretical conditions necessary for performing univariate statistical analyses. To identify differences between physician and imaging factors, we used the nonparametric Kruskal–Wallis test, which is analogous to the analysis of variance (ANOVA) F test. To identify differences between the medians, we then used the Wilcoxon–Mann–Whitney test for independent samples. In all tests, the level of significance was set at 5% (p < 0.05), as analyzed with the aid of the software R. Two scenarios were devised: scenario 1—analysis among the five physicians and the three types of ultrasound systems, evaluating the possibility of comparing images produced by different devices and physicians; scenario 2—comparison among the three physicians who used the same ultrasound system (physicians 1, 2, and 3) and among the four types of images (random, standardized, random-normalized, and standardized-normalized). RESULTS Scenario 1—The five types of physicians were compared, in relation to the GSM variable, using the Kruskal–Wallis test (ANOVA), and significant differences were observed (p < 2.2e-16). To identify intraindividual differences, the Wilcoxon–Mann–Whitney test for independent samples was applied (Figure 3). Figure 3. Univariate analysis among the five physicians, using GSM as a variable (p < 2.2e-16). Scenario 2—A comparison was made among the physicians who used the same ultrasound system (physicians 1, 2, and 3) and the four different types of images (random, standardized, standardized-normalized, and random-normalized). The GSM and the 14 brightness ranges were used as variables for comparison. Random images For each random image, the Kruskal–Wallis test (ANOVA) was used in order to identify differences among the levels of the physician factor (physicians 1, 2, and 3), the median of the GSM being used as a variable. There was a statistically significant difference among the physicians (p = 0.006098). The Wilcoxon–Mann–Whitney test was used in order to compare physicians 1, 2, and 3 in terms of the GSM and of the 14 brightness ranges of the random image, statistical differences being observed between physicians 1 and 2, for 11 brightness ranges and for the GSM, as well as between physicians 1 and 3, for 5 brightness ranges and for the GSM. Notably, there was no statistical difference between physicians 2 and 3. Random-normalized images A random-normalized image is a random image that has undergone the normalization process. For each random-normalized image, the Kruskal–Wallis test (ANOVA) was used in order to identify differences between the levels of the physician factor (physicians 1, 2, and 3), the median of the GSM being used as a variable. The GSM did not differ significantly among the physicians (p = 0.08115). The Wilcoxon–Mann–Whitney test was used in order to identify differences among physicians 1, 2, and 3 in terms of the GSM and of the 14 brightness ranges of the random-normalized images, statistical differences being observed between physicians 1 and 2 for four brightness ranges (although not for the GSM), as well as between physicians 1 and 3 for two brightness ranges. There was no statistical difference between physicians 2 and 3. Standardized images Standardized images represent the most widely used type of image acquisition(4,5,7–10). Comparison of the 14 brightness ranges and the GSM is crucial to describing the equivalence of the images. For each standardized image, the Kruskal–Wallis test (ANOVA) was used in order to identify differences between the levels of the physician factor (physicians 1, 2, and 3), the GSM being used as a variable. The GSM did not differ among the physicians (p = 0.9472). To identify differences in the GSM and of the 14 brightness ranges of the standardized images, the Wilcoxon–Mann–Whitney test was used, a statistical difference being observed only between physicians 1 and 3 and only in one brightness range. Standardized-normalized images A standardized-normalized image is a standardized image that has undergone the normalization procedure. For each standardized-normalized image, the Kruskal–Wallis test (ANOVA) was used in order to identify differences between the levels of the physician factor (physicians 1, 2, and 3), the GSM being used as a variable. The GSM did not differ among the physicians (p = 0.7319). The Wilcoxon–Mann–Whitney test was used in order to determine whether there were any differences between the GSM and of the 14 brightness ranges in the standardized-normalized images generated by physicians 1, 2, and 3. There were no statistical differences among the physicians in terms of the brightness ranges obtained. DISCUSSION Various authors have concluded that the processing and analysis of ultrasound images have become totally dependent on the examiner(1). A study attempting to analyze shades of gray in ultrasound images atherosclerotic plaques produced dissonant results regarding the risk of ischemic stroke(13). The normalization procedure has been shown to partially eliminate the variability among ultrasound images obtained by different professionals(2,7–9). However, all of the studies cited evaluated atherosclerotic plaques in images of the carotid artery, which are obtained relatively easily because of the superficial location of the artery. There have been multiple studies involving gray-scale analysis of renal ultrasound images, using the same normalization principle, adapted for renal images(4,5,10). However, the main question regarding the evaluation of renal images is whether they can be compared among different professionals and ultrasound systems. In the present study, four types of images were used, depending on whether they were standardized or normalized. As a result, the GSMs obtained by the physicians who used the same ultrasound system (physicians 1, 2, and 3) differed from those obtained by the physicians who used another type of ultrasound system (physicians 4 and 5). This leads us to suggest that it is not possible to compare images obtained with different ultrasound systems, because the variability is statistically significant. Despite that result, we cannot be sure that such an analysis is precluded, given that only one aspect (variable) was compared. We also have no explanation for our finding that the results differed between physicians 4 and 5, who used ultrasound systems of the same model, although with different serial numbers (difference in use of one year). To our knowledge, there have been no studies comparing normalized images obtained with different ultrasound systems. Our findings suggest that the same ultrasound system should be used in order to improve the comparison and analysis of shades of gray. The question that remains is whether it is possible to compare renal ultrasound images obtained by different professionals with the same ultrasound system. For the random image and its variant after normalization—the random-normalized image, in which no physical aspect of the image was standardized—the results demonstrated total variability between those obtained by different professionals, making it impossible to use these types of images for comparison. In the standardized image, there was no significant change in the most important variable (GSM). However, there was a statistically significant, albeit marginal, difference between physicians 1 and 3. For the standardized-normalized images, there were no statistical differences among physicians 1, 2, and 3, supporting the hypothesis of equivalence of the images and homogenization after the normalization procedure. Standardized-normalized images have been used in most of the major studies describing the analysis of shades of gray(2,4–6,8–10). We propose that CAD be employed for the analysis of renal images, using images that have been standardized and normalized. Most of the studies of the use of CAD in renal ultrasound imaging have applied it in image segmentation. One of its most rarely used applications, in the context of renal evaluation, is to identify kidney stones(14). A review of the current state of development of new techniques for the computerized analysis of renal ultrasound images showed that there is a paucity of studies on the topic(15). Even after all of the technological advances, renal sonography continues to be totally dependent on the examiner. There is a consensus that the development of CAD applications for renal imaging is too limited and needs to be advanced. Renal elastography might be a future direction for this technology(16,17). Since its invention in 1960 until the beginning of the 21st century, despite all advances, CAD continued to be employed as a “second opinion”, as an aid to the more rapid decision made by the health care professional. Recent research suggests a radical change in the main functions of CAD applications, which are moving from being mere adjuvants to being more complex systems, with the capacity for knowledge and learning, using not only images but also informative data about the condition of the patient, which can result in a more accurate decision-making process(18). CONCLUSION The use of the same ultrasound system to produce all of the images evaluated appears to confer greater credibility on the results. However, because we did not randomize the various types of ultrasound systems and physicians, we cannot rule out the possibility that images produced by different ultrasound systems could be compared. In the procedure for the acquisition of renal images, it is suggested that modifiable physical aspects of the image (e.g., TGC, total gain, and dynamic range) be standardized and that the images be submitted to a post-acquisition normalization procedure. Because there are few data in the literature regarding the computerized analysis of renal ultrasound images, it would be interesting to use a CAD application that focuses on the variations in shades of gray. REFERENCES 1. Faubel S, Patel NU, Lockhart ME, et al. Renal relevant radiology: use of ultrasonography in patients with AKI. Clin J Am Soc Nephrol. 2014;9:382–94. 2. Lal BK, Hobson RW 2nd, Pappas PJ, et al. Pixel distribution analysis of B-mode ultrasound scan images predicts histologic features of atherosclerotic carotid plaques. J Vasc Surg. 2002;35:1210–7. 3. Beach KW, Jong JM, Paun M, et al. Principles and instruments of diagnostic ultrasound and Doppler ultrasound. In: AbuRahma AF, Bergan JJ, editors. Noninvasive vascular diagnosis. London: Springer; 2000. p. 25–48. 4. Valiente Engelhorn ALD, Engelhorn CA, Salles-Cunha SX, et al. Ultrasound tissue characterization of the normal kidney. Ultrasound Q. 2012;28:275–80. 5. Valiente Engelhorn ALD, Engelhorn CA, Salles-Cunha SX, et al. Ultrasonographic tissue characterization of kidneys in patients with unilateral renal artery stenosis. J Vasc Ultrasound. 2016;40:70–5. 6. Deftereos S, Giannopoulos G, Kossyvakis C, et al. Virtual histology. Hellenic J Cardiol. 2010;51:235–44. 7. Lal BK, Hobson RW 2nd, Hameed M, et al. Noninvasive identification of the unstable carotid plaque. Ann Vasc Surg. 2006;20:167–74. 8. Griffin M, Nicolaides A, Kyriacou E. Normalisation of ultrasonic images of atherosclerotic plaques and reproducibility of grey scale median using dedicated software. Int Angiol. 2007;26:372–7. 9. Elatrozy T, Nicolaides A, Tegos T, et al. The effect of B-mode ultrasonic image standardisation on the echodensity of symptomatic and asymptomatic carotid bifurcation plaques. Int Angiol. 1998;17:179–86. 10. Valiente Engelhorn ALD, Engelhorn CA, Salles-Cunha S. Initial evaluation of virtual histology ultrasonographic techniques applied to a case of renal transplant. J Vasc Ultrasound. 2015;39:142–4. 11. Cerrolaza JJ, Safdar N, Biggs E, et al. Renal segmentation from 3D ultrasound via fuzzy appearance models and patient-specific alpha shapes. IEEE Trans Med Imaging. 2016;35:2393–402. 12. Yang X, Schuster D, Master V, et al. Automatic 3D segmentation of ultrasound images using atlas registration and statistical texture prior. Proc SPIE Int Soc Opt Eng. 2011;7964:796432. 13. el-Barghouty N, Nicolaides A, Bahal V, et al. The identification of the high risk carotid plaque. Eur J Vasc Endovasc Surg. 1996;11:470–8. 14. Tamilselvi PR, Thangaraj P. Computer aided diagnosis system for stone detection and early detection of kidney stones. Journal of Computer Science. 2011;7:250–4. 15. Subramanya MB, Kumar V, Mukherjee S, et al. Classification of normal and medical renal disease using B-mode ultrasound images. In: 2015 2nd International Conference on Computing for Sustainable Global Development (INDIACom). New Delhi, India; 2015. p. 1914–8. 16. Grenier N, Gennisson JL, Cornelis F, et al. Renal ultrasound elastography. Diagn Interv Imaging. 2013;94:545–50. 17. Grenier N, Poulain S, Lepreux S, et al. Quantitative elastography of renal transplants using supersonic shear imaging: a pilot study. Eur Radiol. 2012;22:2138–46. 18. Takahashi R, Kajikawa Y. Computer-aided diagnosis: a survey with bibliometric analysis. Int J Med Inform. 2017;101:58–67. 1. Faculdade de Ciências Médicas de Campina Grande (Unifacisa), Campina Grande, PB, Brazil 2. Universidade Estadual da Paraíba (UEPB), Campina Grande, PB, Brazil 3. Pontifícia Universidade Católica do Paraná (PUCPR), Curitiba, PR, Brazil a. https://orcid.org/0000-0002-3832-0187 b. https://orcid.org/0000-0001-8447-0699 c. https://orcid.org/0000-0002-0509-8428 d. https://orcid.org/0000-0002-8760-2279 e. https://orcid.org/0000-0002-3166-9554 f. https://orcid.org/0000-0001-9735-6115 Correspondence: Dr. Gustavo Lopes Gomes de Siqueira Rua Desembargador Trindade, 327, ap. 2501, Centro Campina Grande, PB, Brazil, 58400-260 Email: gustavomed@yahoo.com Received 14 December 2019 Accepted after revision 17 January 2020 |