The conventional screening approaches for ROP necessitate the involvement of skilled pediatric ophthalmologists or retinal specialists, which unfortunately remains inaccessible in numerous regions worldwide.
Wide-field retinal imaging, such as the RetCam, has the potential to do tele-ROP screening in conjunction with a reading center. This strategy enhanced both access to ROP screening and diagnostic objectivity. Nevertheless, the clinical diagnosis of ROP has continued to be subjective, resulting in significant variability and inconsistency in diagnosis. This disagreement has been observed even among experts in ROP diagnosis, as described in previous studies11,12. This inter-expert heterogeneity might be attributed to a variety of factors. The available evidence suggests that certain clinicians may take into account broader perspectives than what is typically depicted in a standard photograph. Additionally, these clinicians may prioritize different abnormalities in the retina, such as venous tortuosity, hemorrhage, or ridge lines. Consequently, experts may encounter challenges in promptly identifying the most essential vascular features for accurate diagnosis. Furthermore, it is noteworthy that experts often employ varying thresholds for determining the presence of vascular abnormalities necessary for diagnosing Plus disease. By acknowledging these concerns, researchers can work towards the development of more efficient diagnostic methods and objective methodologies, so enhancing the management of ROP and mitigating the risk of visual impairment in infancy.
At present, the diagnosis of clinical Plus disease relies on the establishment of certain thresholds in vascular abnormalities, which can be categorized into either a 2-level system (Plus or non-Plus) or a 3-level system (Plus, pre-Plus, or normal)16. Nevertheless, vascular changes in Plus disease, such as increasing vessel tortuosity and dilation, are continuous phenomena. This implies that Plus disease is characterized by a spectrum of vascular abnormalities, ranging from extremely normal to extremely abnormal vessels. Furthermore, ROP experts may have differing criteria for distinguishing between categories on this spectrum of disease, which may result in greater variability among and within experts10. In addition, follow-ups during treatments may become more challenging and less objective if two- or three-level classifications are utilized. In order to tackle these problems, recent research indicates the importance of using a continuous quantitative severity scale for vascular anomalies in ROP.
In this study, 76 posterior retinal images were graded by four ROP specialists using a 5-level grading method including “Normal”, “pre-Plus”, “Plus1”, “Plus2”, and “Plus3” and assigned numbers 1 to 5 to each of the levels to calculate an average score of severity for each image. The rationale for implementing a 5-level severity grading system for retinopathy of prematurity (ROP), as opposed to a 3-level system, can be comprehended by considering the following factors:
1-The existence of Plus disease in ROP signifies a continuous range of vascular abnormalities. This implies that there is considerable variation in the severity of the condition among patients, and a singular measurement may not sufficiently encompass this range of variability.
2. The implementation of a multi-level grading system has the potential to enhance the precision and dependability of diagnostic procedures. It enables a more nuanced measure of disease progression, which can be essential in deciding the best treatment strategy11,31.
3. It was observed that eyes with a greater number of quadrants of vascular tortuosity and dilation exhibited a higher rate of progression. This observation suggests that the implementation of a multi-level grading system has the potential to yield significant insights into the probability of illness development32.
Moreover, this method of grading helped us to calculate a more accurate average score of severity as a gold standard for training a regression model compared to a 3-level grading method in which Normal, pre-Plus, and Plus levels are assigned numbers 1,2, and 3.
An additional contribution of our study involves the utilization of image processing and machine learning techniques to present a computer-based approach for predicting the severity of Plus disease. Multiple research groups have conducted investigations into the advancement of computer-based image analysis for the automated diagnosis of ROP Plus disease18,33–42. The primary objective is to develop an automated system for Plus detection by evaluating retinal fundus images and defining the features of vessels. Conventional algorithms employ handcrafted (HC) features extraction techniques, such as assessing vascular dilation and tortuosity, to analyze retinal fundus images and distinguish between Plus level and pre-Plus/non-Plus conditions18–20,43–45.
On the other hand, Deep Convolutional Neural Networks (DCNN) can learn image features from the inputs to classify labels. DCNNs have been successfully used in the automated detection of diabetic retinopathy46, glaucoma47, age related macular degeneration48 and ROP40,42,49,50. DCNNs typically requires large numbers of good quality and balanced (among labels) training samples, which can be difficult to acquire in the ROP space, due to smaller eyes, less developed pupils, pressure on globe during image acquisition and poor fixation. Moreover, features learnt by DCNNs are not transparent or explainable to clinicians. Thus, using HC features in ROP studies has been remained effective either as an standalone method18,21,51,52 or to provide complementary information for DCNN in image classification tasks19,53.
The existing computer-based methods for automated diagnosis of Plus disease rely on discrete classification models, which do not adequately account for the continuous nature of abnormal changes in retinal vasculature. In contrast, as previously stated, in order to more accurately represent the characteristics of vascular abnormalities and the diagnostic practices of specialists in real-world scenarios, it is necessary to employ a continuous spectrum of severity scores rather than the existing discrete classifications of Plus, pre-Plus, and Normal.
In this study, we proposed a method that extract four image features related to the vascular characteristics i.e. tortuosity, density, curvature and diameter. Mutual t-tests among the 5 severity levels showed that the extracted features were able to significantly differentiate between the mutual levels of the disease severity in most of the cases. All four features exhibited considerable discriminatory ability between pre-Plus and Plus1 levels, a critical factor in guiding decisions regarding clinical interventions. The selected features were employed in the construction of a linear regression model. The suggested model generates a continuous scale of disease severity scores. The goal of our suggested model was to get a computer-assisted ROP diagnosis in order to promote objectivity in diagnosis and to replicate the real-world behavior of experts in identifying vascular anomalies. The findings of this investigation indicate that the proposed model exhibits a greater level of accuracy compared to two out of the four experienced experts included in the study. The model described in this study may also have potential utility in future research endeavors focused on the screening of ROP reactivation following anti-vascular endothelial growth factor (anti-VEGF) treatment.
This study has a number of drawbacks. First off, our dataset included a limited number of ROP images, which could have affected the model's performance. Second, the fundus images were acquired from a single clinical site with consistent device settings and population traits, which might have decreased the diversity of the data and impacted the algorithm's capacity to generalize to other populations. Also, the algorithm's accuracy in measuring Plus disease severity could potentially be enhanced in future studies by software design improvements that incorporate larger data sets and a greater number of expert opinions.
Due to the high quality and optimal focus of the images investigated in this study, it remains uncertain whether the algorithm exhibits comparable effectiveness when lower quality images are employed.
Variable pressures utilized with the RetCam contact camera, which can influence tortuosity and vascular diameter, can potentially affect the results of current study. Also, measurement bias can be influenced by various factors such as the mode and timing of imaging, the imaging angle, and the administration of mydriatics.
In conclusion, the proposed method in this study provides a continuous spectrum severity based on vascular abnormalities with high accuracy in detecting Plus severity score, performing similarly to experts’ diagnoses. By objectively analyzing vessel characteristics, it is possible to quantitatively assess the features of disease progression. The automated system has the potential to improve physicians' ability to diagnose Plus disease, making contributions to the management of ROP by image-based telemedicine methods.