Retinal Blood Vessel Segmentation on Style-augmented Images
DOI:
https://doi.org/10.24193/subbi.2021.1.05Keywords:
Medical Image Processing, Retinal Blood Vessel Segmentation, Neural Style Transfer.Abstract
The average human lifespan increased dramatically in the second half of 20th century. It was mainly due to technological improvements, which were driven by the continuous war preparations, and while humans have got another 20 years to live, unfortunately there are some sad side effects added to the elderly life. Various diseases can attack the eye, our major organ responsible for receiving information, therefore many researches were devoted to examine these diseases, their early signs, and how could they be stopped. From the start of 21th century, methods aided by computer were more and more involved in these processes, up to the current trend of using Convolutional Neural Networks (CNNs). While supervised methods, CNNs do achieve accuracy which can be compared to a skilled ophtalmologist, they require a tremendous amount of labeled data which is sparse in medical fields because the amount of time and resources needed to create them. One natural solution is to augment the data present, that is, copying the distribution while adding a small variety, like coloring an image differently. That is, what our paper aims to explore, whether a texturing algorithm, the Neural Style Transfery can be used to make a data set richer, and therefore helping a classifier CNN to achieve better results.
Received by the editors: 4 December 2020.
2010 Mathematics Subject Classification. 68U10, 68T01, 92B20.
1998 CR Categories and Descriptors. I.4.6 [I.2 Image Processing and Computer Vision]: Segmentation - Region, partitioning; I.5.1 [Pattern Recognition]: Models – Neural Nets.
References
Al-Rawi, M., Qutaishat, M., and Arrar, M. An improved matched filter for blood vessel detection of digital retinal images. Computers in biology and medicine 37, 2 (2007), 262–267.
Chaudhuri, S., Chatterjee, S., Katz, N., Nelson, M., and Goldbaum, M. Detection of blood vessels in retinal images using two-dimensional matched filters. IEEE Transactions on medical imaging 8, 3 (1989), 263–269.
Drive: Digital retinal images for vessel extraction. https://drive.grand-challenge.org/.
Fraz, M. M., Remagnino, P., Hoppe, A., Uyyanonvara, B., Rudnicka, A. R., Owen, C. G., and Barman, S. A. Blood vessel segmentation methodologies in retinal images–a survey. Computer methods and programs in biomedicine 108, 1 (2012), 407–
Gatys, L. A., Ecker, A. S., and Bethge, M. A neural algorithm of artistic style. arXiv preprint arXiv:1508.06576 (2015).
Gatys, L. A., Ecker, A. S., and Bethge, M. Image style transfer using convolutional neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (2016), pp. 2414–2423.
Gatys, L. A., Ecker, A. S., Bethge, M., Hertzmann, A., and Shechtman, E. Controlling perceptual factors in neural style transfer. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017), pp. 3985–3993.
Jing, Y., Yang, Y., Feng, Z., Ye, J., Yu, Y., and Song, M. Neural style transfer: A review. IEEE transactions on visualization and computer graphics (2019).
Johnson, J., Alahi, A., and Fei-Fei, L. Perceptual losses for real-time style transfer and super-resolution. In European conference on computer vision (2016), Springer, pp. 694–711.
Li, Y., Wang, N., Liu, J., and Hou, X. Demystifying neural style transfer. arXiv preprint arXiv:1701.01036 (2017).
Mar´ın, D., Aquino, A., Gegundez-Arias, M. E., and Bravo, J. M. ´ A new supervised method for blood vessel segmentation in retinal images by using gray-level and moment invariants-based features. IEEE Transactions on medical imaging 30, 1 (2010), 146–158.
Nguyen, U. T., Bhuiyan, A., Park, L. A., and Ramamohanarao, K. An effective retinal blood vessel segmentation method using multi-scale line detection. Pattern recognition 46, 3 (2013), 703–715.
Ny´ıri, T., and Kiss, A. Style transfer for dermatological data augmentation. In Proceedings of SAI Intelligent Systems Conference (2019), Springer, pp. 915–923.
Orobix: Retina u-net. https://github.com/orobix/retina-unet.
Risser, E., Wilmot, P., and Barnes, C. Stable and controllable neural texture synthesis and style transfer using histogram losses. arXiv preprint arXiv:1701.08893 (2017).
Ronneberger, O., Fischer, P., and Brox, T. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention (2015), Springer, pp. 234–241.
Simonyan, K., and Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
Wang, C., Zhao, Z., Ren, Q., Xu, Y., and Yu, Y. Dense u-net based on patch-based learning for retinal vessel segmentation. Entropy 21, 2 (2019), 168.
Zhang, B., Zhang, L., Zhang, L., and Karray, F. Retinal vessel extraction by matched filter with first-order derivative of gaussian. Computers in biology and medicine 40, 4 (2010), 438–445.
Zheng, X., Chalasani, T., Ghosal, K., Lutz, S., and Smolic, A. Stada: Style transfer as data augmentation. arXiv preprint arXiv:1909.01056 (2019)
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Studia Universitatis Babeș-Bolyai Informatica
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
