Decomposition of Color Wavelet with Higher Order Statistical Texture and Convolutional Neural Network Features set based Classification of Colorectal Polyps from Video Endoscopy

A.S.M. Shafi, Mohammad Motiur Rahman


Gastrointestinal cancer is one of the leading causes of death across the world. The gastrointestinal polyps are considered as the precursors of developing this malignant cancer. In order to condense the probability of cancer, early detection and removal of colorectal polyps can be cogitated. The most used diagnostic modality for colorectal polyps is video endoscopy. But the accuracy of diagnosis mostly depends on doctors' experience that is crucial to detect polyps in many cases. Computer-aided polyp detection is promising to reduce the miss detection rate of the polyp and thus improve the accuracy of diagnosis results. The proposed method first detects polyp and non-polyp then illustrates an automatic polyp classification technique from endoscopic video through color wavelet with higher-order statistical texture feature and Convolutional Neural Network (CNN). Gray Level Run Length Matrix (GLRLM) is used for higher-order statistical texture features of different directions (Ɵ = 0o, 45o, 90o, 135o). The features are fed into a linear support vector machine (SVM) to train the classifier. The experimental result demonstrates that the proposed approach is auspicious and operative with residual network architecture, which triumphs the best performance of accuracy, sensitivity, and specificity of 98.83%, 97.87%, and 99.13% respectively for classification of colorectal polyps on standard public endoscopic video databases.


Video Endoscopy; Colorectal Cancer; Wavelet; Convolutional Neural Network; Run Length Matrix; Support Vector Machine; Gastrointestinal Lesions


L.A. Alexandre, N. Nobre, J. Casteleiro. “Polyp Detection in Endoscope Videos Using SVMs”, European Conference on Principles and Practice of Knowledge Discovery in Databases, pp. 358-36, 2007.

Wong NA, Hunt LP, Novelli MR, Shephered, Warren BF, “Observer agreement in the diagnosis of serrated polyps of the large bowel”, Histopathology, 55:63-6, 2009.

Leggett B, Whitehall V, “Role of the serrated pathway in colorectal cancer pathogenesis”, Gastroenterology, 138: 2088 100, 2010.

Kahi CJ, “How does the serrated polyp pathway alter CRC screening and surveillance?”, Digestive Diseases and Sciences, 60: 773 80, 2015.

Korbar B, Olofson AM, Miraflor AP, Nicka CM, Suriawinata MA, Torresani L, “Deep learning for classification of colorectal polyps on whole-slide images”, Journal of Pathology Informatics, 8: 30, 2017.

S. A. Karkanis, D. K. Iakovidis, D.E.Maroulis, D. A. Karras, and M. Tzivras, “Computer-aided tumor detection in endoscopic video using color wavelet features”, IEEE Transactions on Information Technology in Biomedicine, vol. 7, no. 3, pp. 141–152, 2003.

D. K. Iakovidis, D. E. Maroulis, and S. A. Karkanis, “An intelligent system for automatic detection of gastrointestinal adenomas in video endoscopy”, Computers in Biology and Medicine, vol. 36, no. 10, pp. 1084–1103, 2006.

B. Li, Y. Fan, M. Q.-H.Meng, and L. Qi, “Intestinal polyp recognition in capsule endoscopy images using color and shape features”, IEEE International Conference on Robotics and Biomimetics , pp. 1490–1494, Institute of Electrical and Electronics Engineers, Guilin, China, December 2009.

Y. Zou, L. Li, Y. Wang, J. Yu, Y. Li, and W. J. Deng, “Classifying digestive organs in wireless capsule endoscopy images based on deep convolutional neural network”, IEEE International Conference on Digital Signal Processing, pp. 1274–1278, Institute of Electrical and Electronics Engineers, Singapore, July 2015.

R. Zhu, R. Zhang, and D. Xue, “Lesion detection of endoscopy images based on convolutional neural network features”, 8th International Congress on Image and Signal Processing, pp. 372–376, Institute of Electrical and Electronics Engineers, Shenyang, China, October 2015.

E. Ribeiro, A. Uhl, andM. H¨afner, “Colonic polyp classification with convolutional neural networks”, IEEE 29th International Symposium on Computer-Based Medical Systems, Institute of Electrical and Electronics Engineers, Dublin, Ireland, June 2016.

S. Y. Park and D. Sargent, “Colonoscopic polyp detection using convolutional neural networks”, International Society for Optics and Photonics, vol. 9785 of SPIEMedical Imaging, San Diego, Cali, USA, March 2016.

Mustain Billah, Sajjad Waheed and Mohammad Motiur Rahman, “An Automatic Gastrointestinal Polyp Detection System in Video Endoscopy Using Fusion of Color Wavelet and Convolutional Neural Network Features”. International Journal of Biomedical Imaging, 9545920, 2017.

Alaa El Khatib, Naoufel Werghi, and Hussain Al-Ahmad, “Enhancing Automatic Polyp Detection Accuracy Using Fusion Techniques”, IEEE 59th International Midwest Symposium on Circuits and Systems, 16-19 October 2016, Abu Dhabi, UAE.

Xi Mo, Ke Tao, Quan Wang, and Guanghui Wang, “An Efficient Approach for Polyps Detection in Endoscopic Videos Based on Faster R-CNN”, arXiv:1809.01263v1 [q-bio.TO] 4 Sep 2018.

N. Tajbakhsh, S. Gurudu, and J. Liang, “A classification-enhanced vote accumulation scheme for detecting colonic polyps,” in Abdominal Imaging. Computation and Clinical Applications, ser. Lecture Notes in Computer Science, 2013, vol. 8198, pp. 53–62.

P. Mesejo, D. Pizarro, A. Abergel, “Computer-aided classification of gastrointestinal lesions in regular colonoscopy”, IEEE Transactions on Medical Imaging, vol. 35, no. 9, pp. 2051–2063, 2016.

J. Bernal, N. Tajkbaksh, F. J. Sanchez, “Comparative validation of polyp detection methods in video colonoscopy: results from the MICCAI 2015 endoscopic vision challenge”, IEEE Transactions on Medical Imaging, vol. 36, no. 6, pp. 1231–1249, 2017.

K. Vassilis and B. Maria, “An adaptive neurofuzzy approach for the diagnosis in wireless capsule endoscopy imaging”, International Journal of Information Technology, vol. 13, no. 1, pp. 46–56, 2007.

Alexander V. Mamonov, Isabel N. Figueiredo, Pedro N. Figueiredo, Yen-His Richard Tsai, “Automated polyp detection in colon capsule endoscopy”, IEEE Transactions on Medical Imaging, vol. 33, no. 7, pp. 1488–1505, 2014.

G. Van deWouwer, P. Scheunders, and D. Van Dyck, “Statistical texture characterization from discrete wavelet representations”, IEEE Transaction on Image Processing, vol. 8, pp. 592–598, Apr. 1999.

Belur VD, Edwin B. Holder, “Image characterizations based on joint gray level-run length distributions”, Pattern Recognition Letters, 12: 497-502, 1991.

Serre, T, “Robust object recognition with cortex-like mechanisms”, IEEE Transaction on Pattern Analysis and Machine Intelligence. 29(3), 411–426, 2007.

Donahue, Jeff, “Decaf: A deep convolutional activation feature for generic visual recognition”. arXiv preprint arXiv: 1310. 1531, 2013.

Total views : 33 times


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.