Suitability of Single Image Super-Resolution Models for Video Super-Resolution
Shreyas D G1, V Sumanth Kaushik2, Gururaja H S3
1Shreyas D G*, Student, Department of Information Science and Engineering, BMS College of Engineering affiliated to Visvesvaraya Technological University, Bangalore, India.
2V Sumanth Kaushik, Student, Department of Information Science and Engineering, BMS College of Engineering affiliated to Visvesvaraya Technological University, Bangalore, India.
3Gururaja H.S., Assistant Professor in the Department of Information Science and Engineering, BMS College of Engineering (BMSCE), Bangalore, India.
Manuscript received on April 11, 2020. | Revised Manuscript received on May 15, 2020. | Manuscript published on June 30, 2020. | PP: 368-371 | Volume-9 Issue-5, June 2020. | Retrieval Number: E9575069520/2020©BEIESP | DOI: 10.35940/ijeat.E9575.069520
Open Access | Ethics and Policies | Cite | Mendeley
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: This project is an attempt to understand the suitability of the Single image super resolution models to video super resolution. Super Resolution refers to the process of enhancing the quality of low resolution images and video. Single image super resolution algorithms refer to those algorithms that can be applied on a single image to enhance its resolution. Whereas, video super resolution algorithms are those algorithms that are applied to a sequence of frames/images that constitute a video to enhance its resolution. In this paper we determine whether single image super resolution models can be applied to videos as well. When images are simply resized in Open CV, the traditional methods such as Interpolation are used which approximate the values of new pixels based on nearby pixel values which leave much to be desired in terms of visual quality, as the details (e.g. sharp edges) are often not preserved. We use deep learning techniques such as GANs (Generative Adversarial Networks) to train a model to output high resolution images from low resolution images. In this paper we analyse suitability of SRGAN and EDSR network architectures which are widely used and are popular for single image super resolution problem. We quantify the performance of these models, provide a method to evaluate and compare the models. We further draw a conclusion on the suitability and extent to which these models may be used for video super resolution. If found suitable this can have huge impact including but not limited to video compression, embedded models in end devices to enhance video output quality.
Keywords: EDSR, Image Enhancement, Super Resolution, SRGAN, Video Enhancemen