menu ☰
menu ˟

Applied Sciences, Vol. 8, Pages 1860: A Novel Lightweight Approach for Video Retrieval on Mobile Augmented Reality Environment

10 Oct 2018

Applied Sciences, Vol. 8, Pages 1860: A Novel Lightweight Approach for Video Retrieval on Mobile Augmented Reality Environment

Applied Sciences doi: 10.3390/app8101860

Authors:
Joolekha Bibi Joolee
Md Azher Uddin
Jawad Khan
Taeyeon Kim
Young-Koo Lee

Mobile Augmented Reality merges the virtual objects with real world on mobile devices, while video retrieval brings out the similar looking videos from the large-scale video dataset. Since mobile augmented reality application demands the real-time interaction and operation, we need to process and interact in real-time. Furthermore, augmented reality based virtual objects can be poorly textured. In order to resolve the above mentioned issues, in this research, we propose a novel, fast and robust approach for retrieving videos on the mobile augmented reality environment using an image and video queries. In the beginning, Top-K key-frames are extracted from the videos which significantly increases the efficiency. Secondly, we introduce a novel frame based feature extraction method, namely Pyramid Ternary Histogram of Oriented Gradient (PTHOG) to extract the shape feature from the virtual objects in an effective and efficient manner. Thirdly, we utilize the Double-Bit Quantization (DBQ) based hashing to accomplish the nearest neighbor search efficiently, which produce the candidate list of videos. Lastly, the similarity measure is performed to re-rank the videos which are obtained from the candidate list. An extensive experimental analysis is performed in order to verify our claims.

Click here to view the full article which appeared in Applied Sciences