Skip to main content
 

 

 

Multi-Object Semantic Video Detection and Indexing using a 3D Deep Learning Model

Author name : AMR ABDELWAHED MAHMOUD ABOZEID
Publication Date : 2022-03-09
Journal Name : International Journal of Intelligent Engineering and Systems (IJIES)

Abstract

Within the exponential growth in raw data production, attributed in no small part to social media - Facebook,
Youtube, and others. Video is proving to be the most important data type thanks to the substantial amount of raw data
it contains, requiring an efficient way to be understood, organized, structured, and stored for ease of retrieval. Hence,
an efficient video indexing architecture is thus crucial for video datasets. This paper proposes an efficient Multi-Object
Semantic Video Detection (MOSD) that leverages the deep learning power to achieve effective indexing on the
semantic concept level. MOSD is multi-detection network of video semantics in multiple frames. MOSD exploits a
3D convolution operation to do multiple detections among multiple frames with higher performance. The detected
semantics then structured and used for indexing the video segments. MOSD has been trained and evaluated on
ImageNet VID dataset and has been compared to peers. MOSD showed efficiency in exploiting the temporal context
of a video to do simultaneous detections of consecutive frames which speeds up the detection of semantic objects.
MOSD also showed performance efficiency in terms of mAP which is 85.2%.

Keywords

Deep learning, Video indexing, Sematic video indexing, Video object detection, 3D convolution

Publication Link

https://inass.org/publications/volume/?y=2022&v=15&c

Block_researches_list_suggestions

Suggestions to read

“Synthesis and Characterization study of SnO2/α-Fe2O3, In2O3/α-Fe2O3 and ZnO/α-Fe2O3 thin films and its application as transparent conducting electrode in silicon heterojunction solar cell”
Asma Arfaoui
Influence of zinc acetate on HPMC/CMC polymer blend: Investigation of their composites’ structural, optical, and dielectric properties for dielectric capacitor applications
ghallab ahmed ahmed nassar sobhy
Study of the structural, optical and electrical properties of PVA/SA performance by incorporating Al2O3 nanoparticles
ghallab ahmed ahmed nassar sobhy
Characterization and Cytotoxic Assessment of Bis(2-hydroxy-3-carboxyphenyl)methane and Its Nickel(II) Complex
ghallab ahmed ahmed nassar sobhy
Contact