A video summarization framework based on activity attention modeling using deep features for smart campus surveillance system

Wasim Muhammad, Imran Ahmed, Jamil Ahmad, Muhammad Nawaz, Eatedal Alabdulkreem, Yazeed Ghadi

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Like other business domains, digital monitoring has now become an integral part of almost every academic institution. These surveillance systems cover all the routine activities happening on the campus while producing a massive volume of video data. Selection and searching the desired video segment in such a vast video repository is highly time-consuming. Effective video summarization methods are thus needed for fast navigation and retrieval of video content. This paper introduces a keyframe extraction method to summarize academic activities to produce a short representation of the target video while preserving all the essential activities present in the original video. First, we perform fine-grain activity recognition using a realistic Campus Activities Dataset (CAD) by modeling activity attention scores using a deep CNN model. In the second phase, we use the generated attention scores for each activity category to extract significant video frames. Finally, we evaluate the interframe similarity index used to reduce the number of redundant frames and extract only the representative keyframes.

Original languageEnglish
Article numbere911
JournalPeerJ Computer Science
Volume8
DOIs
Publication statusPublished - 2022
Externally publishedYes

Keywords

  • Dats science
  • Deep learning
  • Emerging technologies
  • Machine learning

Fingerprint

Dive into the research topics of 'A video summarization framework based on activity attention modeling using deep features for smart campus surveillance system'. Together they form a unique fingerprint.

Cite this