Key frame extraction algorithm for surveillance videos using an evolutionary approach
Abstract With rapid technological advancements, videos are captured, stored, and shared in multiple formats, increasing the requirement for summarization techniques to enable shorter viewing durations. Key Frame Extraction (KFE) algorithms are crucial in video summarization, compression, and offline...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2025-01-01
|
| Series: | Scientific Reports |
| Subjects: | |
| Online Access: | https://doi.org/10.1038/s41598-024-84324-0 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841559750511165440 |
|---|---|
| author | Manjusha Rajan Latha Parameswaran |
| author_facet | Manjusha Rajan Latha Parameswaran |
| author_sort | Manjusha Rajan |
| collection | DOAJ |
| description | Abstract With rapid technological advancements, videos are captured, stored, and shared in multiple formats, increasing the requirement for summarization techniques to enable shorter viewing durations. Key Frame Extraction (KFE) algorithms are crucial in video summarization, compression, and offline analysis. This study aims to develop an efficient KFE approach for generic videos. Existing methods include the Adaptive Key Frame Extraction Algorithm, which reduces redundancy while ensuring maximum content coverage; the Optimal Key Frame Extraction Algorithm, which utilizes a Genetic Algorithm (GA) to select key frames optimally; and the Rapid Key Frame Extraction Algorithm, which employs clustering techniques to identify typical key frames. However, a clear prerequisite remains for a more versatile KFE technique that can address generic applications rather than specific use cases. Evolutionary algorithms offer a powerful solution for achieving optimal KFE. This proposed method leverages an interactive GA with a well-designed Fitness Function and elitism-based survivor selection to enhance performance. This proposed algorithm has been tested on diverse datasets, including VSUMM, SumMe, Mall, user-generated videos, surveillance footage from Amrita Vishwa Vidyapeetham University (Coimbatore, India), and web-sourced videos. The results demonstrate that the proposed KFE approach adheres to benchmark data and captures additional significant frames. Compared to Differential Evolution (DE) techniques and Deep Learning (DL) models from the literature, this recommended algorithm demonstrates superior efficiency, as verified through quantitative and qualitative evaluation metrics. Furthermore, the computational complexity of the GA is intricately compared to that of DE and DL-based approaches, highlighting the distinct efficiencies and performance features. |
| format | Article |
| id | doaj-art-86a78f56159e467e851d6b537bd03a8a |
| institution | Kabale University |
| issn | 2045-2322 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj-art-86a78f56159e467e851d6b537bd03a8a2025-01-05T12:15:18ZengNature PortfolioScientific Reports2045-23222025-01-0115113410.1038/s41598-024-84324-0Key frame extraction algorithm for surveillance videos using an evolutionary approachManjusha Rajan0Latha Parameswaran1Department of Computer Science and Engineering, Amrita School of Computing, CoimbatoreDepartment of Computer Science and Engineering, Amrita School of Computing, CoimbatoreAbstract With rapid technological advancements, videos are captured, stored, and shared in multiple formats, increasing the requirement for summarization techniques to enable shorter viewing durations. Key Frame Extraction (KFE) algorithms are crucial in video summarization, compression, and offline analysis. This study aims to develop an efficient KFE approach for generic videos. Existing methods include the Adaptive Key Frame Extraction Algorithm, which reduces redundancy while ensuring maximum content coverage; the Optimal Key Frame Extraction Algorithm, which utilizes a Genetic Algorithm (GA) to select key frames optimally; and the Rapid Key Frame Extraction Algorithm, which employs clustering techniques to identify typical key frames. However, a clear prerequisite remains for a more versatile KFE technique that can address generic applications rather than specific use cases. Evolutionary algorithms offer a powerful solution for achieving optimal KFE. This proposed method leverages an interactive GA with a well-designed Fitness Function and elitism-based survivor selection to enhance performance. This proposed algorithm has been tested on diverse datasets, including VSUMM, SumMe, Mall, user-generated videos, surveillance footage from Amrita Vishwa Vidyapeetham University (Coimbatore, India), and web-sourced videos. The results demonstrate that the proposed KFE approach adheres to benchmark data and captures additional significant frames. Compared to Differential Evolution (DE) techniques and Deep Learning (DL) models from the literature, this recommended algorithm demonstrates superior efficiency, as verified through quantitative and qualitative evaluation metrics. Furthermore, the computational complexity of the GA is intricately compared to that of DE and DL-based approaches, highlighting the distinct efficiencies and performance features.https://doi.org/10.1038/s41598-024-84324-0ElitismEvolutionary computationGenetic algorithmKey frame extraction |
| spellingShingle | Manjusha Rajan Latha Parameswaran Key frame extraction algorithm for surveillance videos using an evolutionary approach Scientific Reports Elitism Evolutionary computation Genetic algorithm Key frame extraction |
| title | Key frame extraction algorithm for surveillance videos using an evolutionary approach |
| title_full | Key frame extraction algorithm for surveillance videos using an evolutionary approach |
| title_fullStr | Key frame extraction algorithm for surveillance videos using an evolutionary approach |
| title_full_unstemmed | Key frame extraction algorithm for surveillance videos using an evolutionary approach |
| title_short | Key frame extraction algorithm for surveillance videos using an evolutionary approach |
| title_sort | key frame extraction algorithm for surveillance videos using an evolutionary approach |
| topic | Elitism Evolutionary computation Genetic algorithm Key frame extraction |
| url | https://doi.org/10.1038/s41598-024-84324-0 |
| work_keys_str_mv | AT manjusharajan keyframeextractionalgorithmforsurveillancevideosusinganevolutionaryapproach AT lathaparameswaran keyframeextractionalgorithmforsurveillancevideosusinganevolutionaryapproach |