MARATTO

article · Big Data Mining and Analytics

Human Action Recognition Using Difference of Gaussian and Difference of Wavelet

202361 citationsOpen accessUniversité Moulay Ismail de Meknes

In plain language

Human action recognition aims to identify human activities within images and video recordings. A core difficulty lies in creating action descriptors that remain dependable across varied visual environments. A method addressing this combines spatial and spectral filtering techniques. Scale-invariant visual features are extracted using a Difference of Gaussian filter, while spectral characteristics are gathered using a Difference of Wavelet filter. Merging these two outputs creates a unified feature vector for each action image. Linear Discriminant Analysis then reduces dimensionality to remove redundant data, followed by classification using a nearest neighbour approach. Evaluated through five-fold cross-validation on benchmark datasets, the combined feature model achieved average recognition accuracies of 83.66 percent on the Weizmann dataset and 62.52 percent on the UCF 11 dataset, outperforming the individual filters used in isolation.

Key takeaways

  • A hybrid action descriptor combines Difference of Gaussian spatial filters with Difference of Wavelet spectral filters.
  • Linear Discriminant Analysis reduces redundant data prior to nearest neighbour classification.
  • Combining both filters yields higher recognition accuracy than using either filter on its own.
  • Five-fold cross-validation delivered an average accuracy of 83.66 percent on the Weizmann dataset and 62.52 percent on the UCF 11 dataset.

Why it matters

Automated human action recognition allows computer vision systems to understand human movements across varied visual conditions. Improving how movement features are extracted from video frames helps systems handle changes in scale and background. By joining spatial and frequency-based image filtering, recognition accuracy can be enhanced without relying on single, less dependable visual cues.

Commercialisation angle

The work represents early-stage algorithmic development evaluated on academic benchmark datasets. Potential applications include automated video analysis and monitoring tools that require action detection from recorded visual media. Potential users include software developers building computer vision pipelines. Given the modest accuracy on complex real-world data such as UCF 11, the approach remains far from market deployment.

AI-generated from the published abstract. Always read the original work before citing.

Abstract

Human Action Recognition (HAR) attempts to recognize the human action from images and videos. The major challenge in HAR is the design of an action descriptor that makes the HAR system robust for different environments. A novel action descriptor is proposed in this study, based on two independent spatial and spectral filters. The proposed descriptor uses a Difference of Gaussian (DoG) filter to extract scale-invariant features and a Difference of Wavelet (DoW) filter to extract spectral information. To create a composite feature vector for a particular test action picture, the Discriminant of Guassian (DoG) and Difference of Wavelet (DoW) features are combined. Linear Discriminant Analysis (LDA), a widely used dimensionality reduction technique, is also used to eliminate duplicate data. Finally, a closest neighbor method is used to classify the dataset. Weizmann and UCF 11 datasets were used to run extensive simulations of the suggested strategy, and the accuracy assessed after the simulations were run on Weizmann datasets for five-fold cross validation is shown to perform well. The average accuracy of DoG + DoW is observed as 83.6635% while the average accuracy of Discrinanat of Guassian (DoG) and Difference of Wavelet (DoW) is observed as 80.2312% and 77.4215%, respectively. The average accuracy measured after the simulation of proposed methods over UCF 11 action dataset for five-fold cross validation DoG + DoW is observed as 62.5231% while the average accuracy of Difference of Guassian (DoG) and Difference of Wavelet (DoW) is observed as 60.3214% and 58.1247%, respectively. From the above accuracy observations, the accuracy of Weizmann is high compared to the accuracy of UCF 11, hence verifying the effectiveness in the improvisation of recognition accuracy.

Research topics

  • Human Pose and Action Recognition
  • Anomaly Detection Techniques and Applications
  • Gait Recognition and Analysis

Sustainable Development Goals

Read the original research

This page summarises published work. The authoritative version sits with the publisher.

DOI: 10.26599/bdma.2022.9020040

Is something wrong with this record? Report it or request removal.

Discussion

Discuss this research

Have you built on this work, tried to replicate it, or seen it applied in practice? Share what you know. Verified researchers and MARATTO™ domain experts can open a discussion, and any member can reply. Contributions are reviewed before they appear.

No discussion yet. Open the first thread.