HOME Board


Hit 175
Subject [IEEE TDSC] Defending Video Recognition Model (Hong Joo Lee) is accepted in IEEE Transactions on Dependable and Secure Computing
Name 관리자
Date 2023-12-4
Title: Defending Video Recognition Model against Adversarial Perturbations via Defense Patterns

Authors: Hong Joo Lee and Yong Man Ro

Deep Neural Networks (DNNs) have been widely successful in various domains, but they are vulnerable to adversarial attacks. Recent studies have also demonstrated that video recognition models are also susceptible to adversarial perturbations, but the existing defense strategies in the image domain do not transfer well to the video domain due to the lack of considering temporal development and require a high computational cost for training video recognition models. This paper, first, investigates the temporal vulnerability of video recognition models by quantifying the effect of temporal perturbations on the model’s performance. Based on these investigations, we propose Defense Patterns (DPs) that can effectively protect video recognition models by adding them to the input video frames. The DPs are generated on top of a pre-trained model, eliminating the need for retraining or fine-tuning, which significantly reduces the computational cost. Experimental results on two benchmark datasets and various action recognition models demonstrate the effectiveness of the proposed method in enhancing the robustness of video recognition models.

“Note: This work was done when Dr. Lee was a PhD student at KAIST. He is now a Postdoctoral Researcher at Technical University of Munich (TUM) after completing his PhD.”