Logo image
FAST GRAPH SAMPLING FOR SHORT VIDEO SUMMARIZATION USING GERSHGORIN DISC ALIGNMENT
Conference paper

FAST GRAPH SAMPLING FOR SHORT VIDEO SUMMARIZATION USING GERSHGORIN DISC ALIGNMENT

Sadid Sahami, Gene Cheung and Chia-Wen Lin
ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, Vol.2022-May, pp.1765-1769
2022

Abstract

Gershgorin circle theorem graph sampling graph signal processing keyframe extraction video summarization Software Signal Processing Electrical and Electronic Engineering
We study the problem of efficiently summarizing a short video into several keyframes, leveraging recent progress in fast graph sampling. Specifically, we first construct a similarity path graph (SPG) G, represented by graph Laplacian matrix L, where the similarities between adjacent frames are encoded as positive edge weights. We show that maximizing the smallest eigenvalue λmin(B) of a coefficient matrix B = diag(a) + µL, where a is the binary keyframe selection vector, is equivalent to minimizing a worst-case signal reconstruction error. We prove that, after partitioning G into Q sub-graphs {G q } Q q=1 , the smallest Gershgorin circle theorem (GCT) lower bound of Q corresponding coefficient matrices-minq λ min (B q ) -is a lower bound for λmin(B). This inspires a fast graph sampling algorithm to iteratively partition G into Q sub-graphs using Q samples (keyframes), while maximizing λ min (B q ) for each sub-graph G q . Experimental results show that our algorithm achieves comparable video summarization performance as state-of-the-art methods, at a substantially reduced complexity.

Metrics

1 Record Views

Details

Logo image