Sign Spotting



Author:   Tao Jiang, Necati Cihan Camgoz, Richard Bowden
Date:   Mar 03, 2021



Abstract

Given an isolated sign video (on the left side), we want to know whether/where the sign appears in the continous, co-articulated videos (on the right side). The upper bar is the ground truth indicating whether the query appears or not (red for true, white for false). The bottom bar is our prediction for the sign spotting (green for true, white for false) and the curve indicates the spotted probability.


This work is supported by EPSRC grant ExTol project: https://cvssp.org/projects/extol/






Implementation Details

Operating System: Ubuntu16.04
Programming Language: Python
Framework: PyTorch
IDE: PyCharm
GPU: Nvidia Titan X GPU on HT-Condor

Links and Downloads

Paper