Tensorflow - video classification

Question

Is the open source version of TensorFlow suitable for classifying videos - similar to the examples outlined at http://vision.stanford.edu/pdf/karpathy14.pdf ? If not, are there other publicly available packages that can be used for this purpose?

Answer 1

One could change the image models supplied with TensorFlow to train the neural network in such video data.

Main problems:

• Create a custom reader that processes the appropriate video file format (or converts your video data into one of the supported formats).

• Using ops images to create the multi-resolution images required by Karpathy et al. model.

• (possibly) using queues to perform video pipelining and make sure I / O has not become a bottleneck.