Video processing

Sep 11, 2021 Video processing
Share on:
Work Link
Search for papers https://www.semanticscholar.org/search?q=video%20processing%20periodicity&sort=relevance
Video Textures https://cs.colby.edu/courses/F07/cs397/papers/schodl-videoTextures-sig00.pdf
Implementation of Video Textures https://github.com/max-kazak/CP_video_textures
  • changing the order in which the recorded frames are played
  • infinite video from finite input clip
  • video sprites
  • analyzing a video clip to extract its structure, and for synthesizing a new, similar looking video of arbitrary length
  • combine video textures with view morphing techniques to obtain 3D video textures
  • RAVIOLI: A parallel video processing library with auto resolution adjustability. 2
  • Identifying Periodical Activities Independent of Video Content (2014)3
    • Walking, flapping the wings, shaking of tree branches due to wind
  • This project implements 1
  • problem: water, fire, grass in the wind, candle flames, flags face some jitter (conspicuous jumps between frames)
    • paper mentions this can solved by cross-fading
  • this is easily fixed by modifying Distance Matrix D so that the pairwise distance between frames also considers a few frames around it
  • suggestions in 1: use a better distance metric, better blending and maintaining variety
  • 4 implemented Chebyshev Distance and Wavelet-based Distance; compare the results
  • use morphing for better blending
  • for maintaining variety, we define a parameter which controls randomness. It penalizes a lack of variety in the generated sequences
  1. Retrieving BPM from music
    • an idea is to use Teachable Machine
    • Teachable Machine is easy way to train a computer to recognize your own images, sounds, & poses
  2. Public Domain licenced cartoons
    • can be found and downloaded here
    • list of Public Domain cartoons here
  3. Pick a video speed in which animations will fit into music

  1. Schödl, A., R. Szeliski, D. Salesin and Irfan Essa. “Video textures.” Proceedings of the 27th annual conference on Computer graphics and interactive techniques (2000) link1 link2 ↩︎

  2. Sakurai, Hiroko & Ohno, Masaomi & Okada, Shintaro & Tsumura, Tomoaki & Matsuo, Hiroshi. (2009). RAVIOLI: A parallel video processing library with auto resolution adjustability.. 321-329. link ↩︎

  3. Shahin, Mehdipour, Ataee, Ali and Broumandnia. “Identifying Periodical Activities Independent of Video Content.” Journal of Electronic Science and Technology 12 (2014): 122-129 link ↩︎

  4. Panchal, Kunjal. “Improved Algorithm for Seamlessly Creating Infinite Loops from a Video Clip, while Preserving Variety in Textures.” ArXiv abs/2011.02579 (2020) link ↩︎