Video processing

Important links table

Video Textures¹, 2000 paper

• changing the order in which the recorded frames are played
• infinite video from finite input clip
• video sprites
• analyzing a video clip to extract its structure, and for synthesizing a new, similar looking video of arbitrary length
• combine video textures with view morphing techniques to obtain 3D video textures

Realtime video processing

• RAVIOLI: A parallel video processing library with auto resolution adjustability. ²

Periodic activities in video

• Identifying Periodical Activities Independent of Video Content (2014)³
  • Walking, flapping the wings, shaking of tree branches due to wind

Improved Algorithm for Seamlessly Creating Infinite Loops from a Video Clip, while Preserving Variety in Textures⁴, 2020 papaer

• This project implements ¹
• problem: water, fire, grass in the wind, candle flames, flags face some jitter (conspicuous jumps between frames)
  • paper mentions this can solved by cross-fading
• this is easily fixed by modifying Distance Matrix D so that the pairwise distance between frames also considers a few frames around it
• suggestions in ¹: use a better distance metric, better blending and maintaining variety
• ⁴ implemented Chebyshev Distance and Wavelet-based Distance; compare the results
• use morphing for better blending
• for maintaining variety, we define a parameter which controls randomness. It penalizes a lack of variety in the generated sequences

Follow up project description

1. Retrieving BPM from music
   • an idea is to use Teachable Machine
   • Teachable Machine is easy way to train a computer to recognize your own images, sounds, & poses
2. Public Domain licenced cartoons
   • can be found and downloaded here
   • list of Public Domain cartoons here
3. Pick a video speed in which animations will fit into music