AutoFlip is an open source tool released by Google on February 13th (local time). The tool has the ability to allow AI to readjust video frames to optimally customize any video aspect ratio. Something that allows you to escape from unnatural trimming.
According to Google, video aspect ratios made for TV sets and desktops are usually 16:9 or 4:3. However, mobile is the most popular video viewing now. Therefore, a user may feel awkward or uncomfortable with a video whose aspect ratio does not match the terminal.
In order to solve this problem, it is a reality that professional staff manually edit the video by a professional staff and adjust important content for each scene so that it is not cut off on the screen. This requires wasting effort and time.
Autoflip is a tool that aims to focus on the main part of the video screen by using a function similar to a camera stabilizer. It is said that by building an object detection and tracking function that intelligently understands video content through machine learning in the MediaPipe framework, the video aspect ratio can be adjusted immediately.
It also detects changes in the screen composition, properly identifies scene transitions, and automatically readjusts even when scenes change, so there is no downtime for resizing the screen. It analyzes every scene and determines if frame adjustment and tracking mode are needed. Google also posted the project’s source code and instructions on GitHub. Related information can be found here .