It Looks funny, right?

Fun little AI-assisted animation based on an audio recording based on a tumblr post

Music - “Memory Image”, Claude Larson

This began as a test video for a MOMELove workshop I gave in Fall 2021 on CRT/Analogue conversion and capture, but it kind of ended up evolving into something else.

Narration is by Gianni Matragrano and based on this tumblr post by “worm suggestion” on tumblr.

““AI”” Animation Process

All animation was created algorithmically. The character was animated entirely via EbSynth while backgrounds were created with Artbreeder. I probably drew less than 30 images in total to create this entire thing.

Animator Joel Haver has a great in-depth walkthrough on using EbSynth, which I used as a starting point for my own foray into the software. It’s not quite AI or machine learning, but EbSynth uses texture synthesis to auto rotoscope in-betweens from keyframes and reference footage. Then, it’s just a matter of keying out the background. EbSynth’s still in beta, and I found that creating fewer keyframes causes the software to create these funny “hiccup” smear frames where it doesn’t quite know what to do with certain parts of the reference.

Artbreeder is a more straightforward StyleGAN-based model that creates in-betweens to morph between images based on whatever timing and interpolation the user inputs. Both programs are free and relatively easy to use!

Keyframe and reference used as EbSynth input (left) vs. funky auto-generated in-between output (right)

UI of EbSynth (left) and Artbreeder (right). Super simple.

Analogue Conversion Process

Once I’d composited and edited everything in AE, I exported the file to run to a little CRT TV/VCR I stole from my grandma’s garage and then run that footage back to my computer using a capture card. For the workshop, I showcased both the physical analogue conversion process as well as a way to create a similar look in After Effects for those who don’t have a CRT monitor and all the extra miscellaneous equipment at home. Here’s a link to my project files and everything used in said workshop.

More in-depth details on how I get a similar “VHS” look in After Effects (left) and sound in Audition (right)