foxxu7d

using python to make blender pr0nz

Added 2020-02-09 22:21:14 +0000 UTC

During a depression jag and as part of my program to find as much usable bvh data as possible, I decided to see if any video to bvh converters existed. This led me to a number of half-working python repos. After spending literally days compiling openpose for python and installing dependencies, I managed to get this repo: https://github.com/Dosomecrazy/video2bvh to work. I should also add that I had to sift through endless stackexchange articles in a fugue state trying to fix various filesystem issues to get the repo to work on windows.

I'm a novice computer scientist (a lowly web developer) but from what I can gather, the repo combines two neural networks, a 2d estimator and a 3d estimator, to first assemble an array of 2d keypoints representing a person's limbs and then the 3d estimator to guess their positions in 3d space and their rotations. You can then export that information to a bvh file.

I won't get into the details because the inner workings of the neural network are a mystery to me but suffice it to say: I can now extract poses from pictures IF the person's feet and hands are visible, otherwise the neural network tends to fuck up.

Right now, only Ryan Reos's Pillar Woman is rigged to use this bvh data but I'll soon be integrating this into my workflow. Feel free to send me pictures or video you want me to try and use with the neural network on Discord. They didn't train these neural networks on porn (lol) so its a little hard for it to reconstruct poses of people laying down or with limbs partially obscured so keep that in mind.