Machine Learning Deformer

This is my intern project in Tencent.

Machine Learning deformer is a trendy area in gaming technology, it helps with the effect of complex deformations which are not convenient to achieve with traditional skin cluster or blendshapes, while muscle deform and cloth deform is two major directions in MLD.

I built the skeleton rig in Maya according to the anatomical reference, which need to run with logical human kinematic.

The muscle simulation part was done in Houdini, which provide a environment to debug and procedually simulation.

We coorperate with RenderG, who provided us with a massive scale of computing resources. Render farm is great.

Muscle simulation result in Houdini

We trained the Neural network in Unreal Engine. It is a highly optimized framework for geometry deformation. Very light weight.

Also result in cloth ML deformation.