just a demo I thought I'd share. Tensorflow face landmark detection was pretty easy, the 3d model took some learning, I had to create "morph targets" that adjust their value (0.0-1.0) for the eyes/mouth, which gets set in threejs.
One thing I found challenging was rotating and positioning the 3d model directly over the face at the correct orientation, there's some examples in python tensorflow I think but not sure those transformation functions were available in the js version.
