Logo spatialcomputing.info Nicht die Mona Lisa
Tensorflow face detection + threejs + blender

https://reddit.com/link/yy67fo/video/2g4wmdwssl0a1/player

https://ardemo.webkitstudio.com/

just a demo I thought I’d share. Tensorflow face landmark detection was pretty easy, the 3d model took some learning, I had to create „morph targets“ that adjust their value (0.0-1.0) for the eyes/mouth, which gets set in threejs.

One thing I found challenging was rotating and positioning the 3d model directly over the face at the correct orientation, there’s some examples in python tensorflow I think but not sure those transformation functions were available in the js version.

submitted by /u/one_half_quip
[link] [comments] Augmented Reality & /u/one_half_quip