spatialcomputing.info

I want to overlay 3d objects on live webcam for my project. I have overlayed 2d objects like googles, mustache, and hat. Now I want to overlay 3d objects like beard, mustache, and hair. I searched over some articles and tutorials, but all of them were ambiguous and didn’t teach where to start. From what I have learned I need to create 3d objects using blender and import it using OpenGL and then somehow overlay it to the facial landmarks. I want to know what I need to learn to achieve this objective. I have read the previous question on this source1 and it didn’t help much. Also, I have read several blogs like this, this, and the best one here and various others while surfing. I know I am entering into AR/VR, but I ready to learn the things required to get my work done.
There are various libraries/frameworks which don’t require to code anything like SparkAR, Virtualtryon, ditto, etc. but they don’t teach you anything. I want to learn how to do these things by myself. If I create my 3d object like hair(hair-like Goku in SuperSaiyan)/Mustache or eyes in blender how can I overlay it in real-time on webcam using OpenCV or any other python compatible lib/framework? I mean overlaying 3d hair over my own hair, overlaying 3d eyes over my eyes and similar. What are the things required to do such a task? What things do I need to learn?

We’re researchers working with Dr. Serge Egelman at the University of California, Berkeley and Goethe University Frankfurt am Main. We’d like to invite you to participate in our study.

Please answer a 15-minute online survey about your opinions on the smartphone apps.

You can participate in the study if you satisfy all the conditions below:

• You are 18 or older
• In a typical week you use a smartphone on a nearly daily basis

Why is it important that you participate?

• Your answers to this survey will provide invaluable information that will contribute to the ongoing academic research.
• It will also help to design software tools that will benefit users like you!
• As a token of our appreciation, we will make a donation to a non-profit organization of your choice.

Without you this research would not be possible, so we greatly appreciate and value your time and support!

Any questions? Please reach out to [researchlab@icsi.berkeley.edu](mailto:researchlab@icsi.berkeley.edu)

To get as many perspectives as possible, we need each person to take our survey only once. Thanks!

Link to the survey:

https://berkeley.qualtrics.com/jfe/form/SV_1XqfYCsIhB4ellb?ch=1