{"id":3265,"date":"2021-05-24T19:37:04","date_gmt":"2021-05-24T11:37:04","guid":{"rendered":"http:\/\/www.magicandlove.com\/blog\/?p=3265"},"modified":"2021-05-24T21:53:18","modified_gmt":"2021-05-24T13:53:18","slug":"mediapipe-in-touchdesigner-3","status":"publish","type":"post","link":"http:\/\/www.magicandlove.com\/blog\/2021\/05\/24\/mediapipe-in-touchdesigner-3\/","title":{"rendered":"MediaPipe in TouchDesigner 3"},"content":{"rendered":"\n

The last post demonstrated the use of the face detection function in MediaPipe with TouchDesigner. Nevertheless, it only produced an image with the detected results. It is not very useful if we want to manipulate the graphics according to the detected faces. In this example, we switch to the use of Script CHOP to output the detected face data in numeric form.<\/p>\n\n\n\n

As mentioned in the last post, the MediaPipe face detection expects a vertically flipped image as compared with the TouchDesigner texture, this example will flip the image with a TouchDesigner TOP to make the Python code simpler. Instead of showing all the detected faces, the code just pick the largest face and output its bounding box and the position of the left and right eyes.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Since we are working on a Script CHOP, it is not possible to connect directly the flipped TOP to it. In this case, we use the onSetupParameters<\/strong> function to define the Face<\/strong> TOP input in the Custom<\/strong> tab.<\/p>\n\n\n\n

def onSetupParameters(scriptOp):\n     page = scriptOp.appendCustomPage('Custom')\n     topPar = page.appendTOP('Face', label='Image with face')\n     return<\/pre>\n\n\n\n
And in the onCook<\/strong> function, we use the following statement to retrieve the image from the TOP that we dragged into the Face<\/strong> parameter.<\/p>\n\n\n\n
topRef = scriptOp.par.Face.eval()<\/pre>\n\n\n\n
After we found out the largest face from the image, we append a number channels<\/a> to the Script CHOP such that the TouchDesigner project can use them for custom visualisation. The new channels are,<\/p>\n\n\n\n