Tenserflow.js/PoseNet + MaxMSP (Node for Max)+ Socket.IO + OSC example

PS: It is NOT a Blender product!

A showcase I made for describing the communication between Tenserflow.js/PoseNet + MaxMSP (Node for Max) + Socket.IO + OSC.

Some key points here:

• Use PoseNet of TensorFlow based on web-based artificial intelligence for motion capture;
• Link PoseNet Web page to MaxMSP using the Node for Max module provided by MaxMSP;
• The human motion data captured by PoseNet is sent back to MaxMSP through Socket.IO;
• MaxMSP sends the received data to Blender via OSC for example.

You'll get MaxMSP patch and JavaScript source code. 

【NO Blender file there】

-------------------------------

UPDATE:

max-n4m-socketio-posenet.zip is the original version of the demo video. Only nose position.x was sent from PosNet to MaxMSP then to Blender, to drive the car animation.

max-n4m-socketio-posenet-all-joints-data.zip is updated in 2021.1.16, which has all joints position supported.

max-n4m-socketio-posenet-all-joints-data-1.2.zip is updated in 2021.1.27, fixed a bug which will cause MaxMSP stucked. And test it with receiving OSC data in TouchDesigner!

--------------------------

Ref about the video:

PoseNet

https://github.com/tensorflow/tfjs-models/tree/master/posenet

Blender Model

https://gumroad.com/bluefoxcreation#RclL

Blender NodeOSC

https://github.com/maybites/blender.NodeOSC

Find more works/projects/code/tutorials:

Website: https://floatbug.com

YouTube: https://youtube.com/avantcontra

Patreon: https://patreon.com/avantcontra