$2+

Tenserflow.js/PoseNet + MaxMSP (Node for Max)+ Socket.IO + OSC example

0 ratings
I want this!

Tenserflow.js/PoseNet + MaxMSP (Node for Max)+ Socket.IO + OSC example

$2+
Contra
0 ratings

PS: It is NOT a Blender product!


A showcase I made for describing the communication between Tenserflow.js/PoseNet + MaxMSP (Node for Max) + Socket.IO + OSC.

Some key points here:

  • Use PoseNet of TensorFlow based on web-based artificial intelligence for motion capture;
  • Link PoseNet Web page to MaxMSP using the Node for Max module provided by MaxMSP;
  • The human motion data captured by PoseNet is sent back to MaxMSP through Socket.IO;
  • MaxMSP sends the received data to Blender via OSC for example.


You'll get MaxMSP patch and JavaScript source code. 

NO Blender file there】

-------------------------------

UPDATE:

max-n4m-socketio-posenet.zip is the original version of the demo video. Only nose position.x was sent from PosNet to MaxMSP then to Blender, to drive the car animation.

max-n4m-socketio-posenet-all-joints-data.zip is updated in 2021.1.16, which has all joints position supported.

max-n4m-socketio-posenet-all-joints-data-1.2.zip is updated in 2021.1.27, fixed a bug which will cause MaxMSP stucked. And test it with receiving OSC data in TouchDesigner!



--------------------------


Ref about the video:

PoseNet

https://github.com/tensorflow/tfjs-models/tree/master/posenet


Blender Model

https://gumroad.com/bluefoxcreation#RclL


Blender NodeOSC

https://github.com/maybites/blender.NodeOSC


Find more works/projects/code/tutorials:

Website: https://floatbug.com

YouTube: https://youtube.com/avantcontra

Patreon: https://patreon.com/avantcontra

$
I want this!

You'll get MaxMSP patch and JavaScript source code. 【NO Blender file】

Powered by