Summary
Whythetrick.io features
1. Pose estimation technology.
2. Python-based data shaping.
3. 3D animation technology.
Pose estimation technology
What is pose estimation?
Pose estimation technology allows us to digitize 2D video data into 3D coordinates expressed in the x, y, and z axes.
Whythetrick's engine detects, locates, and tracks the number of key points (also called landmarks) on a given person. These key points represent major joints like ankles and shoulders. Whythetrick engine detects 35+ joints of the human body.
Why is pose estimation important?
The pose estimation technology used in whythetrick.io allows everyone to convert their movement into data without coding.
Back in the time when we started whythetric.com, we used to make all 3D models manually. It usually took two weeks to make a 5-second long 3D model of an Ollie, for example.
Creating 3D models requires experience in Blender or other 3D model creation applications. Not surprisingly, only a few people can do that. So we needed to find a way to allow EVERYONE to convert their movement and experiences into data easily.
How does it work?
Whytehtrick's engine detects 35 key points of the human body including toes, ankles, knees, hips and so on.
The system detects and digitalize all those joints and convert pose data into numbers in x, y, z axes.
Digitalization of joints is not enough, though. Whythetrick's engine automatically calculate quaternion angles between joints and digitalize them, too.
Data shaping with Python
What is data shaping?
It is to eliminate/reduce outliers in a data set. This enables smooth transitions of an animation.
Whythetrick's engine detects, locates, and tracks the number of key points (also called landmarks) on a given person. These key points represent major joints like ankles and shoulders. Whythetrick engine detects 35+ joints of the human body.
Why is data shaping important?
Although the automated pose estimation technology is a powerful tool, it's not 100% accurate. As is, it causes "vibration" of the motion data.
The engine detects human's joints that appear in each frame of a video file. As the engine's accuracy's not 100%, it may estimate a location of a joint slightly higher/lower than its actual place in a frame. When they compile, joints appears as if it's vibrating.
In other case, if there's a tree branch right behind your arm, it may erroneously estimate the branch as your arm. This may also cause an error in the estimation. To minimize this type of errors, whythetrick features a customized python engine and reduces outliers.
3D animation technology
How does it work?
Whythetrick uses a Javascript 3D rendering library called Three.js, which works in any modern browsers in the market.
The estimation engine generates a set of "pose data" and later installs it into a 3D model.
3D model offers useful features including interactivity with a mouse, transparency & speed control, and so on.
Why is browser-based 3D animation important?
With this, everyone will be able to access 3D animations regardless of their web browsers and devises without having to install specific applications.
By converting your motion into an animation, you'll be able to deliver your experience to everyone who has access to the internet.
