Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PoseLandmarker segmentationMask doesn't work in web #5395

Closed
achatham opened this issue May 10, 2024 · 3 comments
Closed

PoseLandmarker segmentationMask doesn't work in web #5395

achatham opened this issue May 10, 2024 · 3 comments
Assignees
Labels
platform:javascript MediaPipe Javascript issues task:pose landmarker Issues related to Pose Landmarker: Find people and body positions type:bug Bug in the Source Code of MediaPipe Solution

Comments

@achatham
Copy link

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

Yes

OS Platform and Distribution

web

Mobile device if the issue happens on mobile device

No response

Browser and version if the issue happens on browser

124.0.6367.119 (Official Build) (64-bit) (cohort: Control)

Programming Language and version

typescript

MediaPipe version

tasks-vision 0.10.13

Bazel version

No response

Solution

PoseLandmarker

Android Studio, NDK, SDK versions (if issue is related to building in Android environment)

No response

Xcode & Tulsi version (if issue is related to building for iOS)

No response

Describe the actual behavior

SegmentationMask WebGLTexture not renderable

Describe the expected behaviour

segmentationMasks[0] should render

Standalone code/steps you may have used to try to get what you need

When using PoseLandmarker, I haven't been able to render `result.segmentationMasks[0].getAsWebGLTexture()`. I suspect there may be a bug, as I can render the results of ImageSegmenter with similar code.

I have a standalone demo at https://codepen.io/achatham/pen/BaearyK?editors=1010. It's implemented so that it can switch between ImageSegmenter (which works) and PoseLandmarker (which does not), with all of the rest of the code the same.

With PoseLandmarker, I get the console error: `Feedback loop formed between Framebuffer and active Texture.`

`result.getAsUint8Array()` et al also don't work, or produce zeros. But I'm most interested in getting the texture.

I'm able to retrieve and render the pose detections fine.

Other info / Complete Logs

No response

@achatham achatham added the type:bug Bug in the Source Code of MediaPipe Solution label May 10, 2024
@kuaashish kuaashish assigned kuaashish and unassigned ayushgdev May 10, 2024
@kuaashish kuaashish added platform:javascript MediaPipe Javascript issues task:pose landmarker Issues related to Pose Landmarker: Find people and body positions labels May 10, 2024
@schmidt-sebastian
Copy link
Collaborator

We will take a look.

@schmidt-sebastian
Copy link
Collaborator

Fix is pending review internally.

Copy link

Are you satisfied with the resolution of your issue?
Yes
No

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
platform:javascript MediaPipe Javascript issues task:pose landmarker Issues related to Pose Landmarker: Find people and body positions type:bug Bug in the Source Code of MediaPipe Solution
Projects
None yet
Development

No branches or pull requests

4 participants