Jump to content

Is there a way to use VideoFrame (from the WebCodec API) directly in Pixijs?


Recommended Posts


Is there a way to use a VideoFrame directly in pixiJS? VideoFrame is part of the new WebCodec API (which is currently only supported in Chromium 94 and above). In supported browser, VideoFrame can be directly painted to HTML canvas, as ctx.drawImage supports taking VideoFrame as an input.

So I was wondering whether I can convert it into a Texture/Sprite to use in pixijs. The complete pipeline would be:

MediaStream -> MediaStreamTrackProcessor -> ReadableStream<VideoFrame> -> ??? -> Pixi

The use case is taking a Video from MediaStream(live video, or output of a VideoDecoder), and then using it in a Pixi App.

What would be the most performant way of doing this? I couldnt find anything in the docs, or github issues. Is it even possible?


pixi.js version: 6.5.1
Browser & Version: Chrome Version 105.0.5195.28 (Official Build) beta (64-bit)
OS & Version: Windows 11

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Create New...