is it possible to project a flutter widget into the scene?

[colbymaloy]

hypothetically speaking, i'd llike to be take say a cube, and render a different flutter widget onto each cube face.

i'm really looking for a way to combine flutter's ui into a scene that is lit and has materials, to give the ui a differnet look and feel.

essentially giving us a way to texturize and combine ui with a 3d scene

[nmfisher]

You could use Flutter's RenderRepaintBoundary.toImage to render the widget as an image, then upload that image to a texture.

I doubt this could be done at 60+ fps (I think it's equivalent to readPixels, which involves a GPU-CPU copy) but for static content it should work.

[repentsinner]

For small images this is possible at 60fps+; not sure where the performance envelope is but this definitely works. Just get your flutter content into an Image, e.g. for styled text:

1. TextPainter layouts the text
2. PictureRecorder + Canvas renders it to a dart:ui.Picture
3. picture.toImage() → image.toByteData() extracts raw RGBA pixels as Uint8List
4. FilamentApp.instance.createTexture() allocates a GPU texture (SRGB8_A8)
5. texture.setImage(0, pixels, width, height, RGBA, UBYTE) uploads the pixel data