Skip to content

Inference Text/Image to video - TiledVAE feature #1516

Closed

Description

@Domica

Proposal

As proposed through Discord feature addition, new Inference option for Text/Image to video screen for using TiledVAE to avoid OOMs on low to mid VRAM GPUs.

Would be appreciated for newbies to easier use the appliation rather than entering the Comfyui flow/node view.

Have some AI code ideas (as only know superficialy coding).

Steps (assumed):

  1. New XAML UI Card
    Path: StabilityMatrix.Avalonia/Controls/Inference/TiledVAEEncodeCard.axaml

  2. Code for the card
    Path: StabilityMatrix.Avalonia/Controls/Inference/TiledVAEEncodeCard.axaml.cs

  3. ViewModel for the card (with bindings & validation)
    Path: StabilityMatrix.Avalonia/ViewModels/Inference/TiledVAEEncodeCardViewModel.cs

  4. Inference Module (core)
    Path: StabilityMatrix.Avalonia/ViewModels/Inference/Modules/TiledVAEEncodeModule.cs

  5. Typed Node Definition for ComfyUI
    Add to existing file: StabilityMatrix.Core/Models/Api/Comfy/Nodes/ComfyNodeBuilder.cs

  6. Model register

  7. JSON Serialization Support

  8. Avalonia Style Include (if needed for discovery)

Would be appreaciated by contributors to assess the idea for implementation.

Thanks

Activity

  1. Domica commented on Jan 14, 2026

    @Domica
    Author

    Forked Dev version, will see if can try adding the feature (fingers crossed)

  2. NeuralFault commented on Jan 16, 2026

    @NeuralFault
    Contributor

    I intend on adding it to my already existing contribution here: #1469

    It has the comfy workflow connections for Temporal Tile Size and Temporal Overlap, I just missed the integration with the txt/img2vid project UI's but was my intention to have it in those also.

    I am intending on updating w/ a new PR soon.

  3. Domica commented on Jan 16, 2026

    @Domica
    Author

    Great, thanks for the info.

  4. Domica commented on Jan 17, 2026

    @Domica
    Author

    @NeuralFault Seems I've managed to add it, working on my forked Dev build.

    Image
  5. Domica commented on Jan 17, 2026

    @Domica
    Author

    @mohnjiles Hi, seems I've managed to get TiledVAE for WAN Text/Image to video on forked Dev version. No errors, although still testing is the Comfyui flow working as expected. Will try adding a clear log for confirmation.

    Image
  6. Domica commented on Jan 17, 2026

    @Domica
    Author

    Update, still working on logic, got UI but after testing and log checking not correctly pulling TiledVAE

  7. Domica commented on Jan 19, 2026

    @Domica
    Author

    Update, finished, added debug logger (wan_workflow_debug_request.json to confirm activation/injecting), added application log entries - |WARN|StabilityMatrix.Avalonia.ViewModels.Inference.Modules.TiledVAEModule|TiledVAE: Injecting TiledVAEDecode), UI aligned, toggle for custom Temporal size/overlap or (if off) using default values).

    Image

    @mohnjiles Can you confirm should I do a pull request? There are ofc test/change commits...

    Image Image
  8. Domica commented on Jan 19, 2026

    @Domica
    Author

    @NeuralFault Managed to get it working as was intended (ui, funcionality).

  9. Domica commented on Jan 19, 2026

    @Domica
    Author

    Pushed to Dev version

  10. Domica commented on Jan 21, 2026

    @Domica
    Author

    Abandoned.

  11. reopened this on Jan 21, 2026
  12. Domica commented on Jan 21, 2026

    @Domica
    Author

    @mohnjiles

    After your colleague said to push to main branch instead of initial (dev branch), no porting was done. Porting abandoned

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions