Comfyui support

[EnragedAntelope]

Hi - are you planning to add nodes/support for this to work in ComfyUI?

[fengyifu2000]

Thanks for your interest! We don’t currently have plans for ComfyUI support. At the moment, we are focusing our efforts on organizing the training code and preparing an online demo.

We welcome community contributions and PRs. We will review them promptly and update the repository accordingly.

[SteveImmanuel]

I implemented custom node in ComfyUI to support this model.
Codebase is in github.com/SteveImmanuel/comfyui-lance-aio.
It is installable via comfy nodes manager under the name "Lance-3B AIO". This also add SDPA fallback for flash attention, as well as dynamic VRAM streaming to support device with limited VRAM

I'd be happy to open PR to this repo if needed.

[fengyifu2000]

@SteveImmanuel Thanks a lot for sharing this — it sounds very helpful!
We’ll take a look and test the corresponding code as soon as possible. If it works well on our side, we’d be happy to have you open a PR to the Lance repository.
Thanks again for your contribution!