Any idea about vllm compatible?

[ShadowTeamCN]

How can I inject DRUGS to vllm framework?

[EGjoni]

I ask myself this every day.

I think the right file to modify is probably vllm/model_executor/attention.py. I haven't tried implementing it, so I'm not sure, but if that's the right spot it should be fairly straightforward to get working by following the porting guide.