Compatible with Flash Attention or SDPA?

[Naive-Bayes]

I find VoRA modify the casual attention mask and enable bi-directional modeling for vision token.
So, I want to know could the VoRA be compatible with Flash Attention or SDPA?
Or just back to eager attention when training and inference.