[Hopper] Support sink attention (learnable sink)#4

aoxy wants to merge 20 commits into

mainaoxy/flash-attention:mainfrom

feature/hopper_attention_with_sinkaoxy/flash-attention:feature/hopper_attention_with_sinkCopy head branch name to clipboard