hello,thanks for your sharing!
I donn't know how to implement the swish-1.There is a trainable parameter in swish-1.And the parameter has two models(channel-shared and channel-wise).The implementment is difficult for me. Can you implement it. Thank you!
hello,thanks for your sharing!
I donn't know how to implement the swish-1.There is a trainable parameter in swish-1.And the parameter has two models(channel-shared and channel-wise).The implementment is difficult for me. Can you implement it. Thank you!