FLAG.objective mode logsumexp and softplus

Hi,
I am curious what is the math background for the logsunexp and softplus case in FLAG.objective.

Thanks.

[yilundu]

Hi,
You can find the interpretation of softplus here (appendix):
https://arxiv.org/pdf/1811.02486.pdf
If you assume that negative samples are drawn from the uniform distribution as opposed from the model distribution than you obtain the logsumexp interpretation.