RMSProp optimizer.

[greninja]

Is there any particular reason for using RMSPropOptimizer @shashankg7 ?
I am just curious. I hope discussing it here is fine?

[shashankg7]

Hi. No particular reason. I think this is what is used in the paper. I am not sure though. ADAM was not out back when this paper was published, SGD + Momentum, RMSProp were more common back then. Again I am not sure of this. But this is what I can recollect.