usd SGD to optimize the energy function and replace the recurrent#4

Open

hqy117 wants to merge 9 commits into

libilab:masterfrom

Commits on Aug 13, 2024

usd SGD to optimize the energy function and replace the recurrent
qingyuan hou
committed

Commits on Aug 16, 2024

use L2 norm instead of energy function
qingyuan
committed

Commits on Aug 18, 2024

fix the energy function issue with adding sqrt and x*x.t
qingyuan
committed
fix the problem that expanding weight takes too much time
qingyuan
committed

Commits on Aug 22, 2024

save a backup before adding LD
qingyuan
committed

Commits on Aug 23, 2024

save as backup before adding noise
qingyuan
committed

Commits on Aug 28, 2024

apply solver for PCN_5, acuracy not good
qingyuan
committed
comment the b0 so that PCN_5 weights can be loaded
qingyuan
committed

Commits on Sep 4, 2024

version with GD, SA and LD (basically GD)
qingyuan
committed