Improvement and feature addition and Update from deprecated libraries to new ones#8

Open

FlixCoder wants to merge 23 commits intojackm321:masterfrom

FlixCoder:master

Commits on Oct 4, 2017

small improvements: better random initialization, use of stdlib instead of
FlixCoder
committed
bugfix
FlixCoder
committed
replace ReLU by PELU to fix dead gradients
FlixCoder
committed
little change to initialization
FlixCoder
committed

Commits on Oct 5, 2017

provide both Sigmoid and PELU
FlixCoder
committed
replace PELU by SELU
FlixCoder
committed
MSRA initialization
FlixCoder
committed
MSRA initialization
FlixCoder
committed
SELU deviation fix
FlixCoder
committed
fixes, PELU and LReLU added
FlixCoder
committed
readme change for previous commit
FlixCoder
committed
split hidden and output activation
FlixCoder
committed
fit test to updates NN class
FlixCoder
committed
PELU fix
FlixCoder
committed

Commits on Oct 7, 2017

linear activation, possibly good for output, added
FlixCoder
committed

Commits on Oct 8, 2017

fix PELU function
FlixCoder
committed

Commits on Oct 10, 2017

Tanh activation added, changed initialization
FlixCoder
committed

Commits on Nov 8, 2017

cleanup, cosmetic, updated json library
FlixCoder
committed
fit readme to NN changes
FlixCoder
committed
readd trayis
FlixCoder
committed
trayis rename
FlixCoder
committed

Commits on Dec 21, 2017

remove warnings, that came up after rustc update
FlixCoder
committed
add example
FlixCoder
committed