This is my implementation of a feedforward neural network with ReLU activation functions. I loosely followed the workflow outlined in the book https://nnfs.io.
The project has four main files:
NeuralNetwork.pyincludes all the necessary classes for performing a forward and backward pass in the network.Optimizer.pycontains the stochastic gradient descent optimizer implementation and theTrainerclass responsible for training.Evaluation.pyincludes the class that calculates the model'sAccuracy.main.pyholds the code that trains and tests the neural network on a classification problem using spiral data.
Requirements are specified in requirements.txt.