Lab Assignment from AI for Beginners Curriculum.
Task
Solve the MNIST handwritten digit classification problem using 1-, 2- and 3-layered perceptron. Use the neural network framework we have developed in the lesson.
Stating Notebook
Start the lab by opening MyFW_MNIST.ipynb
Questions
As a result of this lab, try to answer the following questions:
- Does the inter-layer activation function affect network performance?
- Do we need 2- or 3-layered network for this task?
- Did you experience any problems training the network? Especially as the number of layers increased.
- How do weights of the network behave during training? You may plot max abs value of weights vs. epoch to understand the relation.