Playground (Logistic Regression –> Fully Connected)

From logistic regression to fully connected networks.

Logistic Regression

Open the following playground

a) Manually adjust the the weights to find best visual separation (click on lines and uses arrows)

b) Start learning with a learning rate 10 what happens?

c) Change learning rate to sensible values. Why does the success depends on the learning rate?

Neural Networks with hidden units

a) Open the playground. Train the network with zero hidden layers (what do you observe), know increase the number of hidden layers to 1 (what do you see?).

b) Now go to here and increase the number of neurons in the hidden layer. What do you observe?