Gregoire Montavon in our group does a lot of learning on deep NNs. But usually, you still use backprop with a few tricks.