Being a theoretical physicits of disordered systems, I love simulated annealing. It doesn't require differentiability nor continuity and can work even on discrete domains. It's actually wonderful.