Well, that might be true for some models. And of course it does not make sense to throw away prior knowledge if you have it.
But there are also...