There is nothing inconsistent about having a conservative outlook and being vigorous.

Poincaré was a vigorous opponent of the theory that all mathematics can be rewritten in terms of the most elementary notions of classical logic; something more than logic, he believed, makes mathematics what it is.