Try to ensure that the directories our config files want to live in exist.