'I let my party breathe', says PM Morrison