Premier Daniel Andrews had a tough week as Victoria's pandemic response lost its way