Doubt lingers over Material Man for $5 million All-Star Mile at Flemington