The president says he told his team "it's not the right time" for a "big, crowded convention".