French Football Federation (FFF) president Noel Le Graet has said he would "rather" players didn't wear rainbow armbands at the World Cup in Qatar.