According to Wilcox's "French-English Military Technical Dictionary" (1917), p.446, "Tenue de fantaisie" pertained to "nonregulation clothes of finer cut and cloth than the regulation (forbidden)".

Perhaps that sheds some light?

Howie