In 1823, Fresnel published an original (physical) interpretation of complex numbers in his investigations of refraction and reflection of polarized light. This is arguably the first time that complex numbers were given a physical interpretation, which led to a better understanding of elliptical and circular polarizations. This rather unknown episode of the history of physics is described in this work, and some of the pedagogical lessons that can be extracted from it are discussed.