Pushing the limits of near-infrared photometry with the Gemini Multi-Conjugate Adaptive Optics System: study of crowded fields in the globular cluster M5

We present the deepest J −Ks near-infrared photometry of the globular cluster M5 (NGC 5904) from observations taken with the Gemini South Adaptive Optics Imager in tandem with the Gemini Multi-conjugate adaptive optics System (GeMS) on the 8.1-m Gemini South telescope. Point spread function (PSF) photometry was carried out using a spatially variable PSF, zero-point calibrations based on correlations to a standard photometric catalogue, colour corrections, and crowding corrections. The latter corrections provided a new challenge given the field variations of the adaptive optics corrections in the central crowded regions of this cluster. The final photometric precision in our J− Ks colour–magnitude diagram exposes a dispersion among the lower main-sequence stars of M5 for the first time. This dispersion occurs below a main-sequence knee due to variations in the helium and CNO (carbon, nitrogen, and oxygen) abundances from multiple stellar populations, consistent with results from the bright evolved stars in this cluster from ultraviolet to near-infrared Hubble Space Telescope photometry and ground-based spectroscopy. This paper completes our original GeMS quality analysis programme, providing insights into adaptive optics analyses in crowded fields.