Identity authentication using an inlier neural network

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for biometric identity authentication. In one aspect, a method comprises: determining: (i) a plurality of first interest points in a first image of an eye of a first user, and (ii) a plurality of second interest points in a second image of an eye of a second user; determining a plurality of interest point pairs; processing a network input comprising the interest point pairs using an inlier neural network to generate a network output comprising a plurality of inlier scores; and determining whether an identity of the first user matches an identity of the second user based on the inlier scores.