Imaging systems having image sensor pixel arrays with phase detection capabilities

An image sensor may have a pixel array that includes an array of pixels arranged in rows and columns. Each pixel may include a number of adjacent sub-pixels covered by a single microlens. The adjacent sub-pixels of each pixel may include color filter elements of the same color. Image signals from the sub-pixels may be used to calculate phase information in each pixel in the array. This information may be used to generate a depth map of the entire captured image. The pixels may each be able to detect vertical, horizontal, or diagonal edges. Additionally, the image signals from each photodiode in a pixel may be binned or average to obtain image data for each pixel. The image sensor also may generate high-dynamic-range images using the pixel array.