Subsea pumping system with interchangeable pumping units

A system can include a skid, a support structure to support the skid on a sea floor, mounts connected to the skid, an electrical connector for each of the mounts to power an electric submersible pump housed by a tubular housing, fluid connectors for each of the mounts, tubular housing fluid isolation valves for each of the mounts, at least one fluid bypass that comprises a fluid bypass isolation valve, and a subsea control module for control of the tubular housing fluid isolation valves, the fluid bypass isolation valve and electricity to each of the electrical connectors. Various other devices, systems, methods, etc., are also disclosed.