Short-wavelength free-electron laser sources and science: a reviewDedicated to John M J Madey (1943-2016) and Rodolfo Bonifacio (1940-2016) whose perception, drive and perseverance paved the way for the realisation and development of short-wavelength free-electron lasers

This review is focused on free-electron lasers (FELs) in the hard to soft x-ray regime. The aim is to provide newcomers to the area with insights into: the basic physics of FELs, the qualities of the radiation they produce, the challenges of transmitting that radiation to end users and the diversity of current scientific applications. Initial consideration is given to FEL theory in order to provide the foundation for discussion of FEL output properties and the technical challenges of short-wavelength FELs. This is followed by an overview of existing x-ray FEL facilities, future facilities and FEL frontiers. To provide a context for information in the above sections, a detailed comparison of the photon pulse characteristics of FEL sources with those of other sources of high brightness x-rays is made. A brief summary of FEL beamline design and photon diagnostics then precedes an overview of FEL scientific applications. Recent highlights are covered in sections on structural biology, atomic and molecular physics, photochemistry, non-linear spectroscopy, shock physics, solid density plasmas. A short industrial perspective is also included to emphasise potential in this area.