SI2-SSE: Running LSST Software in the Cloud

The data volumes associated with image processing in astronomy can range from small sets of images taken by individual observers to large survey telescopes generating tens of petabytes of data per year. The tools used by researchers to analyze their images are often bespoke, tailored to specific tasks or science use cases. As part of an initiative to share analysis tools across astronomy (and broader communities) we are developing a cloud-aware analysis framework (the astronomy commons). We demonstrate here an image analysis system (built to process data from the Legacy Survey of Space and Time; LSST) that can be deployed on the cloud using Amazon's S3, RDS, Lambda, and EBS services together with HTCondor and Pegasus to manage the overall workflow. We demonstrate the scaling of this system (and associated processing costs) to the size of nightly data volumes expected from the LSST.