Bring your code to the data: SPACIOUS and the road to petabyte-scale surveys

15 Jan 2027, 11:30
20m

Speaker

Dr Alfred Castro-Ginard (Universität Göttingen)

Description

Gaia DR4, DR5 and later GaiaNIR will create a major computational challenge alongside the scientific ones. With catalogues at that scale, the traditional workflow becomes a bottleneck: query the archive, download the data, and compute locally. For many key analyses, this will make the computation impractical, if not impossible. In this talk, I will give an overview of SPACIOUS, a cloud-native, code-to-data platform for astronomical (Big) data analysis. I will summarise the scientific cases developed within SPACIOUS, and present in detail one case study: the estimation of the Gaia DR3 selection function. I will show how the pipeline is deployed, how it gets from raw Gaia data to results, and how its performance compares to traditional approaches. Finally, I will show how to get started with SPACIOUS, and how it can be your entry point to code-to-data analysis for Gaia DR4.

Author

Dr Alfred Castro-Ginard (Universität Göttingen)

Presentation materials

There are no materials yet.