Large scale deployment of the Target Field Lab Big Data Layer

The Generic Data Layer of the Target Field Lab lies at the centre of the Science Ground Segment being developed for the forthcoming Euclid satellite of ESA. In preparation for the expected launch in 2023 this system is now undertaking large scale testing of the data processing system. This involved the distributed processing of data in 10 national data centres in France, Finland, Germany, Italy, Spain, The Netherlands, UK, USA.

The tests started on 15th May 2021 and will continue until the 30th June 2021.The compute resources allocated to this test are 6200 cores, together with 1700 TBytes of data storage. During these tests a sky area of 150 square degrees will be simulated and processed. This is approxiamtely 1% of the data volume expected from the satellite during its 6 years planned operation.