2 minute read
Science Data Challenge paper shares insights (and code)
from Contact 14
BY CASSANDRA CAVALLARO (SKAO)
The SKAO’s Science Data Challenge series is yielding valuable results for the science community in how to tackle the volume and complexity of future SKA data.
A recent paper, led by the SKAO Science team and published in the Monthly Notices of the Royal Astronomical Society, details the full results and lessons learned from the second Science Data Challenge, which ran in 2021. It asked teams to find and measure the neutral hydrogen content of galaxies in simulated SKA-Mid telescope data. The challenge received generous support from eight international supercomputing facilities, which provided dedicated resources for teams.
The paper features contributions from more than 100 participants, representing over 40 institutions in 18 countries. Along with details of how the SKAO’s Science team simulated SKA-Mid’s view of the neutral hydrogen sky, there are descriptions of the techniques – both new and established –that teams used to tackle the challenge. It also includes links to the source code for the simulations and some of the teams’ methods.
The authors note that a combination of methods, and a collaborative, multidisciplinary approach, will be key to exploiting huge astronomical data sets like those the SKAO will create. The winning strategy combined predictions from two independent machine learning techniques to yield a 20% improvement in overall performance.
“By sharing the findings we’re aiming to grow our collective knowledge and hopefully inform those beyond our immediate community, in a way that could feed other innovations,” said SKAO Scientist Dr Philippa Hartley, who co-led the challenge. “That’s why it was really important for us to publish the source code as well, as part of our goal to make science more open and more accessible.”
Meanwhile the latest challenge – number three in the series –has now concluded. It tasked participants with the recovery of the most distant neutral hydrogen signatures from a simulation of the SKA-Low view of Cosmic Dawn. Watch out for the results in the next issue of Contact!
