DB-Bench: Benchmarking Deblenders for LSST DESC Using the Blending ToolKit
Blending will be a major source of systematic uncertainty in downstream science analyses of LSST data. We benchmark the performance of several deblenders, leveraging the Blending ToolKit (BTK) to perform rigorous, end-to-end testing. This benchmark incorporates key deblending algorithms, including SourceExtractor, SCARLET, and DeepDISC, with the goal of comparing their effectiveness in handling blended galaxy images from LSST/Rubin simulations. A key focus is characterizing algorithm performance in the regime of unrecognized blends, where multiple galaxies are misidentified as a single object, as these cases introduce systematic biases that propagate into downstream cosmological analyses for galaxy surveys. By utilizing BTK's ability to create customized, reproducible blends, we systematically test these deblenders against different blending conditions, such as source separation and brightness. The toolkit's standardized evaluation metrics, including detection precision, segmentation accuracy, and source reconstruction, are comprehensive assessments of each algorithm's strengths and limitations. Each deblender has performance caveats that may impact their true performance in real survey conditions. We find that SCARLET has high segmentation and reconstruction performance, whereas DeepDISC has strong detection recall for faint and low-SNR sources, and SourceExtractor has accurate peak finding abilities but low segmentation and reconstruction performance. This benchmark provides valuable insights into the performance of existing deblenders and highlights areas for future development.