arXiv subjects

Salman Habib

Publications and source records attributed to Salman Habib.

At least 55 records · Page 3Linked to original sources

arXiv2022

Portability: A Necessary Approach for Future Scientific Software

Today's world of scientific software for High Energy Physics (HEP) is powered by x86 code, while the future will be much more reliant on accelerators like GPUs and FPGAs. The portable parallelization strategies (PPS) project of the High Energy Physics Center for Computational Excellence (HEP/CCE) is investigating solutions for portability techniques that will allow the coding of an algorithm once, and the ability to execute it on a variety of hardware products from many vendors, especially including accelerators. We think without these solutions, the scientific success of our experiments and endeavors is in danger, as software development could be expert driven and costly to be able to run on available hardware infrastructure. We think the best solution for the community would be an extension to the C++ standard with a very low entry bar for users, supporting all hardware forms and vendors. We are very far from that ideal though. We argue that in the future, as a community, we need to request and work on portability solutions and strive to reach this ideal.

physics.comp-ph↗

arXiv2022

Snowmass2021 Computational Frontier White Paper: Cosmological Simulations and Modeling

Powerful new observational facilities will come online over the next decade, enabling a number of discovery opportunities in the "Cosmic Frontier", which targets understanding of the physics of the early universe, dark matter and dark energy, and cosmological probes of fundamental physics, such as neutrino masses and modifications of Einstein gravity. Synergies between different experiments will be leveraged to present new classes of cosmic probes as well as to minimize systematic biases present in individual surveys. Success of this observational program requires actively pairing it with a well-matched state-of-the-art simulation and modeling effort. Next-generation cosmological modeling will increasingly focus on physically rich simulations able to model outputs of sky surveys spanning multiple wavebands. These simulations will have unprecedented resolution, volume coverage, and must deliver guaranteed high-fidelity results for individual surveys as well as for the cross-correlations across different surveys. The needed advances are as follows: (1) Development of scientifically rich and broadly-scoped simulations, which capture the relevant physics and correlations between probes (2) Accurate translation of simulation results into realistic image or spectral data to be directly compared with observations (3) Improved emulators and/or data-driven methods serving as surrogates for expensive simulations, constructed from a finite set of full-physics simulations (4) Detailed and transparent verification and validation programs for both simulations and analysis tools. (Abridged)

astro-ph.IM↗

arXiv2022

Snowmass2021 Cosmic Frontier White Paper: Rubin Observatory after LSST

The Vera C. Rubin Observatory will begin the Legacy Survey of Space and Time (LSST) in 2024, spanning an area of 18,000 square degrees in six bands, with more than 800 observations of each field over ten years. The unprecedented data set will enable great advances in the study of the formation and evolution of structure and exploration of physics of the dark universe. The observations will hold clues about the cause for the accelerated expansion of the universe and possibly the nature of dark matter. During the next decade, LSST will be able to confirm or dispute if tensions seen today in cosmological data are due to new physics. New and unexpected phenomena could confirm or disrupt our current understanding of the universe. Findings from LSST will guide the path forward post-LSST. The Rubin Observatory will still be a uniquely powerful facility even then, capable of revealing further insights into the physics of the dark universe. These could be obtained via innovative observing strategies, e.g., targeting new probes at shorter timescales than with LSST, or via modest instrumental changes, e.g., new filters, or through an entirely new instrument for the focal plane. This White Paper highlights some of the opportunities in each scenario from Rubin observations after LSST.

astro-ph.CO↗

arXiv2022

Farpoint: A High-Resolution Cosmology Simulation at the Gigaparsec Scale

In this paper we introduce the Farpoint simulation, the latest member of the Hardware/Hybrid Accelerated Cosmology Code (HACC) gravity-only simulation family. The domain covers a volume of (1000$h^{-1}$Mpc)$^3$ and evolves close to two trillion particles, corresponding to a mass resolution of $m_p\sim 4.6\cdot 10^7 h^{-1}$M$_\odot$. These specifications enable comprehensive investigations of the galaxy-halo connection, capturing halos down to small masses. Further, the large volume resolves scales typical of modern surveys with good statistical coverage of high mass halos. The simulation was carried out on the GPU-accelerated system Summit, one of the fastest supercomputers currently available. We provide specifics about the Farpoint run and present an initial set of results. The high mass resolution facilitates precise measurements of important global statistics, such as the halo concentration-mass relation and the correlation function down to small scales. Selected subsets of the simulation data products are publicly available via the HACC Simulation Data Portal.

astro-ph.CO↗

arXiv2021

Physical Benchmarking for AI-Generated Cosmic Web

The potential of deep learning based image-to-image translations has recently drawn a lot of attention; one intriguing possibility is that of generating cosmological predictions with a drastic reduction in computational cost. Such an effort requires optimization of neural networks with loss functions beyond low-order statistics like pixel-wise mean square error, and validation of results beyond simple visual comparisons and summary statistics. In order to study learning-based cosmological mappings, we choose a tractable analytical prescription - the Zel'dovich approximation - modeled using U-Net, a convolutional image translation framework. A comprehensive list of metrics is proposed, including higher-order correlation functions, conservation laws, topological indicators, dynamical robustness, and statistical independence of density fields. We find that the U-Net approach does well with some metrics but has difficulties with others. In addition to validating AI approaches using rigorous physical benchmarks, this study motivates advancements in domain-specific optimization schemes for scientific machine learning.

astro-ph.CO↗

arXiv2021

Machine learning synthetic spectra for probabilistic redshift estimation: SYTH-Z

Photometric redshift estimation algorithms are often based on representative data from observational campaigns. Data-driven methods of this type are subject to a number of potential deficiencies, such as sample bias and incompleteness. Motivated by these considerations, we propose using physically motivated synthetic spectral energy distributions in redshift estimation. In addition, the synthetic data would have to span a domain in colour-redshift space concordant with that of the targeted observational surveys. With a matched distribution and realistically modelled synthetic data in hand, a suitable regression algorithm can be appropriately trained; we use a mixture density network for this purpose. We also perform a zero-point re-calibration to reduce the systematic differences between noise-free synthetic data and the (unavoidably) noisy observational data sets. This new redshift estimation framework, SYTH-Z, demonstrates superior accuracy over a wide range of redshifts compared to baseline models trained on observational data alone. Approaches using realistic synthetic data sets can therefore greatly mitigate the reliance on expensive spectroscopic follow-up for the next generation of photometric surveys.

astro-ph.CO↗

arXiv2021

The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: N-body Mock Challenge for the eBOSS Emission Line Galaxy Sample

Cosmological growth can be measured in the redshift space clustering of galaxies targeted by spectroscopic surveys. Accurate prediction of clustering of galaxies will require understanding galaxy physics which is a very hard and highly non-linear problem. Approximate models of redshift space distortion (RSD) take a perturbative approach to solve the evolution of dark matter and galaxies in the universe. In this paper we focus on eBOSS emission line galaxies (ELGs) which live in intermediate mass haloes. We create a series of mock catalogues using haloes from the Multidark and {\sc Outer Rim} dark matter only N-body simulations. Our mock catalogues include various effects inspired by baryonic physics such as assembly bias and the characteristics of satellite galaxies kinematics, dynamics and statistics deviating from dark matter particles. We analyse these mocks using the TNS RSD model in Fourier space and the CLPT in configuration space. We conclude that these two RSD models provide an unbiased measurement of redshift space distortion within the statistical error of our mocks. We obtain the conservative theoretical systematic uncertainty of $3.3\%$, $1.8\%$ and $1.5\%$ in $fσ_8$, $α_{\parallel}$ and $α_{\bot}$ respectively for the TNS and CLPT models. We note that the estimated theoretical systematic error is an order of magnitude smaller than the statistical error of the eBOSS ELG sample and hence are negligible for the purpose of the current eBOSS ELG analysis.

astro-ph.CO↗

arXiv2021

Enabling particle applications for exascale computing platforms

The Exascale Computing Project (ECP) is invested in co-design to assure that key applications are ready for exascale computing. Within ECP, the Co-design Center for Particle Applications (CoPA) is addressing challenges faced by particle-based applications across four sub-motifs: short-range particle-particle interactions (e.g., those which often dominate molecular dynamics (MD) and smoothed particle hydrodynamics (SPH) methods), long-range particle-particle interactions (e.g., electrostatic MD and gravitational N-body), particle-in-cell (PIC) methods, and linear-scaling electronic structure and quantum molecular dynamics (QMD) algorithms. Our crosscutting co-designed technologies fall into two categories: proxy applications (or apps) and libraries. Proxy apps are vehicles used to evaluate the viability of incorporating various types of algorithms, data structures, and architecture-specific optimizations and the associated trade-offs; examples include ExaMiniMD, CabanaMD, CabanaPIC, and ExaSP2. Libraries are modular instantiations that multiple applications can utilize or be built upon; CoPA has developed the Cabana particle library, PROGRESS/BML libraries for QMD, and the SWFFT and fftMPI parallel FFT libraries. Success is measured by identifiable lessons learned that are translated either directly into parent production application codes or into libraries, with demonstrated performance and/or productivity improvement. The libraries and their use in CoPA's ECP application partner codes are also addressed.

cs.DC↗

arXiv2021

The Petascale DTN Project: High Performance Data Transfer for HPC Facilities

The movement of large-scale (tens of Terabytes and larger) data sets between high performance computing (HPC) facilities is an important and increasingly critical capability. A growing number of scientific collaborations rely on HPC facilities for tasks which either require large-scale data sets as input or produce large-scale data sets as output. In order to enable the transfer of these data sets as needed by the scientific community, HPC facilities must design and deploy the appropriate data transfer capabilities to allow users to do data placement at scale. This paper describes the Petascale DTN Project, an effort undertaken by four HPC facilities, which succeeded in achieving routine data transfer rates of over 1PB/week between the facilities. We describe the design and configuration of the Data Transfer Node (DTN) clusters used for large-scale data transfers at these facilities, the software tools used, and the performance tuning that enabled this capability.

cs.DC↗

arXiv2021

The Completed SDSS-IV Extended Baryon Oscillation Spectroscopic Survey: N-body Mock Challenge for Galaxy Clustering Measurements

We develop a series of N-body data challenges, functional to the final analysis of the extended Baryon Oscillation Spectroscopic Survey (eBOSS) Data Release 16 (DR16) galaxy sample. The challenges are primarily based on high-fidelity catalogs constructed from the Outer Rim simulation - a large box size realization (3 Gpc/h) characterized by an unprecedented combination of volume and mass resolution, down to 1.85x10^9 M_sun/h. We generate synthetic galaxy mocks by populating Outer Rim halos with a variety of halo occupation distribution (HOD) schemes of increasing complexity, spanning different redshift intervals. We then assess the performance of three complementary redshift space distortion (RSD) models in configuration and Fourier space, adopted for the analysis of the complete DR16 eBOSS sample of Luminous Red Galaxies (LRGs). We find all the methods mutually consistent, with comparable systematic errors on the Alcock-Paczynski parameters and the growth of structure, and robust to different HOD prescriptions - thus validating the robustness of the models and the pipelines used for the baryon acoustic oscillation (BAO) and full shape clustering analysis. In particular, all the techniques are able to recover a_par and a_perp to within 0.9%, and fsig8 to within 1.5%. As a by-product of our work, we are also able to gain interesting insights on the galaxy-halo connection. Our study is relevant for the final eBOSS DR16 `consensus cosmology', as the systematic error budget is informed by testing the results of analyses against these high-resolution mocks. In addition, it is also useful for future large-volume surveys, since similar mock-making techniques and systematic corrections can be readily extended to model for instance the Dark Energy Spectroscopic Instrument (DESI) galaxy sample.

astro-ph.CO↗

arXiv2021

Opportunities for DOE National Laboratory-led QuantISED Experiments

A subset of QuantISED Sensor PIs met virtually on May 26, 2020 to discuss a response to a charge by the DOE Office of High Energy Physics. In this document, we summarize the QuantISED sensor community discussion, including a consideration of HEP science enabled by quantum sensors, describing the distinction between Quantum 1.0 and Quantum 2.0, and discussing synergies/complementarity with the new DOE NQI centers and with research supported by other SC offices. Quantum 2.0 advances in sensor technology offer many opportunities and new approaches for HEP experiments. The DOE HEP QuantISED program could support a portfolio of small experiments based on these advances. QuantISED experiments could use sensor technologies that exemplify Quantum 2.0 breakthroughs. They would strive to achieve new HEP science results, while possibly spinning off other domain science applications or serving as pathfinders for future HEP science targets. QuantISED experiments should be led by a DOE laboratory, to take advantage of laboratory technical resources, infrastructure, and expertise in the safe and efficient construction, operation, and review of experiments. The QuantISED PIs emphasized that the quest for HEP science results under the QuantISED program is distinct from the ongoing DOE HEP programs on the energy, intensity, and cosmic frontiers. There is robust evidence for the existence of particles and phenomena beyond the Standard Model, including dark matter, dark energy, quantum gravity, and new physics responsible for neutrino masses, cosmic inflation, and the cosmic preference for matter over antimatter. Where is this physics and how do we find it? The QuantISED program can exploit new capabilities provided by quantum technology to probe these kinds of science questions in new ways and over a broader range of science parameters than can be achieved with conventional techniques.

physics.ins-det↗

arXiv2021

Nested Array-Based Spatially Coupled LDPC Codes

Linear nested codes, where two or more sub-codes are nested in a global code, have been proposed as candidates for reliable multi-terminal communication. In this paper, we consider nested array-based spatially coupled low-density parity-check (SC-LDPC) codes and propose a line-counting based optimization scheme for minimizing the number of dominant absorbing sets in order to improve its performance in the high signal-to-noise ratio regime. Since the parity-check matrices of different nested sub-codes partially overlap, the optimization of one nested sub-code imposes constraints on the optimization of the other sub-codes. To tackle these constraints, a multi-step optimization process is applied first to one of the nested codes, then sequential optimization of the remaining nested codes is carried out based on the constraints imposed by the previously optimized sub-codes. Results show that the order of optimization has a significant impact on the number of dominant absorbing sets in the Tanner graph of the code, resulting in a tradeoff between the performance of a nested code structure and its optimization sequence: the code which is optimized without constraints has fewer harmful structures than the code which is optimized with constraints. We also show that for certain code parameters, dominant absorbing sets in the Tanner graphs of all nested codes are completely removed using our proposed optimization strategy.

cs.IT↗

arXiv2021

The LSST DESC DC2 Simulated Sky Survey

We describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses this interconnectivity in a way that has not been attempted before. This effort encompasses a full end-to-end approach: starting from a large N-body simulation, through setting up LSST-like observations including realistic cadences, through image simulations, and finally processing with Rubin's LSST Science Pipelines. This last step ensures that we generate data products resembling those to be delivered by the Rubin Observatory as closely as is currently possible. The simulated DC2 sky survey covers six optical bands in a wide-fast-deep (WFD) area of approximately 300 deg^2 as well as a deep drilling field (DDF) of approximately 1 deg^2. We simulate 5 years of the planned 10-year survey. The DC2 sky survey has multiple purposes. First, the LSST DESC working groups can use the dataset to develop a range of DESC analysis pipelines to prepare for the advent of actual data. Second, it serves as a realistic testbed for the image processing software under development for LSST by the Rubin Observatory. In particular, simulated data provide a controlled way to investigate certain image-level systematic effects. Finally, the DC2 sky survey enables the exploration of new scientific ideas in both static and time-domain cosmology.

astro-ph.IM↗

arXiv2021

The Last Journey. I. An Extreme-Scale Simulation on the Mira Supercomputer

The Last Journey is a large-volume, gravity-only, cosmological N-body simulation evolving more than 1.24 trillion particles in a periodic box with a side-length of 5.025Gpc. It was implemented using the HACC simulation and analysis framework on the BG/Q system, Mira. The cosmological parameters are chosen to be consistent with the results from the Planck satellite. A range of analysis tools have been run in situ to enable a diverse set of science projects, and at the same time, to keep the resulting data amount manageable. Analysis outputs have been generated starting at redshift z~10 to allow for construction of synthetic galaxy catalogs using a semi-analytic modeling approach in post-processing. As part of our in situ analysis pipeline we employ a new method for tracking halo sub-structures, introducing the concept of subhalo cores. The production of multi-wavelength synthetic sky maps is facilitated by generating particle lightcones in situ, also beginning at z~10. We provide an overview of the simulation set-up and the generated data products; a first set of analysis results is presented. A subset of the data is publicly available.

astro-ph.CO↗

arXiv2020

The Last Journey. II. SMACC -- Subhalo Mass-loss Analysis using Core Catalogs

This paper introduces SMACC -- Subhalo Mass-loss Analysis using Core Catalogs. SMACC adds a mass model to substructure merger trees based on halo "core tracking." Our approach avoids the need for running expensive subhalo finding algorithms and instead uses subhalo mass-loss modeling to assign masses to halo cores. We present details of the SMACC methodology and demonstrate its excellent performance in describing halo substructure and its evolution. Validation of the approach is carried out using cosmological simulations at significantly different resolutions. We apply SMACC to the 1.24 trillion-particle Last Journey simulation and construct core catalogs with the additional mass information. These catalogs can be readily used as input to semi-analytic models or subhalo abundance matching approaches to determine approximate galaxy distributions, as well as for in-depth studies of small-scale structure evolution.

astro-ph.CO↗

arXiv2020

The Completed SDSS-IV Extended Baryon Oscillation Spectroscopic Survey: N-body Mock Challenge for the Quasar Sample

The growth rate and expansion history of the Universe can be measured from large galaxy redshift surveys using the Alcock-Paczynski effect. We validate the Redshift Space Distortion models used in the final analysis of the Sloan Digital Sky Survey (SDSS) extended Baryon Oscillation Spectroscopic Survey (eBOSS) Data Release 16 quasar clustering sample, in configuration and Fourier space, using a series of HOD mock catalogues generated using the OuterRim N-body simulation. We test three models on a series of non-blind mocks, in the OuterRim cosmology, and blind mocks, which have been rescaled to new cosmologies, and investigate the effects of redshift smearing and catastrophic redshifts. We find that for the non-blind mocks, the models are able to recover $fσ_8$ to within 3% and $α_\parallel$ and $α_\bot$ to within 1%. The scatter in the measurements is larger for the blind mocks, due to the assumption of an incorrect fiducial cosmology. From this mock challenge, we find that all three models perform well, with similar systematic errors on $fσ_8$, $α_\parallel$ and $α_\bot$ at the level of $σ_{fσ_8}=0.013$, $σ_{α_\parallel}=0.012$ and $σ_{α_\bot}=0.008$. The systematic error on the combined consensus is $σ_{fσ_8}=0.011$, $σ_{α_\parallel}=0.008$ and $σ_{α_\bot}=0.005$, which is used in the final DR16 analysis. For BAO fits in configuration and Fourier space, we take conservative systematic errors of $σ_{α_\parallel}=0.010$ and $σ_{α_\bot}=0.007$.

astro-ph.CO↗

arXiv2020

The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: exploring the Halo Occupation Distribution model for Emission Line Galaxies

We study the modelling of the Halo Occupation Distribution (HOD) for the eBOSS DR16 Emission Line Galaxies (ELGs). Motivated by previous theoretical and observational studies, we consider different physical effects that can change how ELGs populate haloes. We explore the shape of the average HOD, the fraction of satellite galaxies, their probability distribution function (PDF), and their density and velocity profiles. Our baseline HOD shape was fitted to a semi-analytical model of galaxy formation and evolution, with a decaying occupation of central ELGs at high halo masses. We consider Poisson and sub/super-Poissonian PDFs for satellite assignment. We model both NFW and particle profiles for satellite positions, also allowing for decreased concentrations. We model velocities with the virial theorem and particle velocity distributions. Additionally, we introduce a velocity bias and a net infall velocity. We study how these choices impact the clustering statistics while keeping the number density and bias fixed to that from eBOSS ELGs. The projected correlation function, $w_p$, captures most of the effects from the PDF and satellites profile. The quadrupole, $ξ_2$, captures most of the effects coming from the velocity profile. We find that the impact of the mean HOD shape is subdominant relative to the rest of choices. We fit the clustering of the eBOSS DR16 ELG data under different combinations of the above assumptions. The catalogues presented here have been analysed in companion papers, showing that eBOSS RSD+BAO measurements are insensitive to the details of galaxy physics considered here. These catalogues are made publicly available.

astro-ph.CO↗

arXiv2020

Learning to Decode: Reinforcement Learning for Decoding of Sparse Graph-Based Channel Codes

We show in this work that reinforcement learning can be successfully applied to decoding short to moderate length sparse graph-based channel codes. Specifically, we focus on low-density parity check (LDPC) codes, which for example have been standardized in the context of 5G cellular communication systems due to their excellent error correcting performance. These codes are typically decoded via belief propagation iterative decoding on the corresponding bipartite (Tanner) graph of the code via flooding, i.e., all check and variable nodes in the Tanner graph are updated at once. In contrast, in this paper we utilize a sequential update policy which selects the optimum check node (CN) scheduling in order to improve decoding performance. In particular, we model the CN update process as a multi-armed bandit process with dependent arms and employ a Q-learning scheme for optimizing the CN scheduling policy. In order to reduce the learning complexity, we propose a novel graph-induced CN clustering approach to partition the state space in such a way that dependencies between clusters are minimized. Our results show that compared to other decoding approaches from the literature, the proposed reinforcement learning scheme not only significantly improves the decoding performance, but also reduces the decoding complexity dramatically once the scheduling policy is learned.

cs.IT↗