arXiv subjects

Ashish Mahabal

Publications and source records attributed to Ashish Mahabal.

At least 37 records · Page 2Linked to original sources

arXiv2024

Selfish Evolution: Making Discoveries in Extreme Label Noise with the Help of Overfitting Dynamics

Motivated by the scarcity of proper labels in an astrophysical application, we have developed a novel technique, called Selfish Evolution, which allows for the detection and correction of corrupted labels in a weakly supervised fashion. Unlike methods based on early stopping, we let the model train on the noisy dataset. Only then do we intervene and allow the model to overfit to individual samples. The ``evolution'' of the model during this process reveals patterns with enough information about the noisiness of the label, as well as its correct version. We train a secondary network on these spatiotemporal ``evolution cubes'' to correct potentially corrupted labels. We incorporate the technique in a closed-loop fashion, allowing for automatic convergence towards a mostly clean dataset, without presumptions about the state of the network in which we intervene. We evaluate on the main task of the Supernova-hunting dataset but also demonstrate efficiency on the more standard MNIST dataset.

cs.CV↗

arXiv2024

GWSkyNet II : a refined machine learning pipeline for real-time classification of public gravitational wave alerts

Electromagnetic follow-up observations of gravitational wave events offer critical insights and provide significant scientific gain from this new class of astrophysical transients. Accurate identification of gravitational wave candidates and rapid release of sky localization information are crucial for the success of these electromagnetic follow-up observations. However, searches for gravitational wave candidates in real time suffer a non-negligible false alarm rate. By leveraging the sky localization information and other metadata associated with gravitational wave candidates, GWSkyNet, a machine learning classifier developed by Cabero et al. (2020), demonstrated promising accuracy for the identification of the origin of event candidates. We improve the performance of the classifier for LIGO-Virgo-KAGRA's fourth observing run by reviewing and updating the architecture and features used as inputs by the algorithm. We also retrain and fine-tune the classifier with data from the third observing run. To improve the prospect of electromagnetic follow-up observations, we incorporate GWSkyNet into LIGO-Virgo-KAGRA's low-latency infrastructure as an automatic pipeline for the evaluation of gravitational wave alerts in real time. We test the readiness of the algorithm on a LIGO-Virgo-KAGRA mock data challenge campaign. The results show that by thresholding on the GWSkyNet score, noise masquerading as astrophysical sources can be rejected efficiently and the majority of true astrophysical signals correctly identified.

astro-ph.IM↗

arXiv2024

Light Curve Classification with DistClassiPy: a new distance-based classifier

The rise of synoptic sky surveys has ushered in an era of big data in time-domain astronomy, making data science and machine learning essential tools for studying celestial objects. While tree-based models (e.g. Random Forests) and deep learning models dominate the field, we explore the use of different distance metrics to aid in the classification of astrophysical objects. We developed DistClassiPy, a new distance metric based classifier. The direct use of distance metrics is unexplored in time-domain astronomy, but distance-based methods can help make classification more interpretable and decrease computational costs. In particular, we applied DistClassiPy to classify light curves of variable stars, comparing the distances between objects of different classes. Using 18 distance metrics on a catalog of 6,000 variable stars across 10 classes, we demonstrate classification and dimensionality reduction. Our classifier meets state-of-the-art performance but has lower computational requirements and improved interpretability. Additionally, DistClassiPy can be tailored to specific objects by identifying the most effective distance metric for that classification. To facilitate broader applications within and beyond astronomy, we have made DistClassiPy open-source and available at https://pypi.org/project/distclassipy/.

astro-ph.IM↗

arXiv2024

$\texttt{tdescore}$: An Accurate Photometric Classifier for Tidal Disruption Events

Optical surveys have become increasingly adept at identifying candidate Tidal Disruption Events (TDEs) in large numbers, but classifying these generally requires extensive spectroscopic resources. Here we present $\texttt{tdescore}$, a simple binary photometric classifier that is trained using a systematic census of $\sim$3000 nuclear transients from the Zwicky Transient Facility (ZTF). The sample is highly imbalanced, with TDEs representing $\sim$2% of the total. $\texttt{tdescore}$ is nonetheless able to reject non-TDEs with 99.6% accuracy, yielding a sample of probable TDEs with recall of 77.5% for a precision of 80.2%. $\texttt{tdescore}$ is thus substantially better than any available TDE photometric classifier scheme in the literature, with performance not far from spectroscopy as a method for classifying ZTF nuclear transients, despite relying solely on ZTF data and multi-wavelength catalogue cross-matching. In a novel extension, we use `SHapley Additive exPlanations' ($\texttt{SHAP}$) to provide a human-readable justification for each individual $\texttt{tdescore}$ classification, enabling users to understand and form opinions about the underlying classifier reasoning. $\texttt{tdescore}$ can serve as a model for photometric identification of TDEs with time-domain surveys, such as the upcoming Rubin observatory.

astro-ph.IM↗

arXiv2024

Global Data in Astronomy: Challenges and Opportunities

Policy Brief on "Global Data in Astronomy: Challenges and Opportunities", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023. Astronomy is increasingly becoming a data-driven science. Advances in our understanding of the physical mechanisms at work in the Universe require building ever-more sensitive telescopes to gather observations of the cosmos to test and advance our theoretical models of how the universe works. To confront the observed data with our theoretical models we require data hosting, archiving and storage and high-performance computing resources to run the theoretical calculations and compare our simulated and observed universe. We also require the sophisticated development of highly skilled human resources. Newer large projects are often run through international collaborations and partnerships, driving a need for 'open science' and collaborative structure across national boundaries. While astronomical data are useful scientifically, the data do not come with the same ethical/privacy-related restrictions as medical/biological data. Moreover, the ability to use data for new scientific analysis extends and expands the impact and reach of scientific surveys -- this is a strength that national funding agencies should capitalize on. We discuss the management and analysis of such large volumes of data and the corresponding significant challenges that require policy-level preparations. The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.

astro-ph.IM↗

arXiv2024

Long Term Space Data and Informatics Needs

Policy Brief on "Long Term Space Data and Informatics Needs", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023. Persistent space data gathering, retention, transmission, and analysis play a pivotal role in deepening our grasp of the Universe and fostering the achievement of global sustainable development goals. Long-term data storage and curation is crucial not only to make the wide range of burgeoning data sets available to the global science community, but also to stabilize those data sets, enabling new science in the future to analyse long-term trends over unprecedented time spans. In addition to this, over the long-term, the imperative to store all data on the ground should be ameliorated by use of space-based data stores --maintained and seen to be as reliable as any other data archive. This concept is sometimes referred to as Memory of the Sky. Storing the data must be accompanied by the ability to analyse them. Several concepts covered below acknowledge roots and inspiration based in the Virtual Observatory effort. Within this policy document, we delve into the complexities surrounding the long-term utilization of space data and informatics, shedding light on the challenges and opportunities inherent in this endeavour. Further, we present a series of pragmatic recommendations designed to address these challenges proactively. The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.

astro-ph.IM↗

arXiv2024

Latest Developments and Opportunities in Sky Survey

Policy Brief on "Latest Developments and Opportunities in Sky Survey", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023. Sky surveys have been a crucial tool in advancing our understanding of the Universe. The last few decades have seen an explosion in the number and scope of sky surveys, both ground-based and space-based. This growth has led to a wealth of data that has enabled us to make significant advances in many areas of astronomy, and help understand the physics of the universe. They have helped us discover new astronomical objects, the origin of the elements, dark matter and dark energy, the accelerated expansion of the universe, and gravitational waves. They have helped us study the distribution of neutral and ionized matter in the Universe and test our theories about the origin and evolution of galaxies, stars, and planets. We explore recent advances and potential avenues in sky surveys, and examine how these developments may impact the field of international astronomical research. The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.

astro-ph.IM↗

arXiv2024

Workforce Development in Astronomy and Astroinformatics

Policy Brief on "Workforce Development in Astronomy and Astroinformatics", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023. The discipline of astronomy and astroinformatics is dynamically evolving thereby creating a compelling opportunity to foster a more inclusive, diverse, and proficient workforce. This is crucial for addressing multifaceted challenges that emerge as we progress and harness the potential therein. To realize this goal, it's imperative to cultivate strategies that promote inclusive practices in STEM education, encourage participation from historically excluded groups, provide training and mentorship, as well as provide active champions, especially for students and early career professionals from (historically) excluded groups. We provide an overview of the current status, resources available, and possible steps especially keeping in mind large international projects. The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.

astro-ph.IM↗

arXiv2024

Large Projects in Astronomy: An Indian Endeavour

Policy Brief on "Large Projects in Astronomy: An Indian Endeavour", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023. Cutting-edge astronomy initiatives often entail substantial investment and require a high level of expertise. Even the most technologically advanced nations recognize the value of establishing international partnerships to secure both financial resources and talent for these ambitious endeavours as they hold immense promise for catalysing transformative scientific discoveries, driving technological innovation, provide training opportunities for the next generation of scientists and engineers, and expanding our understanding of the cosmos that surrounds us. Crucially, large-scale multilateral collaborations serve as powerful agents for promoting unity and peace among the global population. Participants from various nations share a vested interest in the success of these projects and the wealth of knowledge they yield, fostering a sense of common purpose and shared goals. By utilizing astroinformatics capabilities, these initiatives are not merely enhancing our comprehension of the universe but are also actively contributing to the attainment of sustainable development objectives. In this discussion, we delve into the challenges faced, and prospects for substantial astronomical undertakings. Additionally, we present recommendations aimed at guaranteeing their effectiveness and optimizing their influence on both scientific advancement and society. The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.

astro-ph.IM↗

arXiv2024

Regional and Global Collaborations in Astronomy

Policy Brief on "Regional and Global Collaborations in Astronomy", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023. Astronomy brings together advanced scientific research, state-of-the-art technology, and educational initiatives, all while captivating and stimulating people of all ages. By doing so, it possesses the potential to serve as a powerful catalyst for sustainable global development and the resolution of global societal issues. It attracts a diverse range of scientists and experts from various fields, fostering collaboration and innovation. By leveraging their resources, influence, and diplomatic initiatives, S20 academies can foster an enabling environment for international collaborations in astronomy, facilitate knowledge exchange, and drive scientific advancements that benefit humanity. This policy brief explores the opportunities and challenges presented by regional and global collaborations in astronomy. The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.

astro-ph.IM↗

arXiv2024

AstroInformatics: Recommendations for Global Cooperation

Policy Brief on "AstroInformatics, Recommendations for Global Collaboration", distilled from panel discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023. The deliberations encompassed a wide array of topics, including broad astroinformatics, sky surveys, large-scale international initiatives, global data repositories, space-related data, regional and international collaborative efforts, as well as workforce development within the field. These discussions comprehensively addressed the current status, notable achievements, and the manifold challenges that the field of astroinformatics currently confronts. The G20 nations present a unique opportunity due to their abundant human and technological capabilities, coupled with their widespread geographical representation. Leveraging these strengths, significant strides can be made in various domains. These include, but are not limited to, the advancement of STEM education and workforce development, the promotion of equitable resource utilization, and contributions to fields such as Earth Science and Climate Science. We present a concise overview, followed by specific recommendations that pertain to both ground-based and space data initiatives. Our team remains readily available to furnish further elaboration on any of these proposals as required. Furthermore, we anticipate further engagement during the upcoming G20 presidencies in Brazil (2024) and South Africa (2025) to ensure the continued discussion and realization of these objectives. The policy webinar took place during the G20 presidency in India (2023). Notes based on the seven panels will be separately published.

astro-ph.IM↗

arXiv2023

Enabling Kilonova Science with Nancy Grace Roman Space Telescope

Binary neutron star mergers and neutron star-black hole mergers are multi-messenger sources that can be detected in gravitational waves and in electromagnetic radiation. The low electron fraction of neutron star merger ejecta favors the production of heavy elements such as lanthanides and actinides via rapid neutron capture (r-process). The decay of these unstable nuclei powers an infrared-bright transient called a "kilonova". The discovery of a population of kilonovae will allow us to determine if neutron star mergers are the dominant sites for r-process element nucleosynthesis, constrain the equation of state of nuclear matter, and make independent measurements of the Hubble constant. The Nancy Grace Roman Space Telescope (Roman) will have a unique combination of depth, near-infrared sensitivity, and wide field of view. These characteristics will enable Roman's discovery of GW counterparts that will be missed by optical telescopes, such as kilonova that are associated with large distances, high lanthanide fractions, high binary mass-ratios, large dust extinction in the line of sight, or that are observed from equatorial viewing angles. Our analysis suggests to (i) make available a rapid (about 1 week) Target of Opportunity mode for GW follow-up; (ii) include observations of the High Latitude Time-Domain survey footprint in at least two filters (preferably the F158 and F213 filters) with a cadence of < 8 days; (iii) operate in synergy with Rubin Observatory. Following these recommendations, we expect that 1-6 kilonovae can be identified by Roman via ToO observations of well localized (A < 10 sq. deg., 90% C.I.) neutron star mergers during 1.5 years of the LIGO-Virgo-KAGRA fifth (or about 4-21 in during the sixth) observing run. A sample of 5-40 serendipitously discovered kilonovae can be collected in a 5-year high latitude survey.

astro-ph.HE↗

arXiv2023

Explaining the GWSkyNet-Multi machine learning classifier predictions for gravitational-wave events

GWSkyNet-Multi is a machine learning model developed for classification of candidate gravitational-wave events detected by the LIGO and Virgo observatories. The model uses limited information released in the low-latency Open Public Alerts to produce prediction scores indicating whether an event is a merger of two black holes, a merger involving a neutron star, or a non-astrophysical glitch. This facilitates time sensitive decisions about whether to perform electromagnetic follow-up of candidate events during LIGO-Virgo-KAGRA (LVK) observing runs. However, it is not well understood how the model is leveraging the limited information available to make its predictions. As a deep learning neural network, the inner workings of the model can be difficult to interpret, impacting our trust in its validity and robustness. We tackle this issue by systematically perturbing the model and its inputs to explain what underlying features and correlations it has learned for distinguishing the sources. We show that the localization area of the 2D sky maps and the computed coherence versus incoherence Bayes factors are used as strong predictors for distinguishing between real events and glitches. The estimated distance to the source is further used to discriminate between binary black hole mergers and mergers involving neutron stars. We leverage these findings to show that events misclassified by GWSkyNet-Multi in LVK's third observing run have distinct sky area, coherence factor, and distance values that influence the predictions and explain these misclassifications. The results help identify the model's limitations and inform potential avenues for further optimization.

astro-ph.IM↗

arXiv2021

Beyond Low Earth Orbit: Biomonitoring, Artificial Intelligence, and Precision Space Health

Human space exploration beyond low Earth orbit will involve missions of significant distance and duration. To effectively mitigate myriad space health hazards, paradigm shifts in data and space health systems are necessary to enable Earth-independence, rather than Earth-reliance. Promising developments in the fields of artificial intelligence and machine learning for biology and health can address these needs. We propose an appropriately autonomous and intelligent Precision Space Health system that will monitor, aggregate, and assess biomedical statuses; analyze and predict personalized adverse health outcomes; adapt and respond to newly accumulated data; and provide preventive, actionable, and timely insights to individual deep space crew members and iterative decision support to their crew medical officer. Here we present a summary of recommendations from a workshop organized by the National Aeronautics and Space Administration, on future applications of artificial intelligence in space biology and health. In the next decade, biomonitoring technology, biomarker science, spacecraft hardware, intelligent software, and streamlined data management must mature and be woven together into a Precision Space Health system to enable humanity to thrive in deep space.

q-bio.OT↗

arXiv2021

Beyond Low Earth Orbit: Biological Research, Artificial Intelligence, and Self-Driving Labs

Space biology research aims to understand fundamental effects of spaceflight on organisms, develop foundational knowledge to support deep space exploration, and ultimately bioengineer spacecraft and habitats to stabilize the ecosystem of plants, crops, microbes, animals, and humans for sustained multi-planetary life. To advance these aims, the field leverages experiments, platforms, data, and model organisms from both spaceborne and ground-analog studies. As research is extended beyond low Earth orbit, experiments and platforms must be maximally autonomous, light, agile, and intelligent to expedite knowledge discovery. Here we present a summary of recommendations from a workshop organized by the National Aeronautics and Space Administration on artificial intelligence, machine learning, and modeling applications which offer key solutions toward these space biology challenges. In the next decade, the synthesis of artificial intelligence into the field of space biology will deepen the biological understanding of spaceflight effects, facilitate predictive modeling and analytics, support maximally autonomous and reproducible experiments, and efficiently manage spaceborne data and metadata, all with the goal to enable life to thrive in deep space.

q-bio.OT↗

arXiv2021

GWSkyNet-Multi: A Machine Learning Multi-Class Classifier for LIGO-Virgo Public Alerts

Compact object mergers which produce both detectable gravitational waves and electromagnetic emission can provide valuable insights into the neutron star equation of state, the tension in the Hubble constant, and the origin of the r-process elements. However, electromagnetic follow-up of gravitational wave sources is complicated by false positive detections, sources which do not emit light, and the transient nature of the associated electromagnetic emission. GWSkyNet-Multi is a machine learning model that attempts to resolve these issues by providing real-time predictions of the source of a gravitational wave detection. The model uses information from Open Public Alerts (OPAs) released by LIGO-Virgo within minutes of a gravitational wave detection. GWSkyNet was first introduced in Cabero et al. (2020) as a binary classifier and uses the OPA skymaps to classify sources as either astrophysical or as glitches. In this paper, we introduce GWSkyNet-Multi, a new version of GWSkyNet which further distinguishes sources as binary black hole mergers, mergers involving a neutron star, or non-astrophysical glitches in the detectors. GWSkyNet-Multi is a sequence of three one-versus-all classifiers trained using a class-balanced and physically-motivated source mass distribution. Training on this data set, we obtain test set accuracies of 94% for BBH-versus-all, 94% for NS-versus-all, and 95% for glitch-versus-all. We obtain an overall accuracy of 93% using a hierarchical classification scheme. Furthermore, we correctly identify 36 of the 40 gravitational wave detections from the first half of LIGO-Virgo's third observing run (O3a) and present predictions for O3b sources. We also briefly discuss the interpretability of our models. As gravitational wave detections increase in number and frequency, GWSkyNet-Multi will be a powerful tool for prioritizing successful electromagnetic follow-up.

astro-ph.IM↗

arXiv2021

The Deeper, Wider, Faster Program: Exploring stellar flare activity with deep, fast cadenced DECam imaging via machine learning

We present our 500 pc distance-limited study of stellar fares using the Dark Energy Camera as part of the Deeper, Wider, Faster Program. The data was collected via continuous 20-second cadence g band imaging and we identify 19,914 sources with precise distances from Gaia DR2 within twelve, ~3 square-degree, fields over a range of Galactic latitudes. An average of ~74 minutes is spent on each field per visit. All light curves were accessed through a novel unsupervised machine learning technique designed for anomaly detection. We identify 96 flare events occurring across 80 stars, the majority of which are M dwarfs. Integrated are energies range from $\sim 10^{31}-10^{37}$ erg, with a proportional relationship existing between increased are energy with increased distance from the Galactic plane, representative of stellar age leading to declining yet more energetic are events. In agreement with previous studies we observe an increase in flaring fraction from M0 -> M6 spectral types. Furthermore, we find a decrease in the flaring fraction of stars as vertical distance from the galactic plane is increased, with a steep decline present around ~100 pc. We find that ~70% of identified flares occur on short timescales of ~8 minutes. Finally we present our associated are rates, finding a volumetric rate of $2.9 \pm 0.3 \times 10^{-6}$ flares pc$^{-3}$ hr$^{-1}$.

astro-ph.SR↗

arXiv2021

Discovery and confirmation of the shortest gamma ray burst from a collapsar

Gamma-ray bursts (GRBs) are among the brightest and most energetic events in the universe. The duration and hardness distribution of GRBs has two clusters, now understood to reflect (at least) two different progenitors. Short-hard GRBs (SGRBs; T90 <2 s) arise from compact binary mergers, while long-soft GRBs (LGRBs; T90 >2 s) have been attributed to the collapse of peculiar massive stars (collapsars). The discovery of SN 1998bw/GRB 980425 marked the first association of a LGRB with a collapsar and AT 2017gfo/GRB 170817A/GW170817 marked the first association of a SGRB with a binary neutron star merger, producing also gravitational wave (GW). Here, we present the discovery of ZTF20abwysqy (AT2020scz), a fast-fading optical transient in the Fermi Satellite and the InterPlanetary Network (IPN) localization regions of GRB 200826A; X-ray and radio emission further confirm that this is the afterglow. Follow-up imaging (at rest-frame 16.5 days) reveals excess emission above the afterglow that cannot be explained as an underlying kilonova (KN), but is consistent with being the supernova (SN). Despite the GRB duration being short (rest-frame T90 of 0.65 s), our panchromatic follow-up data confirms a collapsar origin. GRB 200826A is the shortest LGRB found with an associated collapsar; it appears to sit on the brink between a successful and a failed collapsar. Our discovery is consistent with the hypothesis that most collapsars fail to produce ultra-relativistic jets.

astro-ph.HE↗