arXiv subjects

David Shupe

Publications and source records attributed to David Shupe.

16 recordsLinked to original sources

arXiv2026

Reducing the Dimensions of AGN Lightcurve Manifolds

The Active Galactic Nuclei (AGN) glossary is vast and complex. Depending on selection method, observing wavelength, and brightness, AGNs are assigned distinct labels, yet the relationship between different selection methods and the diversity of time-domain behavior within and across classes remains difficult to characterize in a unified framework. Changing-look AGNs (CLAGNs), which transition between classifications over time, further complicate this picture. In this work, we learn a data-driven, low-dimensional representation of multi-wavelength photometric light curves of AGNs, in which the structure of the projected manifold correlates with AGN class and independent spectroscopic properties. Using the NASA Fornax Science Platform, we assemble light curves from ZTF, Pan-STARRS, Gaia, and WISE/NEOWISE for two samples: (1) a heterogeneous set of $\sim$2000 AGNs spanning $z \lesssim 1$, including SDSS quasars, variability-selected sources, and CLAGNs; and (2) a homogeneous sample of $\sim$65000 narrow-line AGNs at $z \approx 0.1$ with well-characterized optical emission-line measurements. Without using class labels during training, the learned manifolds organize variability-selected AGNs into coherent regions of the low-dimensional space, distinguish between turn-on and turn-off CLAGNs, and place tidal disruption events in distinct regions. Manifold coordinates correlate with key spectroscopic and host-galaxy properties, including stellar mass, [OIII] luminosity, and D$_n$(4000), demonstrating that heterogeneous multi-band variability can be combined in a purely data-driven manner to recover correlations with independent physical diagnostics, without requiring explicit physical modeling. These results show that manifold learning offers a practical, assumption-light approach for integrating time-domain surveys and prioritizing spectroscopic follow-up.

astro-ph.GA↗

arXiv2023

A New Forced Photometry Service for the Zwicky Transient Facility

We describe the Zwicky Transient Facility (ZTF) Forced Photometry Service (ZFPS) as developed and maintained by the ZTF Science Data System Team at IPAC/Caltech. The service is open for public use following a subscription. The ZFPS has been operational since early 2020 and has been used to generate publication quality lightcurves for a myriad of science programs. The ZFPS has been recently upgraded to allow users to request forced-photometry lightcurves for up to 1500 sky positions per request in a single web-application submission. The underlying software has been recoded to take advantage of a parallel processing architecture with the most compute-intensive component rewritten in C and optimized for the available hardware. The ZTF processing cluster consists of 66 compute nodes, each hosting at least 16 physical cores. The compute nodes are generally idle following nightly real-time processing of the ZTF survey data and when other ad hoc processing tasks have been completed. The ZFPS and associated infrastructure at IPAC/Caltech therefore enable thousands of forced-photometry lightcurves to be generated along with a wealth of quality metrics to facilitate analyses and filtering of bad quality data prior to scientific use.

astro-ph.IM↗

arXiv2017

SPIRE Point Source Catalog Explanatory Supplement

The Spectral and Photometric Imaging Receiver (SPIRE) was launched as one of the scientific instruments on board of the space observatory Herschel. The SPIRE photometer opened up an entirely new window in the Submillimeter domain for large scale mapping, that up to then was very difficult to observe. There are already several catalogs that were produced by individual Herschel science projects. Yet, we estimate that the objects of only a fraction of these maps will ever be systematically extracted and published by the science teams that originally proposed the observations. The SPIRE instrument performed its standard photometric observations in an optically very stable configuration, only moving the telescope across the sky, with variations in its configuration parameters limited to scan speed and sampling rate. This and the scarcity of features in the data that require special processing steps made this dataset very attractive for producing an expert reduced catalog of point sources that is being described in this document. The Catalog was extracted from a total of 6878 unmodified SPIRE scan map observations. The photometry was obtained by a systematic and homogeneous source extraction procedure, followed by a rigorous quality check that emphasized reliability over completeness. Having to exclude regions affected by strong Galactic emission, that pushed the limits of the four source extraction methods that were used, this catalog is aimed primarily at the extragalactic community. The result can serve as a pathfinder for ALMA and other Submillimeter and Far-Infrared facilities. 1,693,718 sources are included in the final catalog, splitting into 950688, 524734, 218296 objects for the 250\mu m, 350\mu m, and 500\mu m bands, respectively. The catalog comes with well characterized environments, reliability, completeness, and accuracies, that single programs typically cannot provide.

astro-ph.IM↗

arXiv2016

The IPAC Image Subtraction and Discovery Pipeline for the intermediate Palomar Transient Factory

We describe the near real-time transient-source discovery engine for the intermediate Palomar Transient Factory (iPTF), currently in operations at the Infrared Processing and Analysis Center (IPAC), Caltech. We coin this system the IPAC/iPTF Discovery Engine (or IDE). We review the algorithms used for PSF-matching, image subtraction, detection, photometry, and machine-learned (ML) vetting of extracted transient candidates. We also review the performance of our ML classifier. For a limiting signal-to-noise ratio of 4 in relatively unconfused regions, "bogus" candidates from processing artifacts and imperfect image subtractions outnumber real transients by ~ 10:1. This can be considerably higher for image data with inaccurate astrometric and/or PSF-matching solutions. Despite this occasionally high contamination rate, the ML classifier is able to identify real transients with an efficiency (or completeness) of ~ 97% for a maximum tolerable false-positive rate of 1% when classifying raw candidates. All subtraction-image metrics, source features, ML probability-based real-bogus scores, contextual metadata from other surveys, and possible associations with known Solar System objects are stored in a relational database for retrieval by the various science working groups. We review our efforts in mitigating false-positives and our experience in optimizing the overall system in response to the multitude of science projects underway with iPTF.

astro-ph.IM↗

arXiv2015

The Herschel Point Source Catalogue

The Herschel Space Observatory was the fourth cornerstone mission in the European Space Agency (ESA) science programme with excellent broad band imaging capabilities in the sub-mm and far-infrared part of the spectrum. Although the spacecraft finished its observations in 2013, it left a large legacy dataset that is far from having been fully scrutinised and still has a large potential for new scientific discoveries. This is specifically true for the photometric observations of the PACS and SPIRE instruments. Some source catalogues have already been produced by individual observing programs, but there are many observations that risk to remain unexplored. To maximise the science return of the SPIRE and PACS data sets, we are in the process of building the Herschel Point Source Catalogue (HPSC) from all primary and parallel mode observations. Our homogeneous source extraction enables a systematic and unbiased comparison of sensitivity across the different Herschel fields that single programs will generally not be able to provide. The catalogue will be made available online through archives like the Herschel Science Archive (HSA), the Infrared Science Archive (IRSA), and the Strasbourg Astronomical Data Center (CDS).

astro-ph.GA↗

arXiv2015

The Star-Formation History of BCGs to z = 1.8 from the SpARCS/SWIRE Survey: Evidence for significant in-situ star formation at high-redshift

We present the results of a MIPS-24um study of the Brightest Cluster Galaxies (BCGs) of 535 high-redshift galaxy clusters. The clusters are drawn from the Spitzer Adaptation of the Red-Sequence Cluster Survey (SpARCS), which effectively provides a sample selected on total stellar mass, over 0.2 < z < 1.8 within the Spitzer Wide-Area Infrared Extragalactic (SWIRE) Survey fields. 20%, or 106 clusters have spectroscopically confirmed redshifts, and the rest have redshifts estimated from the color of their red sequence. A comparison with the public SWIRE images detects 125 individual BCGs at 24um > 100uJy, or 23%. The luminosity-limited detection rate of BCGs in similar richness clusters (Ngal> 12) increases rapidly with redshift. Above z ~ 1, an average of ~20\% of the sample have 24um-inferred infrared luminosities of LIR > 10^12 Lsun, while the fraction below z ~ 1 exhibiting such luminosities is < 1 \%. The Spitzer-IRAC colors indicate the bulk of the 24um-detected population is predominantly powered by star formation, with only 7/125 galaxies lying within the color region inhabited by Active Galactic Nuclei (AGN). Simple arguments limit the star-formation activity to several hundred million years and this may therefore be indicative of the timescale for AGN feedback to halt the star formation. Below redshift z ~ 1 there is not enough star formation to significantly contribute to the overall stellar mass of the BCG population, and therefore BCG growth is likely dominated by dry-mergers. Above z~ 1, however, the inferred star formation would double the stellar mass of the BCGs and is comparable to the mass assembly predicted by simulations through dry mergers. We cannot yet constrain the process driving the star formation for the overall sample, though a single object studied in detail is consistent with a gas-rich merger.

astro-ph.GA↗

arXiv2015

Significant problems in FITS limit its use in modern astronomical research

The Flexible Image Transport System (FITS) standard has been a great boon to astronomy, allowing observatories, scientists and the public to exchange astronomical information easily. The FITS standard is, however, showing its age. Developed in the late 1970s the FITS authors made a number of implementation choices for the format that, while common at the time, are now seen to limit its utility with modern data. The authors of the FITS standard could not appreciate the challenges which we would be facing today in astronomical computing. Difficulties we now face include, but are not limited to, having to address the need to handle an expanded range of specialized data product types (data models), being more conducive to the networked exchange and storage of data, handling very large datasets and the need to capture significantly more complex metadata and data relationships. There are members of the community today who find some (or all) of these limitations unworkable, and have decided to move ahead with storing data in other formats. This reaction should be taken as a wakeup call to the FITS community to make changes in the FITS standard, or to see its usage fall. In this paper we detail some selected important problems which exist within the FITS standard today. It is not our intention to prescribe specific remedies to these issues; rather, we hope to call attention of the FITS and greater astronomical computing communities to these issues in the hopes that it will spur action to address them.

astro-ph.IM↗

arXiv2015

Learning from FITS: Limitations in use in modern astronomical research

The Flexible Image Transport System (FITS) standard has been a great boon to astronomy, allowing observatories, scientists and the public to exchange astronomical information easily. The FITS standard, however, is showing its age. Developed in the late 1970s, the FITS authors made a number of implementation choices that, while common at the time, are now seen to limit its utility with modern data. The authors of the FITS standard could not anticipate the challenges which we are facing today in astronomical computing. Difficulties we now face include, but are not limited to, addressing the need to handle an expanded range of specialized data product types (data models), being more conducive to the networked exchange and storage of data, handling very large datasets, and capturing significantly more complex metadata and data relationships. There are members of the community today who find some or all of these limitations unworkable, and have decided to move ahead with storing data in other formats. If this fragmentation continues, we risk abandoning the advantages of broad interoperability, and ready archivability, that the FITS format provides for astronomy. In this paper we detail some selected important problems which exist within the FITS standard today. These problems may provide insight into deeper underlying issues which reside in the format and we provide a discussion of some lessons learned. It is not our intention here to prescribe specific remedies to these issues; rather, it is to call attention of the FITS and greater astronomical computing communities to these problems in the hope that it will spur action to address them.

astro-ph.IM↗

arXiv2014

SPIRE Map-Making Test Report

The photometer section of SPIRE is one of the key instruments on board of Herschel. Its legacy depends very much on how well the scanmap observations that it carried out during the Herschel mission can be converted to high quality maps. In order to have a comprehensive assessment on the current status of SPIRE map-making, as well as to provide guidance for future development of the SPIRE scan-map data reduction pipeline, we carried out a test campaign on SPIRE map-making. In this report, we present results of the tests in this campaign.

astro-ph.IM↗

arXiv2009

The SWIRE/Chandra Survey: The X-ray Sources

We report a moderate-depth (70 ksec), contiguous 0.7 sq.deg, Chandra survey, in the Lockman Hole Field of the Spitzer/SWIRE Legacy Survey coincident with a completed, ultra-deep VLA survey with deep optical and near-infrared imaging in-hand. The primary motivation is to distinguish starburst galaxies and AGN, including the significant, highly obscured (log N_H >23) subset. Chandra has detected 775 X-ray sources to a limiting broad band (0.3-8 keV) flux ~4E-16 erg/cm^2/s. We present the X-ray catalog, fluxes, hardness ratios and multi-wavelength fluxes. The log N vs. log S agrees with those of previous surveys covering similar flux ranges. The Chandra and Spitzer flux limits are well matched: 771 (99%) of the X-ray sources have IR or optical counterparts, and 333 have MIPS 24 um detections. There are 4 optical-only X-ray sources and 4 with no visible optical/IR counterpart. The very deep (~2.7 uJy rms) VLA data yields 251 (> 4 sigma) radio counterparts, 44% of the X-ray sources in the field. We confirm that the tendency for lower X-ray flux sources to be harder is primarily due to absorption. As expected, there is no correlation between observed IR and X-ray flux. Optically bright, Type 1 and red AGN lie in distinct regions of the IR vs X-ray flux plots, demonstrating the wide range of SEDs in this sample and providing the potential for classification/source selection. The classical definition of radio-loudness, R_L, is not effective at selecting strong radio sources for red and relatively optically faint AGN. Using the 24 um to radio flux ratio (q_24) results in the usual ~10% radio-loud AGN (13 of 147).

astro-ph.HE↗

arXiv2008

Photometric redshifts in the SWIRE Survey

We present the SWIRE Photometric Redshift Catalogue, 1025119 redshifts of unprecedented reliability and accuracy. Our method is based on fixed galaxy and QSO templates applied to data at 0.36-4.5 mu, and on a set of 4 infrared emission templates fitted to infrared excess data at 3.6-170 mu. The code involves two passes through the data, to try to optimize recognition of AGN dust tori. A few carefully justified priors are used and are the key to supression of outliers. Extinction, A_V, is allowed as a free parameter. We use a set of 5982 spectroscopic redshifts, taken from the literature and from our own spectroscopic surveys, to analyze the performance of our method as a function of the number of photometric bands used in the solution and the reduced chi^2. For 7 photometric bands the rms value of (z_{phot}-z_{spec})/(1+z_{spec}) is 3.5%, and the percentage of catastrophic outliers is ~1%. We discuss the redshift distributions at 3.6 and 24 mu. In individual fields, structure in the redshift distribution corresponds to clusters which can be seen in the spectroscopic redshift distribution. 10% of sources in the SWIRE photometric redshift catalogue have z >2, and 4% have z>3, so this catalogue is a huge resource for high redshift galaxies. A key parameter for understanding the evolutionary status of infrared galaxies is L_{ir}/L_{opt}, which can be interpreted as the specific star-formation rate for starbursts. For dust tori around Type 1 AGN, L_{tor}/L_{opt} is a measure of the torus covering factor and we deduce a mean covering factor of 40%.

astro-ph↗

arXiv2007

High-Redshift QSOs in the SWIRE Survey and the z~3 QSO Luminosity Function

We use a simple optical/infrared (IR) photometric selection of high-redshift QSOs that identifies a Lyman Break in the optical photometry and requires a red IR color to distinguish QSOs from common interlopers. The search yields 100 z~3 (U-dropout) QSO candidates with 19<r'<22 over 11.7 deg^2 in the ELAIS-N1 (EN1) and ELAIS-N2 (EN2) fields of the Spitzer Wide-area Infrared Extragalactic (SWIRE) Legacy Survey. The z~3 selection is reliable, with spectroscopic follow-up of 10 candidates confirming they are all QSOs at 2.83<z<3.44. We find that our z~4$ (g'-dropout) sample suffers from both unreliability and incompleteness but present 7 previously unidentified QSOs at 3.50<z<3.89. Detailed simulations show our z~3 completeness to be ~80-90% from 3.0<z<3.5, significantly better than the ~30-80% completeness of the SDSS at these redshifts. The resulting luminosity function extends two magnitudes fainter than SDSS and has a faint end slope of beta=-1.42 +- 0.15, consistent with values measured at lower redshift. Therefore, we see no evidence for evolution of the faint end slope of the QSO luminosity function. Including the SDSS QSO sample, we have now directly measured the space density of QSOs responsible for ~70% of the QSO UV luminosity density at z~3. We derive a maximum rate of HI photoionization from QSOs at z~3.2, Gamma = 4.8x10^-13 s^-1, about half of the total rate inferred through studies of the Ly-alpha forest. Therefore, star-forming galaxies and QSOs must contribute comparably to the photoionization of HI in the intergalactic medium at z~3.

astro-ph↗

arXiv2007

IR and UV Galaxies at z=0.6 -- Evolution of Dust Attenuation and Stellar Mass as Revealed by SWIRE and GALEX

We study dust attenuation and stellar mass of $\rm z\sim 0.6$ star-forming galaxies using new SWIRE observations in IR and GALEX observations in UV. Two samples are selected from the SWIRE and GALEX source catalogs in the SWIRE/GALEX field ELAIS-N1-00 ($\Omega = 0.8$ deg$^2$). The UV selected sample has 600 galaxies with photometric redshift (hereafter photo-z) $0.5 \leq z \leq 0.7$ and NUV$\leq 23.5$ (corresponding to $\rm L_{FUV} \geq 10^{9.6} L_\sun$). The IR selected sample contains 430 galaxies with $f_{24\mu m} \geq 0.2$ mJy ($\rm L_{dust} \geq 10^{10.8} L_\sun$) in the same photo-z range. It is found that the mean $\rm L_{dust}/L_{FUV}$ ratios of the z=0.6 UV galaxies are consistent with that of their z=0 counterparts of the same $\rm L_{FUV}$. For IR galaxies, the mean $\rm L_{dust}/L_{FUV}$ ratios of the z=0.6 LIRGs ($\rm L_{dust} \sim 10^{11} L_\sun$) are about a factor of 2 lower than local LIRGs, whereas z=0.6 ULIRGs ($\rm L_{dust} \sim 10^{12} L_\sun$) have the same mean $\rm L_{dust}/L_{FUV}$ ratios as their local counterparts. This is consistent with the hypothesis that the dominant component of LIRG population has changed from large, gas rich spirals at z$>0.5$ to major-mergers at z=0. The stellar mass of z=0.6 UV galaxies of $\rm L_{FUV} \leq 10^{10.2} L_\sun$ is about a factor 2 less than their local counterparts of the same luminosity, indicating growth of these galaxies. The mass of z=0.6 UV lunmous galaxies (UVLGs: $\rm L_{FUV} > 10^{10.2} L_\sun$) and IR selected galaxies, which are nearly exclusively LIRGs and ULIRGs, is the same as their local counterparts.

astro-ph↗

arXiv2006

The spatial clustering of ultraluminous infrared galaxies over 1.5<z<3

We present measurements of the spatial clustering of galaxies with stellar masses >10^11Msun, infrared luminosities >10^12 Lsun, and star formation rates >200Msun per year in two redshift intervals; 1.5 1, both starbursts and AGN. Adopting plausible models for the growth of DM haloes with redshift, then the haloes hosting the 2 1 signpost stellar buildup in galaxies that will reside in clusters at z=0, with ULIRGs at increasing redshifts signposting the buildup of stars in galaxies that will reside in increasingly rich clusters.

astro-ph↗

arXiv2004

First Insights into the SWIRE Galaxy Populations

We characterize the SWIRE galaxy populations in the SWIRE validation field within the Lockman Hole, based on the 3.6-24$μ$ Spitzer data and deep U,g',r',r' optical imaging within an area ~1/3 sq. deg for ~16,000 Spitzer-SWIRE sources. The entire SWIRE survey will discover over 2.3 million galaxies at 3.6$μ$m and almost 350,000 at 24$μ$m; ~70,000 of these will be 5-band 3.6-24$μ$ detections. The colors cover a broad range, generally well represented by redshifted spectral energy distributions of known galaxy populations, however significant samples of unusually blue objects in the [3.6-4.5]$μ$m color are found, as well as many objects very red in the 3.6-24$μ$m mid-IR. Nine of these are investigated and are interpreted as star-forming systems, starbursts and AGN from z=0.37 to 2.8, with luminosities from L$_{IR}$=10$^{10.3}$ to 10$^{13.7}$ L$_{\odot}$

astro-ph↗

arXiv2003

SWIRE: The SIRTF Wide-area InfraRed Extragalactic Survey

The SIRTF Wide-area InfraRed Extragalactic survey (SWIRE), the largest SIRTF Legacy program, is a wide-area, imaging survey to trace the evolution of dusty, star-forming galaxies, evolved stellar populations, and AGN as a function of environment, from redshifts z~3 to the current epoch. SWIRE will survey 7 high-latitude fields, totaling 60 - 65 sq. deg. in all 7 SIRTF bands: IRAC 3.6, 4.5, 5.6, 8 microns and MIPS 24, 70, 160 microns. The Legacy Extragalactic Catalog may contain in excess of 2 million IR-selected galaxies, dominated by (1) ~150,000 luminous infrared galaxies (LIRGs: L{FIR}>10^11 L_sun), ~7000 of these with z>2; (2) 1 million early-type galaxies, ~10,000 with z>2; and (3) \~20,000 classical AGN, plus significantly more dust-obscured QSO/AGN among the LIRGs. SWIRE will provide an unprecedented view of the evolution of galaxies, structure, and AGN. The key scientific goals of SWIRE are: (1) to determine the evolution of actively star-forming and passively evolving galaxies in order to understand the history of galaxy formation in the context of cosmic structure formation; (2) to determine the evolution of the spatial distribution and clustering of evolved galaxies, starbursts and AGN in the key redshift range, 0.5<z<3, over which much of cosmic evolution has occurred; (3) to determine the evolutionary relationship between ``normal galaxies'' and AGN, and the contribution of AGN accretion energy vs stellar nucleosynthesis to the cosmic backgrounds. SWIRE's large area is important to create statistically significant population samples over enough volume cells that we can resolve the star formation history as a function of epoch and environment The large volume is also optimised for finding rare objects.

astro-ph↗