SearcharxivSearch

arXiv subjects

Terry Jones

Publications and source records attributed to Terry Jones.

17 recordsLinked to original sources

Attention-Informed Surrogates for Navigating Power-Performance Trade-offs in HPC

High-Performance Computing (HPC) schedulers must balance user performance with facility-wide resource constraints. The task boils down to selecting the optimal number of nodes for a given job. We present a surrogate-assisted multi-objective Bayesian optimization (MOBO) framework to automate this complex decision. Our core hypothesis is that surrogate models informed by attention-based embeddings of job telemetry can capture performance dynamics more effectively than standard regression techniques. We pair this with an intelligent sample acquisition strategy to ensure the approach is data-efficient. On two production HPC datasets, our embedding-informed method consistently identified higher-quality Pareto fronts of runtime-power trade-offs compared to baselines. Furthermore, our intelligent data sampling strategy drastically reduced training costs while improving the stability of the results. To our knowledge, this is the first work to successfully apply embedding-informed surrogates in a MOBO framework to the HPC scheduling problem, jointly optimizing for performance and power on production workloads.

cs.LG

HPC Digital Twins for Evaluating Scheduling Policies, Incentive Structures and their Impact on Power and Cooling

Schedulers are critical for optimal resource utilization in high-performance computing. Traditional methods to evaluate schedulers are limited to post-deployment analysis, or simulators, which do not model associated infrastructure. In this work, we present the first-of-its-kind integration of scheduling and digital twins in HPC. This enables what-if studies to understand the impact of parameter configurations and scheduling decisions on the physical assets, even before deployment, or regarching changes not easily realizable in production. We (1) provide the first digital twin framework extended with scheduling capabilities, (2) integrate various top-tier HPC systems given their publicly available datasets, (3) implement extensions to integrate external scheduling simulators. Finally, we show how to (4) implement and evaluate incentive structures, as-well-as (5) evaluate machine learning based scheduling, in such novel digital-twin based meta-framework to prototype scheduling. Our work enables what-if scenarios of HPC systems to evaluate sustainability, and the impact on the simulated system.

cs.DC

The Red and Yellow Hypergiants

The red and yellow hypergiants are a rare and important phase in the evolution of the most massive stars that can reach the cool part of the HR Diagram. The hypergiant phase is commonly characterized by high, often episodic mass-loss rates and significant changes in spectral type, probably due to the formation of a pseudo photopsphere during a high mass-loss episode. Many of the yellow hypergiants are the immediate successors to the most luminous red supergiants, and often show evidence in their dusty, circumstellar envelopes from past red supergiant activity. In this paper we review the yellow and red hypergiants with an emphasis on how they differ from more normal red supergiants.

astro-ph.SR

Leveraging AI for Productive and Trustworthy HPC Software: Challenges and Research Directions

We discuss the challenges and propose research directions for using AI to revolutionize the development of high-performance computing (HPC) software. AI technologies, in particular large language models, have transformed every aspect of software development. For its part, HPC software is recognized as a highly specialized scientific field of its own. We discuss the challenges associated with leveraging state-of-the-art AI technologies to develop such a unique and niche class of software and outline our research directions in the two US Department of Energy--funded projects for advancing HPC Software via AI: Ellora and Durban.

cs.SE

Autonomy Loops for Monitoring, Operational Data Analytics, Feedback, and Response in HPC Operations

Many High Performance Computing (HPC) facilities have developed and deployed frameworks in support of continuous monitoring and operational data analytics (MODA) to help improve efficiency and throughput. Because of the complexity and scale of systems and workflows and the need for low-latency response to address dynamic circumstances, automated feedback and response have the potential to be more effective than current human-in-the-loop approaches which are laborious and error prone. Progress has been limited, however, by factors such as the lack of infrastructure and feedback hooks, and successful deployment is often site- and case-specific. In this position paper we report on the outcomes and plans from a recent Dagstuhl Seminar, seeking to carve a path for community progress in the development of autonomous feedback loops for MODA, based on the established formalism of similar (MAPE-K) loops in autonomous computing and self-adaptive systems. By defining and developing such loops for significant cases experienced across HPC sites, we seek to extract commonalities and develop conventions that will facilitate interoperability and interchangeability with system hardware, software, and applications across different sites, and will motivate vendors and others to provide telemetry interfaces and feedback hooks to enable community development and pervasive deployment of MODA autonomy loops.

cs.DC

Online Application Guidance for Heterogeneous Memory Systems

Many high end and next generation computing systems to incorporated alternative memory technologies to meet performance goals. Since these technologies present distinct advantages and tradeoffs compared to conventional DDR* SDRAM, such as higher bandwidth with lower capacity or vice versa, they are typically packaged alongside conventional SDRAM in a heterogeneous memory architecture. To utilize the different types of memory efficiently, new data management strategies are needed to match application usage to the best available memory technology. However, current proposals for managing heterogeneous memories are limited because they either: 1) do not consider high-level application behavior when assigning data to different types of memory, or 2) require separate program execution (with a representative input) to collect information about how the application uses memory resources. This work presents a toolset for addressing the limitations of existing approaches for managing complex memories. It extends the application runtime layer with automated monitoring and management routines that assign application data to the best tier of memory based on previous usage, without any need for source code modification or a separate profiling run. It evaluates this approach on a state-of-the-art server platform with both conventional DDR4 SDRAM and non-volatile Intel Optane DC memory, using both memory-intensive high performance computing (HPC) applications as well as standard benchmarks. Overall, the results show that this approach improves program performance significantly compared to a standard unguided approach across a variety of workloads and system configurations. Additionally, we show that this approach achieves similar performance as a comparable offline profiling-based approach after a short startup period, without requiring separate program execution or offline analysis steps.

cs.PF

PICO: Probe of Inflation and Cosmic Origins

The Probe of Inflation and Cosmic Origins (PICO) is an imaging polarimeter that will scan the sky for 5 years in 21 frequency bands spread between 21 and 799 GHz. It will produce full-sky surveys of intensity and polarization with a final combined-map noise level of 0.87 $\mu$K arcmin for the required specifications, equivalent to 3300 Planck missions, and with our current best-estimate would have a noise level of 0.61 $\mu$K arcmin (6400 Planck missions). PICO will either determine the energy scale of inflation by detecting the tensor to scalar ratio at a level $r=5\times 10^{-4}~(5\sigma)$, or will rule out with more than $5\sigma$ all inflation models for which the characteristic scale in the potential is the Planck scale. With LSST's data it could rule out all models of slow-roll inflation. PICO will detect the sum of neutrino masses at $>4\sigma$, constrain the effective number of light particle species with $\Delta N_{\rm eff}<0.06~(2\sigma)$, and elucidate processes affecting the evolution of cosmic structures by measuring the optical depth to reionization with errors limited by cosmic variance and by constraining the evolution of the amplitude of linear fluctuations $\sigma_{8}(z)$ with sub-percent accuracy. Cross-correlating PICO's map of the thermal Sunyaev-Zeldovich effect with LSST's gold sample of galaxies will precisely trace the evolution of thermal pressure with $z$. PICO's maps of the Milky Way will be used to determine the make up of galactic dust and the role of magnetic fields in star formation efficiency. With 21 full sky legacy maps in intensity and polarization, which cannot be obtained in any other way, the mission will enrich many areas of astrophysics. PICO is the only single-platform instrument with the combination of sensitivity, angular resolution, frequency bands, and control of systematic effects that can deliver this compelling, timely, and broad science.

astro-ph.IM

The EBEX Balloon Borne Experiment - Detectors and Readout

EBEX was a long-duration balloon-borne experiment to measure the polarization of the cosmic microwave background. The experiment had three frequency bands centered at 150, 250, and 410 GHz and was the first to use a kilo-pixel array of transition edge sensor (TES) bolometers aboard a balloon platform; shortly after reaching float we operated 504, 342, and 109 TESs at each of the bands, respectively. We describe the design and characterization of the array and the readout system. We give the distributions of measured thermal conductances, normal resistances, and transition temperatures. With the exception of the thermal conductance at 150 GHz. We measured median low-loop-gain time constants $\tau_{0}=$ 88, 46, and 57 ms and compare them to predictions. Two measurements of bolometer absorption efficiency show high ($\sim$0.9) efficiency at 150 GHz and medium ($\sim$0.35, and $\sim$0.25) at the two higher bands, respectively. We measure a median total optical load of 3.6, 5.3 and 5.0 pW absorbed at the three bands, respectively. EBEX pioneered the use of the digital version of the frequency domain multiplexing (FDM) system which multiplexed the bias and readout of 16 bolometers onto two wires. We present accounting of the measured noise equivalent power. The median per-detector noise equivalent temperatures referred to a black body with a temperature of 2.725 K are 400, 920, and 14500 $\mu$K$\sqrt{s}$ for the three bands, respectively. We compare these values to our pre-flight predictions and to a previous balloon payload, discuss the sources of excess noise, and the path for a future payload to make full use of the balloon environment.

astro-ph.IM

Intensity-Coupled-Polarization in Instruments with a Continuously Rotating Half-Wave Plate

We discuss a systematic effect associated with measuring polarization with a continuously rotating half-wave plate. The effect was identified with the data from the E and B Experiment (EBEX), which was a balloon-borne instrument designed to measure the polarization of the CMB as well as that from Galactic dust. The data show polarization fraction larger than 10\% while less than 3\% were expected from instrumental polarization. We give evidence that the excess polarization is due to detector non-linearity in the presence of a continuously rotating HWP. The non-linearity couples intensity signals into polarization. We develop a map-based method to remove the excess polarization. Applying this method for the 150 (250) GHz bands data we find that 81\% (92\%) of the excess polarization was removed. Characterization and mitigation of this effect is important for future experiments aiming to measure the CMB B-modes with a continuously rotating HWP.

astro-ph.IM

The EBEX Balloon Borne Experiment - Optics, Receiver, and Polarimetry

The E and B Experiment (EBEX) was a long-duration balloon-borne cosmic microwave background polarimeter that flew over Antarctica in 2013. We describe the experiment's optical system, receiver, and polarimetric approach, and report on their in-flight performance. EBEX had three frequency bands centered on 150, 250, and 410 GHz. To make efficient use of limited mass and space we designed a 115 cm$^{2}$sr high throughput optical system that had two ambient temperature mirrors and four anti-reflection coated polyethylene lenses per focal plane. All frequency bands shared the same optical train. Polarimetry was achieved with a continuously rotating achromatic half-wave plate (AHWP) that was levitated with a superconducting magnetic bearing (SMB). Rotation stability was 0.45 % over a period of 10 hours, and angular position accuracy was 0.01 degrees. This is the first use of a SMB in astrophysics. The measured modulation efficiency was above 90 % for all bands. To our knowledge the 109 % fractional bandwidth of the AHWP was the broadest implemented to date. The receiver that contained one lens and the AHWP at a temperature of 4 K, the polarizing grid and other lenses at 1 K, and the two focal planes at 0.25 K performed according to specifications giving focal plane temperature stability with fluctuation power spectrum that had $1/f$ knee at 2 mHz. EBEX was the first balloon-borne instrument to implement technologies characteristic of modern CMB polarimeters including high throughput optical systems, and large arrays of transition edge sensor bolometric detectors with mutiplexed readouts.

astro-ph.IM

The EBEX Balloon-Borne Experiment - Gondola, Attitude Control, and Control Software

The E and B Experiment (EBEX) was a long-duration balloon-borne instrument designed to measure the polarization of the cosmic microwave background (CMB) radiation. EBEX was the first balloon-borne instrument to implement a kilo-pixel array of transition edge sensor (TES) bolometric detectors and the first CMB experiment to use the digital version of the frequency domain multiplexing system for readout of the TES array. The scan strategy relied on 40 s peak-to-peak constant velocity azimuthal scans. We discuss the unique demands on the design and operation of the payload that resulted from these new technologies and the scan strategy. We describe the solutions implemented including the development of a power system designed to provide a total of at least 2.3 kW, a cooling system to dissipate 590 W consumed by the detectors' readout system, software to manage and handle the data of the kilo-pixel array, and specialized attitude reconstruction software. We present flight performance data showing faultless management of the TES array, adequate powering and cooling of the readout electronics, and constraint of attitude reconstruction errors such that the spurious B-modes they induced were less than 10% of CMB B-mode power spectrum with $r=0.05$.

astro-ph.IM

Temperature calibration of the E and B experiment

The E and B Experiment (EBEX) is a balloon-borne polarimeter designed to measure the polarization of the cosmic microwave background radiation and to characterize the polarization of galactic dust. EBEX was launched December 29, 2012 and circumnavigated Antarctica observing $\sim$6,000 square degrees of sky during 11 days at three frequency bands centered around 150, 250 and 410 GHz. EBEX was the first experiment to operate a kilo-pixel array of transition-edge sensor bolometers and a continuously rotating achromatic half-wave plate aboard a balloon platform. It also pioneered the use of detector readout based on digital frequency domain multiplexing. We describe the temperature calibration of the experiment. The gain response of the experiment is calibrated using a two-step iterative process. We use signals measured on passes across the Galactic plane to convert from readout-system counts to power. The effective smoothing scale of the EBEX optics and the star camera-to-detector offset angles are determined through \c{hi}2 minimization using the compact HII region RCW 38. This two-step process is initially performed with parameters measured before the EBEX 2013 flight and then repeated until the calibration factor and parameters converge.

astro-ph.IM

The performance of the bolometer array and readout system during the 2012/2013 flight of the E and B experiment (EBEX)

EBEX is a balloon-borne telescope designed to measure the polarization of the cosmic microwave background radiation. During its eleven day science flight in the Austral Summer of 2012, it operated 955 spider-web transition edge sensor (TES) bolometers separated into bands at 150, 250 and 410 GHz. This is the first time that an array of TES bolometers has been used on a balloon platform to conduct science observations. Polarization sensitivity was provided by a wire grid and continuously rotating half-wave plate. The balloon implementation of the bolometer array and readout electronics presented unique development requirements. Here we present an outline of the readout system, the remote tuning of the bolometers and Superconducting QUantum Interference Device (SQUID) amplifiers, and preliminary current noise of the bolometer array and readout system.

astro-ph.IM

A Thermal Infrared Imaging Study of Very Low-Mass, Wide Separation Brown Dwarf Companions to Upper Scorpius Stars: Constraining Circumstellar Environments

We present a 3-5um LBT/MMT adaptive optics imaging study of three Upper Scorpius stars with brown dwarf (BD) companions with very low-masses/mass ratios (M_BD < 25M_Jup; M_BD / M_star ~ 1-2%), and wide separations (300-700 AU): GSC 06214, 1RXS 1609, and HIP 78530. We combine these new thermal IR data with existing 1-4um and 24um photometry to constrain the properties of the BDs and identify evidence for circumprimary/secondary disks in these unusual systems. We confirm that GSC 06214B is surrounded by a disk, further showing this disk produces a broadband IR excess due to small dust near the dust sublimation radius. An unresolved 24um excess in the system may be explained by the contribution from this disk. 1RXS 1609B exhibits no 3-4um excess, nor does its primary; however, the system as a whole has a modest 24um excess, which may come from warm dust around the primary and/or BD. Neither object in the HIP 78530 system exhibits near- to mid-IR excesses. We additionally find that the 1-4um colors of HIP 78530B match a spectral type of M3+-2, inconsistent with the M8 spectral type assigned based on its near-IR spectrum, indicating it may be a low-mass star rather than a BD. We present new upper limits on additional low-mass companions in the system (<5M_Jup beyond 175AU). Finally, we examine the utility of circumsecondary disks as probes of the formation histories of wide BD companions, finding that the presence of a disk may disfavor BD formation near the primary with subsequent outward scattering.

astro-ph.SR

First Light LBT AO Images of HR 8799 bcde at 1.65 and 3.3 Microns: New Discrepancies between Young Planets and Old Brown Dwarfs

As the only directly imaged multiple planet system, HR 8799 provides a unique opportunity to study the physical properties of several planets in parallel. In this paper, we image all four of the HR 8799 planets at H-band and 3.3 microns with the new LBT adaptive optics system, PISCES, and LBTI/LMIRCam. Our images offer an unprecedented view of the system, allowing us to obtain H and 3.3$ micron photometry of the innermost planet (for the first time) and put strong upper-limits on the presence of a hypothetical fifth companion. We find that all four planets are unexpectedly bright at 3.3 microns compared to the equilibrium chemistry models used for field brown dwarfs, which predict that planets should be faint at 3.3 microns due to CH4 opacity. We attempt to model the planets with thick-cloudy, non-equilibrium chemistry atmospheres, but find that removing CH4 to fit the 3.3 micron photometry increases the predicted L' (3.8 microns) flux enough that it is inconsistent with observations. In an effort to fit the SED of the HR 8799 planets, we construct mixtures of cloudy atmospheres, which are intended to represent planets covered by clouds of varying opacity. In this scenario, regions with low opacity look hot and bright, while regions with high opacity look faint, similar to the patchy cloud structures on Jupiter and L/T transition brown-dwarfs. Our mixed cloud models reproduce all of the available data, but self-consistent models are still necessary to demonstrate their viability.

astro-ph.EP

EBEX: A balloon-borne CMB polarization experiment

EBEX is a NASA-funded balloon-borne experiment designed to measure the polarization of the cosmic microwave background (CMB). Observations will be made using 1432 transition edge sensor (TES) bolometric detectors read out with frequency multiplexed SQuIDs. EBEX will observe in three frequency bands centered at 150, 250, and 410 GHz, with 768, 384, and 280 detectors in each band, respectively. This broad frequency coverage is designed to provide valuable information about polarized foreground signals from dust. The polarized sky signals will be modulated with an achromatic half wave plate (AHWP) rotating on a superconducting magnetic bearing (SMB) and analyzed with a fixed wire grid polarizer. EBEX will observe a patch covering ~1% of the sky with 8' resolution, allowing for observation of the angular power spectrum from \ell = 20 to 1000. This will allow EBEX to search for both the primordial B-mode signal predicted by inflation and the anticipated lensing B-mode signal. Calculations to predict EBEX constraints on r using expected noise levels show that, for a likelihood centered around zero and with negligible foregrounds, 99% of the area falls below r = 0.035. This value increases by a factor of 1.6 after a process of foreground subtraction. This estimate does not include systematic uncertainties. An engineering flight was launched in June, 2009, from Ft. Sumner, NM, and the long duration science flight in Antarctica is planned for 2011. These proceedings describe the EBEX instrument and the North American engineering flight.

astro-ph.CO

The EBEX Cryostat and Supporting Electronics

We describe the cryostat and supporting electronics for the EBEX experiment. EBEX is a balloon-borne polarimeter designed to measure the B-mode polarization of the cosmic microwave background radiation. The instrument includes a 1.5 meter Gregorian-type telescope and 1432 bolometric transition edge sensor detectors operating at 0.3 K. Electronics for monitoring temperatures and controlling cryostat refrigerators is read out over CANbus. A timing system ensures the data from all subsystems is accurately synchronized. EBEX completed an engineering test flight in June 2009 during which the cryogenics and supporting electronics performed according to predictions. The temperatures of the cryostat were stable, and an analysis of a subset of the data finds no scan synchronous signal in the cryostat temperatures. Preparations are underway for an Antarctic flight.

astro-ph.IM