SearcharxivSearch

arXiv subjects

Chris Snyder

Publications and source records attributed to Chris Snyder.

4 recordsLinked to original sources

GOES-East full-disk AI nowcasting of cloud evolution in observation space

Clouds affect aviation, solar energy, remote sensing, and storm prediction, yet they remain among the hardest atmospheric features to forecast, particularly at convective scales. Because clouds are shaped by processes spanning a wide range of space and time scales, numerical weather prediction, extrapolation methods, and existing machine learning (ML) approaches are each limited by some combination of accuracy, domain size, and temporal resolution. We present DOP+, an ML approach for clouds that forecasts GOES-East full-disk infrared brightness temperatures by extending direct observation prediction (DOP) with conditioning on meteorological fields. The domain covers tropical, midlatitude, and marine regimes across $\sim 10^8 ~ km^2$, roughly a fifth of Earth's surface. DOP+ forecasts cloud evolution at 10-minute resolution and outperforms persistence, synoptic-scale NWP, and a pure DOP baseline across 0-6 h lead times in fractions skill score and mean absolute error skill score. Convective structure is retained out to 2-3 h. DOP+ thus achieves a state-of-the-art combination of accuracy, temporal resolution, and spatial coverage. Our work lays the foundation for fully global cloud nowcasting at convective timescales.

physics.ao-ph

What the collapse of the ensemble Kalman filter tells us about particle filters

The ensemble Kalman filter (EnKF) is a reliable data assimilation tool for high-dimensional meteorological problems. On the other hand, the EnKF can be interpreted as a particle filter, and particle filters collapse in high-dimensional problems. We explain that these seemingly contradictory statements offer insights about how particle filters function in certain high-dimensional problems, and in particular support recent efforts in meteorology to "localize" particle filters, i.e., to restrict the influence of an observation to its neighborhood.

math.NA

Space Warps II. New Gravitational Lens Candidates from the CFHTLS Discovered through Citizen Science

We report the discovery of 29 promising (and 59 total) new lens candidates from the CFHT Legacy Survey (CFHTLS) based on about 11 million classifications performed by citizen scientists as part of the first Space Warps lens search. The goal of the blind lens search was to identify lens candidates missed by robots (the RingFinder on galaxy scales and ArcFinder on group/cluster scales) which had been previously used to mine the CFHTLS for lenses. We compare some properties of the samples detected by these algorithms to the Space Warps sample and find them to be broadly similar. The image separation distribution calculated from the Space Warps sample shows that previous constraints on the average density profile of lens galaxies are robust. SpaceWarps recovers about 65% of known lenses, while the new candidates show a richer variety compared to those found by the two robots. This detection rate could be increased to 80% by only using classifications performed by expert volunteers (albeit at the cost of a lower purity), indicating that the training and performance calibration of the citizen scientists is very important for the success of Space Warps. In this work we present the SIMCT pipeline, used for generating in situ a sample of realistic simulated lensed images. This training sample, along with the false positives identified during the search, has a legacy value for testing future lens finding algorithms. We make the pipeline and the training set publicly available.

astro-ph.CO

Space Warps: I. Crowd-sourcing the Discovery of Gravitational Lenses

We describe Space Warps, a novel gravitational lens discovery service that yields samples of high purity and completeness through crowd-sourced visual inspection. Carefully produced colour composite images are displayed to volunteers via a web- based classification interface, which records their estimates of the positions of candidate lensed features. Images of simulated lenses, as well as real images which lack lenses, are inserted into the image stream at random intervals; this training set is used to give the volunteers instantaneous feedback on their performance, as well as to calibrate a model of the system that provides dynamical updates to the probability that a classified image contains a lens. Low probability systems are retired from the site periodically, concentrating the sample towards a set of lens candidates. Having divided 160 square degrees of Canada-France-Hawaii Telescope Legacy Survey (CFHTLS) imaging into some 430,000 overlapping 82 by 82 arcsecond tiles and displaying them on the site, we were joined by around 37,000 volunteers who contributed 11 million image classifications over the course of 8 months. This Stage 1 search reduced the sample to 3381 images containing candidates; these were then refined in Stage 2 to yield a sample that we expect to be over 90% complete and 30% pure, based on our analysis of the volunteers performance on training images. We comment on the scalability of the SpaceWarps system to the wide field survey era, based on our projection that searches of 10$^5$ images could be performed by a crowd of 10$^5$ volunteers in 6 days.

astro-ph.IM