arXiv subjects

D. Shaun Bloomfield

Publications and source records attributed to D. Shaun Bloomfield.

At least 19 recordsLinked to original sources

arXiv2025

Investigating the Efficacy of Topologically Derived Time Series for Flare Forecasting. II. XGBoost Model

Solar flares are a primary driver of space weather, and forecasting their occurrence remains a significant challenge. This paper presents a novel flare prediction model based on topologically derived photospheric magnetic parameters. We employ the \texttt{ARTop} framework to compute the time-dependent input rates of magnetic winding and helicity across more than $10^5$ active region (AR) observations, decomposing them into current-carrying and potential components to reduce sensitivity to optical flow methods. An \texttt{XGBoost} machine learning model is trained on these topological time series, alongside engineered features including rolling statistics, kurtosis, and flare history, to predict the probability of $\geq$M1.0-class flares within the next 24 hours. The model demonstrates strong performance on a validation set, with a True Skill Statistic (TSS) of 0.804 for once daily operational region forecasts. When applied to a fully independent holdout set, the operational forecast achieves a TSS of \tsssa. A SHapley Additive exPlanations (SHAP) analysis confirms the model's physical interpretability, identifying flare history and accumulated current-carrying winding and helicity as the most important features. The main challenges identified are false positives arising from ARs with frequent C-class flaring and systematic errors introduced by projection effects when ARs are near the limb. Excluding limb-affected data yields no improvement in the holdout set TSS (\TSSalert\ versus \tsssa), due to the overall decreased number of flares. However, our per-region analysis indicates that mitigating these projection effects is crucial for future operational deployment. This work establishes magnetic topology, particularly its current-carrying components, as a highly effective and physically meaningful set of predictors for solar flare forecasting.

astro-ph.SR↗

arXiv2023

The SWAP Filter: A Simple Azimuthally Varying Radial Filter for Wide-Field EUV Solar Images

We present the SWAP Filter: an azimuthally varying, radial normalizing filter specifically developed for EUV images of the solar corona, named for the Sun Watcher with Active Pixels and Image Processing (SWAP) instrument on the Project for On-Board Autonomy 2 spacecraft. We discuss the origins of our technique, its implementation and key user-configurable parameters, and highlight its effects on data via a series of examples. We discuss the filter's strengths in a data environment in which wide field-of-view observations that specifically target the low signal-to-noise middle corona are newly available and expected to grow in the coming years.

astro-ph.SR↗

arXiv2020

Ensemble Forecasting of Major Solar Flares: Methods for Combining Models

One essential component of operational space weather forecasting is the prediction of solar flares. With a multitude of flare forecasting methods now available online it is still unclear which of these methods performs best, and none are substantially better than climatological forecasts. Space weather researchers are increasingly looking towards methods used by the terrestrial weather community to improve current forecasting techniques. Ensemble forecasting has been used in numerical weather prediction for many years as a way to combine different predictions in order to obtain a more accurate result. Here we construct ensemble forecasts for major solar flares by linearly combining the full-disk probabilistic forecasts from a group of operational forecasting methods (ASAP, ASSA, MAG4, MOSWOC, NOAA, and MCSTAT). Forecasts from each method are weighted by a factor that accounts for the method's ability to predict previous events, and several performance metrics (both probabilistic and categorical) are considered. It is found that most ensembles achieve a better skill metric (between 5\% and 15\%) than any of the members alone. Moreover, over 90\% of ensembles perform better (as measured by forecast attributes) than a simple equal-weights average. Finally, ensemble uncertainties are highly dependent on the internal metric being optimized and they are estimated to be less than 20\% for probabilities greater than 0.2. This simple multi-model, linear ensemble technique can provide operational space weather centres with the basis for constructing a versatile ensemble forecasting system -- an improved starting point to their forecasts that can be tailored to different end-user needs.

physics.space-ph↗

arXiv2020

A Comparison of Flare Forecasting Methods. IV. Evaluating Consecutive-Day Forecasting Patterns

A crucial challenge to successful flare prediction is forecasting periods that transition between "flare-quiet" and "flare-active". Building on earlier studies in this series (Barnes et al. 2016; Leka et al. 2019a,b) in which we describe methodology, details, and results of flare forecasting comparison efforts, we focus here on patterns of forecast outcomes (success and failure) over multi-day periods. A novel analysis is developed to evaluate forecasting success in the context of catching the first event of flare-active periods, and conversely, of correctly predicting declining flare activity. We demonstrate these evaluation methods graphically and quantitatively as they provide both quick comparative evaluations and options for detailed analysis. For the testing interval 2016-2017, we determine the relative frequency distribution of two-day dichotomous forecast outcomes for three different event histories (i.e., event/event, no-event/event and event/no-event), and use it to highlight performance differences between forecasting methods. A trend is identified across all forecasting methods that a high/low forecast probability on day-1 remains high/low on day-2 even though flaring activity is transitioning. For M-class and larger flares, we find that explicitly including persistence or prior flare history in computing forecasts helps to improve overall forecast performance. It is also found that using magnetic/modern data leads to improvement in catching the first-event/first-no-event transitions. Finally, 15% of major (i.e., M-class or above) flare days over the testing interval were effectively missed due to a lack of observations from instruments away from the Earth-Sun line.

astro-ph.SR↗

arXiv2019

Which Photospheric Characteristics are Most Relevant to Active-Region Coronal Mass Ejections?

We investigate the relation between characteristics of coronal mass ejections and parameterizations of the eruptive capability of solar active regions widely used in solar flare prediction schemes. These parameters, some of which are explored for the first time, are properties related to topological features, namely, magnetic polarity inversion lines (MPILs) that indicate large amounts of stored non-potential (i.e. free) magnetic energy. We utilize the Space Weather Database of Notifications, Knowledge, Information (DONKI) and the Large Angle and Spectrometric Coronograph (LASCO) databases to find flare-associated coronal mass ejections and their kinematic characteristics while properties of MPILs are extracted from Helioseismic and Magnetic Imager (HMI) vector magnetic-field observations of active regions to extract the properties of source-region MPILs. The correlation between all properties and the characteristics of CMEs ranges from moderate to very strong. More significant correlations hold particularly for fast CMEs, which are most important in terms of adverse space-weather manifestations. Non-neutralized currents and the length of the main MPIL exhibit significantly stronger correlations than the rest of the properties. This finding supports a causal relationship between coronal mass ejections and non-neutralized electric currents in highly sheared, conspicuous MPILs. In addition, non-neutralized currents and MPIL length carry distinct, independent information as to the eruptive potential of active regions. The combined total amount of non-neutralized electric currents and the length of the main polarity inversion line, therefore, reflect more efficiently than other parameters the eruptive capacity of solar active regions and the CME kinematic characteristics stemming from these regions.

astro-ph.SR↗

arXiv2019

A Comparison of Flare Forecasting Methods. III. Systematic Behaviors of Operational Solar Flare Forecasting Systems

A workshop was recently held at Nagoya University (31 October - 02 November 2017), sponsored by the Center for International Collaborative Research, at the Institute for Space-Earth Environmental Research, Nagoya University, Japan, to quantitatively compare the performance of today's operational solar flare forecasting facilities. Building upon Paper I of this series (Barnes et al. 2016), in Paper II (Leka et al. 2019) we described the participating methods for this latest comparison effort, the evaluation methodology, and presented quantitative comparisons. In this paper we focus on the behavior and performance of the methods when evaluated in the context of broad implementation differences. Acknowledging the short testing interval available and the small number of methods available, we do find that forecast performance: 1) appears to improve by including persistence or prior flare activity, region evolution, and a human "forecaster in the loop"; 2) is hurt by restricting data to disk-center observations; 3) may benefit from long-term statistics, but mostly when then combined with modern data sources and statistical approaches. These trends are arguably weak and must be viewed with numerous caveats, as discussed both here and in Paper II. Following this present work, we present in Paper IV a novel analysis method to evaluate temporal patterns of forecasting errors of both types (i.e., misses and false alarms; Park et al. 2019). Hence, most importantly, with this series of papers we demonstrate the techniques for facilitating comparisons in the interest of establishing performance-positive methodologies.

astro-ph.SR↗

arXiv2019

A Comparison of Flare Forecasting Methods. II. Benchmarks, Metrics and Performance Results for Operational Solar Flare Forecasting Systems

Solar flares are extremely energetic phenomena in our Solar System. Their impulsive, often drastic radiative increases, in particular at short wavelengths, bring immediate impacts that motivate solar physics and space weather research to understand solar flares to the point of being able to forecast them. As data and algorithms improve dramatically, questions must be asked concerning how well the forecasting performs; crucially, we must ask how to rigorously measure performance in order to critically gauge any improvements. Building upon earlier-developed methodology (Barnes et al, 2016, Paper I), international representatives of regional warning centers and research facilities assembled in 2017 at the Institute for Space-Earth Environmental Research, Nagoya University, Japan to - for the first time - directly compare the performance of operational solar flare forecasting methods. Multiple quantitative evaluation metrics are employed, with focus and discussion on evaluation methodologies given the restrictions of operational forecasting. Numerous methods performed consistently above the "no skill" level, although which method scored top marks is decisively a function of flare event definition and the metric used; there was no single winner. Following in this paper series we ask why the performances differ by examining implementation details (Leka et al. 2019, Paper III), and then we present a novel analysis method to evaluate temporal patterns of forecasting errors in (Park et al. 2019, Paper IV). With these works, this team presents a well-defined and robust methodology for evaluating solar flare forecasting methods in both research and operational frameworks, and today's performance benchmarks against which improvements and new methods may be compared.

astro-ph.SR↗

arXiv2018

Solar flare forecasting from magnetic feature properties generated by Solar Monitor Active Region Tracker

We study the predictive capabilities of magnetic feature properties (MF) generated by Solar Monitor Active Region Tracker (SMART) for solar flare forecasting from two datasets: the full dataset of SMART detections from 1996 to 2010 that has been previously studied by Ahmed et al. (2011) and a subset of that dataset which only includes detections that are NOAA active regions (ARs). Main contributions: we use marginal relevance as a filter feature selection method to identify most useful SMART MF properties for separating flaring from non-flaring detections and logistic regression to derive classification rules to predict future observations. For comparison, we employ a Random Forest, Support Vector Machine and a set of Deep Neural Network models, as well as Lasso for feature selection. Using the linear model with three features we obtain significantly better results (TSS=0.84) to those reported by Ahmed et al.(2011) for the full dataset of SMART detections. The same model produced competitive results (TSS=0.67) for the dataset of SMART detections that are NOAA ARs which can be compared to a broader section of flare forecasting literature. We show that more complex models are not required for this data.

astro-ph.SR↗

arXiv2018

Photospheric Shear Flows in Solar Active Regions and Their Relation to Flare Occurrence

Solar active regions (ARs) that produce major flares typically exhibit strong plasma shear flows around photospheric magnetic polarity inversion lines (MPILs). It is therefore important to quantitatively measure such photospheric shear flows in ARs for a better understanding of their relation to flare occurrence. Photospheric flow fields were determined by applying the Differential Affine Velocity Estimator for Vector Magnetograms (DAVE4VM) method to a large data set of 2,548 co-aligned pairs of AR vector magnetograms with 12-min separation over the period 2012-2016. From each AR flow-field map, three shear-flow parameters were derived corresponding to the mean ( ), maximum (S_max) and integral (S_sum) shear-flow speeds along strong-gradient, strong-field MPIL segments. We calculated flaring rates within 24 hr as a function of each shear-flow parameter, and also investigated the relation between the parameters and the waiting time (τ) until the next major flare (class M1.0 or above) after the parameter observation. In general, it is found that the larger S_sum an AR has, the more likely it is for the AR to produce flares within 24 hr. It is also found that among ARs which produce major flares, if one has a larger value of S_sum then τ generally gets shorter. These results suggest that large ARs with widespread and/or strong shear flows along MPILs tend to not only be more flare productive, but also produce major flares within 24 hr or less.

astro-ph.SR↗

arXiv2018

Flare Forecasting Using the Evolution of McIntosh Sunspot Classifications

Most solar flares originate in sunspot groups, where magnetic field changes lead to energy build-up and release. However, few flare-forecasting methods use information of sunspot-group evolution, instead focusing on static point-in-time observations. Here, a new forecast method is presented based upon the 24-hr evolution in McIntosh classification of sunspot groups. Evolution-dependent $\geqslant$C1.0 and $\geqslant$M1.0 flaring rates are found from NOAA-numbered sunspot groups over December 1988 to June 1996 (Solar Cycle 22; SC22) before converting to probabilities assuming Poisson statistics. These flaring probabilities are used to generate operational forecasts for sunspot groups over July 1996 to December 2008 (SC23), with performance studied by verification metrics. Major findings are: i) considering Brier skill score (BSS) for $\geqslant$C1.0 flares, the evolution-dependent McIntosh-Poisson method ($\text{BSS}_{\text{evolution}}=0.09$) performs better than the static McIntosh-Poisson method ($\text{BSS}_{\text{static}} = -0.09$); ii) low BSS values arise partly from both methods over-forecasting SC23 flares from the SC22 rates, symptomatic of $\geqslant$C1.0 rates in SC23 being on average $\approx$80% of those in SC22 (with $\geqslant$M1.0 being $\approx$50%); iii) applying a bias-correction factor to reduce the SC22 rates used in forecasting SC23 flares yields modest improvement in skill relative to climatology for both methods ($\mathrm{BSS}^{\mathrm{corr}}_{\mathrm{static}} = 0.09$ and $\mathrm{BSS}^{\mathrm{corr}}_{\mathrm{evolution}} = 0.20$) and improved forecast reliability diagrams.

astro-ph.SR↗

arXiv2018

Forecasting Solar Flares Using Magnetogram-based Predictors and Machine Learning

We propose a forecasting approach for solar flares based on data from Solar Cycle 24, taken by the Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamics Observatory (SDO) mission. In particular, we use the Space-weather HMI Active Region Patches (SHARP) product that facilitates cut-out magnetograms of solar active regions (AR) in the Sun in near-real-time (NRT), taken over a five-year interval (2012 - 2016). Our approach utilizes a set of thirteen predictors, which are not included in the SHARP metadata, extracted from line-of-sight and vector photospheric magnetograms. We exploit several Machine Learning (ML) and Conventional Statistics techniques to predict flares of peak magnitude >M1 and >C1, within a 24 h forecast window. The ML methods used are multi-layer perceptrons (MLP), support vector machines (SVM) and random forests (RF). We conclude that random forests could be the prediction technique of choice for our sample, with the second best method being multi-layer perceptrons, subject to an entropy objective function. A Monte Carlo simulation showed that the best performing method gives accuracy ACC=0.93(0.00), true skill statistic TSS=0.74(0.02) and Heidke skill score HSS=0.49(0.01) for >M1 flare prediction with probability threshold 15% and ACC=0.84(0.00), TSS=0.60(0.01) and HSS=0.59(0.01) for >C1 flare prediction with probability threshold 35%.

astro-ph.SR↗

arXiv2017

Active Region Photospheric Magnetic Properties Derived from Line-of-sight and Radial Fields

The effect of using two representations of the normal-to-surface magnetic field to calculate photospheric measures that are related to active region (AR) potential for flaring is presented. Several AR properties were computed using line-of-sight ($B_{\rm los}$) and spherical-radial ($B_{r}$) magnetograms from the Space-weather HMI Active Region Patch (SHARP) products of the \emph{Solar Dynamics Observatory}, characterizing the presence and features of magnetic polarity inversion lines, fractality, and magnetic connectivity of the AR photospheric field. The data analyzed corresponds to $\approx$ 4,000 AR observations, achieved by randomly selecting 25 % of days between September 2012 and May 2016 for analysis at 6-hr cadence. Results from this statistical study include: i) the $B_{r}$ component results in a slight upwards shift of property values in a manner consistent with a field-strength underestimation by the $B_{\rm los}$ component; ii) using the $B_{r}$ component results in significantly lower inter-property correlation in one-third of the cases, implying more independent information about the state of the AR photospheric magnetic field; iii) flaring rates for each property vary between the field components in a manner consistent with the differences in property-value ranges resulting from the components; iv) flaring rates generally increase for higher values of properties, except Fourier spectral power index that has flare rates peaking around a value of $5/3$. These findings indicate that there may be advantages in using $B_{r}$ rather than $B_{\rm los}$ in calculating flare-related AR magnetic properties, especially for regions located far from central meridian.

astro-ph.SR↗

arXiv2016

Understanding the Physical Nature of Coronal "EIT Waves"

For almost 20 years the physical nature of globally propagating waves in the solar corona (commonly called "EIT waves") has been controversial and subject to debate. Additional theories have been proposed over the years to explain observations that did not fit with the originally proposed fast-mode wave interpretation. However, the incompatibility of observations made using the Extreme-ultraviolet Imaging Telescope (EIT) onboard the Solar and Heliospheric Observatory with the fast-mode wave interpretation was challenged by differing viewpoints from the twin Solar Terrestrial Relations Observatory spacecraft and higher spatial/temporal resolution data from the Solar Dynamics Observatory. In this article, we reexamine the theories proposed to explain "EIT waves" to identify measurable properties and behaviours that can be compared to current and future observations. Most of us conclude that "EIT waves" are best described as fast-mode large-amplitude waves/shocks that are initially driven by the impulsive expansion of an erupting coronal mass ejection in the low corona.

astro-ph.SR↗

arXiv2016

Flaring Rates and the Evolution of Sunspot Group McIntosh Classifications

Sunspot groups are the main source of solar flares, with the energy to power them being supplied by magnetic-field evolution (e.g. flux emergence or twisting/shearing). To date, few studies have investigated the statistical relation between sunspot-group evolution and flaring, with none considering evolution in the McIntosh classification scheme. Here we present a statistical analysis of sunspot groups from Solar Cycle 22, focusing on 24-hour changes in the three McIntosh classification components. Evolution-dependent >C1.0, >M1.0, and >X1.0 flaring rates are calculated, leading to the following results: (i) flaring rates become increasingly higher for greater degrees of upward evolution through the McIntosh classes, with the opposite found for downward evolution; (ii) the highest flaring rates are found for upward evolution from larger, more complex, classes (e.g. Zurich D- and E-classes evolving upward to F-class produce >C1.0 rates of 2.66 +/- 0.28 and 2.31 +/- 0.09 flares per 24 hours, respectively); (iii) increasingly complex classes give higher rates for all flare magnitudes, even when sunspot groups do not evolve over 24 hours. These results support the hypothesis that injection of magnetic energy by flux emergence (i.e. increasing in Zurich or compactness classes) leads to a higher frequency and magnitude of flaring.

astro-ph.SR↗

arXiv2015

Performance of Major Flare Watches from the Max Millennium Program (2001-2010)

The physical processes that trigger solar flares are not well understood and significant debate remains around processes governing particle acceleration, energy partition, and particle and energy transport. Observations at high resolution in energy, time, and space are required in multiple energy ranges over the whole course of many flares in order to build an understanding of these processes. Obtaining high-quality, co-temporal data from ground- and space- based instruments is crucial to achieving this goal and was the primary motivation for starting the Max Millennium program and Major Flare Watch (MFW) alerts, aimed at coordinating observations of all flares >X1 GOES X-ray classification (including those partially occulted by the limb). We present a review of the performance of MFWs from 1 February 2001 to 31 May 2010, inclusive, that finds: (1) 220 MFWs were issued in 3,407 days considered (6.5% duty cycle), with these occurring in 32 uninterrupted periods that typically last 2-8 days; (2) 56% of flares >X1 were caught, occurring in 19% of MFW days; (3) MFW periods ended at suitable times, but substantial gain could have been achieved in percentage of flares caught if periods had started 24 h earlier; (4) MFWs successfully forecast X-class flares with a true skill statistic (TSS) verification metric score of 0.500, that is comparable to a categorical flare/no-flare interpretation of the NOAA Space Weather Prediction Centre probabilistic forecasts (TSS = 0.488).

astro-ph.SR↗

arXiv2015

Automatic Detection of Magnetic delta in Sunspot Groups

Large and magnetically complex sunspot groups are known to be associated with flares. To date, the Mount Wilson scheme has been used to classify sunspot groups based on their morphological and magnetic properties. The most flare prolific class, the delta sunspot-group, is characterised by opposite polarity umbrae within a common penumbra, separated by less than 2 degrees. In this article, we present a new system, called the Solar Monitor Active Region Tracker - Delta Finder (SMART-DF), that can be used to automatically detect and classify magnetic deltas in near-realtime. Using continuum images and magnetograms from the Helioseismic and Magnetic Imager (HMI) onboard NASA's Solar Dynamics Observatory (SDO), we first estimate distances between opposite polarity umbrae. Opposite polarity pairs having distances of less that 2 degrees are then identified, and if these pairs are found to share a common penumbra, they are identified as a magnetic delta configuration. The algorithm was compared to manual delta detections reported by the Space Weather Prediction Center (SWPC), operated by the National Oceanic and Atmospheric Administration (NOAA). SMART-DF detected 21 out of 23 active regions (ARs) that were marked as delta spots by NOAA during 2011 - 2012 (within +/- 60 degrees longitude). SMART-DF in addition detected five ARs which were not announced as delta spots by NOAA. The near-relatime operation of SMART-DF resulted in many deltas being identified in advance of NOAA's daily notification. SMART-DF will be integrated with SolarMonitor (www.solarmonitor.org) and the near-realtime information will be available to the public.

astro-ph.SR↗

arXiv2014

Quasiperiodic acceleration of electrons by a plasmoid-driven shock in the solar atmosphere

Cosmic rays and solar energetic particles may be accelerated to relativistic energies by shock waves in astrophysical plasmas. On the Sun, shocks and particle acceleration are often associated with the eruption of magnetized plasmoids, called coronal mass ejections (CMEs). However, the physical relationship between CMEs and shock particle acceleration is not well understood. Here, we use extreme ultraviolet, radio and white-light imaging of a solar eruptive event on 22 September 2011 to show that a CME-induced shock (Alfvén Mach number 2.4$^{+0.7}_{-0.8}$) was coincident with a coronal wave and an intense metric radio burst generated by intermittent acceleration of electrons to kinetic energies of 2-46 keV (0.1-0.4 c). Our observations show that plasmoid-driven quasi-perpendicular shocks are capable of producing quasi-periodic acceleration of electrons, an effect consistent with a turbulent or rippled plasma shock surface.

astro-ph.SR↗

arXiv2014

CorPITA: An Automated Algorithm for the Identification and Analysis of Coronal "EIT Waves"

The continuous stream of data available from the Atmospheric Imaging Assembly (AIA) telescopes onboard the Solar Dynamics Observatory (SDO) spacecraft has allowed a deeper understanding of the Sun. However, the sheer volume of data has necessitated the development of automated techniques to identify and analyse various phenomena. In this article, we describe the Coronal Pulse Identification and Tracking Algorithm (CorPITA) for the identification and analysis of coronal "EIT waves". CorPITA uses an intensity-profile technique to identify the propagating pulse, tracking it throughout its evolution before returning estimates of its kinematics. The algorithm is applied here to a data-set from February 2011, allowing its capabilities to be examined and critiqued. This algorithm forms part of the SDO Feature Finding Team initiative and will be implemented as part of the Heliophysics Event Knowledgebase (HEK). This is the first fully automated algorithm to identify and track the propagating "EIT wave" rather than any associated phenomena and will allow a deeper understanding of this controversial phenomenon.

astro-ph.SR↗