Featured Research

from universities, journals, and other organizations

Space weather forecast study turns table of effective predictions on its head

Date:
July 5, 2013
Source:
Royal Astronomical Society (RAS)
Summary:
A comparison of solar flare forecasting systems has turned the performance table of apparently effective prediction methods on its head. Researchers have tested the reliability of seven techniques against their record of predicting flares and non-flare events correctly, as well as their history of missed flares and false alarms. When the predictions were put into context of the Sun's activity levels over time, some of the most seemingly successful techniques slid down the table.

Zoom-in of the Sun at 9.12am on 11th January 2013 during a strong flare. The energy to power flares is stored in complex intermingled magnetic fields (top left; black pointing into the Sun and white pointing out) that cause dark sunspot "footprints" (bottom left), as seen on the Sun's visible surface by SDO/HMI. The flare is observed by SDO/AIA as the bright release of light from both the several-thousand degree lower atmosphere (bottom right) and the higher-lying multi-million degree corona (top right).
Credit: Image produced by D.S. Bloomfield (TCD). Data courtesy of NASA/SDO and the AIA, EVE, and HMI science teams.

A comparison of solar flare forecasting systems has turned the performance table of apparently effective prediction methods on its head. Researchers at Trinity College Dublin, Ireland, have tested the reliability of seven techniques against their record of predicting flares and non-flare events correctly, as well as their history of missed flares and false alarms. When the predictions were put into context of the Sun's activity levels over time, some of the most seemingly successful techniques slid down the table. Dr D. Shaun Bloomfield is presenting the findings at the RAS National Astronomy Meeting in St. Andrews, Scotland.

Related Articles


Solar flares are sudden and dramatic releases of energy from the Sun's atmosphere in the form of radiation and electrically charged particles. These eruptions are associated with many aspects of 'space weather', which can damage satellites and interfere with communications, navigations and power systems. In our technology-dependent society, accurate advanced warning of solar flare occurrence is an area of increasing concern.

"The most important aspect of any type of forecast is how it performs," said Bloomfield. "If we always say, 'flare expected today', we will have successfully predicted all flares. However, we would be crying wolf and be completely wrong on most days, as flares can occur quite far apart in time. We need be accurate in both our predictions of when flares will occur and when they won't for this to be of real value to society."

Bloomfield and his colleagues compared seven different systems for predicting solar flares: two of these used images showing the structure of sunspots; the other five used a variety of parameters relating to the magnetic field, including maximum field strength, total flux and strengths of gradients. The source data came from a range of ground based and space based solar telescopes, including SOHO.

In the past, solar flare forecasts have generally been tested over periods of time containing different amounts of flare activity. Bloomfield and his colleagues found that the previous standard system for rating flare forecasts was very sensitive to the relative activity levels between testing periods. The team suggest that the True Skill Statistic (TSS) should be adopted as the new standard rating for solar flare prediction systems. TSS is calculated from the fraction of correct flare forecasts out of all flares observed, minus the fraction of false alarms out of all non-flares observed.

"The benefit of the TSS over other ratings methods is that it is not changed by the number of flares or non-flares observed. We can make a proper comparison of forecast systems, regardless whether they have made 50 or 5000 predictions. Even so, surveys with small data sets are still prone to noise and their results must be considered less reliable," said Bloomfield.

Bloomfield and his colleagues found that according to the TSS score, adaptive systems including artificial neural networks, did not actually appear to perform much better than simple predictions based on the shape of sunspots. However, the researchers were not able to include several forecasting systems in their study as not all the data needed to calculate the TSS was available.

"If we are to move forward in developing a standard ratings system for flare predictions that produces meaningful results, we need to encourage solar forecasters to be more open about publishing their results. As well as the number of flares correctly predicted, we need to know numbers of correct non-flare predictions, false alarms and missed flares. If these differences in flare statistics are not taken into account properly, some methods can appear to perform better than others when in reality they are the same or worse," said Bloomfield.


Story Source:

The above story is based on materials provided by Royal Astronomical Society (RAS). Note: Materials may be edited for content and length.


Cite This Page:

Royal Astronomical Society (RAS). "Space weather forecast study turns table of effective predictions on its head." ScienceDaily. ScienceDaily, 5 July 2013. <www.sciencedaily.com/releases/2013/07/130705101521.htm>.
Royal Astronomical Society (RAS). (2013, July 5). Space weather forecast study turns table of effective predictions on its head. ScienceDaily. Retrieved November 20, 2014 from www.sciencedaily.com/releases/2013/07/130705101521.htm
Royal Astronomical Society (RAS). "Space weather forecast study turns table of effective predictions on its head." ScienceDaily. www.sciencedaily.com/releases/2013/07/130705101521.htm (accessed November 20, 2014).

Share This


More From ScienceDaily



More Space & Time News

Thursday, November 20, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Crowdfunded Moon Mission Offers To Store Your Digital Memory

Crowdfunded Moon Mission Offers To Store Your Digital Memory

Newsy (Nov. 19, 2014) Lunar Mission One is offering to send your digital memory (or even your DNA) to the moon to be stored for a billion years. Video provided by Newsy
Powered by NewsLook.com
Accidents Ignite Debate on US Commercial Space Travel

Accidents Ignite Debate on US Commercial Space Travel

AFP (Nov. 19, 2014) Serious accidents with two US commercial spacecraft within a week of each-other in October have re-ignited the debate over the place of private corporations in the exploration of space. Duration: 02:08 Video provided by AFP
Powered by NewsLook.com
Lunar Mission One Could Send Your Hair to The Moon

Lunar Mission One Could Send Your Hair to The Moon

Buzz60 (Nov. 19, 2014) A British-led venture called Lunar Mission One plans to send a module to the moon with keepsakes from Earth. Vanessa Freeman (@VanessaFreeTV) tells you how to get your photos and DNA onboard. Video provided by Buzz60
Powered by NewsLook.com
Why A Russian Object Is Being Called A 'Satellite Killer'

Why A Russian Object Is Being Called A 'Satellite Killer'

Newsy (Nov. 18, 2014) An unidentified Russian spacecraft is getting some attention, with some saying it could be for research while others say it could be a weapon. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins