Featured Research

from universities, journals, and other organizations

Space weather forecast study turns table of effective predictions on its head

Date:
July 5, 2013
Source:
Royal Astronomical Society (RAS)
Summary:
A comparison of solar flare forecasting systems has turned the performance table of apparently effective prediction methods on its head. Researchers have tested the reliability of seven techniques against their record of predicting flares and non-flare events correctly, as well as their history of missed flares and false alarms. When the predictions were put into context of the Sun's activity levels over time, some of the most seemingly successful techniques slid down the table.

Zoom-in of the Sun at 9.12am on 11th January 2013 during a strong flare. The energy to power flares is stored in complex intermingled magnetic fields (top left; black pointing into the Sun and white pointing out) that cause dark sunspot "footprints" (bottom left), as seen on the Sun's visible surface by SDO/HMI. The flare is observed by SDO/AIA as the bright release of light from both the several-thousand degree lower atmosphere (bottom right) and the higher-lying multi-million degree corona (top right).
Credit: Image produced by D.S. Bloomfield (TCD). Data courtesy of NASA/SDO and the AIA, EVE, and HMI science teams.

A comparison of solar flare forecasting systems has turned the performance table of apparently effective prediction methods on its head. Researchers at Trinity College Dublin, Ireland, have tested the reliability of seven techniques against their record of predicting flares and non-flare events correctly, as well as their history of missed flares and false alarms. When the predictions were put into context of the Sun's activity levels over time, some of the most seemingly successful techniques slid down the table. Dr D. Shaun Bloomfield is presenting the findings at the RAS National Astronomy Meeting in St. Andrews, Scotland.

Solar flares are sudden and dramatic releases of energy from the Sun's atmosphere in the form of radiation and electrically charged particles. These eruptions are associated with many aspects of 'space weather', which can damage satellites and interfere with communications, navigations and power systems. In our technology-dependent society, accurate advanced warning of solar flare occurrence is an area of increasing concern.

"The most important aspect of any type of forecast is how it performs," said Bloomfield. "If we always say, 'flare expected today', we will have successfully predicted all flares. However, we would be crying wolf and be completely wrong on most days, as flares can occur quite far apart in time. We need be accurate in both our predictions of when flares will occur and when they won't for this to be of real value to society."

Bloomfield and his colleagues compared seven different systems for predicting solar flares: two of these used images showing the structure of sunspots; the other five used a variety of parameters relating to the magnetic field, including maximum field strength, total flux and strengths of gradients. The source data came from a range of ground based and space based solar telescopes, including SOHO.

In the past, solar flare forecasts have generally been tested over periods of time containing different amounts of flare activity. Bloomfield and his colleagues found that the previous standard system for rating flare forecasts was very sensitive to the relative activity levels between testing periods. The team suggest that the True Skill Statistic (TSS) should be adopted as the new standard rating for solar flare prediction systems. TSS is calculated from the fraction of correct flare forecasts out of all flares observed, minus the fraction of false alarms out of all non-flares observed.

"The benefit of the TSS over other ratings methods is that it is not changed by the number of flares or non-flares observed. We can make a proper comparison of forecast systems, regardless whether they have made 50 or 5000 predictions. Even so, surveys with small data sets are still prone to noise and their results must be considered less reliable," said Bloomfield.

Bloomfield and his colleagues found that according to the TSS score, adaptive systems including artificial neural networks, did not actually appear to perform much better than simple predictions based on the shape of sunspots. However, the researchers were not able to include several forecasting systems in their study as not all the data needed to calculate the TSS was available.

"If we are to move forward in developing a standard ratings system for flare predictions that produces meaningful results, we need to encourage solar forecasters to be more open about publishing their results. As well as the number of flares correctly predicted, we need to know numbers of correct non-flare predictions, false alarms and missed flares. If these differences in flare statistics are not taken into account properly, some methods can appear to perform better than others when in reality they are the same or worse," said Bloomfield.


Story Source:

The above story is based on materials provided by Royal Astronomical Society (RAS). Note: Materials may be edited for content and length.


Cite This Page:

Royal Astronomical Society (RAS). "Space weather forecast study turns table of effective predictions on its head." ScienceDaily. ScienceDaily, 5 July 2013. <www.sciencedaily.com/releases/2013/07/130705101521.htm>.
Royal Astronomical Society (RAS). (2013, July 5). Space weather forecast study turns table of effective predictions on its head. ScienceDaily. Retrieved August 28, 2014 from www.sciencedaily.com/releases/2013/07/130705101521.htm
Royal Astronomical Society (RAS). "Space weather forecast study turns table of effective predictions on its head." ScienceDaily. www.sciencedaily.com/releases/2013/07/130705101521.htm (accessed August 28, 2014).

Share This




More Space & Time News

Thursday, August 28, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Experiment Tests Whether Universe Is Actually A Hologram

Experiment Tests Whether Universe Is Actually A Hologram

Newsy (Aug. 27, 2014) Researchers at Fermilab are using a device called "The Holometer" to test whether our universe is actually a 2-D hologram that just seems 3-D. Video provided by Newsy
Powered by NewsLook.com
SpaceX’s Falcon 9 Rocket Explodes After Liftoff

SpaceX’s Falcon 9 Rocket Explodes After Liftoff

Newsy (Aug. 23, 2014) The private spaceflight company says it is preparing a thorough investigation into Friday's mishap. Video provided by Newsy
Powered by NewsLook.com
Did Russia Really Find Plankton On The ISS? NASA Not So Sure

Did Russia Really Find Plankton On The ISS? NASA Not So Sure

Newsy (Aug. 21, 2014) Russian cosmonauts say they've found evidence of sea plankton on the International Space Station's windows. NASA is a little more skeptical. Video provided by Newsy
Powered by NewsLook.com
Space to Ground: Hello Georges

Space to Ground: Hello Georges

NASA (Aug. 18, 2014) Europe's ATV-5 delivers new science and the crew tests smart SPHERES. Questions or comments? Use #spacetoground to talk to us. Video provided by NASA
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins