wiki.openmod-initiative.org - User contributions [en]

Electricity demand

2021-01-31T15:42:24Z

Sebastian Gonzato: /* ENTSO-E hourly load time series for European countries */

= Asia =

== Japan ==

The Japanese Ministry of Economy Trade and Industry (METI) has provided hourly data for a full year (April 2010-March 2011) for the entire country separated in [https://en.wikipedia.org/wiki/Electricity_sector_in_Japan#/media/File:Power_Grid_of_Japan.svg 10 regions]. Data per region are available in separate <s>[http://www.meti.go.jp/setsuden/performance.html pdf files]</s>. The website is in Japanese, it is, therefore, advisable to use a translate function (e.g. in Chrome).

== Singapore ==

Singapore's Energy Market Authority has provided an [https://www.ema.gov.sg/statistic.aspx?sta_sid=20140826Y84sgBebjwKV online database] with half-hourly demand, downloadable per month from the year 2004 onwards. Data is available in csv format or as pdf.

= Europe =

== ENTSO-E hourly load time series for European countries ==

The European Network of Transmission System Operators for Electricity, [https://www.entsoe.eu/ ENTSOE-E], hold [https://www.entsoe.eu/data/data-portal/consumption/Pages/default.aspx hourly demand data for each EU country]. Their terms and conditions do not allow redistribution. It may be worth our while putting in a single, co-ordinated request to cover access to and redistribution of the archive.

Additionally, the Ten Year Network Development Plans contain ~ 30 years of [https://www.entsos-tyndp2020-scenarios.eu/download-data/ demand] and [https://www.entsoe.eu/outlooks/seasonal/ RES availability factors]. There may be some data missing, in which case an email will get you a long way. 

== Open Power System Data hourly load time series for European countries ==

[http://open-power-system-data.org/ Open Power System Data] (OPSD) is a platform for European power system data such as power plants and load, wind and solar time series.

OPSD will provide coherent versions of the ENTSO-E time series, with errors and time zones consistent across the dataset. 

== Elexon time series for Great Britain ==

[https://www.elexonportal.co.uk/ Elexon] manages the data for the GB network, and this is available half-hourly. Registration is free. They've been very helpful with our network of UK universities in facilitating access to data, to date. Again, a co-ordinated approach will be best. There are also [http://www2.nationalgrid.com/UK/Industry-information/Electricity-transmission-operational-data/Data-Explorer/ several different variations of total demand available from the GB National Grid], also all half-hourly 

== JASM load profiles for Switzerland ==

The Joint Activity on Scenario Modeling (JASM) in Switzerland has published [https://data.sccer-jasm.ch/ typical load profiles] for a variety of different loads along with other input data of their modeling activities.

 

== RTE time series for France ==

The [https://opendata.reseaux-energies.fr/explore/dataset/consommation-quotidienne-brute-elec/information/?disjunctive.qualite Open Data Reseaux-Energies] has time series for continental France for demand from 2008-2018 (2019 is available but not validated), including subdivision in different zones. Additional information (with some gaps) on production from a variety of sources per region is available.  Webpage is in French, but very reasonable to browse through. 

 

== Russia ==

Historical hourly load (updated every hour) for Russia's unified electricity transmission grid system is provided by Russia's [http://www.so-cdu.ru/index.php?id=972&tx_ms1cdu_pi1 Federal Grid Company]. Data can be downloaded in csv or xml format limited to 24 hours (full day) per download. Profiles are available for the unified grid as a whole or per subregion. The website is in Russian, it is therefore advisable to use a translate function (e.g. in Chrome).

= Africa =

== Morocco ==

[http://www.one.ma/ http://www.one.ma/]

= North America =

== Canada ==

Historical hourly load data for the [http://www.ieso.ca/localContent/zonal.map/index.html Ontario area] in Canada, operated by the Indepedent Electricity System Operator (IESO), can be downloaded in CSV format from IESO's [http://www.ieso.ca/en/power-data/data-directory website].

Hourly load data, 2016 only, for the [https://www.google.ie/maps/place/Alberta,+Canada/@54.1652415,-123.9587151,5z/data=!3m1!4b1!4m5!3m4!1s0x5309b282a82419b5:0xb0a9479a409b8e9e!8m2!3d53.9332706!4d-116.5765035 Alberta Interconnected Electric System (AIES)] can be retrieved from the website of [https://www.aeso.ca/market/market-and-system-reporting/data-requests/2016-hourly-load-data/ Alberta Electric System Operator (AESO).]

== United States ==

Hourly load profiles starting July 2015 are updated regularly (from weekly to almost real-time depending on reporting entity) are available from the EIA, [https://www.eia.gov/realtime_grid/ real-time map], [https://www.eia.gov/opendata/qb.php?category=2122628 hourly data]. Data can be downloaded for the entire US, or seperately per region, or balancing authority. A cleaned open access version of the EIA data spanning 4 years from July 2015 - July 2019 is available [https://zenodo.org/record/3690240 here] with a paper describing the cleaning process of removing outlier values and filling in reasonable replacement values for them as well as originally missing values [https://www.nature.com/articles/s41597-020-0483-x here].

Hourly load per balancing authority and/or planning area for years before 2006-2018 can be accessed through the website of the [https://www.ferc.gov/docs-filing/forms/form-714/data.asp Federal Energy Regulatory Commission (FERC).]

= Oceania =

== Australia ==

The [https://www.aemo.com.au/Electricity/National-Electricity-Market-NEM/Data-dashboard#aggregated-data data dashboard] of the Australian Energy Market Operator (AEMO) includes half-hourly load data per month, per subregion, of the Australian National Electricity Market (NEM) downloadable for the period 1998-2017. The NEM consists of the regions Queensland, New South Wales, Victoria, South Australia and Tasmania. In 2013 the NEM covered approximately 90% of Australia's grid connected electricity demand ([https://arena.gov.au/assets/2017/02/CSIRO-Electricity-market-analysis-for-IGEG.pdf p.13]). 

== New Zealand ==

The [https://www.emi.ea.govt.nz/Wholesale/Reports/W_GD_C?DateFrom=20100101&DateTo=20161231&_si=_dr_DateFrom|20150101,_dr_DateTo|20151231,_dr_RegionType|NZ,v|4 electricity market information (EMI) website] of New Zealand's Electricity Authority includes a database with half-hourly load data downloadable in CSV format for any customizable period from 2004 onwards. Data can be aggegrated for New Zealand as a whole, per subregion (5 in total) or per node.

= South America =

== Chile ==

The Coordinador Electrico Nacional, an independent corporation of the Chilean state, provides a wide variety of datasets regarding the power sector on their [https://sic.coordinadorelectrico.cl/informes-y-documentos/fichas/operacion-real/ website]. This includes hourly load data downloadable in aggegrated zip files per year. The zip file consists of seperate excel files per day of the year. All data and supporting information is in Spanish.

Weather data

2021-01-31T15:41:24Z

Sebastian Gonzato: /* Overview */

= Overview =

Weather data can be used to generate profiles for wind, solar and hydro power plants. Re-analysis or “hindcast” projects use state-of the art weather forecast models with long time series of weather observations. They create consistent series of weather data, often of decades and with a global scope. [http://reanalyses.org/ Reanalysis.org] and [https://climatedataguide.ucar.edu/climate-data NCAR] provide a helpful overview of re-analysis models. Data are usually provided in GRIB or NetCDF format and can be very large in size (100s of GB). 

*OPSD compiled a [http://open-power-system-data.org/data-sources#9_Weather_data list of weather data sources] and provides [http://data.open-power-system-data.org/weather_data a script] to download  customized subsets of the MERRA-2 dataset
*[https://renewables.ninja Renewables.ninja] allows users to download weather data (wind speed, solar irradiance, temperature) for specific locations based on MERRA-2 and satellite imaging data.
*The Hans-Ertel-Centre for Weather Research has published two preliminary reanalysis data sets ([http://reanalysis.meteo.uni-bonn.de/?COSMO-REA6 COSMO-REA6] and [http://reanalysis.meteo.uni-bonn.de/?COSMO-REA2 COSMO-REA2]) containing the most often requested variables that may be used without any restrictions
*[http://www.cosmo-model.org/ COSMO (Consortium for Small-scale Modelling)], simulation model for weather in Europe, used for the official weather forecasts. The model is free to use for research applications 
*~30 years worth of [https://www.entsoe.eu/outlooks/seasonal/ RES availability factors from ENTSO-E] (click on PECD data). 

You may have a chance to get data directly from national weather services or participating universities/institutions and thus avoid having to run it yourself. For Germany, the current resolution is 2.8 km. 

*The [https://cdc.dwd.de/portal/ Climate Data Center (CDC)] of the German Weather Service (DWD) has puslished [ftp://ftp-cdc.dwd.de/pub/CDC/ a dataset] of 
**observed parameters from DWD stations,
**derived parameters at the station locations,
**gridded fields covering Germany,
**regional averages for Germany and its federal states,
**gridded fields covering Europe,
**global climate station data
**available at hourly, daily, monthly, annual or multi-annual resolution.
**The data is useable without restrictions provided the source "Deutscher Wetterdienst" is mentioned. 

*[http://rda.ucar.edu/datasets/ds094.1/ National Centers for Environmental Prediction (NCEP) Climate Forecast System (CFS)], worldwide hourly reanalysis weather data, currently 0.2 deg spatial resolution. You need an account to get access to the downloads, but as the data is from a public US institution, it is free.

= Projects to turn weather data into renewable power availability time series =

Various projects exist that transform weather data into power availability time series for different solar/wind power plant model types:

*[http://arxiv.org/abs/1409.3353 Aarhus University RE Atlas]
*[https://github.com/FRESNA/atlite atlite]
*[https://github.com/oemof/feedinlib oemof feedinlib]
*[https://renewables.ninja/ renewables.ninja]

Weather data

2021-01-31T15:40:49Z

Sebastian Gonzato: /* Overview */

= Overview =

Weather data can be used to generate profiles for wind, solar and hydro power plants. Re-analysis or “hindcast” projects use state-of the art weather forecast models with long time series of weather observations. They create consistent series of weather data, often of decades and with a global scope. [http://reanalyses.org/ Reanalysis.org] and [https://climatedataguide.ucar.edu/climate-data NCAR] provide a helpful overview of re-analysis models. Data are usually provided in GRIB or NetCDF format and can be very large in size (100s of GB). 

*OPSD compiled a [http://open-power-system-data.org/data-sources#9_Weather_data list of weather data sources] and provides [http://data.open-power-system-data.org/weather_data a script] to download  customized subsets of the MERRA-2 dataset
*[https://renewables.ninja Renewables.ninja] allows users to download weather data (wind speed, solar irradiance, temperature) for specific locations based on MERRA-2 and satellite imaging data.
*The Hans-Ertel-Centre for Weather Research has published two preliminary reanalysis data sets ([http://reanalysis.meteo.uni-bonn.de/?COSMO-REA6 COSMO-REA6] and [http://reanalysis.meteo.uni-bonn.de/?COSMO-REA2 COSMO-REA2]) containing the most often requested variables that may be used without any restrictions
*[http://www.cosmo-model.org/ COSMO (Consortium for Small-scale Modelling)], simulation model for weather in Europe, used for the official weather forecasts. The model is free to use for research applications 
*~30 years worth of [[:File:https://www.entsoe.eu/outlooks/seasonal/|RES availability factors from ENTSO-E]](click on PECD data). 

You may have a chance to get data directly from national weather services or participating universities/institutions and thus avoid having to run it yourself. For Germany, the current resolution is 2.8 km. 

*The [https://cdc.dwd.de/portal/ Climate Data Center (CDC)] of the German Weather Service (DWD) has puslished [ftp://ftp-cdc.dwd.de/pub/CDC/ a dataset] of 
**observed parameters from DWD stations,
**derived parameters at the station locations,
**gridded fields covering Germany,
**regional averages for Germany and its federal states,
**gridded fields covering Europe,
**global climate station data
**available at hourly, daily, monthly, annual or multi-annual resolution.
**The data is useable without restrictions provided the source "Deutscher Wetterdienst" is mentioned. 

*[http://rda.ucar.edu/datasets/ds094.1/ National Centers for Environmental Prediction (NCEP) Climate Forecast System (CFS)], worldwide hourly reanalysis weather data, currently 0.2 deg spatial resolution. You need an account to get access to the downloads, but as the data is from a public US institution, it is free.

= Projects to turn weather data into renewable power availability time series =

Various projects exist that transform weather data into power availability time series for different solar/wind power plant model types:

*[http://arxiv.org/abs/1409.3353 Aarhus University RE Atlas]
*[https://github.com/FRESNA/atlite atlite]
*[https://github.com/oemof/feedinlib oemof feedinlib]
*[https://renewables.ninja/ renewables.ninja]

Electricity demand

2021-01-31T15:38:37Z

Sebastian Gonzato: /* Europe */

= Asia =

== Japan ==

The Japanese Ministry of Economy Trade and Industry (METI) has provided hourly data for a full year (April 2010-March 2011) for the entire country separated in [https://en.wikipedia.org/wiki/Electricity_sector_in_Japan#/media/File:Power_Grid_of_Japan.svg 10 regions]. Data per region are available in separate <s>[http://www.meti.go.jp/setsuden/performance.html pdf files]</s>. The website is in Japanese, it is, therefore, advisable to use a translate function (e.g. in Chrome).

== Singapore ==

Singapore's Energy Market Authority has provided an [https://www.ema.gov.sg/statistic.aspx?sta_sid=20140826Y84sgBebjwKV online database] with half-hourly demand, downloadable per month from the year 2004 onwards. Data is available in csv format or as pdf.

= Europe =

== ENTSO-E hourly load time series for European countries ==

The European Network of Transmission System Operators for Electricity, [https://www.entsoe.eu/ ENTSOE-E], hold [https://www.entsoe.eu/data/data-portal/consumption/Pages/default.aspx hourly demand data for each EU country]. Their terms and conditions do not allow redistribution. It may be worth our while putting in a single, co-ordinated request to cover access to and redistribution of the archive.

Additionally, the Ten Year Network Development Plans contain ~ 30 years of [[:File:https://www.entsos-tyndp2020-scenarios.eu/download-data/|demand]] and [[:File:https://www.entsoe.eu/outlooks/seasonal/|RES availability factors]]. There may be some data missing, in which case an email will get you a long way.

== Open Power System Data hourly load time series for European countries ==

[http://open-power-system-data.org/ Open Power System Data] (OPSD) is a platform for European power system data such as power plants and load, wind and solar time series.

OPSD will provide coherent versions of the ENTSO-E time series, with errors and time zones consistent across the dataset. 

== Elexon time series for Great Britain ==

[https://www.elexonportal.co.uk/ Elexon] manages the data for the GB network, and this is available half-hourly. Registration is free. They've been very helpful with our network of UK universities in facilitating access to data, to date. Again, a co-ordinated approach will be best. There are also [http://www2.nationalgrid.com/UK/Industry-information/Electricity-transmission-operational-data/Data-Explorer/ several different variations of total demand available from the GB National Grid], also all half-hourly 

== JASM load profiles for Switzerland ==

The Joint Activity on Scenario Modeling (JASM) in Switzerland has published [https://data.sccer-jasm.ch/ typical load profiles] for a variety of different loads along with other input data of their modeling activities.

 

== RTE time series for France ==

The [https://opendata.reseaux-energies.fr/explore/dataset/consommation-quotidienne-brute-elec/information/?disjunctive.qualite Open Data Reseaux-Energies] has time series for continental France for demand from 2008-2018 (2019 is available but not validated), including subdivision in different zones. Additional information (with some gaps) on production from a variety of sources per region is available.  Webpage is in French, but very reasonable to browse through. 

 

== Russia ==

Historical hourly load (updated every hour) for Russia's unified electricity transmission grid system is provided by Russia's [http://www.so-cdu.ru/index.php?id=972&tx_ms1cdu_pi1 Federal Grid Company]. Data can be downloaded in csv or xml format limited to 24 hours (full day) per download. Profiles are available for the unified grid as a whole or per subregion. The website is in Russian, it is therefore advisable to use a translate function (e.g. in Chrome).

= Africa =

== Morocco ==

[http://www.one.ma/ http://www.one.ma/]

= North America =

== Canada ==

Historical hourly load data for the [http://www.ieso.ca/localContent/zonal.map/index.html Ontario area] in Canada, operated by the Indepedent Electricity System Operator (IESO), can be downloaded in CSV format from IESO's [http://www.ieso.ca/en/power-data/data-directory website].

Hourly load data, 2016 only, for the [https://www.google.ie/maps/place/Alberta,+Canada/@54.1652415,-123.9587151,5z/data=!3m1!4b1!4m5!3m4!1s0x5309b282a82419b5:0xb0a9479a409b8e9e!8m2!3d53.9332706!4d-116.5765035 Alberta Interconnected Electric System (AIES)] can be retrieved from the website of [https://www.aeso.ca/market/market-and-system-reporting/data-requests/2016-hourly-load-data/ Alberta Electric System Operator (AESO).]

== United States ==

Hourly load profiles starting July 2015 are updated regularly (from weekly to almost real-time depending on reporting entity) are available from the EIA, [https://www.eia.gov/realtime_grid/ real-time map], [https://www.eia.gov/opendata/qb.php?category=2122628 hourly data]. Data can be downloaded for the entire US, or seperately per region, or balancing authority. A cleaned open access version of the EIA data spanning 4 years from July 2015 - July 2019 is available [https://zenodo.org/record/3690240 here] with a paper describing the cleaning process of removing outlier values and filling in reasonable replacement values for them as well as originally missing values [https://www.nature.com/articles/s41597-020-0483-x here].

Hourly load per balancing authority and/or planning area for years before 2006-2018 can be accessed through the website of the [https://www.ferc.gov/docs-filing/forms/form-714/data.asp Federal Energy Regulatory Commission (FERC).]

= Oceania =

== Australia ==

The [https://www.aemo.com.au/Electricity/National-Electricity-Market-NEM/Data-dashboard#aggregated-data data dashboard] of the Australian Energy Market Operator (AEMO) includes half-hourly load data per month, per subregion, of the Australian National Electricity Market (NEM) downloadable for the period 1998-2017. The NEM consists of the regions Queensland, New South Wales, Victoria, South Australia and Tasmania. In 2013 the NEM covered approximately 90% of Australia's grid connected electricity demand ([https://arena.gov.au/assets/2017/02/CSIRO-Electricity-market-analysis-for-IGEG.pdf p.13]). 

== New Zealand ==

The [https://www.emi.ea.govt.nz/Wholesale/Reports/W_GD_C?DateFrom=20100101&DateTo=20161231&_si=_dr_DateFrom|20150101,_dr_DateTo|20151231,_dr_RegionType|NZ,v|4 electricity market information (EMI) website] of New Zealand's Electricity Authority includes a database with half-hourly load data downloadable in CSV format for any customizable period from 2004 onwards. Data can be aggegrated for New Zealand as a whole, per subregion (5 in total) or per node.

= South America =

== Chile ==

The Coordinador Electrico Nacional, an independent corporation of the Chilean state, provides a wide variety of datasets regarding the power sector on their [https://sic.coordinadorelectrico.cl/informes-y-documentos/fichas/operacion-real/ website]. This includes hourly load data downloadable in aggegrated zip files per year. The zip file consists of seperate excel files per day of the year. All data and supporting information is in Spanish.