|
|
| Line 1: |
Line 1: |
| | | | |
| − | This is work in progress and supposed to become a link list to sources of open <g class="gr_ gr_219 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del multiReplace" id="219" data-gr-id="219">energy related</g> data. We focus on collecting links to data relevant <g class="gr_ gr_221 gr-alert gr_gramm gr_inline_cards gr_run_anim Grammar multiReplace" id="221" data-gr-id="221">for</g> the <g class="gr_ gr_222 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling multiReplace" id="222" data-gr-id="222">modelling</g> of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future.<br/> | + | This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future.<br/> |
| | | | |
| − | = Open data sources for energy <g class="gr_ gr_199 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling multiReplace" id="199" data-gr-id="199">modelling</g> = | + | = Open data sources for energy modelling = |
| | | | |
| | Open datasets related to energy are listed here by type. | | Open datasets related to energy are listed here by type. |
| Line 26: |
Line 26: |
| | == Weather data == | | == Weather data == |
| | | | |
| − | Weather data can be used to generate profiles for wind, solar and <g class="gr_ gr_209 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del" id="209" data-gr-id="209">hydro power</g> plants. Re-analysis or “hindcast” projects use <g class="gr_ gr_211 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del multiReplace" id="211" data-gr-id="211">state-of the</g> art weather forecast models with long time series of weather observations. They create consistent series of weather data, often of decades and with a global scope. [http://reanalyses.org/ Reanalysis.org] and [https://climatedataguide.ucar.edu/climate-data NCAR] provide a helpful overview of re-analysis models. Data are usually provided in GRIB or NetCDF format and can be very large in size (100s of GB). | + | Weather data can be used to generate profiles for wind, solar and hydro power plants. Re-analysis or “hindcast” projects use state-of the art weather forecast models with long time series of weather observations. They create consistent series of weather data, often of decades and with a global scope. [http://reanalyses.org/ Reanalysis.org] and [https://climatedataguide.ucar.edu/climate-data NCAR] provide a helpful overview of re-analysis models. Data are usually provided in GRIB or NetCDF format and can be very large in size (100s of GB). |
| | | | |
| | *OPSD compiled a [http://open-power-system-data.org/data-sources#9_Weather_data list of weather data sources] and provides [http://data.open-power-system-data.org/weather_data a script] to download customized subsets of the MERRA-2 dataset | | *OPSD compiled a [http://open-power-system-data.org/data-sources#9_Weather_data list of weather data sources] and provides [http://data.open-power-system-data.org/weather_data a script] to download customized subsets of the MERRA-2 dataset |
| | *[https://renewables.ninja Renewables.ninja] allows users to download weather data (wind speed, solar irradiance, temperature) for specific locations based on MERRA-2 and satellite imaging data. | | *[https://renewables.ninja Renewables.ninja] allows users to download weather data (wind speed, solar irradiance, temperature) for specific locations based on MERRA-2 and satellite imaging data. |
| | *The Hans-Ertel-Centre for Weather Research has published two preliminary reanalysis [https://www.herz-tb4.uni-bonn.de/index.php/projectdata/reanalysisdata data sets] (COSMO-REA6 and COSMO-REA2) containing the most often requested variables that may be used without any restrictions | | *The Hans-Ertel-Centre for Weather Research has published two preliminary reanalysis [https://www.herz-tb4.uni-bonn.de/index.php/projectdata/reanalysisdata data sets] (COSMO-REA6 and COSMO-REA2) containing the most often requested variables that may be used without any restrictions |
| − | *[http://www.cosmo-model.org/ COSMO (Consortium for Small-scale Modelling)], <g class="gr_ gr_217 gr-alert gr_gramm gr_inline_cards gr_run_anim Grammar only-ins doubleReplace replaceWithoutSep" id="217" data-gr-id="217">simulation</g> model for <g class="gr_ gr_218 gr-alert gr_gramm gr_inline_cards gr_run_anim Grammar only-ins replaceWithoutSep" id="218" data-gr-id="218">weather</g> in Europe, used for the official weather forecasts. The model is free to use for research applications | + | *[http://www.cosmo-model.org/ COSMO (Consortium for Small-scale Modelling)], simulation model for weather in Europe, used for the official weather forecasts. The model is free to use for research applications |
| | | | |
| | You may have a chance to get data directly from national weather services or participating universities/institutions and thus avoid having to run it yourself. For Germany, the current resolution is 2.8 km. | | You may have a chance to get data directly from national weather services or participating universities/institutions and thus avoid having to run it yourself. For Germany, the current resolution is 2.8 km. |
| | | | |
| − | *The Climate Data Center (CDC) of the German Weather Service (DWD) has <g class="gr_ gr_198 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del multiReplace" id="198" data-gr-id="198">puslished</g> [ftp://ftp-cdc.dwd.de/pub/CDC/ a dataset] of<br/> | + | *The Climate Data Center (CDC) of the German Weather Service (DWD) has puslished [ftp://ftp-cdc.dwd.de/pub/CDC/ a dataset] of<br/> |
| | **observed parameters from DWD stations, | | **observed parameters from DWD stations, |
| | **derived parameters at the station locations, | | **derived parameters at the station locations, |
| | **gridded fields covering Germany, | | **gridded fields covering Germany, |
| − | **regional averages for Germany and <g class="gr_ gr_196 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling multiReplace" id="196" data-gr-id="196">its</g> federal states, | + | **regional averages for Germany and its federal states, |
| | **gridded fields covering Europe, | | **gridded fields covering Europe, |
| | **global climate station data | | **global climate station data |
| | **available at hourly, daily, monthly, annual or multi-annual resolution. | | **available at hourly, daily, monthly, annual or multi-annual resolution. |
| − | **The data is <g class="gr_ gr_176 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del" id="176" data-gr-id="176">useable</g> without restrictions <g class="gr_ gr_185 gr-alert gr_gramm gr_inline_cards gr_run_anim Grammar only-ins replaceWithoutSep" id="185" data-gr-id="185">provided</g> the source "Deutscher Wetterdienst" is mentioned.<br/> | + | **The data is useable without restrictions provided the source "Deutscher Wetterdienst" is mentioned.<br/> |
| | | | |
| | *[http://rda.ucar.edu/datasets/ds094.1/ National Centers for Environmental Prediction (NCEP) Climate Forecast System (CFS)], worldwide hourly reanalysis weather data, currently 0.2 deg spatial resolution. You need an account to get access to the downloads, but as the data is from a public US institution, it is free. | | *[http://rda.ucar.edu/datasets/ds094.1/ National Centers for Environmental Prediction (NCEP) Climate Forecast System (CFS)], worldwide hourly reanalysis weather data, currently 0.2 deg spatial resolution. You need an account to get access to the downloads, but as the data is from a public US institution, it is free. |
| Line 87: |
Line 87: |
| | == Costs == | | == Costs == |
| | | | |
| − | "Recent cost estimates for distributed generation (DG) renewable energy technologies are available across capital costs, operations and maintenance (O&M) costs, and <g class="gr_ gr_223 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling" id="223" data-gr-id="223">levelized</g> cost of energy (LCOE). Use the tabs below to navigate the charts. The LCOE tab provides a simple calculator for both utility-scale and DG technologies that compares the combination of capital costs, O&M, performance, and fuel costs. If you are seeking utility-scale technology cost and performance estimates, please visit the Transparent Cost Database website for NREL's information regarding vehicles, biofuels, and electricity generation." | + | "Recent cost estimates for distributed generation (DG) renewable energy technologies are available across capital costs, operations and maintenance (O&M) costs, and levelized cost of energy (LCOE). Use the tabs below to navigate the charts. The LCOE tab provides a simple calculator for both utility-scale and DG technologies that compares the combination of capital costs, O&M, performance, and fuel costs. If you are seeking utility-scale technology cost and performance estimates, please visit the Transparent Cost Database website for NREL's information regarding vehicles, biofuels, and electricity generation." |
| | | | |
| | [http://www.nrel.gov/analysis/tech_cost_data.html http://www.nrel.gov/analysis/tech_cost_data.html] | | [http://www.nrel.gov/analysis/tech_cost_data.html http://www.nrel.gov/analysis/tech_cost_data.html] |
| Line 97: |
Line 97: |
| | == Efficiencies and specific consumptions of end-use technologies<br/> == | | == Efficiencies and specific consumptions of end-use technologies<br/> == |
| | | | |
| − | TODO: Efficiencies or specific consumptions of end-use technologies (e.g. vehicles [<g class="gr_ gr_186 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling multiReplace" id="186" data-gr-id="186">litres</g>/km], etc.) | + | TODO: Efficiencies or specific consumptions of end-use technologies (e.g. vehicles [litres/km], etc.) |
| | | | |
| | == Demographic and Socio-Economic Data == | | == Demographic and Socio-Economic Data == |
| Line 111: |
Line 111: |
| | TODO: historical data on load, generation, emissions, market prices, etc. | | TODO: historical data on load, generation, emissions, market prices, etc. |
| | | | |
| − | == Prospective data and energy scenarios<br/> ==
| + | <br/> |
| − | | + | |
| − | Energy scenarios (for results comparison):
| + | |
| − | | + | |
| − | *Canada: [https://www.neb-one.gc.ca/nrg/ntgrtd/ftr/2017/pblctn-eng.html Canada’s Energy Future 2017: Energy Supply and Demand Projections to 2040]
| + | |
| − | *Chile: [http://pelp.minenergia.cl/informacion-del-proceso/resultados Proceso de Planificación Energética de Largo Plazo]
| + | |
| − | *EU-28: [https://ec.europa.eu/energy/en/data-analysis/energy-modelling EU Reference Scenario 2016]
| + | |
| − | *Denmark, Finland, Norway and Sweden: [http://www.nordicenergy.org/project/nordic-energy-technology-perspectives/ Nordic Energy Technology Perspectives 2016]
| + | |
| − | *US: [https://www.eia.gov/outlooks/aeo/ Annual Energy Outlook 2018]
| + | |
| − | | + | |
| − | TODO: projections on parameters and technology costs.
| + | |
| | | | |
| | == Country-specific policies and targets<br/> == | | == Country-specific policies and targets<br/> == |
| Line 133: |
Line 123: |
| | <br/> | | <br/> |
| | | | |
| − | RES shares, sector-specific targets, subsidies <g class="gr_ gr_174 gr-alert gr_gramm gr_inline_cards gr_run_anim Punctuation only-ins replaceWithoutSep" id="174" data-gr-id="174">and</g> feed-in-tariffs:<br/> | + | RES shares, sector-specific targets, subsidies and feed-in-tariffs:<br/> |
| | | | |
| | *IEA Policies and Measures [https://www.iea.org/policiesandmeasures [4]]<br/> | | *IEA Policies and Measures [https://www.iea.org/policiesandmeasures [4]]<br/> |
| Line 147: |
Line 137: |
| | = Wikipedia page = | | = Wikipedia page = |
| | | | |
| − | The Wikipedia page [https://en.wikipedia.org/wiki/Open_energy_system_databases open energy system databases] <g class="gr_ gr_168 gr-alert gr_gramm gr_inline_cards gr_run_anim Grammar multiReplace" id="168" data-gr-id="168">lists</g> some of the more developed portals serving open energy system datasets. | + | The Wikipedia page [https://en.wikipedia.org/wiki/Open_energy_system_databases open energy system databases] lists some of the more developed portals serving open energy system datasets. |
| | | | |
| | <br/> | | <br/> |
| Line 163: |
Line 153: |
| | | | |
| | *[https://www.europeandataportal.eu/ European Data Portal] | | *[https://www.europeandataportal.eu/ European Data Portal] |
| − | *[http://www.iea-etsap.org/web/E-techDS.asp IEA ETSAP energy technology data source (E-Tech-DS)] is a series of four-page technology briefs similar to the [https://www.iea.org/publications/freepublications/ IEA Energy Technology Essentials (filter for "essentials")]. The page contains short technical descriptions of 29 <g class="gr_ gr_191 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del multiReplace" id="191" data-gr-id="191">energy related</g> technologies from power production, <g class="gr_ gr_195 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling multiReplace" id="195" data-gr-id="195">synthesised</g> fuels, and fossil fuel production. | + | *[http://www.iea-etsap.org/web/E-techDS.asp IEA ETSAP energy technology data source (E-Tech-DS)] is a series of four-page technology briefs similar to the [https://www.iea.org/publications/freepublications/ IEA Energy Technology Essentials (filter for "essentials")]. The page contains short technical descriptions of 29 energy related technologies from power production, synthesised fuels, and fossil fuel production. |
| | *[http://www.iaee.org/en/EnergyDataLinks/ International Association of Energy Economists (IAEE) Energy Data Links (EDL)] provides a searchable database of energy-related resources | | *[http://www.iaee.org/en/EnergyDataLinks/ International Association of Energy Economists (IAEE) Energy Data Links (EDL)] provides a searchable database of energy-related resources |
| − | *[http://en.openei.org/ OpenEI] features a wiki of crowd-sourced energy information and a database of <g class="gr_ gr_167 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del multiReplace" id="167" data-gr-id="167">single source</g> data on buildings, energy, efficiency, consumption, demand, potential. | + | *[http://en.openei.org/ OpenEI] features a wiki of crowd-sourced energy information and a database of single source data on buildings, energy, efficiency, consumption, demand, potential. |
| − | *[https://oep.iks.cs.ovgu.de/dataedit/ OpenEnergy Database] was started with the requirements gathered in the first <g class="gr_ gr_188 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del multiReplace" id="188" data-gr-id="188">openmod</g> meetings and was developed completely open with <g class="gr_ gr_204 gr-alert gr_gramm gr_inline_cards gr_run_anim Grammar only-ins replaceWithoutSep" id="204" data-gr-id="204">support</g> of the <g class="gr_ gr_189 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del multiReplace" id="189" data-gr-id="189">openmod</g> community. Input and result data from research of energy system studies are available via an API. The OEDB provides some automated <g class="gr_ gr_208 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling multiReplace" id="208" data-gr-id="208">visualisations</g> of the available data. | + | *[https://oep.iks.cs.ovgu.de/dataedit/ OpenEnergy Database] was started with the requirements gathered in the first openmod meetings and was developed completely open with support of the openmod community. Input and result data from research of energy system studies are available via an API. The OEDB provides some automated visualisations of the available data. |
| − | *[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to data sources (Electricity consumption, Capacity and generation by fuel, Power plant data, <g class="gr_ gr_160 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del" id="160" data-gr-id="160">Hydro power</g> data, Prices and related data, Weather data, Wind and solar power time series, Country-specific data portals). | + | *[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to data sources (Electricity consumption, Capacity and generation by fuel, Power plant data, Hydro power data, Prices and related data, Weather data, Wind and solar power time series, Country-specific data portals). |
| | *[http://www.ourenergypolicy.org/resource-library/ OurEnergyPolicy.org Resource Library] is a free online energy resource library updated weekly. | | *[http://www.ourenergypolicy.org/resource-library/ OurEnergyPolicy.org Resource Library] is a free online energy resource library updated weekly. |
| | *[http://www.pfbach.dk/ PFBach.dk], a collection of wind and solar in-feed profiles | | *[http://www.pfbach.dk/ PFBach.dk], a collection of wind and solar in-feed profiles |
| Line 178: |
Line 168: |
| | The Open Knowledge foundation promotes the use of its '''[http://data.okfn.org/ data package]''' standard. It consists of using CSV for payload (data) and a file package.json to attach machine-readable metadata. The page links to many examples of existing, curated and maintained datasets that adhere to this standard. Additionally, they drive the creation of a software ecosystem that can create and digest this format. Due to its simplicity, using data packages does not depend on this ecosystem. | | The Open Knowledge foundation promotes the use of its '''[http://data.okfn.org/ data package]''' standard. It consists of using CSV for payload (data) and a file package.json to attach machine-readable metadata. The page links to many examples of existing, curated and maintained datasets that adhere to this standard. Additionally, they drive the creation of a software ecosystem that can create and digest this format. Due to its simplicity, using data packages does not depend on this ecosystem. |
| | | | |
| − | '''GitHub repositories''' are another pragmatic way of sharing "small" (up to about 10 MB) datasets. A fun example is the [http://bundestag.github.io/gesetze/ Bundesgit], a collection of all German federal laws under version control. New laws or <g class="gr_ gr_169 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del multiReplace" id="169" data-gr-id="169">modfications</g> are tracked as commits, allowing to "see" how a dataset -- laws, in that case -- evolve over time. The repository [https://github.com/openmundi/world.db openmundi/world.db] shows a more data-focused way of using Git, or GitHub, for <g class="gr_ gr_179 gr-alert gr_gramm gr_inline_cards gr_run_anim Grammar only-ins doubleReplace replaceWithoutSep" id="179" data-gr-id="179">collaborative</g> collection of data. However, it clearly shows the limitations of using a version control system for code on data. | + | '''GitHub repositories''' are another pragmatic way of sharing "small" (up to about 10 MB) datasets. A fun example is the [http://bundestag.github.io/gesetze/ Bundesgit], a collection of all German federal laws under version control. New laws or modfications are tracked as commits, allowing to "see" how a dataset -- laws, in that case -- evolve over time. The repository [https://github.com/openmundi/world.db openmundi/world.db] shows a more data-focused way of using Git, or GitHub, for collaborative collection of data. However, it clearly shows the limitations of using a version control system for code on data. |
| | | | |
| − | An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta <g class="gr_ gr_165 gr-alert gr_gramm gr_inline_cards gr_run_anim Punctuation only-del replaceWithoutSep" id="165" data-gr-id="165">test,</g> but has come a long way already. | + | An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already. |
| | | | |
| − | = Help <g class="gr_ gr_156 gr-alert gr_gramm gr_inline_cards gr_run_anim Grammar multiReplace" id="156" data-gr-id="156">finding</g> energy data = | + | = Help finding energy data = |
| | | | |
| | *[http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy]<span style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">- latest questions on energy data sources</span> | | *[http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy]<span style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">- latest questions on energy data sources</span> |
| Line 191: |
Line 181: |
| | | | |
| | *[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin] | | *[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin] |
| − | *[http://www.open-power-system-data.org Open Power System Data] developed a data platform with open source scripts (based on Python and Jupyter Notebooks) for data on generation capacities, power plants, load <g class="gr_ gr_161 gr-alert gr_spell gr_inline_cards gr_run_anim ContextualSpelling ins-del multiReplace" id="161" data-gr-id="161">timeseries</g> and weather data. Project running until 07/2017. The public version of the data platform was released 10/2016. | + | *[http://www.open-power-system-data.org Open Power System Data] developed a data platform with open source scripts (based on Python and Jupyter Notebooks) for data on generation capacities, power plants, load timeseries and weather data. Project running until 07/2017. The public version of the data platform was released 10/2016. |
| | | | |
| | = Data organization ideas = | | = Data organization ideas = |
| | | | |
| | A scheme similar to [http://us-city.census.okfn.org/ http://us-city.census.okfn.org/] might be useful for mapping out what types of data are available where. | | A scheme similar to [http://us-city.census.okfn.org/ http://us-city.census.okfn.org/] might be useful for mapping out what types of data are available where. |
This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future.
Weather data can be used to generate profiles for wind, solar and hydro power plants. Re-analysis or “hindcast” projects use state-of the art weather forecast models with long time series of weather observations. They create consistent series of weather data, often of decades and with a global scope. Reanalysis.org and NCAR provide a helpful overview of re-analysis models. Data are usually provided in GRIB or NetCDF format and can be very large in size (100s of GB).
You may have a chance to get data directly from national weather services or participating universities/institutions and thus avoid having to run it yourself. For Germany, the current resolution is 2.8 km.
"Recent cost estimates for distributed generation (DG) renewable energy technologies are available across capital costs, operations and maintenance (O&M) costs, and levelized cost of energy (LCOE). Use the tabs below to navigate the charts. The LCOE tab provides a simple calculator for both utility-scale and DG technologies that compares the combination of capital costs, O&M, performance, and fuel costs. If you are seeking utility-scale technology cost and performance estimates, please visit the Transparent Cost Database website for NREL's information regarding vehicles, biofuels, and electricity generation."
TODO: capital, variable and fixed operational and maintenance costs of all generation, transmission etc. technologies.
TODO: Efficiencies or specific consumptions of end-use technologies (e.g. vehicles [litres/km], etc.)
TODO: biodiversity, health impacts, water extraction, water use, emission factors.
TODO: Criteria for power plant siting (e.g. exclusion zones for wind turbines).
