|
|
| Line 1: |
Line 1: |
| − |
| |
| | This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future.<br/> | | This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future.<br/> |
| | | | |
| Line 40: |
Line 39: |
| | **The data is useable without restrictions provided the source "Deutscher Wetterdienst" is mentioned.<br/> | | **The data is useable without restrictions provided the source "Deutscher Wetterdienst" is mentioned.<br/> |
| | | | |
| − | *[http://rda.ucar.edu/datasets/ds094.1/ National Centers for Environmental Prediction (NCEP) Climate Forecast System (CFS)], worldwide hourly reanalysis weather data, currently 0.2 deg spatial resolution. You need an account to get access to the downloads, but as the data is from a public US institution, it is free.<br/> | + | *[http://rda.ucar.edu/datasets/ds094.1/ National Centers for Environmental Prediction (NCEP) Climate Forecast System (CFS)], worldwide hourly reanalysis weather data, currently 0.2 deg spatial resolution. You need an account to get access to the downloads, but as the data is from a public US institution, it is free. |
| | | | |
| | === Projects to turn weather data into renewable power availability time series === | | === Projects to turn weather data into renewable power availability time series === |
| Line 46: |
Line 45: |
| | Various projects exist that transform weather data into power availability time series for different solar/wind power plant model types, such as the [http://arxiv.org/abs/1409.3353 Aarhus University RE Atlas] or the [https://github.com/oemof/feedinlib oemof feedinlib] or [http://renewables.ninja/ renewables.ninja]. | | Various projects exist that transform weather data into power availability time series for different solar/wind power plant model types, such as the [http://arxiv.org/abs/1409.3353 Aarhus University RE Atlas] or the [https://github.com/oemof/feedinlib oemof feedinlib] or [http://renewables.ninja/ renewables.ninja]. |
| | | | |
| − | == Wind profiles<br/> == | + | == Wind profiles == |
| | | | |
| | OPSD summaries [http://open-power-system-data.org/data-sources#Wind_and_solar_power_time_series European historical wind generation time series] | | OPSD summaries [http://open-power-system-data.org/data-sources#Wind_and_solar_power_time_series European historical wind generation time series] |
| Line 87: |
Line 86: |
| | | | |
| | Historical and projected GHG emission costs. | | Historical and projected GHG emission costs. |
| − |
| |
| − | <br/>
| |
| − |
| |
| − | <br/>
| |
| | | | |
| | == Efficiencies and specific consumptions of end-use technologies<br/> == | | == Efficiencies and specific consumptions of end-use technologies<br/> == |
| | | | |
| | TODO: Efficiencies or specific consumptions of end-use technologies (e.g. vehicles [litres/km], etc.) | | TODO: Efficiencies or specific consumptions of end-use technologies (e.g. vehicles [litres/km], etc.) |
| − |
| |
| − | <br/>
| |
| | | | |
| | == Demographic and Socio-Economic Data == | | == Demographic and Socio-Economic Data == |
| | | | |
| | TODO: population trends, GDP trends, discount rates. | | TODO: population trends, GDP trends, discount rates. |
| − |
| |
| − | <br/>
| |
| | | | |
| | == Environmental data == | | == Environmental data == |
| Line 111: |
Line 102: |
| | | | |
| | TODO: historical data on load, generation, emissions, market prices, etc. | | TODO: historical data on load, generation, emissions, market prices, etc. |
| − |
| |
| − | <br/>
| |
| | | | |
| | == Country-specific policies and targets == | | == Country-specific policies and targets == |
| | | | |
| | TODO GHG emissions targets, renewable share targets, sector-specific targets, subsidy schemes for renewables, criteria for power plant siting (e.g. exclusion zones for wind turbines). | | TODO GHG emissions targets, renewable share targets, sector-specific targets, subsidy schemes for renewables, criteria for power plant siting (e.g. exclusion zones for wind turbines). |
| − |
| |
| − | <br/>
| |
| | | | |
| | = Other lists of energy-related open datasets = | | = Other lists of energy-related open datasets = |
| Line 134: |
Line 121: |
| | *[http://www.pfbach.dk/ PFBach.dk], a collection of wind and solar in-feed profiles<br/> | | *[http://www.pfbach.dk/ PFBach.dk], a collection of wind and solar in-feed profiles<br/> |
| | *[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to data sources (Electricity consumption, Capacity and generation by fuel, Power plant data, Hydro power data, Prices and related data, Weather data, Wind and solar power time series, Country-specific data portals). | | *[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to data sources (Electricity consumption, Capacity and generation by fuel, Power plant data, Hydro power data, Prices and related data, Weather data, Wind and solar power time series, Country-specific data portals). |
| − |
| |
| − | <br/>
| |
| | | | |
| | = Data sharing techniques = | | = Data sharing techniques = |
| | | | |
| − | The Open Knowledge foundation promotes the use of its '''[http://data.okfn.org/ data package]''' standard. It consists of using CSV for payload (data) and a file package.json to attach machine-readable metadata. The page links to many examples of existing, curated and maintained datasets that adhere to this standard. Additionally, they drive the creation of a software ecosystem that can create and digest this format. Due to its simplicity, using data packages does not depend on this ecosystem.<br/> | + | The Open Knowledge foundation promotes the use of its '''[http://data.okfn.org/ data package]''' standard. It consists of using CSV for payload (data) and a file package.json to attach machine-readable metadata. The page links to many examples of existing, curated and maintained datasets that adhere to this standard. Additionally, they drive the creation of a software ecosystem that can create and digest this format. Due to its simplicity, using data packages does not depend on this ecosystem. |
| | | | |
| − | '''GitHub repositories''' are another pragmatic way of sharing "small" (up to about 10 MB) datasets. A fun example is the [http://bundestag.github.io/gesetze/ Bundesgit], a collection of all German federal laws under version control. New laws or modfications are tracked as commits, allowing to "see" how a dataset -- laws, in that case -- evolve over time. The repository [https://github.com/openmundi/world.db openmundi/world.db] shows a more data-focused way of using Git, or GitHub, for collaborative collection of data. However, it clearly shows the limitations of using a version control system for code on data.<br/> | + | '''GitHub repositories''' are another pragmatic way of sharing "small" (up to about 10 MB) datasets. A fun example is the [http://bundestag.github.io/gesetze/ Bundesgit], a collection of all German federal laws under version control. New laws or modfications are tracked as commits, allowing to "see" how a dataset -- laws, in that case -- evolve over time. The repository [https://github.com/openmundi/world.db openmundi/world.db] shows a more data-focused way of using Git, or GitHub, for collaborative collection of data. However, it clearly shows the limitations of using a version control system for code on data. |
| | | | |
| − | An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already.<br/> | + | An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already. |
| | | | |
| | = Help finding energy data = | | = Help finding energy data = |
| | | | |
| | *[http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy]<span style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">- latest questions on energy data sources</span> | | *[http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy]<span style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">- latest questions on energy data sources</span> |
| − |
| |
| − | <br/>
| |
| | | | |
| | = Data extraction scripts = | | = Data extraction scripts = |
| | | | |
| − | Feel free to add scripts here, by creating a new wiki page, or place them on [https://gist.github.com/ Github Gists].<br/> | + | Feel free to add scripts here, by creating a new wiki page, or place them on [https://gist.github.com/ Github Gists]. |
| | | | |
| | *[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin] | | *[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin] |
| − | *[http://www.open-power-system-data.org Open Power System Data] developed a data platform with open source scripts (based on Python and Jupyter Notebooks) for data on generation capacities, power plants, load timeseries and weather data. Project running until 07/2017. The public version of the data platform was released 10/2016.<br/> | + | *[http://www.open-power-system-data.org Open Power System Data] developed a data platform with open source scripts (based on Python and Jupyter Notebooks) for data on generation capacities, power plants, load timeseries and weather data. Project running until 07/2017. The public version of the data platform was released 10/2016. |
| − | | + | |
| − | <br/>
| + | |
| | | | |
| | = Data organization ideas = | | = Data organization ideas = |
| | | | |
| | A scheme similar to [http://us-city.census.okfn.org/ http://us-city.census.okfn.org/] might be useful for mapping out what types of data are available where. | | A scheme similar to [http://us-city.census.okfn.org/ http://us-city.census.okfn.org/] might be useful for mapping out what types of data are available where. |
This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future.
Weather data can be used to generate profiles for wind, solar and hydro power plants. Re-analysis or “hindcast” projects use state-of the art weather forecast models with long time series of weather observations. They create consistent series of weather data, often of decades and with a global scope. Reanalysis.org and NCAR provide a helpful overview of re-analysis models. Data are usually provided in GRIB or NetCDF format and can be very large in size (100s of GB).
"Recent cost estimates for distributed generation (DG) renewable energy technologies are available across capital costs, operations and maintenance (O&M) costs, and levelized cost of energy (LCOE). Use the tabs below to navigate the charts. The LCOE tab provides a simple calculator for both utility-scale and DG technologies that compares the combination of capital costs, O&M, performance, and fuel costs. If you are seeking utility-scale technology cost and performance estimates, please visit the Transparent Cost Database website for NREL's information regarding vehicles, biofuels, and electricity generation."
TODO: capital, variable and fixed operational and maintenance costs of all generation, transmission etc. technologies.
TODO: Efficiencies or specific consumptions of end-use technologies (e.g. vehicles [litres/km], etc.)
TODO: biodiversity, health impacts, water extraction, water use, emission factors.
TODO GHG emissions targets, renewable share targets, sector-specific targets, subsidy schemes for renewables, criteria for power plant siting (e.g. exclusion zones for wind turbines).
