|
|
(11 intermediate revisions by 2 users not shown) |
Line 1: |
Line 1: |
| | | |
− | This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future.<br/> | + | This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data (e.g. for a European energy system model) that we should collect links to in the future: |
| + | |
| + | [[Data requirements for a European energy system model|Data requirements for a European energy system model]] |
| | | |
| = Open data sources for energy modelling = | | = Open data sources for energy modelling = |
Line 6: |
Line 8: |
| Open datasets related to energy are listed here by type. | | Open datasets related to energy are listed here by type. |
| | | |
− | == Demand ==
| + | *Demand |
| + | **[[Electricity demand|Electricity demand]] |
| + | **[[Thermal demand|Thermal demand]] |
| + | **[[Transport demand|Transport demand]] |
| + | **[[Industrial demand|Industrial demand]] |
| | | |
− | === Electricity demand ===
| + | *Resources and Potentials |
| + | **[[Weather data|Weather data and availability of renewable energy]] |
| + | **[[Wind geographical potentials|Wind geographical potentials]] |
| + | **[[Biomass potentials|Biomass potentials]] |
| + | **[[Hydroelectricity data|Hydroelectricity potentials]] |
| | | |
− | See [[Electricity demand|Electricity demand]]
| + | *Networks |
| + | **[[Transmission network datasets|Electricity transmission network datasets]] |
| + | **[[Distribution network datasets|Electricity distribution network datasets]] |
| + | **[[Gas network datasets|Gas network datasets]] |
| | | |
− | === Thermal demand ===
| + | *Technologies |
| + | **[[Power plant portfolios|Power plants]] |
| + | **[[Technology assumptions|Generation technology assumptions and projections]] |
| + | **[[Storage technology assumptions and projections|Storage technology assumptions and projections]] |
| + | **[[End-use technology assumptions and projections|End-use technology assumptions and projections]] |
| | | |
− | See [[Thermal demand|Thermal demand]]
| + | *[[Demographic and socio-economic data|Demographic and socio-economic data]] |
| | | |
− | === Transport demand ===
| + | *[[Environmental data and regulations|Environmental data and regulations]] |
| | | |
− | See [[Transport demand|Transport demand]]
| + | *[[Historical data and profiles|Historical data and profiles]] |
| | | |
− | === Industrial demand ===
| + | *[[Energy Scenarios|Energy scenarios]] |
| | | |
− | See [[Industrial demand|Industrial demand]]
| + | *[[Country-specific targets and policies|Country-specific targets and policies]] |
− | | + | |
− | == Power Plants ==
| + | |
− | | + | |
− | See [[Power plant portfolios|Power plant portfolios]]
| + | |
− | | + | |
− | == Weather Data ==
| + | |
− | | + | |
− | See [[Weather data|Weather data]]
| + | |
− | | + | |
− | == Resources and Potentials ==
| + | |
− | | + | |
− | === Wind profiles ===
| + | |
− | | + | |
− | OPSD summaries [http://open-power-system-data.org/data-sources#Wind_and_solar_power_time_series European historical wind generation time series]
| + | |
− | | + | |
− | === Solar profiles ===
| + | |
− | | + | |
− | OPSD summaries [http://open-power-system-data.org/data-sources#Wind_and_solar_power_time_series European historical solar generation time series]
| + | |
− | | + | |
− | === Wind geographical potentials ===
| + | |
− | | + | |
− | See [[Wind geographical potentials|Wind geographical potentials]]
| + | |
− | | + | |
− | === Biomass potentials ===
| + | |
− | | + | |
− | See [[Biomass potentials|Biomass potentials]]
| + | |
− | | + | |
− | === Hydroelectricity data ===
| + | |
− | | + | |
− | See [[Hydroelectricity data|Hydroelectricity data]]
| + | |
− | | + | |
− | == Networks ==
| + | |
− | | + | |
− | === Electricity transmission network datasets ===
| + | |
− | | + | |
− | See [[Transmission network datasets|Transmission network datasets]]
| + | |
− | | + | |
− | === Electricity distribution network datasets ===
| + | |
− | | + | |
− | See [[Distribution network datasets|Distribution network datasets]]
| + | |
− | | + | |
− | === Gas network datasets ===
| + | |
− | | + | |
− | See [[Gas network datasets|Gas network datasets]]
| + | |
− | | + | |
− | == Technology assumptions (costs, efficiencies, lifetimes) ==
| + | |
− | | + | |
− | See [[Technology assumptions|Technology assumptions]]
| + | |
− | | + | |
− | == Efficiencies and specific consumptions of end-use technologies ==
| + | |
− | | + | |
− | TODO: Efficiencies or specific consumptions of end-use technologies (e.g. vehicles [litres/km], etc.)
| + | |
− | | + | |
− | == Demographic and Socio-Economic Data ==
| + | |
− | | + | |
− | TODO: population trends, GDP trends, discount rates.
| + | |
− | | + | |
− | == Environmental data ==
| + | |
− | | + | |
− | TODO: biodiversity, health impacts, water extraction, water use, emission factors.
| + | |
− | | + | |
− | == Historical data ==
| + | |
− | | + | |
− | TODO: historical data on load, generation, emissions, market prices, etc.
| + | |
− | | + | |
− | == Prospective data ==
| + | |
− | | + | |
− | Energy scenarios (e.g. for results comparison):
| + | |
− | | + | |
− | *Canada:[https://www.neb-one.gc.ca/nrg/ntgrtd/ftr/2017/pblctn-eng.html Canada’s Energy Future 2017: Energy Supply and Demand Projections to 2040]
| + | |
− | *Chile: [http://pelp.minenergia.cl/informacion-del-proceso/resultados Proceso de Planificación Energética de Largo Plazo]
| + | |
− | *Denmark, Finland, Norway and Sweden:[http://www.nordicenergy.org/project/nordic-energy-technology-perspectives/ Nordic Energy Technology Perspectives 2016]
| + | |
− | *EU-28: [https://ec.europa.eu/energy/en/data-analysis/energy-modelling EU Reference Scenario 2016]
| + | |
− | *US: [https://www.eia.gov/outlooks/aeo/ Annual Energy Outlook 2018]
| + | |
− | | + | |
− | TODO: projections on parameters and technology costs.
| + | |
− | | + | |
− | == Country-specific policies and targets<br/> ==
| + | |
− | | + | |
− | Greenhousegas (GHG) reduction targets:<br/>
| + | |
− | | + | |
− | *UNFCCC [http://www4.unfccc.int/submissions/indc/Submission Pages/submissions.aspx [1]]<br/>
| + | |
− | *Worldbank [http://spappssecext.worldbank.org/sites/indc/Pages/Mitigation.aspx [2]]<br/>
| + | |
− | *Kyoto Targets [https://www.c2es.org/international/history-international-negotiations/2020-targets [3]]<br/>
| + | |
| | | |
| <br/> | | <br/> |
| | | |
− | RES shares, sector-specific targets, subsidies and feed-in-tariffs:<br/>
| + | = Other lists of energy-related open datasets = |
− | | + | |
− | *IEA Policies and Measures [https://www.iea.org/policiesandmeasures [4]]<br/>
| + | |
− | *European Commission National Action Plans [https://ec.europa.eu/energy/en/topics/renewable-energy/national-action-plans [5]]<br/>
| + | |
− | *RES Legal [http://www.res-legal.eu [6]]<br/>
| + | |
− | | + | |
− | <br/>
| + | |
− | | + | |
− | TODO: Criteria for power plant siting (e.g. exclusion zones for wind turbines).<br/>
| + | |
− | | + | |
− | = Other lists of energy-related open datasets<br/> = | + | |
| | | |
| *The Wikipedia article [https://en.wikipedia.org/wiki/Open_energy_system_databases open energy system databases] lists some of the portals serving open energy system datasets. | | *The Wikipedia article [https://en.wikipedia.org/wiki/Open_energy_system_databases open energy system databases] lists some of the portals serving open energy system datasets. |
Line 135: |
Line 58: |
| *[http://www.pfbach.dk/ PFBach.dk], a collection of wind and solar in-feed profiles | | *[http://www.pfbach.dk/ PFBach.dk], a collection of wind and solar in-feed profiles |
| *[http://data.reegle.info/ reegle] is a data provider of country energy profiles, energy statistics and a directory of relevant stakeholders. It also offers the clean energy search and an extensive glossary. There is also an insightful clean energy blog with interesting and up-to-date background information. | | *[http://data.reegle.info/ reegle] is a data provider of country energy profiles, energy statistics and a directory of relevant stakeholders. It also offers the clean energy search and an extensive glossary. There is also an insightful clean energy blog with interesting and up-to-date background information. |
− |
| |
− | <br/>
| |
| | | |
| = Data sharing techniques = | | = Data sharing techniques = |
Line 145: |
Line 66: |
| | | |
| An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already. | | An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already. |
− |
| |
− | <br/>
| |
| | | |
| = Help finding energy data = | | = Help finding energy data = |
| | | |
| You can find a list of the latest questions on energy data sources on StackExchange: [http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy] | | You can find a list of the latest questions on energy data sources on StackExchange: [http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy] |
− |
| |
− | <br/>
| |
| | | |
| = Data extraction scripts = | | = Data extraction scripts = |
Line 160: |
Line 77: |
| *[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin] | | *[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin] |
| *[http://www.open-power-system-data.org Open Power System Data] developed a data platform with open source scripts (based on Python and Jupyter Notebooks) for data on generation capacities, power plants, load timeseries and weather data. Project running until 07/2017. The public version of the data platform was released 10/2016. | | *[http://www.open-power-system-data.org Open Power System Data] developed a data platform with open source scripts (based on Python and Jupyter Notebooks) for data on generation capacities, power plants, load timeseries and weather data. Project running until 07/2017. The public version of the data platform was released 10/2016. |
| + | *[https://www.electricitymap.org/ electricitymap.org] has parser scrips for various online data sources in its [https://github.com/tmrowco/electricitymap-contrib#real-time-electricity-data-sources GitHub/parsers page] under GPLv3 license. |
| | | |
− | = Data organization ideas =
| + | <br/> |
| | | |
− | A scheme similar to [http://us-city.census.okfn.org/ http://us-city.census.okfn.org/] might be useful for mapping out what types of data are available where.
| + | <br/> |
| | | |
− | == Structure ==
| + | <br/> |
| | | |
− | * Demand
| + | = Interactive data visualizations = |
− | ** [[Electricity demand|Electricity demand]]
| + | |
− | ** [[Thermal demand|Thermal demand]]
| + | |
− | ** [[Transport demand|Transport demand]]
| + | |
− | ** [[Industrial demand|Industrial demand]]
| + | |
| | | |
− | * [[Power plant portfolios|Power plants]] | + | *[https://www.energy-charts.de/index.htm Energy Charts] by Fraunhofer IEE |
| + | *[https://www.entsoe.eu/data/map/ Interactive Power Transmission Grid Map] by ENTSO-E |
| + | *[https://transparency.entsog.eu/ Interactive Gas Transmission Grid Map] by ENTSO-G |
| + | *[https://www.electricitymap.org/?page=map&solar=false&remote=true&wind=false Electricity Map] shows the current carbon intensity of electricity consumed/produced. |
| + | *[https://www.agora-energiewende.de/en/service/recent-electricity-data/chart/matrix/19.09.2017/19.09.2018/ Recent Electricity Data] by Agora Energiewende (English and German) |
| + | *[https://globalwindatlas.info/ Global Wind Atlas] by Technical University of Denmark |
| + | *[https://globalsolaratlas.info/ Global Solar Atlas] by the World Bank Group |
| + | *[https://www.epexspot.com/en/market-data/dayaheadauction/chart/auction-chart/ EPEX Spot Day Ahead Auction] |
| | | |
− | * Resources and Potentials
| + | <br/> |
− | ** [[Weather data|Weather data and availability of renewable energy]]
| + | |
− | ** [[Wind geographical potentials|Wind geographical potentials]]
| + | |
− | ** [[Biomass potentials|Biomass potentials]]
| + | |
− | ** [[Hydroelectricity data|Hydroelectricity potentials]]
| + | |
| | | |
− | * Networks
| + | = Data organization ideas = |
− | ** [[Transmission network datasets|Electricity transmission network datasets]]
| + | |
− | ** [[Distribution network datasets|Electricity distribution network datasets]]
| + | |
− | ** [[Gas network datasets|Gas network datasets]]
| + | |
| | | |
− | * Technologies
| + | A scheme similar to [http://us-city.census.okfn.org/ http://us-city.census.okfn.org/] might be useful for mapping out what types of data are available where. |
− | ** [[Technology assumptions|Generation technology assumptions and projections]]
| + | |
− | ** [[xxx|Storage technology assumptions and projections]]
| + | |
− | ** [[xxx|End-use technology assumptions and projections]] (efficiencies or specific consumptions of end-use technologies (e.g. vehicles [litres/km], etc.))
| + | |
− | | + | |
− | * [[xxx|Demographic and socio-economic data]] (population trends, GDP trends, discount rates.)
| + | |
− | | + | |
− | * [[xxx|Envionmental data]] (biodiversity, health impacts, water extraction, water use, emission factors.)
| + | |
− | | + | |
− | * [[xxx|Historical data]] (historical data on load, generation, emissions, market prices, etc.)
| + | |
− | | + | |
− | * [[xxx|Energy Scenarios]]
| + | |
− | | + | |
− | * [[xxx|Country-specific targets and policies]]
| + | |
This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data (e.g. for a European energy system model) that we should collect links to in the future:
Open datasets related to energy are listed here by type.