wiki.openmod-initiative.org - User contributions [en]

Data

2021-03-16T08:54:59Z

Jens Schmugge: /* Other lists of energy-related open datasets */

This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data (e.g. for a European energy system model) that we should collect links to in the future:

[[Data requirements for a European energy system model|Data requirements for a European energy system model]]

= Open data sources for energy modelling =

Open datasets related to energy are listed here by type.

*Demand
**[[Electricity demand|Electricity demand]]
**[[Thermal demand|Thermal demand]]
**[[Transport demand|Transport demand]]
**[[Industrial demand|Industrial demand]]
**[[Demand response|Demand response]]

*Resources and Potentials
**[[Weather data|Weather data and availability of renewable energy]]
**[[Wind geographical potentials|Wind geographical potentials]]
**[[Biomass potentials|Biomass potentials]]
**[[Hydroelectricity data|Hydroelectricity potentials]]

*Networks
**[[Transmission network datasets|Electricity transmission network datasets]]
**[[Distribution network datasets|Electricity distribution network datasets]]
**[[Gas network datasets|Gas network datasets]]

*Technologies
**[[Power plant portfolios|Power plants]]
**[[Technology assumptions|Generation technology assumptions and projections]]
**[[Storage technology assumptions and projections|Storage technology assumptions and projections]]
**[[End-use technology assumptions and projections|End-use technology assumptions and projections]]

*[[Demographic and socio-economic data|Demographic and socio-economic data]]

*[[Environmental data and regulations|Environmental data and regulations]]

*[[Historical data and profiles|Historical data and profiles]]

*[[Energy Scenarios|Energy scenarios]]

*[[Country-specific targets and policies|Country-specific targets and policies]]

 

= Other lists of energy-related open datasets =

*The Wikipedia article [https://en.wikipedia.org/wiki/Open_energy_system_databases open energy system databases] lists some of the portals serving open energy system datasets.
*[http://datahub.io/dataset?q=energy datahub.io category "Energy"] has more datasets.
*[http://energypedia.info/ Energypedia] is a wiki platform for collaborative knowledge exchange on renewable energy and energy access issues in the context of development cooperation. *[http://enipedia.tudelft.nl/ Enipedia (TU Delft)] is an active exploration into the applications of wikis and the semantic web for energy and industry issues. An extensive compilation of links to other data sources can be found at [http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets Energy and Industry Data Sets] and [http://enipedia.tudelft.nl/wiki/Electricity_Transmission_Network Electricity_Transmission Network].

*[https://www.europeandataportal.eu/ European Data Portal]
*[http://www.iea-etsap.org/web/E-techDS.asp IEA ETSAP energy technology data source (E-Tech-DS)] is a series of four-page technology briefs similar to the [https://www.iea.org/publications/freepublications/ IEA Energy Technology Essentials (filter for "essentials")]. The page contains short technical descriptions of 29 energy related technologies from power production, synthesised fuels, and fossil fuel production.
*[http://www.iaee.org/en/EnergyDataLinks/ International Association of Energy Economists (IAEE) Energy Data Links (EDL)] provides a searchable database of energy-related resources
*[http://en.openei.org/ OpenEI] features a wiki of crowd-sourced energy information and a database of single source data on buildings, energy, efficiency, consumption, demand, potential.
*[[Openenergy-platform.org/|Open Energy Platform]] (OEP) and [https://openenergy-platform.org/dataedit/schemas Open Energy Database] (OEDB) was started with the requirements gathered in the first openmod meetings and was developed completely open with support of the openmod community. Input and result data from research of energy system studies are available via an API. The OEDB provides some automated visualisations of the available data.
*[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to data sources (Electricity consumption, Capacity and generation by fuel, Power plant data, Hydro power data, Prices and related data, Weather data, Wind and solar power time series, Country-specific data portals).
*[http://www.ourenergypolicy.org/resource-library/ OurEnergyPolicy.org Resource Library] is a free online energy resource library updated weekly.
*[http://www.pfbach.dk/ PFBach.dk], a collection of wind and solar in-feed profiles
*[https://www.reeep.org/reegle-clean-energy-information-portal reegle] is a data provider of country energy profiles, energy statistics and a directory of relevant stakeholders. It also offers the clean energy search and an extensive glossary. There is also an insightful clean energy blog with interesting and up-to-date background information. 
*The [https://globalenergymonitor.org/ Global Energy Monitor] is a project that maintains trackers on global (i) coal plants, (ii) fossil infrastructure, (iii) coal mines, (iv) steel plants, and (v) the European gas infrastructure with a global  gas plant tracker in development. The data underlying the several trackers can be requested.
*[https://energydata.info/ https://energydata.info/] features a collection of almost 600 open energy-related datasets put together by the World Bank Group.
*The [https://opendata.ffe.de/ FfE Open Data Portal] offers free datasets for modelling energy demand and generation with a regional focus on Europe and Germany.
*"[https://deep.eefig.eu/ DEEP] [De-risking Energy Efficiency Platform] is an open-source database for energy efficiency investments performance monitoring and benchmarking."

= Data sharing techniques =

The Open Knowledge foundation promotes the use of its '''[http://data.okfn.org/ data package]''' standard. It consists of using CSV for payload (data) and a file package.json to attach machine-readable metadata. The page links to many examples of existing, curated and maintained datasets that adhere to this standard. Additionally, they drive the creation of a software ecosystem that can create and digest this format. Due to its simplicity, using data packages does not depend on this ecosystem.

'''GitHub repositories''' are another pragmatic way of sharing "small" (up to about 10 MB) datasets. A fun example is the [http://bundestag.github.io/gesetze/ Bundesgit], a collection of all German federal laws under version control. New laws or modfications are tracked as commits, allowing to "see" how a dataset -- laws, in that case -- evolve over time. The repository [https://github.com/openmundi/world.db openmundi/world.db] shows a more data-focused way of using Git, or GitHub, for collaborative collection of data. However, it clearly shows the limitations of using a version control system for code on data.

An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already.

= Help finding energy data =

You can find a list of the latest questions on energy data sources on StackExchange: [http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy]

= Data extraction scripts =

Feel free to add scripts here, by creating a new wiki page, or place them on [https://gist.github.com/ Github Gists].

*[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin]
*[http://www.open-power-system-data.org Open Power System Data] developed a data platform with open source scripts (based on Python and Jupyter Notebooks) for data on generation capacities, power plants, load timeseries and weather data. Project running until 07/2017. The public version of the data platform was released 10/2016.
*[https://www.electricitymap.org/ electricitymap.org] has parser scrips for various online data sources in its [https://github.com/tmrowco/electricitymap-contrib#real-time-electricity-data-sources GitHub/parsers page] under GPLv3 license.
*[https://github.com/OpenEnergyPlatform/open-MaStR open_MaStR] develop to download BNetzA Marktstammdatenregister powerplant data for Germany (AGPL-3.0)

 

 

 

= Interactive data visualizations =

*[https://www.energy-charts.de/index.htm Energy Charts] by Fraunhofer ISE
*[https://www.entsoe.eu/data/map/ Interactive Power Transmission Grid Map] by ENTSO-E
*[https://transparency.entsog.eu/ Interactive Gas Transmission Grid Map] by ENTSO-G
*[https://www.electricitymap.org/?page=map&solar=false&remote=true&wind=false Electricity Map] shows the current carbon intensity of electricity consumed/produced.
*[https://www.agora-energiewende.de/en/service/recent-electricity-data/chart/matrix/19.09.2017/19.09.2018/ Recent Electricity Data] by Agora Energiewende (English and German)
*[https://globalwindatlas.info/ Global Wind Atlas] by Technical University of Denmark
*[https://globalsolaratlas.info/ Global Solar Atlas] by the World Bank Group
*[https://www.epexspot.com/en/market-data/dayaheadauction/chart/auction-chart/ EPEX Spot Day Ahead Auction]
*[https://wam.rl-institut.de/ WAM - Web Applications & Maps] by Reiner Lemoine Institut

 

= Data organization ideas =

A scheme similar to [http://us-city.census.okfn.org/ http://us-city.census.okfn.org/] might be useful for mapping out what types of data are available where.

Power plant portfolios

2021-03-16T08:51:38Z

Jens Schmugge: /* Europe */

The [https://resourcewatch.org/data/explore/a86d906d-9862-4783-9e30-cdb68cd808b8 Global Power Plant Database] published by WRI and partners provides an open comprehensive dataset of power plants of all fuel types and is activley maintained and updated. More details and additonal regional and global data sources can be found below. 

= Desired data on power plants =

For energy model it is useful to know the following data, in rough order of priority

*Plant primary energy (coal/gas/wind/solar/nuclear/hydro etc.)
*Net electrical output capacity (MW)
*Gross electrical output capacity (MW)
*Operational status (in operation, in planning, out of service, etc.)
*Build date
*Efficiency
*Marginal cost
*CO2 emissions in tonnes CO2 per MWh
*Operator name
*Owner name
*Historical data on output/carbon emissions
*Whether it provides heat output
*If heat output: Thermal output capacity (MWth) and dispatch strategy
*Cooling method

= Datasets by region =

== Global ==

=== Power Explorer / Global Power Plant Database ===

The World Resources Institue and partners have been working since 2015 on [http://powerexplorer.org/ Power Explorer], aiming to publish global comprehensive standarized open power system data and activley is looking for contributors. 

The Global Power Plant Database is a comprehensive, open source database of power plants around the world. It centralizes power plant data to make it easier to navigate, compare and draw insights for one’s own analysis. Each power plant is geolocated and entries contain information on plant capacity, generation, ownership, and fuel type. As of June 2018, the database includes around 28,500 power plants from 164 countries. It will be continuously updated as data becomes available. The most recent release of the Global Power Plant Database 1.1 includes the addition of two countries (China and Fiji), over 3,000 power plants, and nearly 1300 gigawatts of power capacity. We highly recommend using version 1.1, available online as of June 2018.

The methodology for the dataset creation is given in the World Resources Institute publication [http://www.wri.org/publication/global-power-plant-database "A Global Database of Power Plants"]

The database can be [http://goo.gl/XMyMLt visualized on Resource Watch]together with hundreds of other datasets.

The database is available for immediate download and use through the [http://datasets.wri.org/dataset/globalpowerplantdatabase WRI Open Data Portal].

Associated code for the creation of the dataset can be found on [https://github.com/wri/global-power-plant-database GitHub]. The bleeding-edge version of the database (which may contain substantial differences from the release you are viewing) is available on GitHub as well.

To be informed of important database releases in the future, please sign up for our [https://docs.google.com/forms/d/e/1FAIpQLSeEBpJurlrxxndIm_TC3cxGiKGdV3S2YwiUjdnuCGuNd1NCsA/viewform newsletter].

Citation Global Energy Observatory, Google, KTH Royal Institute of Technology in Stockholm, Enipedia, World Resources Institute. 2018. Global Power Plant Database. Published on Resource Watch and Google Earth Engine; [http://resourcewatch.org/ http://resourcewatch.org/] [https://earthengine.google.com/ https://earthengine.google.com/]

WRI is also maintaining a general list of power plant sources in this Google doc: [https://goo.gl/1oX71J https://goo.gl/1oX71J]

=== Enipedia ===

[http://enipedia.tudelft.nl/wiki/Portal:Power_Plants http://enipedia.tudelft.nl/wiki/Portal:Power_Plants]

Enpedia was initially based on CARMA, but also pulls in data from Wikipedia and user entries.

=== Global Energy Observatory (GEO) ===

[http://globalenergyobservatory.org/ http://globalenergyobservatory.org/]

=== Carbon Monitoring for Action (CARMA) ===

[http://carma.org/ http://carma.org/]

=== industryAbout ===

[http://www.industryabout.com/energy http://www.industryabout.com/energy]

=== Ventus ===

[http://ventus.project.asu.edu/ http://ventus.project.asu.edu/] (dead link)

=== OpenStreetMap ===

The OpenStreetMap project has [http://wiki.openstreetmap.org/wiki/Tag:power=plant Tags for power plants]

=== Wikipedia ===

[https://en.wikipedia.org/wiki/List_of_power_stations List of power stations]

 

== Europe ==

=== ENTSO-E Transparency Platform ===

[https://transparency.entsoe.eu/generation/r2/installedCapacityPerProductionUnit/show ENTSO-E Transparency Platform]

All power plants above 100 MW in the ENTSO-E area should be listed, although data is missing from some countries.

=== Open Power System Data ===

[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to European data sources on power plants as well as datasets on 

*[http://data.open-power-system-data.org/conventional_power_plants Conventional power plants]
*[http://data.open-power-system-data.org/renewable_power_plants Renewable power plants] and
*[http://data.open-power-system-data.org/national_generation_capacity National Generation capacities] 

 

=== Bundesnetzagentur for Germany (Germany's Network Regulator) ===

The German grid regulator "Bundesnetzagentur" (Federal Network Agency) publishes and regularly updates a list of existing power plants feeding into the German grid (including units in Luxemburg, Austria and Switzerland that are connected to the German grid).

In a separate document, also units that are subject to planned decommissioning or new construction are documented (minimum net power generation capacity: 10 MW).

Further description (in German) and download in .xls and .csv format is available here:

[http://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/Versorgungssicherheit/Erzeugungskapazitaeten/Kraftwerksliste/kraftwerksliste-node.html External Link] (dead link)

 

=== UBA Database of German Power Plants ===

[http://www.umweltbundesamt.de/dokument/datenbank-kraftwerke-in-deutschland http://www.umweltbundesamt.de/dokument/datenbank-kraftwerke-in-deutschland]

All plants above 100MW in Germany

=== RENPASS ===

[http://renpass.eu/ http://renpass.eu/]

=== North-West EU 2020 Model ===

This is an open access Excel database of a North-West European Power System for a sample year 2020. Data and files were collected and complied by researchers at University College Cork, Ireland.

Simplified Power plant portfolios are contained in the *.rar file below  [Master Dataset for Distribution] 

An associated functioning PLEXOS model and database  for teaching and academic research is also provided. The model and model data should be checked and verified by users before use. This current version has not been validated against historic data. 

The PLEXOS model includes hourly wind profiles, demand profiles profiles, simplified power plant data, hourly solar profiles and NTC data for Interconnectors. There is  a *.xml file [EU Model Carbon _30] which will function in the PLEXOS for Power Systems Software available from Energy Exemplar. 

Any improvements/errors or suggestions on the data or model can be sent to Paul Deane [ jp.deane@ucc.ie]. This is a market model based on freely available data for the year 2020. 

Please feel free to use as you wish.

Files may be accessed here

[[File:Master Dataset for Distribution.rar|180px|http://wiki.openmod-initiative.org/wiki/File:Master_Dataset_for_Distribution.rar|alt=http://wiki.openmod-initiative.org/wiki/File:Master_Dataset_for_Distribution.rar]]

=== ELMOD ===

Some of ELMOD, particularly for Germany is available (but just replicates the BNetzA list?).

=== EnergyMap (Germany) ===

Until 2016, [http://www.energymap.info/download.html EnergyMap] provided data on installed renewable energy power plants in Germany. Evaluations for more recent years cannot be found, with changing legislation in Germany given as reason.

= Other lists of datasets =

== Open Power System Data List of European Network Operator Sites ==

Many network operators/regulators have online datasets, see the [http://open-power-system-data.org/data-sources#Other_European_countries OPSD list of European countries with power plant databases].

 

= Projects to improve power plant datasets =

== powerplantmatching (PPM) ==

A toolset for cleaning, standardizing and combining multiple power plant databases. This package provides '''ready-to-use power plant data for the European power system'''. It cleans, standardizes and merges several input databases and creates a new dataset, which includes all the important information. The package allows to easily update the combined data as soon as new input datasets are released.

It is entirely ''free-and-open-source software'' (FOSS) and ready-to-download available at [https://github.com/FRESNA/powerplantmatching GitHub].

The application of the toolset has been '''broadly tested and peer-reviewed''' in these two papers here [https://doi.org/10.1016/j.esr.2018.11.004 here] and [https://doi.org/10.1016/j.esr.2018.08.012 here].

Currently, the toolset is constantly being improved, please feel free to get in touch!

== Enipedia ==

Enipedia has a nice [http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets list of energy and industry data sets]

Enipedia's [http://enipedia.tudelft.nl/Elasticsearch.html Elastic Search] can search most of the open databases - the challenge is to match the different databases, combine their information and identify missing data (e.g. in the Balkans).

Energy Scenarios

2021-03-16T07:49:16Z

Jens Schmugge:

*Canada: [https://www.neb-one.gc.ca/nrg/ntgrtd/ftr/2017/pblctn-eng.html Canada’s Energy Future 2017: Energy Supply and Demand Projections to 2040]
*Chile: [http://pelp.minenergia.cl/informacion-del-proceso/resultados Proceso de Planificación Energética de Largo Plazo]
*Denmark, Finland, Norway and Sweden:[http://www.nordicenergy.org/project/nordic-energy-technology-perspectives/ Nordic Energy Technology Perspectives 2016]
*EU-28: [https://ec.europa.eu/energy/en/data-analysis/energy-modelling EU Reference Scenario 2016]
*US: [https://www.eia.gov/outlooks/aeo/ Annual Energy Outlook 2018]
*Developing countries: An "overview of electrification investment scenarios for a selection of [developing] countries" is given on the [https://electrifynow.energydata.info/ Global Electrificaton Platform]. The years 2025 ("indermediate strategy") and 2030 ("full electrification") are implemented. The results are "created using the Open Source Spatial Electrification Tool ([https://github.com/global-electrification-platform/gep-onsset gep-onsset])".

Data

2021-03-16T07:47:37Z

Jens Schmugge: /* Other lists of energy-related open datasets */

This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data (e.g. for a European energy system model) that we should collect links to in the future:

[[Data requirements for a European energy system model|Data requirements for a European energy system model]]

= Open data sources for energy modelling =

Open datasets related to energy are listed here by type.

*Demand
**[[Electricity demand|Electricity demand]]
**[[Thermal demand|Thermal demand]]
**[[Transport demand|Transport demand]]
**[[Industrial demand|Industrial demand]]
**[[Demand response|Demand response]]

*Resources and Potentials
**[[Weather data|Weather data and availability of renewable energy]]
**[[Wind geographical potentials|Wind geographical potentials]]
**[[Biomass potentials|Biomass potentials]]
**[[Hydroelectricity data|Hydroelectricity potentials]]

*Networks
**[[Transmission network datasets|Electricity transmission network datasets]]
**[[Distribution network datasets|Electricity distribution network datasets]]
**[[Gas network datasets|Gas network datasets]]

*Technologies
**[[Power plant portfolios|Power plants]]
**[[Technology assumptions|Generation technology assumptions and projections]]
**[[Storage technology assumptions and projections|Storage technology assumptions and projections]]
**[[End-use technology assumptions and projections|End-use technology assumptions and projections]]

*[[Demographic and socio-economic data|Demographic and socio-economic data]]

*[[Environmental data and regulations|Environmental data and regulations]]

*[[Historical data and profiles|Historical data and profiles]]

*[[Energy Scenarios|Energy scenarios]]

*[[Country-specific targets and policies|Country-specific targets and policies]]

 

= Other lists of energy-related open datasets =

*The Wikipedia article [https://en.wikipedia.org/wiki/Open_energy_system_databases open energy system databases] lists some of the portals serving open energy system datasets.
*[http://datahub.io/dataset?q=energy datahub.io category "Energy"] has more datasets.
*[http://energypedia.info/ Energypedia] is a wiki platform for collaborative knowledge exchange on renewable energy and energy access issues in the context of development cooperation. *[http://enipedia.tudelft.nl/ Enipedia (TU Delft)] is an active exploration into the applications of wikis and the semantic web for energy and industry issues. An extensive compilation of links to other data sources can be found at [http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets Energy and Industry Data Sets] and [http://enipedia.tudelft.nl/wiki/Electricity_Transmission_Network Electricity_Transmission Network].

*[https://www.europeandataportal.eu/ European Data Portal]
*[http://www.iea-etsap.org/web/E-techDS.asp IEA ETSAP energy technology data source (E-Tech-DS)] is a series of four-page technology briefs similar to the [https://www.iea.org/publications/freepublications/ IEA Energy Technology Essentials (filter for "essentials")]. The page contains short technical descriptions of 29 energy related technologies from power production, synthesised fuels, and fossil fuel production.
*[http://www.iaee.org/en/EnergyDataLinks/ International Association of Energy Economists (IAEE) Energy Data Links (EDL)] provides a searchable database of energy-related resources
*[http://en.openei.org/ OpenEI] features a wiki of crowd-sourced energy information and a database of single source data on buildings, energy, efficiency, consumption, demand, potential.
*[[Openenergy-platform.org/|Open Energy Platform]] (OEP) and [https://openenergy-platform.org/dataedit/schemas Open Energy Database] (OEDB) was started with the requirements gathered in the first openmod meetings and was developed completely open with support of the openmod community. Input and result data from research of energy system studies are available via an API. The OEDB provides some automated visualisations of the available data.
*[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to data sources (Electricity consumption, Capacity and generation by fuel, Power plant data, Hydro power data, Prices and related data, Weather data, Wind and solar power time series, Country-specific data portals).
*[http://www.ourenergypolicy.org/resource-library/ OurEnergyPolicy.org Resource Library] is a free online energy resource library updated weekly.
*[http://www.pfbach.dk/ PFBach.dk], a collection of wind and solar in-feed profiles
*[https://www.reeep.org/reegle-clean-energy-information-portal reegle] is a data provider of country energy profiles, energy statistics and a directory of relevant stakeholders. It also offers the clean energy search and an extensive glossary. There is also an insightful clean energy blog with interesting and up-to-date background information. 
*The [https://globalenergymonitor.org/ Global Energy Monitor] is a project that maintains trackers on global (i) coal plants, (ii) fossil infrastructure, (iii) coal mines, (iv) steel plants, and (v) the European gas infrastructure with a global  gas plant tracker in development. The data underlying the several trackers can be requested.
*[https://energydata.info/ https://energydata.info/] features a collection of almost 600 open energy-related datasets put together by the World Bank Group.
*The [https://opendata.ffe.de/ FfE Open Data Portal] offers free datasets for modelling energy demand and generation with a regional focus on Europe and Germany.

= Data sharing techniques =

The Open Knowledge foundation promotes the use of its '''[http://data.okfn.org/ data package]''' standard. It consists of using CSV for payload (data) and a file package.json to attach machine-readable metadata. The page links to many examples of existing, curated and maintained datasets that adhere to this standard. Additionally, they drive the creation of a software ecosystem that can create and digest this format. Due to its simplicity, using data packages does not depend on this ecosystem.

'''GitHub repositories''' are another pragmatic way of sharing "small" (up to about 10 MB) datasets. A fun example is the [http://bundestag.github.io/gesetze/ Bundesgit], a collection of all German federal laws under version control. New laws or modfications are tracked as commits, allowing to "see" how a dataset -- laws, in that case -- evolve over time. The repository [https://github.com/openmundi/world.db openmundi/world.db] shows a more data-focused way of using Git, or GitHub, for collaborative collection of data. However, it clearly shows the limitations of using a version control system for code on data.

An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already.

= Help finding energy data =

You can find a list of the latest questions on energy data sources on StackExchange: [http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy]

= Data extraction scripts =

Feel free to add scripts here, by creating a new wiki page, or place them on [https://gist.github.com/ Github Gists].

*[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin]
*[http://www.open-power-system-data.org Open Power System Data] developed a data platform with open source scripts (based on Python and Jupyter Notebooks) for data on generation capacities, power plants, load timeseries and weather data. Project running until 07/2017. The public version of the data platform was released 10/2016.
*[https://www.electricitymap.org/ electricitymap.org] has parser scrips for various online data sources in its [https://github.com/tmrowco/electricitymap-contrib#real-time-electricity-data-sources GitHub/parsers page] under GPLv3 license.
*[https://github.com/OpenEnergyPlatform/open-MaStR open_MaStR] develop to download BNetzA Marktstammdatenregister powerplant data for Germany (AGPL-3.0)

 

 

 

= Interactive data visualizations =

*[https://www.energy-charts.de/index.htm Energy Charts] by Fraunhofer ISE
*[https://www.entsoe.eu/data/map/ Interactive Power Transmission Grid Map] by ENTSO-E
*[https://transparency.entsog.eu/ Interactive Gas Transmission Grid Map] by ENTSO-G
*[https://www.electricitymap.org/?page=map&solar=false&remote=true&wind=false Electricity Map] shows the current carbon intensity of electricity consumed/produced.
*[https://www.agora-energiewende.de/en/service/recent-electricity-data/chart/matrix/19.09.2017/19.09.2018/ Recent Electricity Data] by Agora Energiewende (English and German)
*[https://globalwindatlas.info/ Global Wind Atlas] by Technical University of Denmark
*[https://globalsolaratlas.info/ Global Solar Atlas] by the World Bank Group
*[https://www.epexspot.com/en/market-data/dayaheadauction/chart/auction-chart/ EPEX Spot Day Ahead Auction]
*[https://wam.rl-institut.de/ WAM - Web Applications & Maps] by Reiner Lemoine Institut

 

= Data organization ideas =

A scheme similar to [http://us-city.census.okfn.org/ http://us-city.census.okfn.org/] might be useful for mapping out what types of data are available where.