wiki.openmod-initiative.org - User contributions [en]

Data

2016-12-13T12:47:06Z

Martin Jahn:

This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future. 

= Open data sources for energy modelling =

Open datasets related to energy are listed here by type.

== Electricity demand ==

See [[Electricity demand|Electricity demand]]

== Thermal demand ==

See [[Thermal demand|Thermal demand]]

== Transport demand ==

See [[Transport demand|Transport demand]]

== Power Plants ==

See [[Power plant portfolios|Power plant portfolios]]

== Weather data ==

Weather data can be used to generate profiles for wind, solar and hydro power plants. Re-analysis or “hindcast” projects use state-of the art weather forecast models with long time series of weather observations. They create consistent series of weather data, often of decades and with a global scope. [http://reanalyses.org/ Reanalysis.org] and [https://climatedataguide.ucar.edu/climate-data NCAR] provide a helpful overview of re-analysis models. Data are usually provided in GRIB or NetCDF format and can be very large in size (100s of GB).

*OPSD compiled a [http://open-power-system-data.org/data-sources#9_Weather_data list of weather data sources] and provides [http://data.open-power-system-data.org/weather_data a script] to download  customized subsets of the MERRA-2 dataset.
*The Hans-Ertel-Centre for Weather Research has published two preliminary reanalysis [https://www.herz-tb4.uni-bonn.de/index.php/projectdata/reanalysisdata data sets] (COSMO-REA6 and COSMO-REA2) containing the most often requested variables that may be used without any restrictions. 

*[http://www.cosmo-model.org/ COSMO (Consortium for Small-scale Modelling)], simulation model for weather in Europe, used for the official weather forecasts. The model is free to use for research applications. You may have a chance to get data directly from national weather services or participating universities/institutions and thus avoid having to run it yourself. For Germany, the current resolution is 2.8 km. 
*The Climate Data Center (CDC) of the German Weather Service (DWD) has puslished [ftp://ftp-cdc.dwd.de/pub/CDC/ a dataset] of 
**observed parameters from DWD stations,
**derived parameters at the station locations,
**gridded fields covering Germany,
**regional averages for Germany and its federal states,
**gridded fields covering Europe,
**global climate station data
**available at hourly, daily, monthly, annual or multi-annual resolution.
**The data is useable without restrictions provided the source "Deutscher Wetterdienst" is mentioned. 

*[http://rda.ucar.edu/datasets/ds094.1/ National Centers for Environmental Prediction (NCEP) Climate Forecast System (CFS)], worldwide hourly reanalysis weather data, currently 0.2 deg spatial resolution. You need an account to get access to the downloads, but as the data is from a public US institution, it is free. 

=== Projects to turn weather data into renewable power availability time series ===

Various projects exist that transform weather data into power availability time series for different solar/wind power plant model types, such as the [http://arxiv.org/abs/1409.3353 Aarhus University RE Atlas] or the [https://github.com/oemof/feedinlib oemof feedinlib] or [http://renewables.ninja/ renewables.ninja].

== Wind profiles ==

OPSD summaries [http://open-power-system-data.org/data-sources#Wind_and_solar_power_time_series European historical wind generation time series]

== Solar profiles ==

OPSD summaries [http://open-power-system-data.org/data-sources#Wind_and_solar_power_time_series European historical solar generation time series]

== Wind geographical potentials ==

See [[Wind geographical potentials|Wind geographical potentials]]

== Biomass potentials ==

See [[Biomass potentials|Biomass potentials]]

== Hydroelectricity data ==

See [[Hydroelectricity data|Hydroelectricity data]]

== Electricity transmission network datasets ==

See [[Transmission network datasets|Transmission network datasets]]

== Electricity distribution network datasets ==

See [[Distribution network datasets|Distribution network datasets]]

== Gas network datasets ==

See [[Gas network datasets|Gas network datasets]]

== Costs ==

"Recent cost estimates for distributed generation (DG) renewable energy technologies are available across capital costs, operations and maintenance (O&M) costs, and levelized cost of energy (LCOE). Use the tabs below to navigate the charts. The LCOE tab provides a simple calculator for both utility-scale and DG technologies that compares the combination of capital costs, O&M, performance, and fuel costs. If you are seeking utility-scale technology cost and performance estimates, please visit the Transparent Cost Database website for NREL's information regarding vehicles, biofuels, and electricity generation."

[http://www.nrel.gov/analysis/tech_cost_data.html http://www.nrel.gov/analysis/tech_cost_data.html]

TODO: capital, variable and fixed operational and maintenance costs of all generation, transmission etc. technologies.

Historical and projected GHG emission costs.

 

 

== Efficiencies and specific consumptions of end-use technologies ==

TODO: Efficiencies or specific consumptions of end-use technologies (e.g. vehicles [litres/km], etc.)

 

== Demographic and Socio-Economic Data ==

TODO: population trends, GDP trends, discount rates.

 

== Environmental data ==

TODO: biodiversity, health impacts, water extraction, water use, emission factors.

== Historical data ==

TODO: historical data on load, generation, emissions, market prices, etc.

 

== Country-specific policies and targets ==

TODO GHG emissions targets, renewable share targets, sector-specific targets, subsidy schemes for renewables, criteria for power plant siting (e.g. exclusion zones for wind turbines).

 

= Other lists of energy-related open datasets =

*[http://enipedia.tudelft.nl/ Enipedia (TU Delft)] is an active exploration into the applications of wikis and the semantic web for energy and industry issues.
**An extensive compilation of links to other data sources can be found at [http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets Energy and Industry Data Sets] and [http://enipedia.tudelft.nl/wiki/Electricity_Transmission_Network Electricity_Transmission Network]

*[http://energypedia.info/ Energypedia] is a wiki platform for collaborative knowledge exchange on renewable energy and energy access issues in the context of development cooperation. 
*[http://data.reegle.info/ reegle] is a data provider of country energy profiles, energy statistics and a directory of relevant stakeholders. It also offers the clean energy search and an extensive glossary. There is also an insightful clean energy blog with interesting and up-to-date background information.
*[http://www.iaee.org/en/EnergyDataLinks/ International Association of Energy Economists (IAEE) Energy Data Links (EDL)] provides a searchable database of energy-related resources
*[http://www.europeandataportal.eu/) European Data Portal]
*[http://www.iea-etsap.org/web/E-techDS.asp IEA ETSAP energy technology data source (E-Tech-DS)] is a series of four-page technology briefs similar to the [https://www.iea.org/publications/freepublications/ IEA Energy Technology Essentials (filter for "essentials")]. The page contains short technical descriptions of 29 energy related technologies from power production, synthesised fuels, and fossil fuel production.
*[http://en.openei.org/ OpenEI] features a wiki of crowd-sourced energy information and a database of single source data on buildings, energy, efficiency, consumption, demand, potential.
*[http://datahub.io/dataset?q=energy datahub.io category "Energy"] has more datasets
*[http://www.pfbach.dk/ PFBach.dk], a collection of wind and solar in-feed profiles 
*[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to data sources (Electricity consumption, Capacity and generation by fuel, Power plant data, Hydro power data, Prices and related data, Weather data, Wind and solar power time series, Country-specific data portals).

 

= Data sharing techniques =

The Open Knowledge foundation promotes the use of its '''[http://data.okfn.org/ data package]''' standard. It consists of using CSV for payload (data) and a file package.json to attach machine-readable metadata. The page links to many examples of existing, curated and maintained datasets that adhere to this standard. Additionally, they drive the creation of a software ecosystem that can create and digest this format. Due to its simplicity, using data packages does not depend on this ecosystem. 

'''GitHub repositories''' are another pragmatic way of sharing "small" (up to about 10 MB) datasets. A fun example is the [http://bundestag.github.io/gesetze/ Bundesgit], a collection of all German federal laws under version control. New laws or modfications are tracked as commits, allowing to "see" how a dataset -- laws, in that case -- evolve over time. The repository [https://github.com/openmundi/world.db openmundi/world.db] shows a more data-focused way of using Git, or GitHub, for collaborative collection of data. However, it clearly shows the limitations of using a version control system for code on data. 

An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already. 

= Help finding energy data =

*[http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy]<span style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">- latest questions on energy data sources

 

= Data extraction scripts =

Feel free to add scripts here, by creating a new wiki page, or place them on [https://gist.github.com/ Github Gists]. 

*[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin]
*[http://www.open-power-system-data.org Open Power System Data] developed a data platform with open source scripts (based on Python and Jupyter Notebooks) for data on generation capacities, power plants, load timeseries and weather data. Project running until 07/2017. The public version of the data platform was released 10/2016. 

 

= Data organization ideas =

A scheme similar to [http://us-city.census.okfn.org/ http://us-city.census.okfn.org/] might be useful for mapping out what types of data are available where.

Power plant portfolios

2016-12-13T12:46:02Z

Martin Jahn: /* Open Power System Data */

This page is mostly focussed on large conventional power plants; see also [[Hydroelectricity data|hydroelectricity data]] for hydro-specific data. Datasets of small renewable power plants may have to be treated separately.

 

= List of Power Plant Data Sources =

List started by WRI with the aim to agreegate all source. Please contribute and add your name. 

[https://goo.gl/1oX71J https://goo.gl/1oX71J]

 

= Desired data on power plants =

For energy model it is useful to know the following data, in rough order of priority

*Plant primary energy (coal/gas/wind/solar/nuclear/hydro etc.)
*Net electrical output capacity (MW)
*Gross electrical output capacity (MW)
*Operational status (in operation, in planning, out of service, etc.)
*Build date
*Efficiency
*Marginal cost
*CO2 emissions in tonnes CO2 per MWh
*Operator name
*Owner name
*Historical data on output/carbon emissions
*Whether it provides heat output
*If heat output: Thermal output capacity (MWth) and dispatch strategy
*Cooling method

= Datasets by region =

== Global ==

=== Enipedia ===

[http://enipedia.tudelft.nl/wiki/Portal:Power_Plants http://enipedia.tudelft.nl/wiki/Portal:Power_Plants]

Enpedia was initially based on CARMA, but also pulls in data from Wikipedia and user entries.

=== Global Energy Observatory (GEO) ===

[http://globalenergyobservatory.org/ http://globalenergyobservatory.org/]

=== Carbon Monitoring for Action (CARMA) ===

[http://carma.org/ http://carma.org/]

=== industryAbout ===

[http://www.industryabout.com/energy http://www.industryabout.com/energy]

=== Ventus ===

[http://ventus.project.asu.edu/ http://ventus.project.asu.edu/]

=== OpenStreetMap ===

The OpenStreetMap project has [http://wiki.openstreetmap.org/wiki/Tag:power=plant Tags for power plants]

=== Wikipedia ===

== Europe ==

=== ENTSO-E Transparency Platform ===

[https://transparency.entsoe.eu/generation/r2/installedCapacityPerProductionUnit/show [1]]

All power plants above 100 MW in the ENTSO-E area should be listed, although data is missing from some countries.

 

=== Open Power System Data ===

[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to European data sources on power plants as well as datasets on 

*[http://data.open-power-system-data.org/conventional_power_plants Conventional power plants]
*[http://data.open-power-system-data.org/renewable_power_plants Renewable power plants] and
*[http://data.open-power-system-data.org/national_generation_capacity National Generation capacities] 

 

=== Bundesnetzagentur for Germany (Germany's Network Regulator) ===

The German grid regulator "Bundesnetzagentur" (Federal Network Agency) publishes and regularly updates a list of existing power plants feeding into the German grid (including units in Luxemburg, Austria and Switzerland that are connected to the German grid).

In a separate document, also units that are subject to planned decommissioning or new construction are documented (minimum net power generation capacity: 10 MW).

Further description (in German) and download in .xls and .csv format is available here:

[http://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/Versorgungssicherheit/Erzeugungskapazitaeten/Kraftwerksliste/kraftwerksliste-node.html External Link]

=== UBA Database of German Power Plants ===

[http://www.umweltbundesamt.de/dokument/datenbank-kraftwerke-in-deutschland http://www.umweltbundesamt.de/dokument/datenbank-kraftwerke-in-deutschland]

All plants above 100MW in Germany

=== RENPASS ===

[http://renpass.eu/ http://renpass.eu/]

=== North-West EU 2020 Model ===

This is an open access Excel database of a North-West European Power System for a sample year 2020. Data and files were collected and complied by researchers at University College Cork, Ireland.

Simplified Power plant portfolios are contained in the *.rar file below  [Master Dataset for Distribution] 

An associated functioning PLEXOS model and database  for teaching and academic research is also provided. The model and model data should be checked and verified by users before use. This current version has not been validated against historic data. 

The PLEXOS model includes hourly wind profiles, demand profiles profiles, simplified power plant data, hourly solar profiles and NTC data for Interconnectors. There is  a *.xml file [EU Model Carbon _30] which will function in the PLEXOS for Power Systems Software available from Energy Exemplar. 

Any improvements/errors or suggestions on the data or model can be sent to Paul Deane [ jp.deane@ucc.ie]. This is a market model based on freely available data for the year 2020. 

Please feel free to use as you wish.

Files may be accessed here

[[File:Master Dataset for Distribution.rar|180px|http://wiki.openmod-initiative.org/wiki/File:Master_Dataset_for_Distribution.rar|alt=http://wiki.openmod-initiative.org/wiki/File:Master_Dataset_for_Distribution.rar]]

=== ELMOD ===

Some of ELMOD, particularly for Germany is available (but just replicates the BNetzA list?).

= Other lists of datasets =

== Enipedia ==

Enipedia has a nice [http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets list of energy and industry data sets]

Enipedia's [http://enipedia.tudelft.nl/Elasticsearch.html Elastic Search] can search most of the open databases - the challenge is to match the different databases, combine their information and identify missing data (e.g. in the Balkans).

== Open Power System Data List of European Network Operator Sites ==

Many network operators/regulators have online datasets, see the [http://open-power-system-data.org/data-sources#Other_European_countries OPSD list of European countries with power plant databases].

= Projects to improve power plant datasets =

== Enipedia ==

== World Resource Institute Power Plant Project ==

See the [https://github.com/Arjay7891/WRI-Powerplant WRI Power Plant github repo].

Power plant portfolios

2016-12-13T12:44:56Z

Martin Jahn: /* Open Power System Data */

This page is mostly focussed on large conventional power plants; see also [[Hydroelectricity data|hydroelectricity data]] for hydro-specific data. Datasets of small renewable power plants may have to be treated separately.

 

= List of Power Plant Data Sources =

List started by WRI with the aim to agreegate all source. Please contribute and add your name. 

[https://goo.gl/1oX71J https://goo.gl/1oX71J]

 

= Desired data on power plants =

For energy model it is useful to know the following data, in rough order of priority

*Plant primary energy (coal/gas/wind/solar/nuclear/hydro etc.)
*Net electrical output capacity (MW)
*Gross electrical output capacity (MW)
*Operational status (in operation, in planning, out of service, etc.)
*Build date
*Efficiency
*Marginal cost
*CO2 emissions in tonnes CO2 per MWh
*Operator name
*Owner name
*Historical data on output/carbon emissions
*Whether it provides heat output
*If heat output: Thermal output capacity (MWth) and dispatch strategy
*Cooling method

= Datasets by region =

== Global ==

=== Enipedia ===

[http://enipedia.tudelft.nl/wiki/Portal:Power_Plants http://enipedia.tudelft.nl/wiki/Portal:Power_Plants]

Enpedia was initially based on CARMA, but also pulls in data from Wikipedia and user entries.

=== Global Energy Observatory (GEO) ===

[http://globalenergyobservatory.org/ http://globalenergyobservatory.org/]

=== Carbon Monitoring for Action (CARMA) ===

[http://carma.org/ http://carma.org/]

=== industryAbout ===

[http://www.industryabout.com/energy http://www.industryabout.com/energy]

=== Ventus ===

[http://ventus.project.asu.edu/ http://ventus.project.asu.edu/]

=== OpenStreetMap ===

The OpenStreetMap project has [http://wiki.openstreetmap.org/wiki/Tag:power=plant Tags for power plants]

=== Wikipedia ===

== Europe ==

=== ENTSO-E Transparency Platform ===

[https://transparency.entsoe.eu/generation/r2/installedCapacityPerProductionUnit/show [1]]

All power plants above 100 MW in the ENTSO-E area should be listed, although data is missing from some countries.

 

=== Open Power System Data ===

[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to European data sources on power plants as well as datasets on 

[http://data.open-power-system-data.org/conventional_power_plants Conventional power plants] 
[http://data.open-power-system-data.org/renewable_power_plants Renewable power plants] and 
 

 

=== Bundesnetzagentur for Germany (Germany's Network Regulator) ===

The German grid regulator "Bundesnetzagentur" (Federal Network Agency) publishes and regularly updates a list of existing power plants feeding into the German grid (including units in Luxemburg, Austria and Switzerland that are connected to the German grid).

In a separate document, also units that are subject to planned decommissioning or new construction are documented (minimum net power generation capacity: 10 MW).

Further description (in German) and download in .xls and .csv format is available here:

[http://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/Versorgungssicherheit/Erzeugungskapazitaeten/Kraftwerksliste/kraftwerksliste-node.html External Link]

=== UBA Database of German Power Plants ===

[http://www.umweltbundesamt.de/dokument/datenbank-kraftwerke-in-deutschland http://www.umweltbundesamt.de/dokument/datenbank-kraftwerke-in-deutschland]

All plants above 100MW in Germany

=== RENPASS ===

[http://renpass.eu/ http://renpass.eu/]

=== North-West EU 2020 Model ===

This is an open access Excel database of a North-West European Power System for a sample year 2020. Data and files were collected and complied by researchers at University College Cork, Ireland.

Simplified Power plant portfolios are contained in the *.rar file below  [Master Dataset for Distribution] 

An associated functioning PLEXOS model and database  for teaching and academic research is also provided. The model and model data should be checked and verified by users before use. This current version has not been validated against historic data. 

The PLEXOS model includes hourly wind profiles, demand profiles profiles, simplified power plant data, hourly solar profiles and NTC data for Interconnectors. There is  a *.xml file [EU Model Carbon _30] which will function in the PLEXOS for Power Systems Software available from Energy Exemplar. 

Any improvements/errors or suggestions on the data or model can be sent to Paul Deane [ jp.deane@ucc.ie]. This is a market model based on freely available data for the year 2020. 

Please feel free to use as you wish.

Files may be accessed here

[[File:Master Dataset for Distribution.rar|180px|http://wiki.openmod-initiative.org/wiki/File:Master_Dataset_for_Distribution.rar|alt=http://wiki.openmod-initiative.org/wiki/File:Master_Dataset_for_Distribution.rar]]

=== ELMOD ===

Some of ELMOD, particularly for Germany is available (but just replicates the BNetzA list?).

= Other lists of datasets =

== Enipedia ==

Enipedia has a nice [http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets list of energy and industry data sets]

Enipedia's [http://enipedia.tudelft.nl/Elasticsearch.html Elastic Search] can search most of the open databases - the challenge is to match the different databases, combine their information and identify missing data (e.g. in the Balkans).

== Open Power System Data List of European Network Operator Sites ==

Many network operators/regulators have online datasets, see the [http://open-power-system-data.org/data-sources#Other_European_countries OPSD list of European countries with power plant databases].

= Projects to improve power plant datasets =

== Enipedia ==

== World Resource Institute Power Plant Project ==

See the [https://github.com/Arjay7891/WRI-Powerplant WRI Power Plant github repo].

Talk:Logo development 2016

2016-10-20T08:42:15Z

Martin Jahn: <nice-discussions-summary>

<div class="NiceDiscussions START">

==C1 and C2==
Hi, thanks for taking the initiative, Robbie. Personally I prefer C1 and C2 over all others. The reason is that they appear much more compact and readible than all the others. I would suggest to mix colors though. Black writing and colorful box, maybe stick to the red. I think I would need to see some combination experiments here. A-logos: I find they look like a cloud picture of text (I forget how they are called, you know, when you count words and size the font according to their frequency) B-logos: My eye does not know where to focus as the left bound is hopping from o to i to o D: Too fat, too much color, it is jumping at me E: I could go for that as an alternative, however, I still prefer C as C is more "airy", E is square and full, C is open and leaves room for the eye F: My eye does not know where to focus G: My eye does not know where to focus and I feel like spinning sideways :) too much playing around for me H1-4: Again too complex for a logo for my liking, too many elements H5-6: Could potentially do with that however I find the logo not compact enough. It looks as it is falling apart due to gravity. Kind of words drooling. Hope that helps. My personal views. Looking forward to discussion. Best Eva[[User:Eva Schmid|Eva Schmid]] 19 October 2016, 08:08 (CEST)
==Style Guide==
Thank you Robbie. I can see and appreciate the effort you put in this! Before going into a feedback loop I would suggest to discuss and clarify the objective and purpose and questions like: 1. Do we want/need just an icon or a logo (with icon and text)? 2. Where do we want to use it? 3. Do we want to use picture language from the open source community? [http://fabfarm.net/wordpress/wp-content/uploads/2014/10/open-source-concept_root.png http://fabfarm.net/wordpress/wp-content/uploads/2014/10/open-source-concept_root.png] [[User:Ludwig Schneider|Ludwig Schneider]] 19 October 2016, 10:57 (CEST)
:I would second Ludwigs comment/suggestion to possibly use the open source community picture language. I based the logo for Open Power System Data Project as well on the open circle (even though quite abstracted: http://www.open-power-system-data.org/Logo_OPSD_bw_80.png). As does open_eGo: https://www.next-energy.de/wp-content/uploads/2016/03/open_ego_logo.png. But I don't think it's a must, just see it as a suggestion to spark your creativity ;) Completely changing a "brand's" visual appearance is always tricky, better to make incremental improvements. Aalthough I would argue that our brand's prominence isn't very high yet to take this argument very serious. Nevertheless I prefer C and would suggest to use a colourful default version wherever possible (for better visibility) that also works when printed as a greyscale version if necessary. I would also prefer a bold font that is not noo round (as in B). Thanks for your work! [[User:Martin Jahn|Martin Jahn]] 20 October 2016, 10:42 (CEST)
</div>

Power plant portfolios

2016-05-31T10:03:49Z

Martin Jahn: /* Open Power System Data */

This page is mostly focussed on large conventional power plants; see also [[Hydroelectricity data|Hydroelectricity data]] for hydro-specific data. Datasets of small renewable power plants may have to be treated separately.

= List of Power Plant Data Sources =

List started by WRI with the aim to agreegate all source. Please contribute and add your name. 

https://goo.gl/1oX71J

= Desired data on power plants =

For energy model it is useful to know the following data, in rough order of priority

*Plant primary energy (coal/gas/wind/solar/nuclear/hydro etc.)
*Net electrical output capacity (MW)
*Gross electrical output capacity (MW)
*Operational status (in operation, in planning, out of service, etc.)
*Build date
*Efficiency
*Marginal cost
*CO2 emissions in tonnes CO2 per MWh
*Operator name
*Owner name
*Historical data on output/carbon emissions
*Whether it provides heat output
*If heat output: Thermal output capacity (MWth) and dispatch strategy
*Cooling method

= Datasets by region =

== Global ==

=== Enipedia ===

[http://enipedia.tudelft.nl/wiki/Portal:Power_Plants http://enipedia.tudelft.nl/wiki/Portal:Power_Plants]

Enpedia was initially based on CARMA, but also pulls in data from Wikipedia and user entries.

=== Global Energy Observatory (GEO) ===

[http://globalenergyobservatory.org/ http://globalenergyobservatory.org/]

=== Carbon Monitoring for Action (CARMA) ===

[http://carma.org/ http://carma.org/]

=== industryAbout ===

[http://www.industryabout.com/energy http://www.industryabout.com/energy]

=== Ventus ===

[http://ventus.project.asu.edu/ http://ventus.project.asu.edu/]

=== OpenStreetMap ===

The OpenStreetMap project has [http://wiki.openstreetmap.org/wiki/Tag:power=plant Tags for power plants]

=== Wikipedia ===

== Europe ==

=== ENTSO-E Transparency Platform ===

[https://transparency.entsoe.eu/generation/r2/installedCapacityPerProductionUnit/show [1]]

All power plants above 100 MW in the ENTSO-E area should be listed, although data is missing from some countries.

=== Open Power System Data ===

[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to European data sources on power plants.

=== Bundesnetzagentur for Germany (Germany's Network Regulator) ===

The German grid regulator "Bundesnetzagentur" (Federal Network Agency) publishes and regularly updates a list of existing power plants feeding into the German grid (including units in Luxemburg, Austria and Switzerland that are connected to the German grid).

In a separate document, also units that are subject to planned decommissioning or new construction are documented (minimum net power generation capacity: 10 MW).

Further description (in German) and download in .xls and .csv format is available here:

[http://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/Versorgungssicherheit/Erzeugungskapazitaeten/Kraftwerksliste/kraftwerksliste-node.html External Link]

=== UBA Database of German Power Plants ===

[http://www.umweltbundesamt.de/dokument/datenbank-kraftwerke-in-deutschland http://www.umweltbundesamt.de/dokument/datenbank-kraftwerke-in-deutschland]

All plants above 100MW in Germany

=== RENPASS ===

[http://renpass.eu/ http://renpass.eu/]

=== North-West EU 2020 Model ===

This is an open access Excel database of a North-West European Power System for a sample year 2020. Data and files were collected and complied by researchers at University College Cork, Ireland.

Simplified Power plant portfolios are contained in the *.rar file below  [Master Dataset for Distribution] 

An associated functioning PLEXOS model and database  for teaching and academic research is also provided. The model and model data should be checked and verified by users before use. This current version has not been validated against historic data. 

The PLEXOS model includes hourly wind profiles, demand profiles profiles, simplified power plant data, hourly solar profiles and NTC data for Interconnectors. There is  a *.xml file [EU Model Carbon _30] which will function in the PLEXOS for Power Systems Software available from Energy Exemplar. 

Any improvements/errors or suggestions on the data or model can be sent to Paul Deane [ jp.deane@ucc.ie]. This is a market model based on freely available data for the year 2020. 

Please feel free to use as you wish.

Files may be accessed here

[[File:Master Dataset for Distribution.rar|180px|http://wiki.openmod-initiative.org/wiki/File:Master_Dataset_for_Distribution.rar|alt=http://wiki.openmod-initiative.org/wiki/File:Master_Dataset_for_Distribution.rar]]

=== ELMOD ===

Some of ELMOD, particularly for Germany is available (but just replicates the BNetzA list?).

= Other lists of datasets =

== Enipedia ==

Enipedia has a nice [http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets list of energy and industry data sets]

Enipedia's [http://enipedia.tudelft.nl/Elasticsearch.html Elastic Search] can search most of the open databases - the challenge is to match the different databases, combine their information and identify missing data (e.g. in the Balkans).

== Open Power System Data List of European Network Operator Sites ==

Many network operators/regulators have online datasets, see the [http://open-power-system-data.org/data-sources#Other_European_countries OPSD list of European countries with power plant databases].

= Projects to improve power plant datasets =

== Enipedia ==

== World Resource Institute Power Plant Project ==

See the [https://github.com/Arjay7891/WRI-Powerplant WRI Power Plant github repo].

Data

2016-03-21T10:43:01Z

Martin Jahn: /* Data extraction scripts */

This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future. 

 

 

== Model relevant data ==

Please note that red links indicate planned, but not yet filled pages. You are welcome to start creating the missing pages and breathe life into them.

*[[Electricity demand|Electricity demand]]
*[[Wind profiles|Wind profiles]]
*[[Power plant portfolios|Power plant portfolios]]
*[[Transmission network datasets|Transmission network datasets]]
*[[:File:Flexible demand and storage|Flexible demand and storage]]
*[[Hydroelectricity data|Hydroelectricity data]]

 

 

== Various other open energy data sources ==

A small selection of high-quality datasets per type could be compiled here.

=== Fuel ===

=== Transmission network ===

*[http://www.scigrid.de/ SciGRID], a European transmission grid model based on OpenStreetMap 

See [[Transmission network datasets|Transmission network datasets]] 

 

=== Power Plants ===

*[http://open-power-system-data.org/ Open Power System Data], a platform for European power system data such as power plants and load, wind and solar time series

=== Weather data ===

*[http://www.cosmo-model.org/ COSMO (Consortium for Small-scale Modelling)], simulation model for weather in Europe, used for the official weather forecasts. The model is free to use for research applications. You may have a chance to get data directly from national weather services or participating universities/institutions and thus avoid having to run it yourself. For Germany, the current resolution is 2.8 km.
*[http://rda.ucar.edu/datasets/ds094.1/ National Centers for Environmental Prediction (NCEP) Climate Forecast System (CFS)], worldwide hourly reanalysis weather data, currently 0.2 deg spatial resolution. You need an account to get access to the downloads, but as the data is from a public US institution, it is free.

=== Hydroelectricity data ===

See [[Hydroelectricity data|Hydroelectricity data]]

 

=== Distribution network ===

It would be useful to have reference datasets of e.g. distribution networks in the city/suburb/countryside for different regions of the world.

=== Storage ===

=== Consumption ===
<ul style="font-size: 13.6px;">
<li>[http://open-power-system-data.org/ Open Power System Data], a platform for European power system data such as power plants and load, wind and solar time series</li>
</ul>

 

 

=== Meta ===

This is a list to lists of datasets:

*[http://enipedia.tudelft.nl/ Enipedia (TU Delft)] is an active exploration into the applications of wikis and the semantic web for energy and industry issues.
**An extensive compilation of links to other data sources can be found at [http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets Energy and Industry Data Sets] and [http://enipedia.tudelft.nl/wiki/Electricity_Transmission_Network Electricity_Transmission Network]

*[http://energypedia.info/ Energypedia] is a wiki platform for collaborative knowledge exchange on renewable energy and energy access issues in the context of development cooperation. 
*[http://data.reegle.info/ reegle] is a data provider of country energy profiles, energy statistics and a directory of relevant stakeholders. It also offers the clean energy search and an extensive glossary. There is also an insightful clean energy blog with interesting and up-to-date background information.
*[http://www.iea-etsap.org/web/E-techDS.asp IEA ETSAP energy technology data source (E-Tech-DS)] is a series of four-page technology briefs similar to the [https://www.iea.org/publications/freepublications/ IEA Energy Technology Essentials (filter for "essentials")]. The page contains short technical descriptions of 29 energy related technologies from power production, synthesised fuels, and fossil fuel production.
*[http://en.openei.org/ OpenEI] features a wiki of crowd-sourced energy information and a database of single source data on buildings, energy, efficiency, consumption, demand, potential.
*[http://datahub.io/dataset?q=energy datahub.io category "Energy"] has more datasets
*[http://www.pfbach.dk/ PFBach.dk], a collection of wind and solar in-feed profiles 
*[http://open-power-system-data.org/data-sources Open Power System Data] has an extensive collection of links to data sources (Electricity consumption, Capacity and generation by fuel, Power plant data, Hydro power data, Prices and related data, Weather data, Wind and solar power time series, Country-specific data portals).

 

 

 

== Data sharing techniques ==

The Open Knowledge foundation promotes the use of its '''[http://data.okfn.org/ data package]''' standard. It consists of using CSV for payload (data) and a file package.json to attach machine-readable metadata. The page links to many examples of existing, curated and maintained datasets that adhere to this standard. Additionally, they drive the creation of a software ecosystem that can create and digest this format. Due to its simplicity, using data packages does not depend on this ecosystem. 

'''GitHub repositories''' are another pragmatic way of sharing "small" (up to about 10 MB) datasets. A fun example is the [http://bundestag.github.io/gesetze/ Bundesgit], a collection of all German federal laws under version control. New laws or modfications are tracked as commits, allowing to "see" how a dataset -- laws, in that case -- evolve over time. The repository [https://github.com/openmundi/world.db openmundi/world.db] shows a more data-focused way of using Git, or GitHub, for collaborative collection of data. However, it clearly shows the limitations of using a version control system for code on data. 

An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already. 

== Help finding energy data ==

*[http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy]<span style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">- latest questions on energy data sources

 

== Data extraction scripts ==

Feel free to add scripts here, by creating a new wiki page, or place them on [https://gist.github.com/ Github Gists]. 

*[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin]
*[http://www.open-power-system-data.org Open Power System Data] is developing a daata platform with open source scripts (based on Python and Jupyter Notebooks) for data on generation capacities, power plants and load timeseries. Project running until 07/2017. Data platform currently in beta testing phase (as of 03/2016)

 

== Data organization ideas ==

*<span id="docs-internal-guid-154daf3c-a714-76df-26f2-8a392ea8c33d" style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">A scheme similar to [http://us-city.census.okfn.org/ http://us-city.census.okfn.org/]<span style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">might be useful for mapping out what types of data are available where

Data

2016-03-21T10:39:21Z

Martin Jahn: /* Meta */

Data

2016-02-24T15:55:24Z

Martin Jahn: /* Meta */

Data

2016-02-24T15:54:19Z

Martin Jahn: /* Meta */

Open Energy Modelling Workshop - London 2015

2015-08-03T14:21:52Z

Martin Jahn: /* Participants */

'''[http://www.openmod-initiative.org/ openmod initiative main homepage]''' 

Energy models are widely used for policy advice and research. They serve to answer questions on energy policy, decarbonization, and transitions towards renewable energy sources. Yet, most energy models are black boxes – even to fellow researchers. This is what we want to change. We are a group of modellers from various universities and research institutes who want to promote open energy modelling. We believe that Open Source models and Open Data will advance knowledge and lead to better energy policies. Our mission is to enable Open Source energy modelling by providing a platform for collaboration as well as tools along the full value chain of energy economics and energy system models. That is why we founded the Open Energy Modelling Initiative (openmod initiative) just a year ago. You are welcome to join us for our next workshop!

After two extremely fruitful and encouraging workshops in Berlin ([[Founding workshop|Sept 2014]], [[2nd Open Energy Modelling Workshop|April 2015]]), we will have our next workshop in London with an even more international focus. The aim is to give researchers a chance to present their own contributions to the field of open energy modelling and data, as well as to provide a forum to exchange ideas and work on concrete projects of the openmod initiative and more generally in the field of open energy modelling and data.

'''In order to sign up, please register on the Wiki, scroll all the way down to the participant list and add yourself. Please also feel free to add an idea for a presentation to the list below or propose break out sessions. Finally, please [https://groups.google.com/forum/#!forum/openmod-initiative join our mailing list] to receive updates.'''

 

[[File:The Royal School of Mines building on Imperial College London's South Kensington Campus.jpg|left|300px|Imperial College, Royal School of Mines|alt=Imperial College, Royal School of Mines|link=]]

'''3rd Open Energy Modelling Workshop''' London, Imperial College 10/11 September 2015 Imperial College, Royal School of Mines Building Map: [https://goo.gl/maps/zZu3T https://goo.gl/maps/zZu3T] Begin: Thursday (10 September) 10.00 End: Friday (11 September) 16:00

Registration deadline: 10th August 2015

 

Accommodation option: [http://www3.imperial.ac.uk/summeraccommodation Imperial College student halls of residence] can be booked as a bed and breakfast.

 [[File:Grantham Institute Logo.jpg|left|250px|Imperial College, Royal School of Mines|alt=Imperial College, Royal School of Mines|link=]]

The workshop is hosted by the [http://www.imperial.ac.uk/grantham Grantham Institute - Climate Change and the Environment].

 

 

 

== Ideas for Presentations ==

If you would like to make a presentation at the workshop, please add your name and proposed title to the list below.  All suggestions are welcome!

 

*High Quality Wind Data for Energy Systems Models: Bias Correction and EU-wide Validation (Iain Staffell) 
*Renewables.ninja - an open access platform for solar and wind simulations (live walkthrough, Q&A) (Stefan Pfenninger) 
*The DESSTINEE Model for Demand for Energy Services, Supply and Transmission of Electricity IN EuropE, a simple open-source excel model for performing EU-wide electricity market simulations (Iain Staffell) 
*Using reanalysis data to design optimal portfolios of renewable energies for Brazil  (Johannes Schmidt)
*[https://github.com/tum-ens/urbs urbs] and [https://github.com/ojdo/rivus rivus], two energy system optimisation models based on the Python/Pyomo/Pandas stack. One year of development and (new) user experiences.
*The design of NEMO, an open source electricity modelling tool (Ben Elliston, remote presentation)
*Presentation of the open source network model SciGRID: lessons learned so far (Wided Medjroubi, NEXT ENERGY)
*'''[Add your idea here!]'''

 

 

 

 

 

 

 

== Ideas for break-out-groups ==

If you would like to discuss a topic at the workshop, please add your name and proposed theme to the list below.  Please feel free to add to existing topics or suggest your own - all suggestions are welcome!

 

*Next generation climate models: applying higher resolution and future simulated time series to interesting energy problems 
**What modelling groups / data sets are there?
**What can and can't be answered with these? 

 

*Establish a conference on (open) energy system modeling
**Possibility of organising an Openmod session at the 2016 London Energy Systems conference (Iain)

 

*Renewables.ninja hackathon (Stefan / Iain)
**What other simulation modules could be added to Renewables.ninja?
**What would people like to see / could they add (e.g. hydro resource, electricity demand, high resolution heat and transport demand, temperature, heating and cooling degree days, etc.)

 

*Use of models in government (ideally someone from DECC / Ofgem) 
**What are government agencies looking for?
**How to get open models into government processes - what is preventing their uptake?

 

*Use of models in industry (Catalina Spataru)

 

*Wiki model factsheet: which models are good for which task? (anybody interested in leading this?) 
**We have a growing list of models - can we create a guide on picking a model, for users that are looking to solve a specific problem?

 

*Weather data for energy modelling (Iain) 
**Bring together meteorologists who produce reanalyses and those who use this data for energy systems models 
**Brainstorm new applications or big questions that can be answered with this (perhaps with the aim of a joint paper / proposal)

 

*Modelling energy storage and demand-side response (Paul D)
**Probably the most difficult set of technologies to model and understand
**Generally modelled badly or not at all by energy system models
**DSR is ignored by many models

 

*Wind capacity potentials
**Assess different open land usage databases
**Free software (QGIS etc.) for determining suitability of sites for wind development (distance from buildings, exclusion of nature reserves, etc.)
**Predicting where wind will be built based on e.g. resource-dependent feed-in tariffs

 

*Modelling hydroelectricity
**Incorporating precipitation and snow melt weather data
**Models for run-of-river, storage dams with inflow, pumped storage and mixed variants
**Getting Scandinavian/Alpine hydro markets right

 

*Open Access Publishing in the field of energy system modeling
**Are there any good possibilities
**Sharing experiences
**Possibilities to launch an own new fully open access journal?

 

*Pushing the open energy modeling article forward 

 

*Modelling demand curves for other energy sectors: electrified heating/cooling and transport
**Open modelling of heat pump/electrical heating/air conditioning demand based on temperature data
**Modelling of transport demand

 

*'''[Add your ideas here!]''' 

 

 

 

 

== Break out groups from last workshop ==

Some of these groups may wish to continue based on the outcomes from the last workshop:

*Transparency checklist for scenarios (Felix) [[:File:Openmod-Transparency Energy Scenarios-Breakout.pdf|Kickoff slide]] | [https://docs.google.com/document/d/1iWV6HNLcuU3NaTLQnIHYFAIIWEnt-Db-FCSg-SJTTyU/edit Results]
*Model fact sheets and website (Jörn) [[:File:Openmod-Website-Breakout.pdf|Kickoff slide]] | [https://docs.google.com/document/d/1f0UFdvb4QM1VNAWYVdWpHnYIttl9n4GApNA-jITvwpI/edit Results]
*Which license fits my model? (Frauke) [[:File:Openmod whichLicenseFits-breakout.pdf|Kickoff slide]] | [https://docs.google.com/document/d/1x8BH1Ev53d6MY8y72cXtbw24uCLk4vaHy2JtGW_iSws/edit Results]
*Open energy system data - concrete steps for collaboration (Simon S) [[:File:Openmod-Concrete steps for open data collaboration-Breakout.pdf|Openmod-Concrete steps for open data collaboration-Breakout.pdf]] | [https://docs.google.com/document/d/179Y1f9U_FuDMWQOJu8Q_1HbUZyzkH52YGws3h4ztk_A/edit# Results]
*Unique identifies for European power plants: how to we get there? (Chris) [https://docs.google.com/document/d/1CL8jKuPkGOLKijcwqxtlTz8-Y0EEN0guGPjs6Vo3OcQ/edit?usp=sharing Results]
*Open energy system data - concrete steps for collaboration (Simon S) [[:File:Openmod-Concrete steps for open data collaboration-Breakout.pdf|Kickoff slide]] | [https://docs.google.com/document/d/179Y1f9U_FuDMWQOJu8Q_1HbUZyzkH52YGws3h4ztk_A/edit# Results] 
*"Best practice" catalogue for funders (Lion) [[:File:Openmod-Best practice-Breakout.pdf|Kickoff slide]] | [https://docs.google.com/document/d/1CELP_XxPqxcE_002J7Qvwz6MAJBfyVvJtSt6GWgME-4/edit Results] 
*Article on benefits and challenges of open source (Eva) [[:File:Openmod-Article-Breakout.pdf|Kickoff slide]] | [https://docs.google.com/document/d/13ZzPHsHnakOjqlDvJphw3bvEVGILYGT7unL-FI4lCmw/edit# Results]
*Weather data [https://docs.google.com/document/d/1USIAqOmEPnP7dNmECOPHIvX9ZYjTU7_ySnluHI4vZfw/edit Results]
*establish a conference on (open) energy system modeling - concrete steps (Berit) 

 

 

 

 

 

 

 

 

 

 

 

 

 

== Participants ==

Registration deadline: 10th August 2015

#Stefan Pfenninger (Imperial College London) 
#Lion Hirth (neon) 
#Ingmar Schlecht (University of Basel) 
#Iain Staffell (Imperial College Business School)
#Richard Green (Imperial College Business School)
#Johannes Dorfner (Technische Universität München)
#Clemens Gerbaulet (Technische Universität Berlin) (participation likely)
#Johannes Schmidt (University of Natural Resources and Life Sciences BOKU, Vienna)
#Ed Sharp (University College London)
#Catalina Spataru (University College London)
#Mark Barrett (University College London)
#Graeme Hawker ([[User:Graeme Hawker|profile]]) (University of Strathclyde)
#Warren Hicks (Reading University) 
#Alejandro Dávila (university of Groningen)
#Adrien Schwane (Forschungszentrum Jülich)
#Jörn Richstein (TU Delft, participation likely)
#Alice Gunn (University of Reading) 
#Abhishek Shivakumar (KTH) 
#Tom Brown (from October: Frankfurt Institute of Advanced Studies) 
#Paul Dodds (University College London, participation probably on only one day)
#James Price (UCL)
#David Kleinhans (NEXT ENERGY, participation likely)
#Wided Medjroubi (NEXT ENERGY)
#Carsten Matke (NEXT ENERGY)
#Daniel Drew (University of Reading)
#Francesco Gardumi (Politecnico di Milano)
#Daniel Crow (Imperial College) 
#Simon Tindemans (Imperial College)
#Guido Pleßmann (Reiner Lemoine Institut [someone else of the institute]) 
#Verena Viskovic (University College London)
#Daniel Huppmann (DIW Berlin)
#Martin Jahn (Europa-Universität Flensburg)
#Wolf-Dieter Bunke (Europa-Universität Flensburg)
#'''...add your name here...''' Registration is open: just [[Special:RequestAccount|register with this wiki]] and click edit on this page. 

 

[[Events|Back to events overview]] __NOTOC__