https://wiki.openmod-initiative.org/api.php?action=feedcontributions&feedformat=atom&user=Jonathan+Ammewiki.openmod-initiative.org - User contributions [en]2026-04-30T20:44:26ZUser contributionsMediaWiki 1.19.7https://wiki.openmod-initiative.org/wiki/Transmission_network_datasetsTransmission network datasets2023-12-12T15:45:55Z<p>Jonathan Amme: </p>
<hr />
<div><br />
= Network datasets by region<br/> =<br />
<br />
== Europe<br/> ==<br />
<br />
{| style="width:100%" class="wikitable sortable" cellspacing="1" cellpadding="1" border="1"<br />
|-<br />
! Name<br />
! Version<br />
! <br />
Year<br/><br />
<br />
Published<br />
<br />
! Represented year<br />
! Region<br />
! Num. Substations or Buses<br />
! Num. Lines<br />
! Contains<br />
! Direct download?<br />
! Licence<br />
! Format<br />
|-<br />
| [http://scigrid.de/ SciGRID]<br />
| 0.2<br />
| 2015<br />
| 2015<br/><br />
| Germany, but in principle whole world<br />
| 495<br />
| 825<br />
| Topology, Impedances<br />
| Yes<br />
| Apache Licence, Version 2.0 (code, documentation). ODBL (data)<br/><br />
| CSV (csvdata)<br />
|-<br />
| [http://www.powerworld.com/knowledge-base/updated-and-validated-power-flow-model-of-the-main-continental-european-transmission-network Bialek European Model]<br />
| 2<br />
| 2013<br />
| 2009<br />
| Continental Europe<br />
| 1494 buses<br />
| 2322<br />
| Topology, Impedances, Loads, Generators<br />
| Yes<br />
| Public Domain Dedication<br />
| PowerWorld, Excel<br />
|-<br />
| [http://www2.nationalgrid.com/UK/Industry-information/Future-of-Energy/Electricity-Ten-Year-Statement/ National Grid ETYS 2014 Model]<br />
| <br/><br />
| 2014<br />
| 2014<br />
| Great Britain<br />
| 365<br />
| 316<br />
| Topology, Impedances, Loads, Generators<br/><br />
| Yes<br />
| Unclear<br />
| <br/><br />
|-<br />
| [https://www.apg.at/en/Stromnetz/APG-Netz Austrian Power Network Grid]<br/><br />
| <br/><br />
| 2015<br />
| 2015<br />
| Austria<br />
| <br/><br />
| ~100<br />
| Topology, Impedances<br />
| Yes<br />
| Unclear<br />
| PDF<br />
|-<br />
| [https://www.entsoe.eu/stum/ ENTSO-E STUM]<br />
| 1<br />
| 2015 and before<br />
| 2020?<br />
| Continental Europe?<br />
| 1000s<br />
| 1000s<br />
| Topology, Impedances<br />
| Requires registration<br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Restrictive</span><br />
| CIM<br />
|-<br />
| [https://www.entsoe.eu/stum/ ENTSO-E STUM]<br />
| 2<br />
| 2015<br />
| 2030<br />
| GB, Ireland, Baltics, Finland, Continental Europe<br />
| 1000s<br />
| 1000s<br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Topology, Impedances</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Requires registration</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Restrictive</span><br />
| Excel<br />
|-<br />
| [https://www.entsoe.eu/stum/ ENTSO-E STUM]<br />
| 3<br />
| 2016<br />
| 2030<br/><br />
| GB, Ireland, Baltics, Finland, Continental Europe<br />
| 1000s<br />
| 1000s<br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Topology, Impedances</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Requires registration</span><br/><br />
| Restrictive<br/><br />
| Excel<br/><br />
|-<br />
| [https://www.entsoe.eu/stum/ ENTSO-E STUM]<br />
| 2<br />
| 2015<br />
| 2030<br />
| GB, Ireland, Baltics, Finland, Continental Europe<br />
| 1000s<br />
| 1000s<br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Topology, Impedances</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Requires registration</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Restrictive</span><br />
| Excel<br />
|-<br />
| [https://doi.org/10.5281/zenodo.3601881 PyPSA-Eur]<br />
| 0.1.0<br />
| 2020<br/><br />
| 2020<br/><br />
| GB, Ireland, Baltics, Scandinavia, Continental Europe<br/><br />
| 5000<br/><br />
| 6000<br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Topology, Impedances, Loads, Generators, Renewable Availability Time Series</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Yes</span><br/><br />
| CC BY 4.0 (Dataset), GNU GPL v3.0 (Code)<br />
| NetCDF, CSV (alternative)<br />
|}<br />
<br />
<br/><br />
<br />
=== SciGRID ===<br />
<br />
[http://scigrid.de/ SciGRID] is a project which started in 2014 and will be running for three years. The aim of SciGRID is to develop an open and free model of the European transmission network based on data from the [http://www.openstreetmap.org/ OpenStreetMap]. It is carried out by [http://www.next-energy.de/ NEXT ENERGY - EWE Research Centre for Energy Technology], an independent non-profit institute at the University of Oldenburg, Germany, and funded by the [https://www.bmbf.de/ German Ministry of Education and Research],&nbsp; and the initiative [http://forschung-stromnetze.info/ Zukunftsfähige Stromnetze].<br />
<br />
An unofficial, post-processed version of SciGRID version 0.2 for Germany with attached load, generation and transformers is available as a [https://github.com/FRESNA/PyPSA/tree/master/examples/scigrid-de PyPSA example], see also [http://pypsa.org/index.html#screenshots-and-example-jupyter-ipython-notebooks screenshots].<br/><br />
<br />
=== GridKit European Dataset ===<br />
<br />
[https://github.com/bdw/GridKit GridKit] uses spatial and topological analysis to transform map objects from [http://www.openstreetmap.org/ OpenStreetMap] into a network model of the electric power system. It has been developed in the context of the [http://scigrid.de/ SciGRID] project at the [http://www.next-energy.de/ NEXT ENERGY - EWE Research Centre for Energy Technology], to investigate the possibility of 'heuristic' analysis to augment the route-based analysis used in [http://scigrid.de/ SciGRID]. This has been implemented as a series of scripts for the PostgreSQL database using the PostGIS spatial extensions.<br />
<br />
[https://zenodo.org/record/47317 Data extracts] are provided for Europe and North America in a similar CSV format to [http://scigrid.de/ SciGRID].<br />
<br />
=== osmTGmod Model<br/> ===<br />
<br />
[https://github.com/maltesc/osmTGmod osmTGmod] is a load-flow model of the German transmission-gird, based on the free geo-database [http://www.openstreetmap.org/ OpenStreetMap] (OSM). The model, respectively the heuristic abstraction process employs a PostgreSQL-database extended by PostGIS. The key part of the abstraction process is implemented in SQL and ProstgreSQL's procedural language pl/pgSQL. The abstraction and all additional modules are controlled by a Python-environment.<br />
<br />
=== Bialek European Model<br/> ===<br />
<br />
The 2nd version of the [http://www.powerworld.com/knowledge-base/updated-and-validated-power-flow-model-of-the-main-continental-european-transmission-network Bialek European Model] is downloadable as an Excel file and in the format of the proprietary modelling software [http://www.powerworld.com/ PowerWorld]. The model covers voltages from 110 kV (a single line in the Balkans) up to 380 kV. It is released under a Public Domain Dedication.<br/><br />
<br />
The 1st version was released in 2002-2004 and is no longer available (see [http://web.archive.org/web/20100525115039/http://www.see.ed.ac.uk/~jbialek/Europe_load_flow/ Archive mirror]). The 1st version did not contain the Balkans region.<br />
<br />
The methodology and validation for the 1st version of the model can be found in the paper [http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=1425573 Approximate model of European interconnected system as a benchmark system to study effects of cross-border trades] by Zhou and Bialek, 2005.<br />
<br />
The model contains the impedances and number of circuits of each line, but not the length (which can in principle be determined from the impedance and number of circuits, given standard line parameters). Only cross-border lines are assigned thermal capacities.<br />
<br />
There is currently no coordinate dataset for the buses. The PowerWorld file contains spatial data, but in an unknown projection. The [https://github.com/nworbmot/georef-bialek/ georef-bialek github project] is an attempt to fix this; there is also a [https://zenodo.org/record/35177 geo-referenced version] from Tue Vissing Jensen.<br />
<br />
=== DIW ELMOD-DE open model of Germany ===<br />
<br />
[http://www.diw.de/de/diw_01.c.528493.de/forschung_beratung/nachhaltigkeit/umwelt/verkehr/energie/modelle/elmod.html#ELMOD-DE ELMOD-DE] is an open model of the German electricity system developed at DIW and TU Berlin, which includes both a model of the high voltage transmission network, power plants, hourly load and weather data for the year 2012 and GAMS code to run linear optimisation simulations. It contains 438 geo-referenced network nodes and 697 transmission lines at 380 kV and 220 kV. Transformers are not modelled but per unit line series impedances are adjusted to the voltage level.<br />
<br />
The model includes 47 pages of documentation.<br />
<br />
The transmission data was, according to the documentation, derived from the VDE and TSO maps and from [http://www.openstreetmap.org/ OpenStreetMap]. The data is provided as-is without the code that generated it.<br />
<br />
=== National Grid Model ===<br />
<br />
[http://www2.nationalgrid.com/UK/Industry-information/Future-of-Energy/Electricity-Ten-Year-Statement/ National Grid Electricity Ten Year Statement 2014 Model]<br />
<br />
Shapefiles and maps of tower, lines, cables and substations [https://www.nationalgridet.com/network-and-assets/network-route-maps here].<br/><br />
<br />
=== Austrian Power Network Grid Model<br/> ===<br />
<br />
[https://www.apg.at/en/Stromnetz/APG-Netz Austrian Power Network Grid]<br/><br />
<br />
<br/><br />
<br />
=== Danish Power Network Grid Model<br/> ===<br />
<br />
[https://en.energinet.dk/Electricity/Energy-data/System-data Danish Transmission network data]<br />
<br />
The data are not directly available, but rather a [https://en.energinet.dk/About-us/Registrations/Formular056 registration form] is required before obtaining access.<br />
<br />
It has features not present in the ENTSO-E STUM (see below):<br />
<br />
*It's a full non-linear model with all the reactive power demand, P and Q capabilities of gens and shunt reactive power compensation.<br />
*It lists the power capabilities of the generators and their fuel type (wind/solar/gas etc), not just the dispatch.<br />
*They seem to have separated RE feed-in from the load, which wasn't the case for STUM where wind and solar are lumped with the load as residual load.<br />
<br />
What's missing are geocoordinates for the substations (which can be read off roughly from the JPG map) and time-dependence of the loads and/or variable generators. For Denmark, which has many CHP units, it would also be useful to know the heat demand and how the CHP units are operated.<br />
<br />
<br/><br />
<br />
=== RTE Network Dataset for France<br/> ===<br />
<br />
[https://clients.rte-france.com/lang/an/visiteurs/vie/indispos_caracteristiques_statiques.jsp RTE network dataset]<br />
<br />
=== Elia Network Dataset for Belgium ===<br />
<br />
[http://www.elia.be/en/grid-data/Grid-Technical-Data Elia network dataset]<br />
<br />
=== TenneT NL Network Dataset for the Netherlands<br/> ===<br />
<br />
[http://www.tennet.org/english/operational_management/transmission_services/Calculated_crossborder_cap/explanatory_documents.aspx TenneT NL]<br />
<br />
=== TenneT DE Network Dataset for Central Germany<br/> ===<br />
<br />
[http://www.tennettso.de/site/Transparenz/veroeffentlichungen/statisches-netzmodell/statisches-netzmodell Tennet DE]<br/><br />
<br />
=== Amprion Network Dataset for Western Germany<br/> ===<br />
<br />
[https://www.amprion.net/Energy-Market/Congestion-Management/Static-Grid-Model/ Amprion], [https://www.amprion.net/Netzausbau/Interaktive-Karte/ interactive map] of the grid extension projects<br/><br />
<br />
=== TransnetBW Network Dataset for Southwest Germany<br/> ===<br />
<br />
[https://www.transnetbw.de/de/strommarkt/engpassmanagement/standards-zukunft TransnetBW]<br/><br />
<br />
=== 50 Hertz Network Dataset for Eastern Germany<br/> ===<br />
<br />
[https://www.50hertz.com/de/Transparenz/Kennzahlen/StatischesNetzmodell 50 Hertz statistisches Netz]<br/><br />
<br />
<br/><br />
<br />
=== Ceps Network Dataset for <span lang="EN-GB">Czec</span>h Republic<br/> ===<br />
<br />
[https://www.ceps.cz/ENG/Cinnosti/Technicka-infrastruktura/Pages/Udaje-o-PS.aspx CEPS]<br/><br />
<br />
=== ENTSO-E Interactive Grid Map ===<br />
<br />
ENTSO-E announced its [https://www.entsoe.eu/map/Pages/default.aspx Interactive ENTSO-E Transmission Network Map] in March 2016.<br />
<br />
The map uses [http://www.openstreetmap.org/ OpenStreetMap] as a background and [https://www.mapbox.com/about/maps/ Mapbox] for displaying the map data.<br />
<br />
The map is based on the ENTSO-E static grid map, which is based on the TSOs' own maps. It is known to be an approximate artistic representation rather than an accurate geographical map. Some power plants may be incorrectly labelled (e.g. fuel type may not be accurate).<br />
<br />
The map includes information on the number of circuits and the voltage levels of transmission lines.<br />
<br />
Information, including all geographical coordinates, can be extracted from the web API, but requires further topological processing to be turned into an electrical network model. Lines need to be connected, etc. The [https://github.com/bdw/GridKit GridKit] project provides code for this purpose and has released an [https://zenodo.org/record/55853 unofficial dataset], which forms an electrical network model complete with buses, links, generators and transformers, full geographic coordinates, as well as all electrical metadata contained in the ENTSO-E map.<br />
<br />
=== ENTSO-E Static Grid Map ===<br />
<br />
ENTSO-E releases [https://www.entsoe.eu/publications/order-maps-and-publications/electronic-grid-maps/Pages/default.aspx maps of the European transmission grid], both electronically and in paper form.<br />
<br />
The maps for the whole ENTSO-E system are in the projection [http://prj2epsg.org/epsg/3034 EPSG 3034], which is a [https://en.wikipedia.org/wiki/Lambert_conformal_conic_projection Lambert Conformal Conic projection]. The lower left corner is approximately at (lon,lat) = (-9.5,28) and the upper left corner is at (75.5,58.5). This was checked in the [https://github.com/nworbmot/georef-bialek/ georef-bialek github project].<br />
<br />
=== ENTSO-E STUM ===<br />
<br />
ENTSO-E makes available a model of the European transmission system. Registration is required to download it on the [https://www.entsoe.eu/stum/ ENTSO-E STUM] page. It is not totally clear what one may and may not do with it (e.g. whether it is possible to publish results derived from it or an aggregation of the nodes, etc.).<br />
<br />
The first version of the model was released in the CIM XML-based format for the old UCTE area. The model was a winter snapshot for 2020, including TYNDP projects. The node names were obscured so that the model was unusable. Line capacities were missing.<br />
<br />
The second version, published in June 2015 as Excel spreadsheets, is more useful. It contains the whole ENTSO-E area with the exception of Norway, Sweden, Cyrus and Iceland. The node names are the same as those used by the TSOs. Quoting from the documentation: "It represents the power system of the ENTSO-E members for 2030 in Vision I of the TYNDP 2014", i.e. it includes planned TYNDP projects. It includes all nodes, lines, transformers and aggregated loads and generators at each node for one snapshot. Line data includes series reactance and resistance, but not line length or capacity or number of circuits or wires per circuit bundle. Geolocation data for the nodes is missing. Node names are recognisable from the substation names on the ENTSO-E map. The model is intended for a linear load flow only. It is not clear which wind/solar/load snapshot the model represents (it is an "exemplary scenario"). Generators are not distinguished by generation source.<br />
<br />
The third version, published in February 2016 as Excel spreadsheets has in addition thermal ratings for most transformers and most transmission lines, along with reactive power feed-in, consumption and compensation, so that a full non-linear power flow can be run on the grid.<br />
<br />
=== ENTSO-E Initial Dynamic Model of Continental Europe ===<br />
<br />
[https://www.entsoe.eu/publications/system-operations-reports/continental-europe/Initial-Dynamic-Model/Pages/default.aspx ENTSO-E Initial Dynamic Model of Continental Europe]<br />
<br />
Requires registration. Can model "the main frequency response of the system as well as the main inter-area oscillation modes".<br />
<br />
=== Core Static grid model by Joint Allocation Office ===<br />
<br />
From the handbook:&nbsp;<br />
<br />
The Core Static Grid Model is a list of relevant grid elements of the transmission system, including their electrical properties, that is published every six months by the Core TSOs in accordance with Article 25(2)(f) of the Day-ahead capacity calculation methodology of the Core capacity calculation region.<br />
<br />
It consists of an Excel table with a list of relevant grid elements of the transmission system of Core TSOs, including their electrical properties.<br />
<br />
[https://www.jao.eu/static-grid-model https://www.jao.eu/static-grid-model]<br />
<br />
=== Flow-based market coupling data by Joint Allocation Office ===<br />
<br />
The joint allocation office hosts various official data (including [http://utilitytool.jao.eu/CascUtilityWebService.asmx?op=GetPTDFEarlyPublicationForAPeriod PTDFs]) around the Flow-based market coupling algorithm in use in Europe.<br />
<br />
[http://utilitytool.jao.eu/ http://utilitytool.jao.eu/]<br />
<br />
[http://utilitytool.jao.eu/CascUtilityWebService.asmx http://utilitytool.jao.eu/CascUtilityWebService.asmx]<br />
<br />
=== PyPSA-Eur: An Open Optimisation Model of the European Transmission System ===<br />
<br />
PyPSA-Eur is a model/dataset of the European power system at the transmission network level.<br />
<br />
The transmission network data is based on a cleaned up extraction of the [https://www.entsoe.eu/map/Pages/default.aspx Interactive ENTSO-E Transmission Network Map], extracted using [https://github.com/bdw/GridKit GridKit].<br />
<br />
The model covers the ENTSO-E area and contains all alternating current lines at and above 220 kV voltage level and all high voltage direct current lines, substations, an open database of conventional power plants, time series for electrical demand and variable renewable generator availability, and geographic potentials for the expansion of wind and solar power.<br />
<br />
The model only includes freely available and open data. It provides a fully automated free software pipeline to assemble the load-flow-ready model from the original datasets. The model is suitable both for operational studies and generation and transmission expansion planning studies.<br />
<br />
Current versions of the code and dataset can be found on zenodo:<br />
<br />
*[https://zenodo.org/record/3603127#.Xhcvdtl7m0I https://zenodo.org/record/3603127#.Xhcvdtl7m0I] (Code)<br />
*[https://zenodo.org/record/3601882#.XhcvqNl7m0J https://zenodo.org/record/3601882#.XhcvqNl7m0J] (Dataset)<br />
<br />
Documentation is available at [https://pypsa-eur.readthedocs.io https://pypsa-eur.readthedocs.io]<br />
<br />
Development takes place on Github at [https://github.com/pypsa/pypsa-eur https://github.com/pypsa/pypsa-eur]<br />
<br />
The netcdf files (.nc) can be imported with PyPSA. Documentation for this is available at [https://pypsa.readthedocs.io/en/latest/import_export.html#import-from-netcdf https://pypsa.readthedocs.io/en/latest/import_export.html#import-from-netcdf].<br />
<br />
Some basic validation is provided in a paper describing the dataset:<br />
<br />
Jonas Hörsch, Fabian Hofmann, David Schlachtberger, and Tom Brown. PyPSA-Eur: An open optimisation model of the European transmission system. Energy Strategy Reviews, 22:207-215, 2018. [https://arxiv.org/abs/1806.01613 https://arxiv.org/abs/1806.01613], [https://doi.org/10.1016/j.esr.2018.08.012 https://doi.org/10.1016/j.esr.2018.08.012].<br />
<br />
<br/><br />
<br />
== Australia<br/> ==<br />
<br />
[https://data.gov.au/dataset/ds-ga-1185c97c-c042-be90-e053-12a3070a969b/details?q=national Lines] and [https://data.gov.au/dataset/ds-ga-13be62a4-4fe3-f812-e053-12a3070a22be/details?q=national substations]<br />
<br />
<br/><br />
<br />
== United States<br/> ==<br />
<br />
There is a [https://hifld-geoplatform.opendata.arcgis.com/datasets/geoplatform::electric-power-transmission-lines/about shapefile of the electric power transmission lines] (69+ kV) in the contiguous US available from the Homeland Infrastructure Foundation Level Database.<br/><br />
<br />
There is raster graphic of the US transmission grid at [https://www.e-education.psu.edu/geog469/book/export/html/111 https://www.e-education.psu.edu/geog469/book/export/html/111].<br/><br />
<br />
=== Western Electricity Coordinating Council ===<br />
<br />
Apparently there is a a WECC Transmission Expansion Planning Policy Committee (TEPPC) 2024 Common Case GridView dataset, but the exact link seems elusive.<br />
<br />
The WECC [https://www.wecc.biz/TransmissionExpansionPlanning/Pages/Datasets.aspx Transmission Expansion Planning] has links to Excel files.<br />
<br />
=== Western US Power Grid ===<br />
<br />
The [http://nexus.igraph.org/api/dataset_info?id=15&format=html Western US Power Grid dataset] has 4941 nodes and 6594 lines, but apparently these are not well enough labelled to distinguish where and what the nodes/lines are.<br/><br />
<br />
=== GridKit North American Dataset ===<br />
<br />
[https://github.com/bdw/GridKit GridKit] uses spatial and topological analysis to transform map objects from [http://www.openstreetmap.org/ OpenStreetMap] into a network model of the electric power system. It has been developed in the context of the [http://scigrid.de/ SciGRID] project at the [http://www.next-energy.de/ NEXT ENERGY - EWE Research Centre for Energy Technology], to investigate the possibility of 'heuristic' analysis to augment the route-based analysis used in [http://scigrid.de/ SciGRID]. This has been implemented as a series of scripts for the PostgreSQL database using the PostGIS spatial extensions.<br />
<br />
[https://zenodo.org/record/47317 Data extracts] are provided for Europe and North America in a similar CSV format to [http://scigrid.de/ SciGRID].<br />
<br />
=== US grid dataset by Breakthrough Energy ===<br />
<br />
US grid dataset by Bill Gates' Breakthrough Energy<br />
<br />
*[https://science.breakthroughenergy.org/ https://science.breakthroughenergy.org/]<br />
*Dataset: [https://zenodo.org/record/3905429 https://zenodo.org/record/3905429]<br />
*[https://arxiv.org/abs/2002.06155 https://arxiv.org/abs/2002.06155]<br />
<br />
<br/><br />
<br />
== Global ==<br />
<br />
=== OpenStreetMap ===<br />
<br />
The global OpenStreetMap (OSM) power grid data is visible at [http://www.itoworld.com/map/4 ITO World Electricity Distribution] and [http://enipedia.tudelft.nl/ Enipedia] has [http://enipedia.tudelft.nl/OpenStreetMap/ nightly extracts of the power grid from OSM].<br />
<br />
=== GridKit Datasets ===<br />
<br />
[https://github.com/bdw/GridKit GridKit] uses spatial and topological analysis to transform map objects from [http://www.openstreetmap.org/ OpenStreetMap] into a network model of the electric power system. It has been developed in the context of the [http://scigrid.de/ SciGRID] project at the [http://www.next-energy.de/ NEXT ENERGY - EWE Research Centre for Energy Technology], to investigate the possibility of 'heuristic' analysis to augment the route-based analysis used in [http://scigrid.de/ SciGRID]. This has been implemented as a series of scripts for the PostgreSQL database using the PostGIS spatial extensions.<br />
<br />
[https://zenodo.org/record/47317 Data extracts] are provided for Europe and North America in a similar CSV format to [http://scigrid.de/ SciGRID].<br />
<br />
=== IRENA OpenStreetMap Extract ===<br />
<br />
See [http://globalatlas.irena.org/NewsDetailPublic.aspx?id=2278 IRENA News Announcement]<br/><br />
<br />
=== PLEXOS-World ===<br />
<br />
<span style="font-size: 13.6px; background-color: rgb(255, 255, 255);">A global dataset of Net Transfer Capacities between countries and sub-regions as retrieved for the global power system model PLEXOS-World based on the 2015 calendar year is openly available. The dataset can be retrieved at the dedicated&nbsp;</span>[https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/CBYXBY PLEXOS-World Harvard Dataverse.]<br/><br />
<br />
<br/><br />
<br />
== Non-Region Specific ==<br />
<br />
=== University of Washington Power Systems Test Case Archive ===<br />
<br />
[http://www.ee.washington.edu/research/pstca/ Power Systems Test Case Archive]<br />
<br />
=== IEEE PES Power Grid Library ===<br />
<br />
[https://power-grid-lib.github.io/ Overview]<br />
<br />
[https://github.com/power-grid-lib/pglib-opf Optimal Power Flow Cases]<br />
<br />
=== RWTH Aachen Transmission Expansion Problem Benchmark Case ===<br />
<br />
RWTH Aachen has published [http://www.ifht.rwth-aachen.de/en/tep A Benchmark Case for Network Expansion], which is "derived from the IEEE 118 bus network and modified in accordance with European standards such as a nominal frequency of 50Hz, the use of conventional voltage levels, and conductor dimensions."<br />
<br />
Registration is required to download the model.<br />
<br />
The paper describing the model is [http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=7232601 A benchmark case for network expansion methods], 2015.<br />
<br />
= Other lists of network datasets =<br />
<br />
*[http://enipedia.tudelft.nl/wiki/Electricity_Transmission_Network Enipedia list]<br />
<br />
*[http://enipedia.tudelft.nl/OpenStreetMap/ Nightly extracts of the power grid from OpenStreetMap]<br />
**See the maps at [http://www.itoworld.com/map/106 ITO World Electricity Generation] and [http://www.itoworld.com/map/4 ITO World Electricity Distribution] for a visual overview of what this covers.<br />
**This data is fed into the [http://enipedia.tudelft.nl/Elasticsearch.html search page here] where you locate data on individual power plants.<br />
<br />
*[http://www.maths.ed.ac.uk/optenergy/data/Summary.pdf Edinburgh University list]<br />
<br />
*[https://github.com/ComplexNetTSP/ComplexNetWiki/wiki/2.2.3-PowerGrid- Github repository] of several transmission network models<br/><br />
<br />
*[https://github.com/caesar0301/awesome-public-datasets#complex-networks Github list of complex network datasets]<br />
<br />
<br/><br />
<br />
= Free software for power system analysis =<br />
<br />
[https://github.com/rwl/PYPOWER PyPower] in Python<br/><br />
<br />
[https://github.com/FRESNA/PyPSA PyPSA]: Python for Power System Analysis<br />
<br />
[https://bitbucket.org/harald_g_svendsen/powergama/wiki/Home PowerGAMA] in Python<br />
<br />
[http://www.pserc.cornell.edu/matpower/ MATPOWER] in Matlab or Octave<br />
<br />
[http://sourceforge.net/projects/electricdss/ OpenDSS] in Delphi<br />
<br />
[http://faraday1.ucd.ie/psat.html PSAT] in Matlab or Octave<br />
<br />
[https://github.com/lanl-ansi/PowerModels.jl PowerModels.jl] in Julia<br />
<br />
[https://github.com/wheitkoetter/AutoGridComp AutoGridComp] in Python for the comparison of power grid models<br />
<br />
'''Other lists of power system analysis software'''<br />
<br />
[https://wiki.openelectrical.org/index.php?title=Power_Systems_Analysis_Software https://wiki.openelectrical.org/index.php?title=Power_Systems_Analysis_Software]<br />
<br />
[https://nkloc.wordpress.com/2011/11/11/power-system-simulation-software-list/ https://nkloc.wordpress.com/2011/11/11/power-system-simulation-software-list/]<br />
<br />
[http://www2.econ.iastate.edu/tesfatsi/ElectricOSS.htm http://www2.econ.iastate.edu/tesfatsi/ElectricOSS.htm]<br />
<br />
<br/><br />
<br />
= Typical electrical parameters for transmission infrastructure =<br />
<br />
== Calculating cable impedances ==<br />
<br />
<span style="font-size: 0.85em;">see [https://www.siechem.com/tech-support/impedance-2/ https://www.siechem.com/tech-support/impedance-2/] (</span>[http://www.openelectrical.org/wiki/index.php?title=Cable_Impedance_Calculations http://www.openelectrical.org/wiki/index.php?title=Cable_Impedance_Calculations], link is broken)<span style="font-size: 0.85em;">&nbsp;and electrical engineering textbooks.</span><br />
<br />
<br/><br />
<br />
'''Referring impedances, i.e.&nbsp;<span style="color: rgb(32, 33, 34); font-family: sans-serif; font-size: 14px; background-color: rgb(255, 255, 255);">convert impedances from one voltage to another</span>:&nbsp;'''<br />
<br />
see [http://openelectrical.org/index.php?title=Referring_Impedances http://openelectrical.org/index.php?title=Referring_Impedances]<br/><br />
<br />
<br/><br />
<br />
== Generalities on overhead alternating current transmission lines ==<br />
<br />
=== Three-phase power ===<br />
<br />
In almost all of the world electrical power is transmitted using alternating current with three phases separated by 120 degrees, see [https://en.wikipedia.org/wiki/Three-phase_electric_power Wikipedia: Three-phase electric power].<br />
<br />
For this reason the cables on power lines are bundled in groups of three.<br />
<br />
(Exceptions include: direct current power lines and some [https://en.wikipedia.org/wiki/Railway_electrification_system transmission systems for supplying trains], which are e.g. in Germany two-phase and at 16.7 Hz.)<br />
<br />
Current I and current limits are almost always quoted per phase.<br />
<br />
Voltage in the transmission system is almost always quoted as the phase-to-phase potential difference, often called line-to-line voltage V_{LL}, since this is the easiest value to measure. It is related to the line-to-ground or line-to-neutral potential difference V_{LN} by V_{LL} = \sqrt{3} V_{LN}.<br />
<br />
The apparent power transported in each phase is give by I*V_{LN}, so that for a complete transmission circuit the power is three times this value:<br />
<br />
S = 3*I*V_{LN} = \sqrt(3)*I*V_{LL}<br />
<br />
Often it is assumed that the voltage and current magnitudes are the same in each phase, i.e. that the system is balanced and symmetric. This should be the case in the normal operation of the transmission system. The impedances and limits below are quoted assuming that the system is balanced, so that only positive sequence impedances are given. See [https://en.wikipedia.org/wiki/Symmetrical_components Wikipedia: Symmetrical components].<br />
<br />
In an unbalanced system, the three phases can be described using the positive-, negative- and zero-sequence components, where the impedances are different for each sequence.<br />
<br />
=== Bundled conductors ===<br />
<br />
See [https://en.wikipedia.org/wiki/Overhead_power_line#Bundle_conductors Wikipedia: Overhead power line: Bundle conductors].<br />
<br />
Often the conducting wires for each phase are separated into bundles of several parallel wires, connected at intervals by spacers. This has several advantages: the higher surface area increases the current-carrying capacity, which is limited by the [https://en.wikipedia.org/wiki/Skin_effect skin effect], it reduces inductance and it helps to cool the wires.<br />
<br />
=== Circuits ===<br />
<br />
Each group of three phases is called a circuit. Power-carrying capability can be increased by having several circuits on a single pylon, so that wire bundles always appear in multiples of 3 in power lines.<br />
<br />
<br/><br />
<br />
== European 50 Hz transmission lines ==<br />
<br />
The main European alternating current (AC) electricity system is operated at 50 Hz. (Other networks, such as those for electrified trains, operate at other frequencies and some transmission lines use direct current.)<br />
<br />
On the continent AC transmission voltages are typically 220 kV or 380 kV (sometimes quoted as 400 kV, since network operators often run their grid above nominal voltage to reduce network losses).<br />
<br />
220 kV overhead lines are typically configured with a bundle of 2 wires per phase with wires of cross-section Al/St 240/40.<br />
<br />
380 kV overhead lines are typically configured with a bundle of 4 wires per phase with wires of cross-section Al/St 240/40.<br />
<br />
We now list the impedances of the transmission lines, which can be used for example in the [http://www.electrical4u.com/medium-transmission-line/ lumped pi model].<br />
<br />
{| style="width:100%" class="wikitable sortable" cellspacing="1" cellpadding="1" border="1"<br />
|+ Electrical properties for single circuits<br />
|-<br />
! scope="col" | Voltage level (kV)<br />
! scope="col" | Type<br />
! scope="col" | Conductors<br />
! scope="col" | Series resistance (Ohm/km)<br />
! scope="col" | Series inductive reactance (Ohm/km)<br />
! scope="col" | Shunt capacitance (nF/km)<br />
! scope="col" | Current thermal limit (A)<br />
! scope="col" | Apparent power thermal limit (MVA)<br />
|-<br />
| 220<br />
| Overhead line<br />
| 2-wire-bundle Al/St 240/40<br />
| 0.06<br />
| 0.301<br />
| 12.5<br />
| 1290<br />
| 492<br />
|-<br />
| 380<br />
| Overhead line<br />
| 4-wire-bundle Al/St 240/40<br />
| 0.03<br />
| 0.246<br />
| 13.8<br />
| 2580<br />
| 1698<br />
|}<br />
<br />
In the table the thermal limit for the current is calculated as 645 A per wire at an outside temperature of 35&nbsp;degrees Celsius, wind speed of 0.6 m/s and solar insolation typical for Germany.<br />
<br />
The thermal limit for the apparent power S is derived from the per-phase current limit I and the line-to-line voltage V by S = \sqrt{3}VI.<br />
<br />
Sources for the electrical parameters:<br />
<br />
Oeding and Oswald [http://www.springer.com/us/book/9783642192456 Elektrische Kraftwerke und Netze], 2011, Chapter 9<br />
<br />
See also comparable parameters in:<br />
<br />
*[http://www.dena.de/fileadmin/user_upload/Projekte/Energiesysteme/Dokumente/denaVNS_Abschlussbericht.pdf DENA Distribution Network Study], 2012, Table 5.6<br />
*[https://www.diw.de/documents/publikationen/73/diw_01.c.440963.de/diw_datadoc_2014-072.pdf DIW Data Documentation 72], 2014, Table 15, taken from Kießling, F., Nefzger, P., Kaintzyk, U., "Freileitungen: Planung, Berechnung, Ausführung", 2001, Springer<br />
*[https://www.zml.kit.edu/downloads/Elektrische_Energieuebertragung_Leseprobe_Kapitel_2.pdf KIT Electrical Parameters Reading Sample], 2013<br />
<br />
<br/><br />
<br />
== European 50 Hz high voltage transformers ==<br />
<br />
Typical 380/220 kV transformers have a nominal power of around 400-500 MVA and a per unit series reactance of around 0.08-0.1.<br />
<br />
#TODO: references<br />
<br />
== Combining electrical parameters for multiple circuits ==<br />
<br />
In the table above, the impedances are quoted for a single circuit. The resistance and inductive reactance decrease proportional to the number of parallel circuits (with small modifications to the inductance due to the different geometry of the parallel circuits). Similarly the capacitance increases proportional to the number of parallel circuits (again, roughly because of changing geometry).<br />
<br />
<br/><br />
<br />
== Standard Test Test Networks ==<br />
<br />
[http://sites.ieee.org/pes-testfeeders/resources/ http://sites.ieee.org/pes-testfeeders/resources/]<br />
<br />
[https://github.com/e2nIEE/pandapower/tree/develop/pandapower/networks https://github.com/e2nIEE/pandapower/tree/develop/pandapower/networks]</div>Jonathan Ammehttps://wiki.openmod-initiative.org/wiki/Transmission_network_datasetsTransmission network datasets2023-12-12T15:40:50Z<p>Jonathan Amme: </p>
<hr />
<div><br />
= Network datasets by region<br/> =<br />
<br />
== Europe<br/> ==<br />
<br />
{| style="width:100%" class="wikitable sortable" cellspacing="1" cellpadding="1" border="1"<br />
|-<br />
! Name<br />
! Version<br />
! <br />
Year<br/><br />
<br />
Published<br />
<br />
! Represented year<br />
! Region<br />
! Num. Substations or Buses<br />
! Num. Lines<br />
! Contains<br />
! Direct download?<br />
! Licence<br />
! Format<br />
|-<br />
| [http://scigrid.de/ SciGRID]<br />
| 0.2<br />
| 2015<br />
| 2015<br/><br />
| Germany, but in principle whole world<br />
| 495<br />
| 825<br />
| Topology, Impedances<br />
| Yes<br />
| Apache Licence, Version 2.0 (code, documentation). ODBL (data)<br/><br />
| CSV (csvdata)<br />
|-<br />
| [http://www.powerworld.com/knowledge-base/updated-and-validated-power-flow-model-of-the-main-continental-european-transmission-network Bialek European Model]<br />
| 2<br />
| 2013<br />
| 2009<br />
| Continental Europe<br />
| 1494 buses<br />
| 2322<br />
| Topology, Impedances, Loads, Generators<br />
| Yes<br />
| Public Domain Dedication<br />
| PowerWorld, Excel<br />
|-<br />
| [http://www2.nationalgrid.com/UK/Industry-information/Future-of-Energy/Electricity-Ten-Year-Statement/ National Grid ETYS 2014 Model]<br />
| <br/><br />
| 2014<br />
| 2014<br />
| Great Britain<br />
| 365<br />
| 316<br />
| Topology, Impedances, Loads, Generators<br/><br />
| Yes<br />
| Unclear<br />
| <br/><br />
|-<br />
| [https://www.apg.at/en/Stromnetz/APG-Netz Austrian Power Network Grid]<br/><br />
| <br/><br />
| 2015<br />
| 2015<br />
| Austria<br />
| <br/><br />
| ~100<br />
| Topology, Impedances<br />
| Yes<br />
| Unclear<br />
| PDF<br />
|-<br />
| [https://www.entsoe.eu/stum/ ENTSO-E STUM]<br />
| 1<br />
| 2015 and before<br />
| 2020?<br />
| Continental Europe?<br />
| 1000s<br />
| 1000s<br />
| Topology, Impedances<br />
| Requires registration<br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Restrictive</span><br />
| CIM<br />
|-<br />
| [https://www.entsoe.eu/stum/ ENTSO-E STUM]<br />
| 2<br />
| 2015<br />
| 2030<br />
| GB, Ireland, Baltics, Finland, Continental Europe<br />
| 1000s<br />
| 1000s<br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Topology, Impedances</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Requires registration</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Restrictive</span><br />
| Excel<br />
|-<br />
| [https://www.entsoe.eu/stum/ ENTSO-E STUM]<br />
| 3<br />
| 2016<br />
| 2030<br/><br />
| GB, Ireland, Baltics, Finland, Continental Europe<br />
| 1000s<br />
| 1000s<br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Topology, Impedances</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Requires registration</span><br/><br />
| Restrictive<br/><br />
| Excel<br/><br />
|-<br />
| [https://www.entsoe.eu/stum/ ENTSO-E STUM]<br />
| 2<br />
| 2015<br />
| 2030<br />
| GB, Ireland, Baltics, Finland, Continental Europe<br />
| 1000s<br />
| 1000s<br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Topology, Impedances</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Requires registration</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Restrictive</span><br />
| Excel<br />
|-<br />
| [https://doi.org/10.5281/zenodo.3601881 PyPSA-Eur]<br />
| 0.1.0<br />
| 2020<br/><br />
| 2020<br/><br />
| GB, Ireland, Baltics, Scandinavia, Continental Europe<br/><br />
| 5000<br/><br />
| 6000<br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Topology, Impedances, Loads, Generators, Renewable Availability Time Series</span><br/><br />
| <span style="font-size: 13.6px; background-color: rgb(255, 255, 255)">Yes</span><br/><br />
| CC BY 4.0 (Dataset), GNU GPL v3.0 (Code)<br />
| NetCDF, CSV (alternative)<br />
|}<br />
<br />
<br/><br />
<br />
=== SciGRID ===<br />
<br />
[http://scigrid.de/ SciGRID] is a project which started in 2014 and will be running for three years. The aim of SciGRID is to develop an open and free model of the European transmission network based on data from the [http://www.openstreetmap.org/ OpenStreetMap]. It is carried out by [http://www.next-energy.de/ NEXT ENERGY - EWE Research Centre for Energy Technology], an independent non-profit institute at the University of Oldenburg, Germany, and funded by the [https://www.bmbf.de/ German Ministry of Education and Research],&nbsp; and the initiative [http://forschung-stromnetze.info/ Zukunftsfähige Stromnetze].<br />
<br />
An unofficial, post-processed version of SciGRID version 0.2 for Germany with attached load, generation and transformers is available as a [https://github.com/FRESNA/PyPSA/tree/master/examples/scigrid-de PyPSA example], see also [http://pypsa.org/index.html#screenshots-and-example-jupyter-ipython-notebooks screenshots].<br/><br />
<br />
=== GridKit European Dataset ===<br />
<br />
[https://github.com/bdw/GridKit GridKit] uses spatial and topological analysis to transform map objects from [http://www.openstreetmap.org/ OpenStreetMap] into a network model of the electric power system. It has been developed in the context of the [http://scigrid.de/ SciGRID] project at the [http://www.next-energy.de/ NEXT ENERGY - EWE Research Centre for Energy Technology], to investigate the possibility of 'heuristic' analysis to augment the route-based analysis used in [http://scigrid.de/ SciGRID]. This has been implemented as a series of scripts for the PostgreSQL database using the PostGIS spatial extensions.<br />
<br />
[https://zenodo.org/record/47317 Data extracts] are provided for Europe and North America in a similar CSV format to [http://scigrid.de/ SciGRID].<br />
<br />
=== osmTGmod Model<br/> ===<br />
<br />
[https://github.com/maltesc/osmTGmod osmTGmod] is a load-flow model of the German transmission-gird, based on the free geo-database [http://www.openstreetmap.org/ OpenStreetMap] (OSM). The model, respectively the heuristic abstraction process employs a PostgreSQL-database extended by PostGIS. The key part of the abstraction process is implemented in SQL and ProstgreSQL's procedural language pl/pgSQL. The abstraction and all additional modules are controlled by a Python-environment.<br />
<br />
=== Bialek European Model<br/> ===<br />
<br />
The 2nd version of the [http://www.powerworld.com/knowledge-base/updated-and-validated-power-flow-model-of-the-main-continental-european-transmission-network Bialek European Model] is downloadable as an Excel file and in the format of the proprietary modelling software [http://www.powerworld.com/ PowerWorld]. The model covers voltages from 110 kV (a single line in the Balkans) up to 380 kV. It is released under a Public Domain Dedication.<br/><br />
<br />
The 1st version was released in 2002-2004 and is no longer available (see [http://web.archive.org/web/20100525115039/http://www.see.ed.ac.uk/~jbialek/Europe_load_flow/ Archive mirror]). The 1st version did not contain the Balkans region.<br />
<br />
The methodology and validation for the 1st version of the model can be found in the paper [http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=1425573 Approximate model of European interconnected system as a benchmark system to study effects of cross-border trades] by Zhou and Bialek, 2005.<br />
<br />
The model contains the impedances and number of circuits of each line, but not the length (which can in principle be determined from the impedance and number of circuits, given standard line parameters). Only cross-border lines are assigned thermal capacities.<br />
<br />
There is currently no coordinate dataset for the buses. The PowerWorld file contains spatial data, but in an unknown projection. The [https://github.com/nworbmot/georef-bialek/ georef-bialek github project] is an attempt to fix this; there is also a [https://zenodo.org/record/35177 geo-referenced version] from Tue Vissing Jensen.<br />
<br />
=== DIW ELMOD-DE open model of Germany ===<br />
<br />
[http://www.diw.de/de/diw_01.c.528493.de/forschung_beratung/nachhaltigkeit/umwelt/verkehr/energie/modelle/elmod.html#ELMOD-DE ELMOD-DE] is an open model of the German electricity system developed at DIW and TU Berlin, which includes both a model of the high voltage transmission network, power plants, hourly load and weather data for the year 2012 and GAMS code to run linear optimisation simulations. It contains 438 geo-referenced network nodes and 697 transmission lines at 380 kV and 220 kV. Transformers are not modelled but per unit line series impedances are adjusted to the voltage level.<br />
<br />
The model includes 47 pages of documentation.<br />
<br />
The transmission data was, according to the documentation, derived from the VDE and TSO maps and from [http://www.openstreetmap.org/ OpenStreetMap]. The data is provided as-is without the code that generated it.<br />
<br />
=== National Grid Model ===<br />
<br />
[http://www2.nationalgrid.com/UK/Industry-information/Future-of-Energy/Electricity-Ten-Year-Statement/ National Grid Electricity Ten Year Statement 2014 Model]<br />
<br />
Shapefiles and maps of tower, lines, cables and substations [https://www.nationalgridet.com/network-and-assets/network-route-maps here].<br/><br />
<br />
=== Austrian Power Network Grid Model<br/> ===<br />
<br />
[https://www.apg.at/en/Stromnetz/APG-Netz Austrian Power Network Grid]<br/><br />
<br />
<br/><br />
<br />
=== Danish Power Network Grid Model<br/> ===<br />
<br />
[https://en.energinet.dk/Electricity/Energy-data/System-data Danish Transmission network data]<br />
<br />
The data are not directly available, but rather a [https://en.energinet.dk/About-us/Registrations/Formular056 registration form] is required before obtaining access.<br />
<br />
It has features not present in the ENTSO-E STUM (see below):<br />
<br />
*It's a full non-linear model with all the reactive power demand, P and Q capabilities of gens and shunt reactive power compensation.<br />
*It lists the power capabilities of the generators and their fuel type (wind/solar/gas etc), not just the dispatch.<br />
*They seem to have separated RE feed-in from the load, which wasn't the case for STUM where wind and solar are lumped with the load as residual load.<br />
<br />
What's missing are geocoordinates for the substations (which can be read off roughly from the JPG map) and time-dependence of the loads and/or variable generators. For Denmark, which has many CHP units, it would also be useful to know the heat demand and how the CHP units are operated.<br />
<br />
<br/><br />
<br />
=== RTE Network Dataset for France<br/> ===<br />
<br />
[https://clients.rte-france.com/lang/an/visiteurs/vie/indispos_caracteristiques_statiques.jsp RTE network dataset]<br />
<br />
=== Elia Network Dataset for Belgium ===<br />
<br />
[http://www.elia.be/en/grid-data/Grid-Technical-Data Elia network dataset]<br />
<br />
=== TenneT NL Network Dataset for the Netherlands<br/> ===<br />
<br />
[http://www.tennet.org/english/operational_management/transmission_services/Calculated_crossborder_cap/explanatory_documents.aspx TenneT NL]<br />
<br />
=== TenneT DE Network Dataset for Central Germany<br/> ===<br />
<br />
[http://www.tennettso.de/site/Transparenz/veroeffentlichungen/statisches-netzmodell/statisches-netzmodell Tennet DE]<br/><br />
<br />
=== Amprion Network Dataset for Western Germany<br/> ===<br />
<br />
[https://www.amprion.net/Energy-Market/Congestion-Management/Static-Grid-Model/ Amprion], [https://www.amprion.net/Netzausbau/Interaktive-Karte/ interactive map] of the grid extension projects<br/><br />
<br />
=== TransnetBW Network Dataset for Southwest Germany<br/> ===<br />
<br />
[https://www.transnetbw.de/de/strommarkt/engpassmanagement/standards-zukunft TransnetBW]<br/><br />
<br />
=== 50 Hertz Network Dataset for Eastern Germany<br/> ===<br />
<br />
[https://www.50hertz.com/de/Transparenz/Kennzahlen/StatischesNetzmodell 50 Hertz statistisches Netz]<br/><br />
<br />
<br/><br />
<br />
=== Ceps Network Dataset for <span lang="EN-GB">Czec</span>h Republic<br/> ===<br />
<br />
[https://www.ceps.cz/ENG/Cinnosti/Technicka-infrastruktura/Pages/Udaje-o-PS.aspx CEPS]<br/><br />
<br />
=== ENTSO-E Interactive Grid Map ===<br />
<br />
ENTSO-E announced its [https://www.entsoe.eu/map/Pages/default.aspx Interactive ENTSO-E Transmission Network Map] in March 2016.<br />
<br />
The map uses [http://www.openstreetmap.org/ OpenStreetMap] as a background and [https://www.mapbox.com/about/maps/ Mapbox] for displaying the map data.<br />
<br />
The map is based on the ENTSO-E static grid map, which is based on the TSOs' own maps. It is known to be an approximate artistic representation rather than an accurate geographical map. Some power plants may be incorrectly labelled (e.g. fuel type may not be accurate).<br />
<br />
The map includes information on the number of circuits and the voltage levels of transmission lines.<br />
<br />
Information, including all geographical coordinates, can be extracted from the web API, but requires further topological processing to be turned into an electrical network model. Lines need to be connected, etc. The [https://github.com/bdw/GridKit GridKit] project provides code for this purpose and has released an [https://zenodo.org/record/55853 unofficial dataset], which forms an electrical network model complete with buses, links, generators and transformers, full geographic coordinates, as well as all electrical metadata contained in the ENTSO-E map.<br />
<br />
=== ENTSO-E Static Grid Map ===<br />
<br />
ENTSO-E releases [https://www.entsoe.eu/publications/order-maps-and-publications/electronic-grid-maps/Pages/default.aspx maps of the European transmission grid], both electronically and in paper form.<br />
<br />
The maps for the whole ENTSO-E system are in the projection [http://prj2epsg.org/epsg/3034 EPSG 3034], which is a [https://en.wikipedia.org/wiki/Lambert_conformal_conic_projection Lambert Conformal Conic projection]. The lower left corner is approximately at (lon,lat) = (-9.5,28) and the upper left corner is at (75.5,58.5). This was checked in the [https://github.com/nworbmot/georef-bialek/ georef-bialek github project].<br />
<br />
=== ENTSO-E STUM ===<br />
<br />
ENTSO-E makes available a model of the European transmission system. Registration is required to download it on the [https://www.entsoe.eu/stum/ ENTSO-E STUM] page. It is not totally clear what one may and may not do with it (e.g. whether it is possible to publish results derived from it or an aggregation of the nodes, etc.).<br />
<br />
The first version of the model was released in the CIM XML-based format for the old UCTE area. The model was a winter snapshot for 2020, including TYNDP projects. The node names were obscured so that the model was unusable. Line capacities were missing.<br />
<br />
The second version, published in June 2015 as Excel spreadsheets, is more useful. It contains the whole ENTSO-E area with the exception of Norway, Sweden, Cyrus and Iceland. The node names are the same as those used by the TSOs. Quoting from the documentation: "It represents the power system of the ENTSO-E members for 2030 in Vision I of the TYNDP 2014", i.e. it includes planned TYNDP projects. It includes all nodes, lines, transformers and aggregated loads and generators at each node for one snapshot. Line data includes series reactance and resistance, but not line length or capacity or number of circuits or wires per circuit bundle. Geolocation data for the nodes is missing. Node names are recognisable from the substation names on the ENTSO-E map. The model is intended for a linear load flow only. It is not clear which wind/solar/load snapshot the model represents (it is an "exemplary scenario"). Generators are not distinguished by generation source.<br />
<br />
The third version, published in February 2016 as Excel spreadsheets has in addition thermal ratings for most transformers and most transmission lines, along with reactive power feed-in, consumption and compensation, so that a full non-linear power flow can be run on the grid.<br />
<br />
=== ENTSO-E Initial Dynamic Model of Continental Europe ===<br />
<br />
[https://www.entsoe.eu/publications/system-operations-reports/continental-europe/Initial-Dynamic-Model/Pages/default.aspx ENTSO-E Initial Dynamic Model of Continental Europe]<br />
<br />
Requires registration. Can model "the main frequency response of the system as well as the main inter-area oscillation modes".<br />
<br />
=== Core Static grid model by Joint Allocation Office ===<br />
<br />
From the handbook:&nbsp;<br />
<br />
The Core Static Grid Model is a list of relevant grid elements of the transmission system, including their electrical properties, that is published every six months by the Core TSOs in accordance with Article 25(2)(f) of the Day-ahead capacity calculation methodology of the Core capacity calculation region.<br />
<br />
It consists of an Excel table with a list of relevant grid elements of the transmission system of Core TSOs, including their electrical properties.<br />
<br />
[https://www.jao.eu/static-grid-model https://www.jao.eu/static-grid-model]<br />
<br />
=== Flow-based market coupling data by Joint Allocation Office ===<br />
<br />
The joint allocation office hosts various official data (including [http://utilitytool.jao.eu/CascUtilityWebService.asmx?op=GetPTDFEarlyPublicationForAPeriod PTDFs]) around the Flow-based market coupling algorithm in use in Europe.<br />
<br />
[http://utilitytool.jao.eu/ http://utilitytool.jao.eu/]<br />
<br />
[http://utilitytool.jao.eu/CascUtilityWebService.asmx http://utilitytool.jao.eu/CascUtilityWebService.asmx]<br />
<br />
=== PyPSA-Eur: An Open Optimisation Model of the European Transmission System ===<br />
<br />
PyPSA-Eur is a model/dataset of the European power system at the transmission network level.<br />
<br />
The transmission network data is based on a cleaned up extraction of the [https://www.entsoe.eu/map/Pages/default.aspx Interactive ENTSO-E Transmission Network Map], extracted using [https://github.com/bdw/GridKit GridKit].<br />
<br />
The model covers the ENTSO-E area and contains all alternating current lines at and above 220 kV voltage level and all high voltage direct current lines, substations, an open database of conventional power plants, time series for electrical demand and variable renewable generator availability, and geographic potentials for the expansion of wind and solar power.<br />
<br />
The model only includes freely available and open data. It provides a fully automated free software pipeline to assemble the load-flow-ready model from the original datasets. The model is suitable both for operational studies and generation and transmission expansion planning studies.<br />
<br />
Current versions of the code and dataset can be found on zenodo:<br />
<br />
*[https://zenodo.org/record/3603127#.Xhcvdtl7m0I https://zenodo.org/record/3603127#.Xhcvdtl7m0I] (Code)<br />
*[https://zenodo.org/record/3601882#.XhcvqNl7m0J https://zenodo.org/record/3601882#.XhcvqNl7m0J] (Dataset)<br />
<br />
Documentation is available at [https://pypsa-eur.readthedocs.io https://pypsa-eur.readthedocs.io]<br />
<br />
Development takes place on Github at [https://github.com/pypsa/pypsa-eur https://github.com/pypsa/pypsa-eur]<br />
<br />
The netcdf files (.nc) can be imported with PyPSA. Documentation for this is available at [https://pypsa.readthedocs.io/en/latest/import_export.html#import-from-netcdf https://pypsa.readthedocs.io/en/latest/import_export.html#import-from-netcdf].<br />
<br />
Some basic validation is provided in a paper describing the dataset:<br />
<br />
Jonas Hörsch, Fabian Hofmann, David Schlachtberger, and Tom Brown. PyPSA-Eur: An open optimisation model of the European transmission system. Energy Strategy Reviews, 22:207-215, 2018. [https://arxiv.org/abs/1806.01613 https://arxiv.org/abs/1806.01613], [https://doi.org/10.1016/j.esr.2018.08.012 https://doi.org/10.1016/j.esr.2018.08.012].<br />
<br />
<br/><br />
<br />
== Australia<br/> ==<br />
<br />
[https://data.gov.au/dataset/ds-ga-1185c97c-c042-be90-e053-12a3070a969b/details?q=national Lines] and [https://data.gov.au/dataset/ds-ga-13be62a4-4fe3-f812-e053-12a3070a22be/details?q=national substations]<br />
<br />
<br/><br />
<br />
<br/><br />
<br />
== United States<br/> ==<br />
<br />
There is a [https://hifld-geoplatform.opendata.arcgis.com/datasets/geoplatform::electric-power-transmission-lines/about shapefile of the electric power transmission lines] (69+ kV) in the contiguous US available from the Homeland Infrastructure Foundation Level Database.<br/><br />
<br />
There is raster graphic of the US transmission grid at [https://www.e-education.psu.edu/geog469/book/export/html/111 https://www.e-education.psu.edu/geog469/book/export/html/111].<br/><br />
<br />
=== Western Electricity Coordinating Council ===<br />
<br />
Apparently there is a a WECC Transmission Expansion Planning Policy Committee (TEPPC) 2024 Common Case GridView dataset, but the exact link seems elusive.<br />
<br />
The WECC [https://www.wecc.biz/TransmissionExpansionPlanning/Pages/Datasets.aspx Transmission Expansion Planning] has links to Excel files.<br />
<br />
=== Western US Power Grid ===<br />
<br />
The [http://nexus.igraph.org/api/dataset_info?id=15&format=html Western US Power Grid dataset] has 4941 nodes and 6594 lines, but apparently these are not well enough labelled to distinguish where and what the nodes/lines are.<br/><br />
<br />
=== GridKit North American Dataset ===<br />
<br />
[https://github.com/bdw/GridKit GridKit] uses spatial and topological analysis to transform map objects from [http://www.openstreetmap.org/ OpenStreetMap] into a network model of the electric power system. It has been developed in the context of the [http://scigrid.de/ SciGRID] project at the [http://www.next-energy.de/ NEXT ENERGY - EWE Research Centre for Energy Technology], to investigate the possibility of 'heuristic' analysis to augment the route-based analysis used in [http://scigrid.de/ SciGRID]. This has been implemented as a series of scripts for the PostgreSQL database using the PostGIS spatial extensions.<br />
<br />
[https://zenodo.org/record/47317 Data extracts] are provided for Europe and North America in a similar CSV format to [http://scigrid.de/ SciGRID].<br />
<br />
=== US grid dataset by Breakthrough Energy ===<br />
<br />
US grid dataset by Bill Gates' Breakthrough Energy<br />
<br />
*[https://science.breakthroughenergy.org/ https://science.breakthroughenergy.org/]<br />
*Dataset: [https://zenodo.org/record/3905429 https://zenodo.org/record/3905429]<br />
*[https://arxiv.org/abs/2002.06155 https://arxiv.org/abs/2002.06155]<br />
<br />
<br/><br />
<br />
== Global ==<br />
<br />
=== OpenStreetMap ===<br />
<br />
The global OpenStreetMap (OSM) power grid data is visible at [http://www.itoworld.com/map/4 ITO World Electricity Distribution] and [http://enipedia.tudelft.nl/ Enipedia] has [http://enipedia.tudelft.nl/OpenStreetMap/ nightly extracts of the power grid from OSM].<br />
<br />
=== GridKit Datasets ===<br />
<br />
[https://github.com/bdw/GridKit GridKit] uses spatial and topological analysis to transform map objects from [http://www.openstreetmap.org/ OpenStreetMap] into a network model of the electric power system. It has been developed in the context of the [http://scigrid.de/ SciGRID] project at the [http://www.next-energy.de/ NEXT ENERGY - EWE Research Centre for Energy Technology], to investigate the possibility of 'heuristic' analysis to augment the route-based analysis used in [http://scigrid.de/ SciGRID]. This has been implemented as a series of scripts for the PostgreSQL database using the PostGIS spatial extensions.<br />
<br />
[https://zenodo.org/record/47317 Data extracts] are provided for Europe and North America in a similar CSV format to [http://scigrid.de/ SciGRID].<br />
<br />
=== IRENA OpenStreetMap Extract ===<br />
<br />
See [http://globalatlas.irena.org/NewsDetailPublic.aspx?id=2278 IRENA News Announcement]<br/><br />
<br />
=== PLEXOS-World ===<br />
<br />
<span style="font-size: 13.6px; background-color: rgb(255, 255, 255);">A global dataset of Net Transfer Capacities between countries and sub-regions as retrieved for the global power system model PLEXOS-World based on the 2015 calendar year is openly available. The dataset can be retrieved at the dedicated&nbsp;</span>[https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/CBYXBY PLEXOS-World Harvard Dataverse.]<br/><br />
<br />
<br/><br />
<br />
== Non-Region Specific ==<br />
<br />
=== University of Washington Power Systems Test Case Archive ===<br />
<br />
[http://www.ee.washington.edu/research/pstca/ Power Systems Test Case Archive]<br />
<br />
=== IEEE PES Power Grid Library ===<br />
<br />
[https://power-grid-lib.github.io/ Overview]<br />
<br />
[https://github.com/power-grid-lib/pglib-opf Optimal Power Flow Cases]<br />
<br />
=== RWTH Aachen Transmission Expansion Problem Benchmark Case ===<br />
<br />
RWTH Aachen has published [http://www.ifht.rwth-aachen.de/en/tep A Benchmark Case for Network Expansion], which is "derived from the IEEE 118 bus network and modified in accordance with European standards such as a nominal frequency of 50Hz, the use of conventional voltage levels, and conductor dimensions."<br />
<br />
Registration is required to download the model.<br />
<br />
The paper describing the model is [http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=7232601 A benchmark case for network expansion methods], 2015.<br />
<br />
= Other lists of network datasets =<br />
<br />
*[http://enipedia.tudelft.nl/wiki/Electricity_Transmission_Network Enipedia list]<br />
<br />
*[http://enipedia.tudelft.nl/OpenStreetMap/ Nightly extracts of the power grid from OpenStreetMap]<br />
**See the maps at [http://www.itoworld.com/map/106 ITO World Electricity Generation] and [http://www.itoworld.com/map/4 ITO World Electricity Distribution] for a visual overview of what this covers.<br />
**This data is fed into the [http://enipedia.tudelft.nl/Elasticsearch.html search page here] where you locate data on individual power plants.<br />
<br />
*[http://www.maths.ed.ac.uk/optenergy/data/Summary.pdf Edinburgh University list]<br />
<br />
*[https://github.com/ComplexNetTSP/ComplexNetWiki/wiki/2.2.3-PowerGrid- Github repository] of several transmission network models<br/><br />
<br />
*[https://github.com/caesar0301/awesome-public-datasets#complex-networks Github list of complex network datasets]<br />
<br />
<br/><br />
<br />
= Free software for power system analysis =<br />
<br />
[https://github.com/rwl/PYPOWER PyPower] in Python<br/><br />
<br />
[https://github.com/FRESNA/PyPSA PyPSA]: Python for Power System Analysis<br />
<br />
[https://bitbucket.org/harald_g_svendsen/powergama/wiki/Home PowerGAMA] in Python<br />
<br />
[http://www.pserc.cornell.edu/matpower/ MATPOWER] in Matlab or Octave<br />
<br />
[http://sourceforge.net/projects/electricdss/ OpenDSS] in Delphi<br />
<br />
[http://faraday1.ucd.ie/psat.html PSAT] in Matlab or Octave<br />
<br />
[https://github.com/lanl-ansi/PowerModels.jl PowerModels.jl] in Julia<br />
<br />
[https://github.com/wheitkoetter/AutoGridComp AutoGridComp] in Python for the comparison of power grid models<br />
<br />
'''Other lists of power system analysis software'''<br />
<br />
[https://wiki.openelectrical.org/index.php?title=Power_Systems_Analysis_Software https://wiki.openelectrical.org/index.php?title=Power_Systems_Analysis_Software]<br />
<br />
[https://nkloc.wordpress.com/2011/11/11/power-system-simulation-software-list/ https://nkloc.wordpress.com/2011/11/11/power-system-simulation-software-list/]<br />
<br />
[http://www2.econ.iastate.edu/tesfatsi/ElectricOSS.htm http://www2.econ.iastate.edu/tesfatsi/ElectricOSS.htm]<br />
<br />
<br/><br />
<br />
= Typical electrical parameters for transmission infrastructure =<br />
<br />
== Calculating cable impedances ==<br />
<br />
<span style="font-size: 0.85em;">see [https://www.siechem.com/tech-support/impedance-2/ https://www.siechem.com/tech-support/impedance-2/] (</span>[http://www.openelectrical.org/wiki/index.php?title=Cable_Impedance_Calculations http://www.openelectrical.org/wiki/index.php?title=Cable_Impedance_Calculations], link is broken)<span style="font-size: 0.85em;">&nbsp;and electrical engineering textbooks.</span><br />
<br />
<br/><br />
<br />
'''Referring impedances, i.e.&nbsp;<span style="color: rgb(32, 33, 34); font-family: sans-serif; font-size: 14px; background-color: rgb(255, 255, 255);">convert impedances from one voltage to another</span>:&nbsp;'''<br />
<br />
see [http://openelectrical.org/index.php?title=Referring_Impedances http://openelectrical.org/index.php?title=Referring_Impedances]<br/><br />
<br />
<br/><br />
<br />
== Generalities on overhead alternating current transmission lines ==<br />
<br />
=== Three-phase power ===<br />
<br />
In almost all of the world electrical power is transmitted using alternating current with three phases separated by 120 degrees, see [https://en.wikipedia.org/wiki/Three-phase_electric_power Wikipedia: Three-phase electric power].<br />
<br />
For this reason the cables on power lines are bundled in groups of three.<br />
<br />
(Exceptions include: direct current power lines and some [https://en.wikipedia.org/wiki/Railway_electrification_system transmission systems for supplying trains], which are e.g. in Germany two-phase and at 16.7 Hz.)<br />
<br />
Current I and current limits are almost always quoted per phase.<br />
<br />
Voltage in the transmission system is almost always quoted as the phase-to-phase potential difference, often called line-to-line voltage V_{LL}, since this is the easiest value to measure. It is related to the line-to-ground or line-to-neutral potential difference V_{LN} by V_{LL} = \sqrt{3} V_{LN}.<br />
<br />
The apparent power transported in each phase is give by I*V_{LN}, so that for a complete transmission circuit the power is three times this value:<br />
<br />
S = 3*I*V_{LN} = \sqrt(3)*I*V_{LL}<br />
<br />
Often it is assumed that the voltage and current magnitudes are the same in each phase, i.e. that the system is balanced and symmetric. This should be the case in the normal operation of the transmission system. The impedances and limits below are quoted assuming that the system is balanced, so that only positive sequence impedances are given. See [https://en.wikipedia.org/wiki/Symmetrical_components Wikipedia: Symmetrical components].<br />
<br />
In an unbalanced system, the three phases can be described using the positive-, negative- and zero-sequence components, where the impedances are different for each sequence.<br />
<br />
=== Bundled conductors ===<br />
<br />
See [https://en.wikipedia.org/wiki/Overhead_power_line#Bundle_conductors Wikipedia: Overhead power line: Bundle conductors].<br />
<br />
Often the conducting wires for each phase are separated into bundles of several parallel wires, connected at intervals by spacers. This has several advantages: the higher surface area increases the current-carrying capacity, which is limited by the [https://en.wikipedia.org/wiki/Skin_effect skin effect], it reduces inductance and it helps to cool the wires.<br />
<br />
=== Circuits ===<br />
<br />
Each group of three phases is called a circuit. Power-carrying capability can be increased by having several circuits on a single pylon, so that wire bundles always appear in multiples of 3 in power lines.<br />
<br />
<br/><br />
<br />
== European 50 Hz transmission lines ==<br />
<br />
The main European alternating current (AC) electricity system is operated at 50 Hz. (Other networks, such as those for electrified trains, operate at other frequencies and some transmission lines use direct current.)<br />
<br />
On the continent AC transmission voltages are typically 220 kV or 380 kV (sometimes quoted as 400 kV, since network operators often run their grid above nominal voltage to reduce network losses).<br />
<br />
220 kV overhead lines are typically configured with a bundle of 2 wires per phase with wires of cross-section Al/St 240/40.<br />
<br />
380 kV overhead lines are typically configured with a bundle of 4 wires per phase with wires of cross-section Al/St 240/40.<br />
<br />
We now list the impedances of the transmission lines, which can be used for example in the [http://www.electrical4u.com/medium-transmission-line/ lumped pi model].<br />
<br />
{| style="width:100%" class="wikitable sortable" cellspacing="1" cellpadding="1" border="1"<br />
|+ Electrical properties for single circuits<br />
|-<br />
! scope="col" | Voltage level (kV)<br />
! scope="col" | Type<br />
! scope="col" | Conductors<br />
! scope="col" | Series resistance (Ohm/km)<br />
! scope="col" | Series inductive reactance (Ohm/km)<br />
! scope="col" | Shunt capacitance (nF/km)<br />
! scope="col" | Current thermal limit (A)<br />
! scope="col" | Apparent power thermal limit (MVA)<br />
|-<br />
| 220<br />
| Overhead line<br />
| 2-wire-bundle Al/St 240/40<br />
| 0.06<br />
| 0.301<br />
| 12.5<br />
| 1290<br />
| 492<br />
|-<br />
| 380<br />
| Overhead line<br />
| 4-wire-bundle Al/St 240/40<br />
| 0.03<br />
| 0.246<br />
| 13.8<br />
| 2580<br />
| 1698<br />
|}<br />
<br />
In the table the thermal limit for the current is calculated as 645 A per wire at an outside temperature of 35&nbsp;degrees Celsius, wind speed of 0.6 m/s and solar insolation typical for Germany.<br />
<br />
The thermal limit for the apparent power S is derived from the per-phase current limit I and the line-to-line voltage V by S = \sqrt{3}VI.<br />
<br />
Sources for the electrical parameters:<br />
<br />
Oeding and Oswald [http://www.springer.com/us/book/9783642192456 Elektrische Kraftwerke und Netze], 2011, Chapter 9<br />
<br />
See also comparable parameters in:<br />
<br />
*[http://www.dena.de/fileadmin/user_upload/Projekte/Energiesysteme/Dokumente/denaVNS_Abschlussbericht.pdf DENA Distribution Network Study], 2012, Table 5.6<br />
*[https://www.diw.de/documents/publikationen/73/diw_01.c.440963.de/diw_datadoc_2014-072.pdf DIW Data Documentation 72], 2014, Table 15, taken from Kießling, F., Nefzger, P., Kaintzyk, U., "Freileitungen: Planung, Berechnung, Ausführung", 2001, Springer<br />
*[https://www.zml.kit.edu/downloads/Elektrische_Energieuebertragung_Leseprobe_Kapitel_2.pdf KIT Electrical Parameters Reading Sample], 2013<br />
<br />
<br/><br />
<br />
== European 50 Hz high voltage transformers ==<br />
<br />
Typical 380/220 kV transformers have a nominal power of around 400-500 MVA and a per unit series reactance of around 0.08-0.1.<br />
<br />
#TODO: references<br />
<br />
== Combining electrical parameters for multiple circuits ==<br />
<br />
In the table above, the impedances are quoted for a single circuit. The resistance and inductive reactance decrease proportional to the number of parallel circuits (with small modifications to the inductance due to the different geometry of the parallel circuits). Similarly the capacitance increases proportional to the number of parallel circuits (again, roughly because of changing geometry).<br />
<br />
<br/><br />
<br />
== Standard Test Test Networks ==<br />
<br />
[http://sites.ieee.org/pes-testfeeders/resources/ http://sites.ieee.org/pes-testfeeders/resources/]<br />
<br />
[https://github.com/e2nIEE/pandapower/tree/develop/pandapower/networks https://github.com/e2nIEE/pandapower/tree/develop/pandapower/networks]</div>Jonathan Ammehttps://wiki.openmod-initiative.org/wiki/Distribution_network_datasetsDistribution network datasets2023-12-12T15:31:06Z<p>Jonathan Amme: </p>
<hr />
<div><br />
== Network Models ==<br />
<br />
=== REDS: REpository of Distribution Systems ===<br />
<br />
[http://www.dejazzer.com/reds.html http://www.dejazzer.com/reds.html]<br />
<br />
Lists 8 radial distribution system datasets, focus seems to be on US.<br />
<br />
=== IEEE PES Distribution Test Feeders ===<br />
<br />
[http://www.ewh.ieee.org/soc/pes/dsacom/testfeeders/index.html http://www.ewh.ieee.org/soc/pes/dsacom/testfeeders/index.html]<br />
<br />
<br/><br />
<br />
=== ENEXIS Gas and Electricity Network Open Data<br/> ===<br />
<br />
Power and gas grid data from an energy network operator in the Netherlands:<br />
<br />
[https://www.enexis.nl/over-ons/wat-bieden-we/andere-diensten/open-data https://www.enexis.nl/over-ons/wat-bieden-we/andere-diensten/open-data]<br />
<br />
The asset files are published as shapefiles with attributes. The spatial reference system used seems to be the 'Amersfoort / RD New' (EPSG 28992) coordinate system, which is standard in the Netherlands.<br />
<br />
<br/><br />
<br />
A small subset of the electric network data is available for viewing online as a CIM ([https://en.wikipedia.org/wiki/Common_Information_Model_(electricity) Common Information Model]) file by navigating to [http://derrickoswald.github.io/CIMSpace/ CIMSpace] and clicking the '''Enexis''' item in the Preset dropdown of the Load dialog. Loading the 500MB file takes about 2 minutes. Instructions for CIMSpace usage are found on [https://github.com/derrickoswald/CIMSpace GitHub].<br/><br />
<br />
=== Enedis Distribution Grid Open Data<br/> ===<br />
<br />
Power grid data (low and medium voltage, up to 50 kV) from Enedis, the largest DSO in France (covers 95&nbsp;% of all distribution grids):<br />
<br />
[https://data.enedis.fr/pages/cartographie-des-reseaux-contenu/ https://data.enedis.fr/pages/cartographie-des-reseaux-contenu/]<br />
<br />
=== Atlantide - Archive of Distribution Grid Models ===<br />
<br />
Grid Models gained from Italian Distribution Grids. Registration required.<br />
<br />
[http://www.progettoatlantide.it/Atlantide/jsp/index.jsp http://www.progettoatlantide.it/Atlantide/jsp/index.jsp]<br />
<br />
From the Website:<br />
<br />
"[...] archive of models to be used as a reference for future research and development initiatives on MV and LV electrical distribution networks (passive and active). [...]&nbsp;:<br/><br />
<br />
*Models of reference network configurations typical of the Italian territory;<br />
*Models of generating units and loads;<br />
*Models of components supported by a database containing their typical characteristics;<br />
*Evolutionary scenarios of distribution systems in the next future."<br />
<br />
<br/><br />
<br />
=== Simbench ===<br />
<br />
[https://simbench.de/ Simbench] has [http://141.51.193.167/simbench/gui/usecase/download/?Simbench_Code=1-complete_data-mixed-all-0-sw datasets] in CSV format that appear to be a complete model of an over 100,000 node medium and low voltage network with electrical parameters.<br />
<br />
=== Pandapower ===<br />
<br />
[http://www.pandapower.org Pandapower] has included various [https://pandapower.readthedocs.io/en/v2.0.1/networks.html sample networks] in the pandapower.networks python module.<br />
<br />
=== Ding0 ===<br />
<br />
[https://github.com/openego/ding0 Ding0/openEGO] will generate [https://dingo.readthedocs.io/en/dev/usage_details.html#examples synthetic medium and low voltage networks]. There is a desire to expand this to cover an entire region.<br />
<br />
=== Basisnetztopologien MONA 2030 ===<br />
<br />
In the project MONA 2030 several [https://www.ffe.de/themen-und-methoden/speicher-und-netze/752-ffe-stellt-rechenfaehige-basisnetztopologien-aus-projekt-mona-2030-zur-verfuegung low voltage base topologies] were published (<span>CC BY 4.0</span>).<br />
<br />
== Time Series ==<br />
<br />
=== Low Carbon London ===<br />
<br />
[https://data.london.gov.uk/dataset/smartmeter-energy-use-data-in-london-households Detailed load data] is available for 100 of the set of 5,567 housholds of the Low Carbon London project. This data has been used in two pending papers ([https://doi.org/10.1016/j.apenergy.2018.08.004 https://doi.org/10.1016/j.apenergy.2018.08.004] & [https://doi.org/10.1016/j.enbuild.2018.12.003 https://doi.org/10.1016/j.enbuild.2018.12.003]) related to local electricity markets, such as [http://quartier-strom.ch/index.php/en/homepage/ Quartierstrom] and [https://cityxchange.eu/ CityXchange].<br />
<br />
=== RAMP ===<br />
<br />
Stocastic load profiles can be generated using [https://github.com/SESAM-Polimi/RAMP RAMP].<br />
<br />
=== Sector Coupling - Load Shape Generator ===<br />
<br />
The [https://github.com/Pyosch/Sectorcoupling-Loadshapegenerator Loadshapegenerator] adds load shapes of heat pumps, electric vehicles, photovoltaic and electric home storage to a base load.<br />
<br />
=== Load Profile Generator ===<br />
<br />
The [https://www.loadprofilegenerator.de/ LoadProfileGenerator] can generate load profiles based on appliances and activities.<br />
<br />
== Distribution Network Studies ==<br />
<br />
=== For distributed renewables ===<br />
<br />
[https://www.dena.de/themen-projekte/projekte/energiesysteme/dena-verteilnetzstudie/ DENA Verteilnetzstudie], German Energy Agency (DENA), 2012, considers up to 82% renewable electricity in 2030<br />
<br />
[https://www.bundesregierung.de/breg-de/service/publikationen/-moderne-verteilernetze-fuer-deutschland-verteilernetzstudie--727438 BMWi Verteilernetzstudie], German Ministry for Economic Affairs and Energy, 2014<br />
<br />
=== For electrified transport and building heating ===<br />
<br />
[https://www.agora-energiewende.de/veroeffentlichungen/verteilnetzausbau-fuer-die-energiewende-1/ Verteilnetzausbau für die Energiewende: Elektromobilität im Fokus], Agora Verkehrswende, 2019, focus on full electrification of passenger cars<br />
<br />
[https://www.dena.de/themen-projekte/projekte/energiesysteme/dena-leitstudie-integrierte-energiewende/ DENA Leitstudie Integrierte Energiewende], German Energy Agency (DENA), 2018</div>Jonathan Ammehttps://wiki.openmod-initiative.org/wiki/Learning_materialsLearning materials2020-09-21T07:58:58Z<p>Jonathan Amme: </p>
<hr />
<div><br />
A list of openly-available, preferably openly-licensed learning materials. Please add information on the materials and licence.<br/><br />
<br />
*[https://data.ene.iiasa.ac.at/teaching/ Open Energy System Modeling]&nbsp;by Daniel Huppmann at IIASA for TU Wien (2020, 7 lectures with slides and videos, CC-BY 4.0)<br/><br />
*[https://labs.ece.uw.edu/real/videos.html Operations Research] by Anthony Papavasiliou (2020, 18 lectures with slides and videos, unknown licence)<br/><br />
*[https://www.youtube.com/watch?v=gB43TmcoUpA Convex Relaxations in Power System Optimization] by Carleton Coffrin and Line Roald at Los Alamos National Laboratory (2018, 8 lectures with videos, unknown licence)<br />
*[http://www.open-electricity-economics.org/book/text/OEE.html Open Electricity Economics] by&nbsp;??? (20xx, online textbook, unknown licence)<br/><br />
*[https://online-learning.tudelft.nl/courses/energy-markets-of-today/ Energy Markets of Today]&nbsp;by Rudi Hakvoort and Laurens de Vries at TU Delft (2020, edX, material available on enrollment under CC-BY-NC-SA?)<br/><br />
*[https://nworbmot.org/courses/esm-2020/ Energy System Modelling]&nbsp;by Tom Brown at KIT (2020, 15 lectures with slides, videos and Python coding examples, CC-BY 4.0)<br/><br />
*[https://zhangbaosen.github.io/teaching/EE553 Power System Economics]&nbsp;by&nbsp;Baosen Zhang at the University of Washington (2017, 11 lectures with slides and Julia coding examples, unknown licence)<br/><br />
*[https://energy-markets-school.dk/ DTU Summer Schools on Energy Markets and Optimization] by many different lecturers (2016-2019, many lecture slides online from previous schools)<br/><br />
*[https://labs.ece.uw.edu/real/videos.html Power System Economics] by Daniel Kirschen (2013, dozens of videos, unknown licence)<br />
*[http://switch-model.org/ Switch home page] by Switch authors (2015–18, open-access paper, tutorial and examples for Switch capacity planning model for high-renewable power systems)<br/><br />
*[https://www.youtube.com/channel/UCphLz_BXrOAInHozAlTsigA CO@Work Summer School] on Combinatorial Optimization by TU Berlin, Berlin Mathematical School and MATH+ (Youtube Channel, Sep. 2020, Details see [http://co-at-work.zib.de/ Website], unknown license)</div>Jonathan Ammehttps://wiki.openmod-initiative.org/wiki/Distribution_network_datasetsDistribution network datasets2020-02-26T11:32:46Z<p>Jonathan Amme: </p>
<hr />
<div><br />
== Network Models ==<br />
<br />
=== REDS: REpository of Distribution Systems ===<br />
<br />
[http://www.dejazzer.com/reds.html http://www.dejazzer.com/reds.html]<br />
<br />
Lists 8 radial distribution system datasets, focus seems to be on US.<br />
<br />
=== IEEE PES Distribution Test Feeders ===<br />
<br />
[http://www.ewh.ieee.org/soc/pes/dsacom/testfeeders/index.html http://www.ewh.ieee.org/soc/pes/dsacom/testfeeders/index.html]<br />
<br />
<br/><br />
<br />
=== ENEXIS Gas and Electricity Network Open Data<br/> ===<br />
<br />
Power and gas grid data from an energy network operator in the Netherlands:<br />
<br />
[https://www.enexis.nl/over-ons/wat-bieden-we/andere-diensten/open-data https://www.enexis.nl/over-ons/wat-bieden-we/andere-diensten/open-data]<br />
<br />
The asset files are published as shapefiles with attributes. The spatial reference system used seems to be the 'Amersfoort / RD New' (EPSG 28992) coordinate system, which is standard in the Netherlands.<br />
<br />
<br/><br />
<br />
A small subset of the electric network data is available for viewing online as a CIM ([https://en.wikipedia.org/wiki/Common_Information_Model_(electricity) Common Information Model]) file by navigating to [http://derrickoswald.github.io/CIMSpace/ CIMSpace] and clicking the '''Enexis''' item in the Preset dropdown of the Load dialog. Loading the 500MB file takes about 2 minutes. Instructions for CIMSpace usage are found on [https://github.com/derrickoswald/CIMSpace GitHub].<br/><br />
<br />
<br/><br />
<br />
=== Atlantide - Archive of Distribution Grid Models ===<br />
<br />
Grid Models gained from Italian Distribution Grids. Registration required.<br />
<br />
[http://www.progettoatlantide.it/Atlantide/jsp/index.jsp http://www.progettoatlantide.it/Atlantide/jsp/index.jsp]<br />
<br />
From the Website:<br />
<br />
"[...] archive of models to be used as a reference for future research and development initiatives on MV and LV electrical distribution networks (passive and active). [...]&nbsp;:<br/><br />
<br />
*Models of reference network configurations typical of the Italian territory;<br />
*Models of generating units and loads;<br />
*Models of components supported by a database containing their typical characteristics;<br />
*Evolutionary scenarios of distribution systems in the next future."<br />
<br />
<br/><br />
<br />
=== Simbench ===<br />
<br />
[https://simbench.de/ Simbench] has [http://141.51.193.167/simbench/gui/usecase/download/?Simbench_Code=1-complete_data-mixed-all-0-sw datasets] in CSV format that appear to be a complete model of an over 100,000 node medium and low voltage network with electrical parameters.<br />
<br />
=== Pandapower ===<br />
<br />
[http://www.pandapower.org Pandapower] has included various [https://pandapower.readthedocs.io/en/v2.0.1/networks.html sample networks] in the pandapower.networks python module.<br />
<br />
=== Ding0 ===<br />
<br />
[https://github.com/openego/ding0 Ding0/openEGO] will generate [https://dingo.readthedocs.io/en/dev/usage_details.html#examples synthetic medium and low voltage networks]. There is a desire to expand this to cover an entire region.<br />
<br />
=== Basisnetztopologien MONA 2030 ===<br />
<br />
In the project MONA 2030 several [https://www.ffe.de/themen-und-methoden/speicher-und-netze/752-ffe-stellt-rechenfaehige-basisnetztopologien-aus-projekt-mona-2030-zur-verfuegung low voltage base topologies] were published (<span>CC BY 4.0</span>).<br />
<br />
== Time Series ==<br />
<br />
=== Low Carbon London ===<br />
<br />
[https://data.london.gov.uk/dataset/smartmeter-energy-use-data-in-london-households Detailed load data] is available for 100 of the set of 5,567 housholds of the Low Carbon London project. This data has been used in two pending papers ([https://doi.org/10.1016/j.apenergy.2018.08.004 https://doi.org/10.1016/j.apenergy.2018.08.004] & [https://doi.org/10.1016/j.enbuild.2018.12.003 https://doi.org/10.1016/j.enbuild.2018.12.003]) related to local electricity markets, such as [http://quartier-strom.ch/index.php/en/homepage/ Quartierstrom] and [https://cityxchange.eu/ CityXchange].<br />
<br />
=== RAMP ===<br />
<br />
Stocastic load profiles can be generated using [https://github.com/SESAM-Polimi/RAMP RAMP].<br />
<br />
=== Sector Coupling - Load Shape Generator ===<br />
<br />
The [https://github.com/Pyosch/Sectorcoupling-Loadshapegenerator Loadshapegenerator] adds load shapes of heat pumps, electric vehicles, photovoltaic and electric home storage to a base load.<br />
<br />
=== Load Profile Generator ===<br />
<br />
The [https://www.loadprofilegenerator.de/ LoadProfileGenerator] can generate load profiles based on appliances and activities.<br />
<br />
== Distribution Network Studies ==<br />
<br />
=== For distributed renewables ===<br />
<br />
[https://www.dena.de/themen-projekte/projekte/energiesysteme/dena-verteilnetzstudie/ DENA Verteilnetzstudie], German Energy Agency (DENA), 2012, considers up to 82% renewable electricity in 2030<br />
<br />
[https://www.bundesregierung.de/breg-de/service/publikationen/-moderne-verteilernetze-fuer-deutschland-verteilernetzstudie--727438 BMWi Verteilernetzstudie], German Ministry for Economic Affairs and Energy, 2014<br />
<br />
=== For electrified transport and building heating ===<br />
<br />
[https://www.agora-energiewende.de/veroeffentlichungen/verteilnetzausbau-fuer-die-energiewende-1/ Verteilnetzausbau für die Energiewende: Elektromobilität im Fokus], Agora Verkehrswende, 2019, focus on full electrification of passenger cars<br />
<br />
[https://www.dena.de/themen-projekte/projekte/energiesysteme/dena-leitstudie-integrierte-energiewende/ DENA Leitstudie Integrierte Energiewende], German Energy Agency (DENA), 2018</div>Jonathan Ammehttps://wiki.openmod-initiative.org/wiki/Distribution_network_datasetsDistribution network datasets2020-02-26T11:20:40Z<p>Jonathan Amme: /* Ding0 */</p>
<hr />
<div><br />
== Network Models ==<br />
<br />
=== REDS: REpository of Distribution Systems ===<br />
<br />
[http://www.dejazzer.com/reds.html http://www.dejazzer.com/reds.html]<br />
<br />
Lists 8 radial distribution system datasets, focus seems to be on US.<br />
<br />
=== IEEE PES Distribution Test Feeders ===<br />
<br />
[http://www.ewh.ieee.org/soc/pes/dsacom/testfeeders/index.html http://www.ewh.ieee.org/soc/pes/dsacom/testfeeders/index.html]<br />
<br />
<br/><br />
<br />
=== ENEXIS Gas and Electricity Network Open Data<br/> ===<br />
<br />
Power and gas grid data from an energy network operator in the Netherlands:<br />
<br />
[https://www.enexis.nl/over-ons/wat-bieden-we/andere-diensten/open-data https://www.enexis.nl/over-ons/wat-bieden-we/andere-diensten/open-data]<br />
<br />
The asset files are published as shapefiles with attributes. The spatial reference system used seems to be the 'Amersfoort / RD New' (EPSG 28992) coordinate system, which is standard in the Netherlands.<br />
<br />
<br/><br />
<br />
A small subset of the electric network data is available for viewing online as a CIM ([https://en.wikipedia.org/wiki/Common_Information_Model_(electricity) Common Information Model]) file by navigating to [http://derrickoswald.github.io/CIMSpace/ CIMSpace] and clicking the '''Enexis''' item in the Preset dropdown of the Load dialog. Loading the 500MB file takes about 2 minutes. Instructions for CIMSpace usage are found on [https://github.com/derrickoswald/CIMSpace GitHub].<br/><br />
<br />
<br/><br />
<br />
=== Atlantide - Archive of Distribution Grid Models ===<br />
<br />
Grid Models gained from Italian Distribution Grids. Registration required.<br />
<br />
[http://www.progettoatlantide.it/Atlantide/jsp/index.jsp http://www.progettoatlantide.it/Atlantide/jsp/index.jsp]<br />
<br />
From the Website:<br />
<br />
"[...] archive of models to be used as a reference for future research and development initiatives on MV and LV electrical distribution networks (passive and active). [...]&nbsp;:<br/><br />
<br />
*Models of reference network configurations typical of the Italian territory;<br />
*Models of generating units and loads;<br />
*Models of components supported by a database containing their typical characteristics;<br />
*Evolutionary scenarios of distribution systems in the next future."<br />
<br />
<br/><br />
<br />
=== Simbench ===<br />
<br />
[https://simbench.de/ Simbench] has [http://141.51.193.167/simbench/gui/usecase/download/?Simbench_Code=1-complete_data-mixed-all-0-sw datasets] in CSV format that appear to be a complete model of an over 100,000 node medium and low voltage network with electrical parameters.<br />
<br />
=== Pandapower ===<br />
<br />
[http://www.pandapower.org Pandapower] has included various [https://pandapower.readthedocs.io/en/v2.0.1/networks.html sample networks] in the pandapower.networks python module.<br />
<br />
<br />
=== Ding0 ===<br />
<br />
[https://github.com/openego/ding0 Ding0/openEGO] will generate [https://dingo.readthedocs.io/en/dev/usage_details.html#examples synthetic medium and low voltage networks]. There is a desire to expand this to cover an entire region.<br />
<br />
<br />
== Time Series ==<br />
<br />
=== Low Carbon London ===<br />
<br />
[https://data.london.gov.uk/dataset/smartmeter-energy-use-data-in-london-households Detailed load data] is available for 100 of the set of 5,567 housholds of the Low Carbon London project. This data has been used in two pending papers ([https://doi.org/10.1016/j.apenergy.2018.08.004 https://doi.org/10.1016/j.apenergy.2018.08.004] & [https://doi.org/10.1016/j.enbuild.2018.12.003 https://doi.org/10.1016/j.enbuild.2018.12.003]) related to local electricity markets, such as [http://quartier-strom.ch/index.php/en/homepage/ Quartierstrom] and [https://cityxchange.eu/ CityXchange].<br />
<br />
=== RAMP ===<br />
<br />
Stocastic load profiles can be generated using [https://github.com/SESAM-Polimi/RAMP RAMP].<br />
<br />
=== Sector Coupling - Load Shape Generator ===<br />
<br />
The [https://github.com/Pyosch/Sectorcoupling-Loadshapegenerator Loadshapegenerator] adds load shapes of heat pumps, electric vehicles, photovoltaic and electric home storage to a base load.<br />
<br />
=== Load Profile Generator ===<br />
<br />
The [https://www.loadprofilegenerator.de/ LoadProfileGenerator] can generate load profiles based on appliances and activities.<br />
<br />
== Distribution Network Studies ==<br />
<br />
=== For distributed renewables ===<br />
<br />
[https://www.dena.de/themen-projekte/projekte/energiesysteme/dena-verteilnetzstudie/ DENA Verteilnetzstudie], German Energy Agency (DENA), 2012, considers up to 82% renewable electricity in 2030<br />
<br />
[https://www.bundesregierung.de/breg-de/service/publikationen/-moderne-verteilernetze-fuer-deutschland-verteilernetzstudie--727438 BMWi Verteilernetzstudie], German Ministry for Economic Affairs and Energy, 2014<br />
<br />
=== For electrified transport and building heating ===<br />
<br />
[https://www.agora-energiewende.de/veroeffentlichungen/verteilnetzausbau-fuer-die-energiewende-1/ Verteilnetzausbau für die Energiewende: Elektromobilität im Fokus], Agora Verkehrswende, 2019, focus on full electrification of passenger cars<br />
<br />
[https://www.dena.de/themen-projekte/projekte/energiesysteme/dena-leitstudie-integrierte-energiewende/ DENA Leitstudie Integrierte Energiewende], German Energy Agency (DENA), 2018</div>Jonathan Ammehttps://wiki.openmod-initiative.org/wiki/DatabaseRulesDatabaseRules2018-04-20T09:48:38Z<p>Jonathan Amme: </p>
<hr />
<div>{{GlossaryTermTemp<br />
|SubtermOf=Database<br />
}}<br />
= OpenEnergy Data Base (oedb)<br/> =<br />
<br />
The following database rules explain the basic principles of the database called oedb, which will become a part of the openmod internet presence. For further details see also [[Database|here]].<br/><br />
<br />
== Open Data<br/> ==<br />
<br />
*Only use data with suitable licences<br/><br />
*<span lang="EN-US">Do not upload restricted data into the database</span><br/><br />
<br />
More Information can be found on [[Choosing a license|Open Licenses.]] Additional, the Project Open Power System Data is dealing this topic on [http://open-power-system-data.org/legal OPSD - Legal].<br />
<br />
<br/><br />
<br />
<br/><br />
<br />
== Data Documentation<br/> ==<br />
<br />
*All data included in the databases has be documented! On this wiki page you learn how to do so<br/><br />
*All abreviations have to be documentated in the of the openmod wiki<br/><br />
<br />
== Naming of Data<br/> ==<br />
<br />
*The nomenclature should follow a logical structure<br/><br />
*There are different levels of naming<br/><br />
<br />
=== Database Name<br/> ===<br />
<br />
*The name of the database is<br/><br />
<br />
<br/><br />
<br />
<br/><br />
<br />
=== Database Schema<br/> ===<br />
<br />
you find the current version of the oedb schema [[Database schema|here]]<br/><br/><br />
<br />
<br/><br />
<br />
=== Database Table<br/> ===<br />
<br />
*always lower case<br/><br />
*no points, no commas<br/><br />
*no spaces<br/><br />
*no dates<br/><br />
*use underscores<br />
*use ASCII characters only<br />
<br />
<br/><br />
<br />
The table name consists of<br />
<br />
#name starts with the source, project or model name (e.g. zensus, eGo)<br />
#main value (e.g. population)<br />
#if separated by [attribute] (e.g. by_gender)<br />
#with resolution [tupel] (e.g. per_mun)<br />
<br />
Example: ''zensus_population_by_gender_per_mun''<br/><br/><br />
<br />
Remember to put your abbreviations in the Glossary<br />
<br />
<br/><br />
<br />
=== Database View / Materialized View ===<br />
<br />
Views should only be used to<br />
<br />
*filter a table<br />
*join diferent tables<br />
*st_transform to change kbs<br />
<br />
<br/><br />
<br />
The views name should the original table with action and _view or _mview.<br />
<br />
Example: ''zensus_population_by_gender_per_mun_berlin_mview''<br />
<br />
<br/><br />
<br />
Hint: Do not open large views with QGIS, use MView and set GIST index on geom.<br />
<br />
<br/><br />
<br />
== Data Integrity<br/> ==<br />
<br />
"Data integrity refers to maintaining and assuring the accuracy and consistency of data over its entire life-cycle." ([https://en.wikipedia.org/wiki/Data_integrity Wikipedia]) These two aspects belong to the [[Data quality|data quality]] criteria, the data in the oedb should meet.<br />
<br />
<br/><br />
<br />
=== General<br/> ===<br />
<br />
*Each table should have a single auto-incremented integer column as Primary Key with the corresponding table constraint.<br/><br />
*Grant all privilegs to oeuser (automatically done by the system)<br />
<br />
<br/><br />
<br />
=== Geografic Data<br/> ===<br />
<br />
*Attribut name is '''geom.'''<br />
*Data type is '''geometry''' (or raster).<br />
*One of the '''Geometric Types''' is defined ([https://www.postgresql.org/docs/current/static/datatype-geometric.html https://www.postgresql.org/docs/current/static/datatype-geometric.html])<br />
*The '''CRS''' is defined as EPSG ([http://spatialreference.org/ref/epsg/ http://spatialreference.org/ref/epsg/])<br />
**Original data stays with the original CRS!<br />
**Prefered CRS of the oedb are:<br/><br />
<br />
#WGS84 - EPSG: 4326 ([http://spatialreference.org/ref/epsg/4326/ http://spatialreference.org/ref/epsg/4326/])<br />
#ETRS89 / ETRS-LAEA - EPSG: 3035 ([http://spatialreference.org/ref/epsg/3035/ http://spatialreference.org/ref/epsg/3035/])<br />
<br />
*Spacial index '''GIST''' has to be set<br />
<br />
<br/><br />
<br />
== Data Referencing<br/> ==<br />
<br />
There are several useful attributes on a table users have to know in order to work with the contained data efficiently. Therefore, ensuring the quality of these meta data is as important as ensuring the quality of the data itself (see also [[Data quality|here]]).<br/><br />
<br />
For these meta data the documentation open-standard Json is used ([https://en.wikipedia.org/wiki/JSON Wiki] and [http://www.json.org/ Json.org]). The documentation is separated in two major categories:<br />
<br />
#Comments on tables: Contains metadata that define several aspects for the whole table<br />
#Comments on rows: Store important informations on a specific row and the stored data<br />
<br />
<br/><br />
<br />
=== Comments on Tables<br/> ===<br />
<br />
Comments on a table are json-dictionary as strings that describe the overall structure of the corresponding table. For every field the corresponding unit (in case of numerical values) and a description that specifies the contained data should be attached. The attribute names begin with an <u>upper case</u> and are given by the following definition of <span style="font-weight: normal"></span><span style="font-weight: normal">Database Tables. The Json meta documentation string is stored as table comment&nbsp; on the database table.</span><br />
<br />
<br/><br />
<br />
<br/><br />
<br />
==== &nbsp;Meta Documentation of Tables<br/> ====<br />
<br />
Original Data (orig) are defined as data from one source which are not further processed (see: '''Database Schema'''). The metadata Documentation for those data sets are set as a comment on the table. Following meta data are proposed:<br/><br />
<br />
<br/><br />
<br />
{| style="width: 643px" cellspacing="1" cellpadding="1"<br />
|+ Metadata Documentation of original data on table<br/><br />
|- valign="top"<br />
! style="border-width: 1px medium 1px 1px; border-style: solid none solid solid; border-color: rgb(0, 0, 0) -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0.1cm 0cm 0.1cm 0.1cm; width: 198px; height: 15px" scope="col" | <div>Attribute (level 1)<br/></div><br />
! style="border-width: 1px medium 1px 1px; border-style: solid none solid solid; border-color: rgb(0, 0, 0) -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0.1cm 0cm 0.1cm 0.1cm; width: 131px" scope="col" | <div>Attribute (level 2)<br/></div><br />
! style="width: 291px; border: 1px solid rgb(0, 0, 0); padding: 0.1cm" scope="col" | <div>Description<br/></div><br />
|- valign="top"<br />
| style="height: 15px; width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Name<br/></div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px; height: 15px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm; height: 15px" | <div>Original name of the data set</div><br />
|-<br />
| style="height: 15px; width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Source</div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div><br/></div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" rowspan="2" | <div><br/></div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Name&nbsp;<br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Source Name<br/></div><br />
|- valign="top"<br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>URL<br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>URL string</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Reference date</div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Reference date of the data set.<br/></div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Date of collection</div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Date of data collection into the database.</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Original file</div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Name of the original data file with file extension (e.g. .xls,.shp, .pdf, etc.)</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Spatial resolution</div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Spatial resolution of the data set</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Description</div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Short description of the data set.</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Column</div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Metadata of all table fields / columns<br/></div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" rowspan="3" | <div><br/></div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Name</div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Name of Column 1<br/></div><br />
|- valign="top"<br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Description</div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>English description of Column 1</div><br />
|- valign="top"<br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Unit</div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Unit if exist e.g. (€, MWh, etc.)</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div><br/></div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>…</div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>...</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" rowspan="3" | <div><br/></div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Name</div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Name of Column N</div><br />
|- valign="top"<br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Description</div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>English description of Column N</div><br />
|- valign="top"<br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Unit</div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Unit if exist e.g. (€, MWh, etc.)</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Changes</div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Information of changes and user</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" rowspan="4" | <div><br/></div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Name</div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Name of Person created or changed dataset</div><br />
|- valign="top"<br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Mail</div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>E-mail Address</div><br />
|- valign="top"<br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Date<br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Date of changes</div><br />
|- valign="top"<br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div>Comment<br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Comment of changes</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | Note<br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Comment of ToDo which are not done yet</div><br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Licence</div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Licence of the data set</div><br />
|-<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <br/><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | Name<br/><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | Name of Licence<br/><br />
|-<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | URL<br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | URL of Licence<br />
|- valign="top"<br />
| style="width: 168px; border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 198px" | <div>Instructions for proper use<br/></div><br />
| style="border-width: medium medium 1px 1px; border-style: none none solid solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0cm 0.1cm 0.1cm; width: 131px" | <div><br/></div><br />
| style="width: 291px; border-width: medium 1px 1px; border-style: none solid solid; border-color: -moz-use-text-color rgb(0, 0, 0) rgb(0, 0, 0); padding: 0cm 0.1cm 0.1cm" | <div>Instructions for proper use of Licences.</div><br />
|}<br />
<br />
<br/><br />
<br />
<u>'''[https://github.com/openego/data_processing/tree/master/data_documentation Json Example:]'''</u><br/><br />
<br />
{| style="width: 100%" cellspacing="0" cellpadding="0" border="0"<br />
|-<br />
| <pre><br />
{<br />
"Name": "Original name of the data set",<br />
"Source":[{<br />
"Name": "Website of data",<br />
"URL": "www.website.com" }],<br />
"Reference date": ["2013"],<br />
"Date of collection": ["01.08.2013"],<br />
"Original file": ["346-22-5.xls"],<br />
"Spatial resolution": ["Germany"],<br />
"Description": ["Example Data (annual totals)", "Regional level: national"],<br />
<br />
"Column": [<br />
{"Name":"id",<br />
"Description":"Unique identifier",<br />
"Unit":"" },<br />
<br />
{"Name":"year",<br />
"Description":"Reference Year",<br />
"Unit":"" },<br />
<br />
{"Name":"example_value",<br />
"Description": "Some important value",<br />
"Unit":"EUR" }],<br />
<br />
"Changes":[<br />
{"Name":"Joe Nobody",<br />
"Mail":"joe.nobody@gmail.com (fake)",<br />
"Date":"16.06.2014",<br />
"Comment":"Created table" },<br />
<br />
{"Name":"Joana Anybody",<br />
"Mail":"joana.anybody@gmail.com (fake)",<br />
"Date":"17.07.2014",<br />
"Comment":"Translated field names"}],<br />
<br />
"Note": ["Some datasets are odd -> Check numbers against another data"],<br />
"Licence": [{"Name":"Licence – Version 2.0 (dl-de/by-2-0",<br />
"URL": "http://www.govdata.de/dl-de/by-2-0]"],<br />
"Instructions for proper use": ["Always state licence"]<br />
}</pre><br />
|}<br />
<br />
<br/><br />
<br />
<br/><br />
<br />
<br/><br />
<br />
<br/><br />
<br />
<br/><br />
<br />
<br/><br />
<br />
<br/><br />
<br />
=== Meta Documentation of data collections from several sources: ===<br />
<br />
'''This section is still work in progress! Please contribute to the discussion to improve the implementation.'''<br />
<br />
<br/><br />
<br />
In addition to the meta documentation described above, data tables (blue table in figure) which include data from several sources get a ref_id column. The ref_id links each row with a json documentation string (ref_data_json) in the database table public.reference_to_entries (green table in figure).This table also includes the ref_data_json column which links to all sources of the row to be referenced (blue). The ref_data_json string includes one jabref_entries_id for each source used. The jabref_entries_id is matched by one entries_id belonging to a source stored in the public.entries table (orange table).<br />
<br />
<br/><br />
<br />
'''''<u>Example: ER-Model</u>'''''<br/><br />
<br />
[[File:ERM oedb references example.png|frame|center|100px|ERM references example|alt=ERM references example]]<br/><br />
<br />
''<u>reference_to_entries table structure:</u>''<br/><br />
<br />
{| style="width: 100%" cellspacing="0" cellpadding="4"<br />
|- valign="top"<br />
| style="width: 14%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''ref_id'''</font></font><br/></div><br />
| style="width: 18%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''ref_data_json'''</font></font></div><br />
| style="width: 20%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''schema_name'''</font></font></div><br />
| style="width: 15%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''tbl_name'''</font></font></div><br />
| style="width: 17%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''changed_by'''</font></font></div><br />
| style="width: 17%; border: 1px solid #000000; padding: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''lastmodified'''</font></font></div><br />
|- valign="top"<br />
| style="width: 14%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Reference ID</font></font></div><br />
| style="width: 18%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Json Documentation string</font></font></div><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Name of the schema which includes the table “tbl_name”</font></font></div><br />
| style="width: 15%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Name of table with the data to be referenced</font></font></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Name of user changing or creating this reference entry. (Automatic</font></font>default setting)<br/></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Date of entry modification.&nbsp;(Automatic</font></font> default setting)<br/></div><br />
&nbsp;<br/><br />
<br />
|}<br />
<br />
Each row in the reference_to_entries table (green) contains a ref_data_json documentation string which links to the meta data in the Jabref table public.entries (orange).<br/><br/><u>'''Example:'''</u><br />
<br />
'''Database table: '''ref_test.parameter_electrical_power_plant<br />
<br />
{| style="width: 100%" cellspacing="0" cellpadding="4"<br />
|- valign="top"<br />
| style="width: 8%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div style="text-align: justify"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">fuel</font></font></div><br />
| style="width: 25%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div style="text-align: justify"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">type_of_generation</font></font></div><br />
| style="width: 17%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div style="text-align: justify"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">effnetto_el</font></font></div><br />
| style="width: 17%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div style="text-align: justify"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">...</font></font></div><br />
| style="width: 17%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div style="text-align: justify"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">opex_var</font></font></div><br />
| style="width: 17%; border: 1px solid #000000; padding: 0.1cm" | <div style="text-align: justify"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">ref_id</font></font></div><br />
|- valign="top"<br />
| style="width: 8%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">coal</font></font></div><br />
| style="width: 25%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">st</font></font></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''0.35'''</font></font></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">...</font></font></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''2'''</font></font></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">1</font></font></div><br />
|- valign="top"<br />
| style="width: 8%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">...</font></font></div><br />
| style="width: 25%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><br/></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><br/></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><br/></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><br/></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><br/></div><br />
|}<br />
<br />
<br/><br />
<br />
'''''Database table: '''<u>reference_to_entries table structure:</u>''<br />
<br />
{| style="width: 100%" cellspacing="0" cellpadding="4"<br />
|- valign="top"<br />
| style="width: 14%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''ref_id'''</font></font></div><br />
| style="width: 18%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''ref_data_json'''</font></font></div><br />
| style="width: 20%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''schema_name'''</font></font></div><br />
| style="width: 15%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''tbl_name'''</font></font></div><br />
| style="width: 17%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''changed_by'''</font></font></div><br />
| style="width: 17%; border: 1px solid #000000; padding: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''lastmodified'''</font></font></div><br />
|- valign="top"<br />
| style="width: 14%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">1</font></font></div><br />
| style="width: 18%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div style="margin-bottom: 0cm"><font face="Arial, sans-serif"><font style="font-size: 8pt" size="1">{</font></font></div><div style="margin-bottom: 0cm"><font face="Arial, sans-serif"><font style="font-size: 8pt" size="1">"Name": "Collection of electrical power plant parameter",</font></font></div><div><font face="Arial, sans-serif"><font style="font-size: 8pt" size="1">"Discription": "Technical parameter of confentional electrical power plants '''…'''</font></font></div><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">ref_test</font></font></div><br />
| style="width: 15%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">parameter_electrical_power_plant</font></font></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">user_1</font></font></div><br />
| style="width: 17%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">2016-03-17 15:37:24.538213</font></font></div><br />
|}<br />
<br />
<u>'''Json'''</u>''<u><span style="font-weight: normal"></span></u>''<u>'''Example:'''</u><br />
<br />
{| style="width: 100%" cellspacing="0" cellpadding="0" border="0"<br />
|-<br />
| <br />
<pre><br />
{<br />
"Name": ["Collection of electrical power plant parameter"],<br />
"Description":["Technical parameter of conventional electrical power plants "],<br />
"Column": [{<br />
"effnetto_el":{"jabref_entries_id": 1,<br />
"Description":"Electrical net efficiency},<br />
<br />
"opex_var": {"jabref_entries_id": 2,<br />
"Description":"Variable operational expenditure"} }],<br />
<br />
"Note":["Short note or comment to this entry"]<br />
}</pre><br/><br />
<br />
|}<br />
<br />
'''Note:''' The general meta information like units are given meta documentation of the table.<br />
<br />
The metadata [https://en.wikipedia.org/wiki/BibTeX BibTeX standard] from [http://www.jabref.org JabRef] is used for the Data Referencing in the table public.entries.<br />
<br />
<br/><br />
<br />
<br/><br />
<br />
=== Comments on Rows<br/> ===<br />
<br />
'''This section is still work in progress! Please contribute to the discussion to improve the implementation.'''<br />
<br />
<br/><br />
<br />
The comments on a row aim to enhance the reproducabilty of data that is present in the database by stating the underlying data that was used to compute this&nbsp; row as well as the applied computational methods.<br/><br />
<br />
During these processes some kinds of uncertainities might occur as well as the decissions (assumtions) that were made to deal with them. Examplatory, some values might be missing amid this row and a linear development during this period was assumed to fix this gap. Each row has to be annotated by a json dictionary that must contain the following fields:<br/><br />
<br />
''<u>Json documentation string structure on row:</u>''<br/><br />
<br />
{| style="width: 100%" cellspacing="0" cellpadding="4"<br />
|+ Metadata Documentation of data on rows<br />
|- valign="top"<br />
| style="width: 22%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''Attribute (level 1)'''</font></font><br/></div><br />
| style="width: 20%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''Attribute (level 2)'''</font></font><br/></div><br />
| style="width: 19%; border-top: 1px solid #000000; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0.1cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''Attribute (level 3)'''</font></font></div><br />
| style="width: 39%; border: 1px solid #000000; padding: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">'''Description'''</font></font></div><br />
|- valign="top"<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div class="western"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Name</font></font></div><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div class="western"></div><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><br/></div><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Name of the table to be referenced</font></font></div><br />
|-<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | Origin<br/><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br/><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br/><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | Link or textual description of the data set this row origins from<br/><br />
|-<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | Assumption<br/><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br/><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br/><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | A list of dictionaries. Each dictionary describes an assumption and annotates the affected rows<br/><br />
|-<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br/><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | begin<br/><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br/><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | First column affected by the assumption<br/><br />
|-<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | end<br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | Last column affected by the assumption<br />
|-<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br/><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | type<br/><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br/><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | Type of the problem that had to be solved. Each type requires one or more additional keys in this dictionary. Possible types and their required additional keys are: gap, multiplicity<br/><br />
|-<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | solution<br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | Method that was used to generate date to fix this problem (e.g. linear interpolation)<br />
|-<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | values<br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | [Only if type is multiplicity] Possible Values that could have been used<br />
|- valign="top"<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div class="western"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Discription</font></font><br/></div><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div class="western"></div><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><br/></div><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Short description of the table</font></font></div><br />
|- valign="top"<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div class="western"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2"><span style="background: transparent">Column</span></font></font></div><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div class="western"></div><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><br/></div><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Columns which need to be referenced</font></font></div><br />
|- valign="top"<br />
| style="height: 15px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" rowspan="6" | <div style="text-align: center" class="western"></div><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div style="text-align: left" class="western"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">&lt;column name 1&gt;</font></font></div><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><br/></div><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Column name 1, (original column name and spelling)</font></font></div><br />
|- valign="top"<br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" rowspan="2" | <div style="text-align: center" class="western"></div><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">jabref_entries_id</font></font></div><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Jabref entries id of Literature entry</font></font></div><br />
|- valign="top"<br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Description</font></font></div><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Short description</font></font></div><br />
|- valign="top"<br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div style="text-align: left" class="western"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2"><</font></font><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">column</font></font><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">name</font></font><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">2</font></font><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">></font></font></div><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><br/></div><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div style="text-align: left" class="western"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Column name 2, (original column name and spelling)</font></font></div><br />
|- valign="top"<br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" rowspan="2" | <div style="text-align: center" class="western"></div><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">jabref_entries_id</font></font></div><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Jabref entries id of Literature entry</font></font></div><br />
|- valign="top"<br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Description</font></font></div><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Short description</font></font></div><br />
|- valign="top"<br />
| style="height: 14px; width: 22%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div style="text-align: left" class="western"><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Note</font></font></div><br />
| style="width: 20%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div style="text-align: left" class="western"></div><br />
| style="width: 19%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm" | <div><br/></div><br />
| style="width: 39%; border-top: none; border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; padding-top: 0cm; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm" | <div><font face="Arial, sans-serif"><font style="font-size: 10pt" size="2">Note or comment to this entry</font></font></div><br />
|}<br />
<br />
<br/><br />
<br />
<br/><br />
<br />
<br/><br/>An examplatory dictionary:<br/><br />
<br />
{| style="width: 100%" cellspacing="0" cellpadding="0" border="0"<br />
|-<br />
| <pre><br />
{<br />
"origin":"https://data.openmod-initiative.org/data/oedb/orig_db/table<br />
"method":"https://github.com/openego/data_processing/blob/master/calc_ego_substation/Voronoi_ehv.sql"<br />
"assumptions":<br />
[<br />
{<br />
"type": "gap"<br />
"begin": "step_15"<br />
"end": "step_34"<br />
"solution": "linear_interpolation"<br />
} <br />
]<br />
}<br />
</pre><br />
|}</div>Jonathan Ammehttps://wiki.openmod-initiative.org/wiki/Open_Energy_Modelling_Workshop_-_Frankfurt_2017Open Energy Modelling Workshop - Frankfurt 20172017-03-15T11:00:27Z<p>Jonathan Amme: /* Short Presentations */</p>
<hr />
<div><br />
This is the wiki page for the upcoming Sixth Workshop of the Open Energy Modelling Initiative, a grass-roots organization of modellers from various research institutes, universities and companies. The workshop will take place in '''Frankfurt, Germany''' hosted by the [https://fias.uni-frankfurt.de/en/ Frankfurt Institute for Advanced Studies] (see [[Events|Events]] for previous workshops). The workshop will take place on '''20-21 April 2017''', with an optional tutorial day before on 19 April 2017. Since the workshop is run by volunteers, there is no registration fee, so feel free to join!<br/><br />
<br />
This wiki page will be updated frequently with a programme and practical information. All participants are invited to contribute suggestions of different sessions to be included in the programme. In the meantime, feel free to register on the [https://groups.google.com/forum/#!forum/openmod-initiative mailing list] where all things regarding energy modelling are discussed.<br />
<br />
= About the workshop =<br />
<br />
The Openmod Workshops provide a forum for modellers to come together and discuss how to further the use of open data and open software tools in the energy modelling community. Topics range from exchanges about specific types of data (e.g. sources for open data on building stocks or distribution networks) to advocacy and outreach.<br />
<br />
Only a small part of the workshop consists of prepared presentations. For the rest of the workshop, participants work together in breakout groups on specific topics. The topics are chosen by the participants themselves, so please get actively involved by suggesting topics! To get the most out of the workshop, it is suggested to consider in advance what you would like to discuss.<br />
<br />
Breakout groups should have specific aims, which can be followed up after the workshop, e.g. improving the openmod wiki pages, lobbying a data-holder to change its licencing, improving educational tools, or outreach.<br />
<br />
= Practical information =<br />
<br />
[[File:FIAS.jpg|left|400px|Frankfurt Institute for Advanced Studies|alt=Frankfurt Institute for Advanced Studies]]<br />
<br />
<br/>'''Venue:''' Main Auditorium, [https://fias.uni-frankfurt.de/en/ Frankfurt Institute for Advanced Studies]<br />
<br />
'''Getting there:''' [https://fias.uni-frankfurt.de/en/how-to-find-us/ How to find us] - please note that it talkes 30-40 minutes with the local train to get from the Frankfurt main train station to the Uni Riedberg campus where FIAS is situated<br />
<br />
'''Map:''' [http://www.openstreetmap.org/way/37803842 OpenStreetMap]<br />
<br />
'''Train connections:''' Brussels (3 hours), Berlin (4 hours), Denmark (8 hours via Hamburg), London (7 hours via Brussels), Milan (7 hours via Basel), Paris (4 hours)<br />
<br />
'''Accommodation:''' There is no specific accommodation recommendation - Frankfurt is small enough that you can travel easily from any part of the city to the workshop venue. For bookings, try [https://www.airbnb.com/ airbnb], [https://booking.com booking.com] or [https://hrs.de HRS]. We do recommend that you book early, since room prices can be high at short notice. It is also possible to commute from nearby towns such as Bad Homburg, Offenbach, Wiesbaden, Mainz or Darmstadt.<br />
<br />
= Registration =<br />
<br />
Registration has now closed because the workshop is full! There are only 65 places. You can join the waiting list be filling out the [https://docs.google.com/forms/d/e/1FAIpQLSfIPWiecbSSfk4Wx2qjVYmWccVrDdFoccxQtJqqkEZJEk0T3A/viewform registration form], but we cannot guarantee you a place. If people drop out, we will inform you by email that your place is now secure.<br />
<br />
All the information that you enter in the form is visible on the [https://docs.google.com/spreadsheets/d/1DhJilqY7QumFpT-i5hhO9CdLzFX7gtOIvbQv5LUq-io/ participant list], apart from your email address which is kept private.<br />
<br />
If you run into any problems with the registration, drop an email to Wided Medjroubi (Wided.Medjroubi at next-energy.de).<br />
<br />
If you would like to give a 4-minute talk, please edit the list of talks below (you have to create an account on the wiki and log in first - see the buttons at the top right of this page).<br />
<br />
= Participants =<br />
<br />
Everyone who has registered is visible on the [https://docs.google.com/spreadsheets/d/1DhJilqY7QumFpT-i5hhO9CdLzFX7gtOIvbQv5LUq-io/ participant list].<br />
<br />
= Filming / Live Streaming =<br />
<br />
It is planned to film and live stream the first 3 hours of the conference.<br />
<br />
If speakers consent to the filming of their talks, please fill out the [[:File:Fias filming consent.pdf|filming consent form]] and email/fax it to the FIAS contact listed in the form. Otherwise it will be assumed you do not give permission for your presentation to be filmed.<br />
<br />
All filmed material will be released unter a [https://creativecommons.org/licenses/by/4.0/ Creative Commons BY 4.0] licence.<br />
<br />
= Programme =<br />
<br />
== Day 1: Optional Tutorials (Wednesday 19th April 2017) ==<br />
<br />
On the day before the main official workshop, optional tutorials will be organised for students new to scientific computing and energy system modelling.<br />
<br />
The tutorials will be split into two streams "General Scientific Computing" (entry-level git, Python) and "Advanced Topics" (Geographical Information Systems (GIS), visualisation, optimisation, energy system modelling). Each stream will take place in separate rooms at FIAS, each of which has a maximum of 20 places available.<br />
<br />
See the [https://docs.google.com/document/d/1_F6n9ePO2apa7V7XzE3KO6Ii0VASel-inIW_3i-n1EM/edit#heading=h.ojqn8etuudzn provisional plan].<br />
<br />
== Day 2: Main Workshop (Thursday 20th April 2017) ==<br />
<br />
=== Thursday Morning ===<br />
<br />
10:00 Start<br />
<br />
10:00 - 10:15 Welcome address and logistical information (FIAS)<br />
<br />
10:15 - 10:30 What is the Open Energy Modelling Initative?<br />
<br />
10:30 - 11:10 Introduction (everyone)<br />
<br />
11:10 - 11:40 Short model presentations<br />
<br />
11:40 - 12:00 Coffee<br />
<br />
12:00 - 12:30 Short model presentations<br />
<br />
12:30 - 13:30 Lunch<br />
<br />
=== Thursday Afternoon ===<br />
<br />
13:30 - 14:00 Introducing break-out groups (plenary) and organisation of where and when<br />
<br />
14:00 - 15:30 Break-out groups 1 (parallel)<br />
<br />
15:30 - 16:00 Coffee break<br />
<br />
16:00 - 17.30 Break-out groups 2 (parallel)<br />
<br />
17.30 - 18:00 Reporting back (plenary)<br />
<br />
18:00 Finish<br />
<br />
19:00 Dinner at [http://www.apfelwein-dax.de/essen_trinken.html Apfelwein Dax] in Sachsenhausen, approximately 35 minutes from the workshop location. Seats have been reserved for 40 people; the maximum space is for 45 people. There is a reasonable selection of vegetarian dishes; they can also provide vegan dishes, but the selection is somewhat limited.<br />
<br />
== Day 3: Main Workshop (Friday 21st April 2017) ==<br />
<br />
=== Friday Morning ===<br />
<br />
09:30 Start<br />
<br />
09:30 - 10:00 Summary of first day, discussion of breakout groups for this day<br />
<br />
10:00 - 11:30 Break-out groups 3 (parallel)<br />
<br />
11:30 - 12:00 Coffee break<br />
<br />
12:00 - 12:30 Reporting back (plenary)<br />
<br />
12:30 - 13:30 Lunch<br />
<br />
=== Friday Afternoon ===<br />
<br />
13:30 - 14:30 TechTalks or other discussion<br />
<br />
14:30 - 15:30 Wrap up, next workshop<br />
<br />
16.00 End of workshop<br />
<br />
== Day 4: Optional Tour of the Region (Saturday 22nd April 2017) ==<br />
<br />
Walk through vineyards of Rheingau / Tour of Frankfurt / Museums Tour (if raining)<br />
<br />
On this day there is also a [http://marchforscience.de/auch-in-deiner-stadt/frankfurt-rhein-main/ March for Science through Frankfurt] to celebrate Earth Day<br />
<br />
<br/><br />
<br />
= Breakout groups =<br />
<br />
The workshop is organised from and for modellers and stakeholders of the open energy modelling community who want to exchange and discuss about energy models, code, data, licenses, transparency, making results understandable to stakeholders, campaigning for open data...; if you are interested to discuss a special subject you can propose [https://docs.google.com/document/d/1d86QsKWc3hKWyUNuEKeEndhuOW03xFWUSzXnsi3Bl9o/edit# breakout groups] on the google sheet. Please communicate your ideas for new breakout groups and add your name to a group that you would like to join. You can add suggestions for the content either in the table or as a comment.<br />
<br />
<br/><br />
<br />
<br />
= Short Presentations =<br />
<br />
If you want to give a short presentation at the start of the workshop (4 mins + 1 min questions), e.g. a model introduction, please add your talk title and name here.<br />
<br />
It is planned to film and live stream the presentations. If speakers consent to the filming of their talks, please fill out the [[:File:Fias filming consent.pdf|filming consent form]] and email/fax it to the FIAS contact listed in the form. Otherwise it will be assumed you do not give permission for your presentation to be filmed. All filmed material will be released unter a [https://creativecommons.org/licenses/by/4.0/ Creative Commons BY 4.0] licence.<br />
<br />
#[https://github.com/FRESNA/atlite Atlite]: A light-weight xarray-based Python library for processing weather data ([[Jonas Hörsch|Jonas Hörsch]])<br />
#[https://renewables.ninja Renewables.ninja]: an open platform for modelling global wind and solar power (Stefan Pfenninger or Iain Staffell)...<br/><br />
#The Electricity Systems Optimisation framework - capacity planning considering endogneous technology learning (Clara Heuberger)<br />
#[http://open-power-system-data.org/ Open Power System Data]: A free and open data platform for power system modelling (Ingmar Schlecht or Kristian Reincke)<br />
#[https://github.com/openego/dingo DIstribution Network GeneratOr (DINGO)]: An open tool to generate synthetic medium-voltage and low-voltage distribution grids based on open data (Editha Kötter).<br />
<br />
<br />
= Tech talks =<br />
<br />
If you want to give a short presentation on some neat piece of software or methodology, etc., that has improved your research or workflow, add your talk title and your name here.<br />
<br />
#[https://conda-forge.github.io conda-forge] -- community driven package distribution (Tim Tröndle)<br />
#...</div>Jonathan Ammehttps://wiki.openmod-initiative.org/wiki/Distribution_network_datasetsDistribution network datasets2016-06-03T13:23:28Z<p>Jonathan Amme: </p>
<hr />
<div><br />
This page collects reference datasets of distribution networks in the city/suburb/countryside for different regions of the world.<br/><br />
<br />
== REDS: REpository of Distribution Systems ==<br />
<br />
[http://www.dejazzer.com/reds.html http://www.dejazzer.com/reds.html]<br />
<br />
Lists 8 radial distribution system datasets, focus seems to be on US.<br />
<br />
== IEEE PES Distribution Test Feeders ==<br />
<br />
[http://www.ewh.ieee.org/soc/pes/dsacom/testfeeders/index.html http://www.ewh.ieee.org/soc/pes/dsacom/testfeeders/index.html]<br />
<br />
== ENEXIS Gas and Electricity Network Open Data<br/> ==<br />
<br />
Power and gas grid data from an energy network operator in the Netherlands:<br />
<br />
[https://www.enexis.nl/over-enexis/open-data https://www.enexis.nl/over-enexis/open-data]<br />
<br />
The asset files are published as shapefiles with attributes. The spatial reference system used seems to be the 'Amersfoort / RD New' (EPSG 28992) coordinate system, which is standard in the Netherlands.<br />
<br />
== Atlantide - Archive of Distribution Grid Models ==<br />
<br />
Grid Models gained from Italian Distribution Grids. Registration required.<br />
<br />
[http://www.progettoatlantide.it/Atlantide/jsp/index.jsp http://www.progettoatlantide.it/Atlantide/jsp/index.jsp]<br />
<br />
From the Website:<br />
<br />
"[...] archive of models to be used as a reference for future research and development initiatives on MV and LV electrical distribution networks (passive and active). [...] :<br/><br />
<br />
*Models of reference network configurations typical of the Italian territory;<br />
*Models of generating units and loads;<br />
*Models of components supported by a database containing their typical characteristics;<br />
*Evolutionary scenarios of distribution systems in the next future."</div>Jonathan Ammehttps://wiki.openmod-initiative.org/wiki/MarktstammdatenMarktstammdaten2015-08-13T13:29:55Z<p>Jonathan Amme: </p>
<hr />
<div><br />
<br/><br />
<br />
Germany (BMWi, BNetzA) plans to to develop a register of power plant data that covers all plants (“starting from 0 kW”) that supersedes the current “EEG Stammdatenbank” and the “BNetzA Kraftwerksliste”.<br />
<br />
*geographic scope: Germany<br />
*content: capacity, technical characteristics, detailed information such as hub height of wind turbines (“master data”)<br />
*detail: individual blocks<br/><br />
*go-live: early 2017<br />
*not included: time series of any sort; yearly generation data<br />
*license: BMWi and BNetzA has not thought about a license yet<br/><br />
<br />
[http://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/DatenaustauschundMonitoring/MaStR/Datendefinitionen/mastr_datendefinitionen-node.html http://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/DatenaustauschundMonitoring/MaStR/Datendefinitionen/mastr_datendefinitionen-node.html]<br/><br />
<br />
<br/><br />
<br />
The consultation process is open now until end of August 2015. This page collects issue we would like to raise in the consultation.<br />
<br />
*we support such a register<br/><br />
*the register should “think” European, be compatible with existing registers elsewhere.'''Do we have specific examples? (ORISPL - Office of Regulatory Information System Plant Location (US)'''''')'''<br/><br />
*should be published under an open license.&nbsp;'''(suggesting ODbL? [1])'''<br/><br />
*the coverage of the data should become clear (e.g., "X% of all capacity is included; most missing capacity is small-scale gas-fired plants")<br />
**There are > 800k PV installations - will these be included?<br/><br />
<br />
*Does Stromerzeugungsanlagen (EAS) distinguish between generators and boilers?<br/><br />
*[http://www.eia.gov/electricity/data/eia923/ Form EIA-923] & [http://www.eia.gov/electricity/data/eia860/ Form EIA-860] are excellent examples of how to manage data on the power sector<br/><br />
*Are market roles and functions linked? Or would we have to deduplicate things by hand? Also, what about companies that may have a joint partnership in a power plant? Or subsidiaries? Relations that change over time? Mergers & splits?<br/><br />
*Ability to track changes on a power plant site? A wind farm may be built in stages, generators may be decommissed, upgraded, etc.&nbsp; Primary fuel used may change as well.<br/><br />
*What format will the data be published in?&nbsp; Will it be machine-readable?&nbsp; The [http://www.bundesnetzagentur.de/cln_1932/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/Versorgungssicherheit/Erzeugungskapazitaeten/Kraftwerksliste/kraftwerksliste-node.html BNetzA xls database] is mostly ok in this regard, but columns like ''Spezifizierung "Mehrere Energieträger" und "Sonstige Energieträger" - Hauptbrennstoff'' are difficult to parse consistently.<br />
**Best would be to provide data in different formats: Georeferenced database table (online accessible and downloadable dump) and Spreadsheet. To keep costs low, spreadsheet should be derived from database table.<br/>=> Relational DB (related tables for plants, operators etc.) to model structure including change history<br />
<br />
*Plants could be linked to power network (at least IDs?) to be on target for a possible future power grid database (i.e. grid conection point to medium-voltage power grid)<br/>=> General question: Should we consider interfaces to other potential DBs?<br/><br />
*It might be useful to suggest collecting use cases for the data to help ensure that what is being gathered can help to answer real research problems.<br />
**e.g. "be able to sum up all CO2 emissions for all facilities owned by company X and all its subsidiaries" - for this to be answered, the data structures need to provide links both between organizations and from organizations to their facilities.&nbsp; In other words, through this exercise we're mapping out what types of data should ideally be linked to what other types of data.&nbsp; This isn't just about putting data in tables, it's about if we can link data spread across multiple tables.<br/><br />
<br />
*Include spatial data<br />
**Best longitude and latitude, Ok adress data<br/><br />
**Anonymisation of very small (private) EAS => assignment to (unique) grid conection point / local grid&nbsp;?<br/><br />
<br />
*Why not include time-series or annual generation data?<br />
<br />
*...<br/><br />
<br />
<br/>[1] [http://opendatacommons.org/licenses/odbl/ http://opendatacommons.org/licenses/odbl/] (also used by OpenStreetMap)<br/><br/><br/></div>Jonathan Amme