|
|
| Line 1: |
Line 1: |
| − | This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets.
| |
| − | You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future.
| |
| | | | |
| − | == Model relevant data == | + | This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future.<br/> |
| | + | |
| | + | == Model relevant data<br/> == |
| | | | |
| | Please note that red links indicate planned, but not yet filled pages. You are welcome to start creating the missing pages and breathe life into them. | | Please note that red links indicate planned, but not yet filled pages. You are welcome to start creating the missing pages and breathe life into them. |
| Line 12: |
Line 12: |
| | | | |
| | <br/> | | <br/> |
| − |
| |
| − |
| |
| − |
| |
| | | | |
| | == Various other open energy data sources<br/> == | | == Various other open energy data sources<br/> == |
| | | | |
| | *[http://enipedia.tudelft.nl/ Enipedia (TU Delft)] is an active exploration into the applications of wikis and the semantic web for energy and industry issues. <br/> | | *[http://enipedia.tudelft.nl/ Enipedia (TU Delft)] is an active exploration into the applications of wikis and the semantic web for energy and industry issues. <br/> |
| − | **An extensive compilation of links to other data sources can be found at [http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets] and [http://enipedia.tudelft.nl/wiki/Electricity_Transmission_Network http://enipedia.tudelft.nl/wiki/Electricity_Transmission_Network] | + | **An extensive compilation of links to other data sources can be found at [http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets http://enipedia.tudelft.nl/wiki/Energy_and_Industry_Data_Sets] and [http://enipedia.tudelft.nl/wiki/Electricity_Transmission_Network http://enipedia.tudelft.nl/wiki/Electricity_Transmission_Network]<br/> |
| | | | |
| | *[http://energypedia.info/ Energypedia] is a wiki platform for collaborative knowledge exchange on renewable energy and energy access issues in the context of development cooperation.<br/> | | *[http://energypedia.info/ Energypedia] is a wiki platform for collaborative knowledge exchange on renewable energy and energy access issues in the context of development cooperation.<br/> |
| | *[http://data.reegle.info/ reegle] is a data provider of country energy profiles, energy statistics and a directory of relevant stakeholders. It also offers the clean energy search and an extensive glossary. There is also an insightful clean energy blog with interesting and up-to-date background information. | | *[http://data.reegle.info/ reegle] is a data provider of country energy profiles, energy statistics and a directory of relevant stakeholders. It also offers the clean energy search and an extensive glossary. There is also an insightful clean energy blog with interesting and up-to-date background information. |
| | *[http://www.iea-etsap.org/web/E-techDS.asp IEA ETSAP energy technology data source (E-Tech-DS)] is a series of four-page technology briefs similar to the [https://www.iea.org/publications/freepublications/ IEA Energy Technology Essentials (filter for "essentials")]. The page contains short technical descriptions of 29 energy related technologies from power production, synthesised fuels, and fossil fuel production. | | *[http://www.iea-etsap.org/web/E-techDS.asp IEA ETSAP energy technology data source (E-Tech-DS)] is a series of four-page technology briefs similar to the [https://www.iea.org/publications/freepublications/ IEA Energy Technology Essentials (filter for "essentials")]. The page contains short technical descriptions of 29 energy related technologies from power production, synthesised fuels, and fossil fuel production. |
| − | *[http://en.openei.org/ OpenEI] features a wiki of crowd-sourced energy information and a database of single source data on buildings, energy, efficiency, consumption, demand, potential. | + | *[http://en.openei.org/ OpenEI] features a wiki of crowd-sourced energy information and a database of single source data on buildings, energy, efficiency, consumption, demand, potential.<br/> |
| | | | |
| | + | <br/> |
| | | | |
| − | == Data sharing techniques == | + | == Data sharing techniques<br/> == |
| | | | |
| − | The Open Knowledge foundation promotes the use of its '''[http://data.okfn.org/ data package]''' standard. It consists of using CSV for payload (data) and a file package.json to attach machine-readable metadata. The page links to many examples of existing, curated and maintained datasets that adhere to this standard. Additionally, they drive the creation of a software ecosystem that can create and digest this format. Due to its simplicity, using data packages does not depend on this ecosystem. | + | The Open Knowledge foundation promotes the use of its '''[http://data.okfn.org/ data package]''' standard. It consists of using CSV for payload (data) and a file package.json to attach machine-readable metadata. The page links to many examples of existing, curated and maintained datasets that adhere to this standard. Additionally, they drive the creation of a software ecosystem that can create and digest this format. Due to its simplicity, using data packages does not depend on this ecosystem.<br/> |
| | | | |
| − | '''GitHub repositories''' are another pragmatic way of sharing "small" (up to about 10 MB) datasets. A fun example is the [http://bundestag.github.io/gesetze/ Bundesgit], a collection of all German federal laws under version control. New laws or modfications are tracked as commits, allowing to "see" how a dataset -- laws, in that case -- evolve over time. The repository [https://github.com/openmundi/world.db openmundi/world.db] shows a more data-focused way of using Git, or GitHub, for collaborative collection of data. However, it clearly shows the limitations of using a version control system for code on data. | + | '''GitHub repositories''' are another pragmatic way of sharing "small" (up to about 10 MB) datasets. A fun example is the [http://bundestag.github.io/gesetze/ Bundesgit], a collection of all German federal laws under version control. New laws or modfications are tracked as commits, allowing to "see" how a dataset -- laws, in that case -- evolve over time. The repository [https://github.com/openmundi/world.db openmundi/world.db] shows a more data-focused way of using Git, or GitHub, for collaborative collection of data. However, it clearly shows the limitations of using a version control system for code on data.<br/> |
| | | | |
| − | An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already. | + | An upcoming and (technically) promising project is '''[http://dat-data.com/ dat]''', which "is a version-controlled, decentralized data tool for collaboration between data people and data systems." Or, simply: Git for data. It is currently in public beta test, but has come a long way already.<br/> |
| | | | |
| | + | == Help finding energy data<br/> == |
| | | | |
| − | == Data extraction scripts == | + | *[http://opendata.stackexchange.com/questions/tagged/energy http://opendata.stackexchange.com/questions/tagged/energy]<span style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">- latest questions on energy data sources</span> |
| | | | |
| − | Feel free to add scripts here, by creating a new wiki page, or place them on [https://gist.github.com/ Github Gists]. | + | |
| | + | |
| | + | == Data extraction scripts<br/> == |
| | + | |
| | + | Feel free to add scripts here, by creating a new wiki page, or place them on [https://gist.github.com/ Github Gists].<br/> |
| | | | |
| | *[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin] | | *[https://gitlab.tubit.tu-berlin.de/electricity-modeling/crossborder-skript ENTSOE Cross-border Trading Flows Extraction Script by TU Berlin] |
| | + | |
| | + | |
| | + | |
| | + | == Data organization ideas<br/> == |
| | + | |
| | + | *<span id="docs-internal-guid-154daf3c-a714-76df-26f2-8a392ea8c33d" style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">A scheme similar to </span>[http://us-city.census.okfn.org/ http://us-city.census.okfn.org/]<span style="font-size:14.666666666666666px; font-family:Arial; color:#000000; background-color:transparent; font-weight:400; font-style:normal; font-variant:normal; text-decoration:none; vertical-align:baseline">might be useful for mapping out what types of data are available where</span> |
This is work in progress and supposed to become a link list to sources of open energy related data. We focus on collecting links to data relevant for the modelling of energy and electricity systems and markets. You are welcome to fill in the missing spots and non-existing pages. Also, you are welcome to extend the list of relevant data that we should collect links to in the future.
Please note that red links indicate planned, but not yet filled pages. You are welcome to start creating the missing pages and breathe life into them.
