Installation

The subsequently described installation steps are demonstrated as shell commands, where the path before the % sign denotes the directory in which the commands following the % should be entered.

Install PyPSA-Eur and its data

First install PyPSA-Eur and all its dependencies. Clone the repository:

projects % git clone https://github.com/PyPSA/pypsa-eur.git

then download and unpack all the PyPSA-Eur data files by running the following snakemake rule:

projects/pypsa-eur % snakemake -j 1 retrieve_databundle

Clone technology-data repository

Next install the technology assumptions database technology-data by creating a parallel directory:

projects % git clone https://github.com/PyPSA/technology-data.git

Clone PyPSA-Eur-Sec repository

Create a parallel directory for PyPSA-Eur-Sec with:

projects % git clone https://github.com/PyPSA/pypsa-eur-sec.git

Environment/package requirements

The requirements are the same as PyPSA-Eur. For solve_network.py in addition you need gurobipy. If you have xarray version >= 0.15.1, you will need the latest master branch of atlite version 0.0.2.

You can create an enviroment using the environment.yaml file in pypsa-eur/envs:

.../pypsa-eur % conda env create -f envs/environment.yaml

.../pypsa-eur % conda activate pypsa-eur

See details in PyPSA-Eur Installation

Data requirements

Small data files are included directly in the git repository, while larger ones are archived in a data bundle on zenodo (10.5281/zenodo.5546517). The data bundle’s size is around 640 MB.

To download and extract the data bundle on the command line:

projects/pypsa-eur-sec/data % wget "https://zenodo.org/record/5546517/files/pypsa-eur-sec-data-bundle.tar.gz"
projects/pypsa-eur-sec/data % tar -xvzf pypsa-eur-sec-data-bundle.tar.gz

The data licences and sources are given in the following table.

description file/folder licence source    
JRC IDEES database jrc-idees-2015/ CC BY 4.0 https://ec.europa.eu/jrc/en/potencia/jrc-idees    
urban/rural fraction urban_percent.csv unknown unknown    
JRC biomass potentials biomass/ unknown https://doi.org/10.2790/39014    
JRC ENSPRESO biomass potentials remote CC BY 4.0 https://data.jrc.ec.europa.eu/dataset/74ed5a04-7d74-4807-9eab-b94774309d9f    
EEA emission statistics eea/UNFCCC_v23.csv EEA standard re-use policy https://www.eea.europa.eu/data-and-maps/data/national-emissions-reported-to-the-unfccc-and-to-the-eu-greenhouse-gas-monitoring-mechanism-16    
Eurostat Energy Balances eurostat-energy_balances-*/ Eurostat https://ec.europa.eu/eurostat/web/energy/data/energy-balances    
Swiss energy statistics from Swiss Federal Office of Energy switzerland-sfoe/ unknown http://www.bfe.admin.ch/themen/00526/00541/00542/02167/index.html?dossier_id=02169    
BASt emobility statistics emobility/ unknown http://www.bast.de/DE/Verkehrstechnik/Fachthemen/v2-verkehrszaehlung/Stundenwerte.html?nn=626916    
BDEW heating profile heat_load_profile_BDEW.csv unknown https://github.com/oemof/demandlib    
heating profiles for Aarhus heat_load_profile_DK_AdamJensen.csv unknown Adam Jensen MA thesis at Aarhus University    
George Lavidas wind/wave costs WindWaveWEC_GLTB.xlsx unknown George Lavidas    
country codes Country_codes.csv CC BY 4.0 Marta Victoria    
co2 budgets co2_budget.csv CC BY 4.0 https://arxiv.org/abs/2004.11009    
existing heating potentials existing_infrastructure/existing_heating_raw.csv unknown https://ec.europa.eu/energy/studies/mapping-and-analyses-current-and-future-2020-2030-heatingcooling-fuel-deployment_en?redir=1    
IRENA existing VRE capacities existing_infrastructure/{solar|onwind|offwind}_capcity_IRENA.csv unknown https://www.irena.org/Statistics/Download-Data    
USGS ammonia production myb1-2017-nitro.xls unknown https://www.usgs.gov/centers/nmic/nitrogen-statistics-and-information    
hydrogen salt cavern potentials hydrogen_salt_cavern_potentials.csv CC BY 4.0 https://doi.org/10.1016/j.ijhydene.2019.12.161    
hotmaps industrial site database Industrial_Database.csv CC BY 4.0 https://gitlab.com/hotmaps/industrial_sites/industrial_sites_Industrial_Database    
Hotmaps building stock data data_building_stock.csv CC BY 4.0 https://gitlab.com/hotmaps/building-stock    
U-values Poland u_values_poland.csv unknown https://data.europa.eu/euodp/de/data/dataset/building-stock-observatory    
Floor area missing in hotmaps building stock data floor_area_missing.csv unknown https://data.europa.eu/euodp/de/data/dataset/building-stock-observatory    
Comparative level investment comparative_level_investment.csv Eurostat https://ec.europa.eu/eurostat/statistics-explained/index.php?title=Comparative_price_levels_for_investment    
Electricity taxes electricity_taxes_eu.csv Eurostat https://appsso.eurostat.ec.europa.eu/nui/show.do?dataset=nrg_pc_204&lang=en    
Building topologies and corresponding standard values tabula-calculator-calcsetbuilding.csv unknown https://episcope.eu/fileadmin/tabula/public/calc/tabula-calculator.xlsx    
Retrofitting thermal envelope costs for Germany retro_cost_germany.csv unkown https://www.iwu.de/forschung/handlungslogiken/kosten-energierelevanter-bau-und-anlagenteile-bei-modernisierung/    
District heating most countries jrc-idees-2015/ CC BY 4.0 https://ec.europa.eu/jrc/en/potencia/jrc-idees    
District heating missing countries district_heat_share.csv unkown https://www.euroheat.org/knowledge-hub/country-profiles    
           

Set up the default configuration

First make your own copy of the config.yaml based on
config.default.yaml. For example:
projects/pypsa-eur-sec % cp config.default.yaml config.yaml

Getting started

In config.yaml you can control the settings for the scenarios you want to run, such as the number of nodes, the CO2 limit, the installable potentials for solar and wind, which technologies are activated, etc.

To run the full optimization with your settings:

projects/pypsa-eur-sec % snakemake -j1

Warning: you may need a computer cluster for this (with e.g. 10-100 GB of RAM and several processors).

To only prepare the networks, you can run the scripts up to the point before optimization:

projects/pypsa-eur-sec % snakemake -j1 prepare_sector_networks