To receive notifications about scheduled maintenance, please subscribe to the mailing-list gitlab-operations@sympa.ethz.ch. You can subscribe to the mailing-list at https://sympa.ethz.ch

Commit 3fee15a3 authored by Xuqian Yan's avatar Xuqian Yan
Browse files

Edits on dbSuffix and Euler commands

parent 2069f67c
......@@ -97,6 +97,9 @@ Other useful options are the following.
`bsub [...] matlab -nodisplay -r run_Nexuse`
- Set the output filename using `-o <output_filename>`. Default is `lsf.o<JobID>`.
- Add `-B` and/or `-N` to be notified via email when your job begins and/or ends ([reference](https://scicomp.ethz.ch/wiki/FAQ#How_do_I_know_when_my_job_is_done.3F)). Also, you need to have a file `.forward` in your home directory containing your email address.
`bsub -B -N [...] matlab -r run_Nexuse`
- For [parallel computation using OpenMP](https://scicomp.ethz.ch/wiki/Using_the_batch_system#OpenMP), the number of processor cores available needs to be specified using the environmental variable OMP\_NUM\_THREADS.
Set this with the command
......@@ -125,7 +128,7 @@ Other useful options are the following.
##### Experience with resource usage #####
**8-day time resolution with convergence criterium 2 percent**
**(1) 8-day time resolution with convergence criterium 2 percent**
For this, change line
......@@ -145,12 +148,20 @@ When running Nexus-e with a 8-day time resolution and energy-econonmic convergen
works fine.
**8-day time resolution with convergence criterium 0.1 percent**
**(2) 8-day time resolution with convergence criterium 0.1 percent**
As above, but set `limDifference = 0.001` in run\_Nexuse.m and give Euler more time for solving:
`bsub -n 36 -R "rusage[mem=2180]" -W "60:00" matlab -r run_Nexuse`. (This is still being tested as of October 22 2020).
**(3) Run the benchmark script bench_Nexuse.m**
As instructed in the [setup](setup.html#id3) procedure, you sometimes need to run the script `bench_Nexuse.m` to (re-)calibrate GemEl. This script runs rather quickly because it doesn't run the entire energy-economic loop and has a low time resolution. The command
`bsub -n 36 -W "2:00" matlab -r bench_Nexuse`
works fine.
##### Finding your way around output on Euler #####
After you issue a batch job through `bsub`, Euler will respond by telling you what the jobID is.
......
......@@ -160,12 +160,12 @@ So far you should have already downloaded MySQL from the section [Connect with t
- Connect to ETH VPN (in order to connect with the database)
- Open Matlab
- Double check the `user_conf.m` file: whether you have edited `DB_SUFFIX` to be your name initials; whether the paths of the software are correct.
- Before running `run_Nexuse.m` for the first time, you need to run `bench_Nexuse.m`.
It is recommended to repeat this step after major changes to the modules eMark and CentIv.
- Run the script `run_Nexuse.m` in the `Run_Nexuse` folder. Note, make sure you are into the `Run_Nexuse` folder before runing the `run_Nexuse.m` script.
- You could change the variables `scen`, `tpRes`, and `limDifference` as instructed in the script
- Consult Blazhe Gjorgiev (gblazhe@ethz.ch) if you want to run other scripts in the `Run_Nexuse` folder.
- Double check the `user_conf.m` file, e.g., whether the paths of the software are correct.
- (Optional) Run `bench_Nexuse.m`. This is required before you run `run_Nexuse.m` for the first time, or after major changes have been made to eMark and/or CentIv. Running `bench_Nexuse.m` will create a file `/Gemel/results/benchmark_2015.mat` which is necessary to run `run_Nexuse.m`.
- Run the script `run_Nexuse.m` in the `Run_Nexuse` folder. There are a few parameters that you can customize in the beginning of this run script:
- You could change the variables `scen`, `scenShortName`, `tpRes`, `limDifference`, and `dbSuffix` as instructed in the script
- If you don't want to run all 4 years, adjust `endY` for the case you are running. E.g., if endY=staY, it will only run one year.
- Consult the [Nexus-e team](nexus-e@ethz.ch) if you want to run other scripts in the `Run_Nexuse` folder.
#### Software for interacting with Euler from local machine ####
......@@ -240,7 +240,7 @@ We can highly recommend MobaXTerm.
In order to run the full Nexus-e platform efficiently, we use [Euler](https://scicomp.ethz.ch/wiki/Euler), an ETH cluster for High Performance Computing. To set up the Nexus-e platform on Euler, you first need to access Euler. Instructions on accessing Euler and commands for Euler can be found [here](https://scicomp.ethz.ch/wiki/Getting_started_with_clusters#Euler).
##### 1. Join the Nexus-e user group
We have a user group for access to Nexus-e specific licenses (e.g. GAMS) and the Euler pre-paid share. The user group is called: **MAVT-esc-nexus-e**, and is set and maintained by D-MAVT IT. To join the user group, ask Blazhe Gjorgiev (gblazhe@ethz.ch) to send an email to `servicedesk@mavt.ethz.ch`.
We have a user group for access to Nexus-e specific licenses (e.g. GAMS) and the Euler pre-paid share. The user group is called: **MAVT-esc-nexus-e**, and is set and maintained by D-MAVT IT. To join the user group, ask Blazhe Gjorgiev <gblazhe@ethz.ch> to send an email to `servicedesk@mavt.ethz.ch`.
To check whether you are added to the user group, use command line ssh to Euler (type `ssh username@euler.ethz.ch`), then type `groups` to show a list of groups that your user account is linked to, which should contain “MAVT-esc-nexus-e”.
......@@ -309,14 +309,8 @@ But still, we need to explicitely load all the dependencies, including modules (
You might encounter software compatibility problems when running Nexus-e on Euler, follow the link for possible solutions:
[Matlab & Python compatibility error: "ImportError: ...pyexpat...: undefined symbol: XML_SetHashSalt"](faq.html#matlab-python)
##### 5. Edit user_conf.m
- Make a copy of `user_example_conf.m` in the folder `Run_Nexuse`. Name the copy as `user_conf.m`. (Note: You should only work with the copy, because the original file `xxx_example_conf.m` is synchronized with git and it shouldn't be changed.)
```
cp user_example_conf.m user_conf.m
```
- Edit the variable `DB_SUFFIX` in to be your name initials.
##### 6. Run Nexus-e
##### 5. Run Nexus-e
- cd to the `Run_Nexuse` folder
- (Optional) Run `bench_Nexuse.m`. This is required before you run `run_Nexuse.m` for the first time, or after major changes have been made to eMark and/or CentIv. Running `bench_Nexuse.m` will create a file `/Gemel/results/benchmark_2015.mat` which is necessary to run `run_Nexuse.m`.
- Submit the job (the standard run script is `run_Nexuse.m`) with a command such as
......@@ -331,6 +325,6 @@ Here we give a short explanation to the example command above:
After submission, Euler will respond by telling you what the jobID is.
- Run script customization
- You could change the variables `scen`, `tpRes`, and `limDifference` as instructed in the script
- You could change the variables `scen`, `scenShortName`, `tpRes`, `limDifference`, and `dbSuffix` as instructed in the script
- If you don't want to run all 4 years, adjust `endY` for the case you are running. E.g., if endY=staY, it will only run one year.
- Consult Blazhe Gjorgiev (gblazhe@ethz.ch) if you want to run other scripts in the `Run_Nexuse` folder.
- Consult [Nexus-e team](nexus-e@ethz.ch) if you want to run other scripts in the `Run_Nexuse` folder.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment