Initial commit

README.md

+# Statistical Learning Theory: Coding Exercises
+
+## Getting Started
+
+### Cloning the repo
+
+To clone the repository, you need to setup the [deploy key](slt2020) first. Make sure your file has a name `slt2020` without any extension. 
+
+Copy the deploy-key to your `~/.ssh/` folder.
+    
+Sometimes, you need to explicitly add an entry in the `~/.ssh/config`:
+
+```
+    Host gitlab.ethz.ch
+        IdentityFile ~/.ssh/slt2020
+        IdentitiesOnly yes
+```
+
+Moreover, if you get permission errors, you should reset the permissions:
+
+```
+    chmod 640 ~/.ssh/config
+    chmod 400 ~/.ssh/slt2020
+```
+
+Finally, clone the repository via ssh (not https!):
+
+```
+    git clone git@gitlab.ethz.ch:ccarlos/slt-coding-exercises-20.git
+    cd slt-coding-exercises-20
+```
+
+### Creating the environment
+
+Create the [conda](https://docs.conda.io/projects/conda/en/latest/user-guide/install/index.html) environment, which contains the basic packages:
+
+```
+    conda env create -n slt-ce -f environment.yml
+```
+
+Activate the environment, and start the notebook:
+
+```
+    source activate slt-ce
+    jupyter notebook slt-ce-0.ipynb
+```
+A new browser window with the first exercise should open.
+
+## Complete and submit an exercise
+
+To get the latest exercise, simply pull from the remote repo:
+
+```
+    cd slt-coding-exercises-20
+    git checkout master
+    git pull origin master
+```
+
+Before you start working on an exercise, you should create a new branch:
+
+```
+    git checkout -b <your-gitlab-username>/slt-ce-0
+```
+    
+The name of the branch should be your-gitlab-username/slt-ce-i, where i denotes the respective exercise. For example, in my case (gitlab username: ccarlos), it would be
+
+```
+    git checkout -b ccarlos/slt-ce-0
+```
+
+The instructions for each exercise can be found directly in the notebook.
+
+Once you are done, `put your legi somewhere clearly at the beginning of the notebook.`
+
+Then encrypt your notebook:
+
+```
+    ./encrypt.sh slt-ce-0.ipynb
+    > File encrypted as slt-ce-0.ipynb.encr
+```
+
+Then commit and push the encrypted notebook:
+
+```
+    git add slt-ce-0.ipynb.encr
+    git commit slt-ce-0.ipynb.encr -m "Submit slt-ce-0"
+    git push origin <your-gitlab-username>/slt-ce-0
+```
+
+`You can only submit your notebook before the respective deadline.`
+
+`We accept submissions only via git as described above.`
+
+`Be aware that all information you push, including the name you give to github and the email you give, will be visible to your colleagues. For this reason, do not push notebooks which are not encrypted and do not use your real name and email address if you do not want them to be visible to your colleagues.`
+
+`Do not push notebooks which are not encrypted.`
+
+
+## Exercise grading
+
+We offer 7 exercises. Each submitted exercise is graded between 4 and 6.
+
+For admission to the written exam, you need to receive a grade of 4 in at least **four** exercises.
+
+The exercise grade is computed as the average of your best four submissions.
+
+The course grade is the weighted average of written exam and exercise (70%/30%). 
+
+### Example 1
+
+Exercise grades: 5.5, 5.0, 6.0, -, -, -, -
+
+Failed course, submitted only three exercises!
+
+### Example 2
+
+Exercise grades: 5.0, 5.0, 4.0, 6.0, 6.0, -, -
+
+Exercise grade = (5.0 + 5.0 + 6.0 + 6.0) / 4 = 5.5
+
+Exam grade = 5.0
+
+Course grade = round(0.3 * 5.5 + 0.7 * 5.0) = 5.25
+
+
+## Exercise deadlines
+
+Hand-Ins are due by **noon** of the respective hand-in day, and the hand-in period typically starts one week earlier.
+
+`Exercises can not be handed in after the deadline, because the server is blocked!`
+
+|   | Exercise                 | Release   |  Hand-In          | 
+|---|--------------------------|-----------|-------------------|
+| 1 | Sampling                 | Mar 2nd   | Mar 16th 11:59am  |
+| 2 | Deterministic Annealing  | Mar 16th  | Mar 30th 11:59am  |
+| 3 | Histogram Clustering     | Mar 30th  | Apr 13th 11:59am  |
+| 4 | Constant Shift Embedding | Apr 20th  | May 4th  11:59am  |
+| 5 | Pairwise Clustering      | May 4th   | May 18th 11:59am  |
+| 6 | Mean Field approximation | May 18th  | Jun 1st  11:59am  |
+| 7 | Validation               | Jun 1st   | Jun 15th 11:59am  |
+

decrypt.sh

+#!/bin/bash
+
+if [ ! -e ~/.ssh/slt2020_prv.pem ]
+then
+    echo "> Private key ~/.ssh/slt2020_prv.pem does not exist."
+    exit 1
+fi
+
+notebookfile=$1
+
+if [ ! -e "$notebookfile" ]
+then
+    echo "> Notebook file $notebookfile does not exist."
+else
+    openssl smime -decrypt -aes256 -in "$notebookfile" -binary -inform DEM \
+        -inkey ~/.ssh/slt2020_prv.pem -out "${notebookfile%'.encr'}"
+    
+    echo "> File decrypted as ${notebookfile%'.encr'}"
+fi

encrypt.sh

+#!/bin/bash
+
+if [ ! -e slt2020_pub.pem ]
+then
+    echo "> Public key ./slt2020_pub.pem does not exist."
+    exit 1
+fi
+
+notebookfile=$1
+
+if [ ! -e "$notebookfile" ]
+then
+    echo "> Notebook file $notebookfile does not exist."
+else
+    openssl smime -encrypt -aes256 -in "$notebookfile" -binary -outform DEM \
+        -out "$notebookfile.encr" slt2020_pub.pem
+    
+    echo "> File encrypted as $notebookfile.encr"
+fi

environment.yml

+dependencies:
+  - python=3.5.4
+  - scikit-learn
+  - scikit-image
+  - scipy
+  - pandas
+  - numpy
+  - matplotlib
+  - jupyter
+  - tensorflow
+  - pip
+  - pip:
+    - treelib
+    - pathos

slt-ce-0.ipynb

+{
+ "cells": [
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "This is a test exercise, which is not graded.\n",
+    "You can use it to test the submission process.\n",
+    "\n",
+    "Exercise: Answer the question below to modify the notebook."
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "What is the result of 1+1?\n",
+    "\n",
+    "Answer:"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "metadata": {},
+   "outputs": [],
+   "source": []
+  }
+ ],
+ "metadata": {
+  "kernelspec": {
+   "display_name": "Python 3",
+   "language": "python",
+   "name": "python3"
+  },
+  "language_info": {
+   "codemirror_mode": {
+    "name": "ipython",
+    "version": 3
+   },
+   "file_extension": ".py",
+   "mimetype": "text/x-python",
+   "name": "python",
+   "nbconvert_exporter": "python",
+   "pygments_lexer": "ipython3",
+   "version": "3.5.5"
+  }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 2
+}

slt2020

+-----BEGIN RSA PRIVATE KEY-----
+MIIJKQIBAAKCAgEAyuj2/6KRPaaOpA0YqRjN0TiNiGy+1E0E6ZeiiRrlbiRoeAV5
+Mh7XiTV0mcp/SXdClDzuteVNKeZYdNocbJQfL1YKoPCN9INYeGWEOe2jbLsyBbIf
+kq9KsALORTvBdh1GpEhfBAQgplncCPkdkl3RZpgQzM8H2RFKQuai8XGG//DnChml
+jbe8VZICo+4Kb932LAe/mJ6xHkWkHctUlFCmZO6uq7DGqJrov32Ln9anayojn6ZJ
+ookA1i6DvrfXDzcKZmPbj57WhvYIIbC7tktXyayJjU/w/uRzaCE3CChp575jh6AH
+C+IX+FyZFfM+SoGlntmDCddUcgMV7sL6rs4mn+lnNIK4fbhzq0vqTggY4xtipcpF
+uTY/YF0BneU7y1UFBISCpCHn7wQGBbdrWCxd3X5YUzabCYg3N0FNY2Wst6xYUxq/
+Bxm+BrhGJ+KTk5QHIXd4pWmyMwrQrcp0CYsTDi1uid40MXcHWn+7ONFkCf144UOd
+ScjIKtd21pJBE09Rs7Uhso/oZYTSJvfhDk5EzNAZeWz/Ba90yET48CkDHtF9vi6E
+cIIVsywGmUHji1AVQZF8ybnjUPn1bfqhEajZKYS1rNIk2kGKudnEmeiYSrNI/39u
+4olJfujmlDSVueh41RRVqmeWqM4sS+baJuUQnyUvTt1d0bC/3BxJc84baTcCAwEA
+AQKCAgAjS7LrdNPe7YISd1S61V237yZvfLsVIvCf0YisYMlYB21Es28JkOPdMjc+
+KUNK/DvQnWjIq0Jo73Cjou0e1gU2rrjalf2bct2I09/UU8oBt+5Tn1Buq59KTrKi
+yGo2qZEIMq6UfENRrH/h77N9KmSqe/kwJzMuRxur14KwjRb2nmkSELQDmtpf6C4d
+ZeLa4rlXn2Fsou4cXfDWXfAwfHb1R6+Kng1wdsHVzXjkLOqicYoQ01QrubkziJPS
+MRhvxRtCBEzFBtQ6VcHEWoHMi/6RTjn/ItDBBewtSNnRyXXiofOeO+/92S5iPXlD
+oDRNsY+luiBZLeO6kV7XUYNZtPJyvz71j5xubRp/jcQb9yZ6TiEkGiavr1EjMdnE
+wk15sMQxETCHZMdmv8LdLUlPz4Jog0yGzrrR3nHsedyphpr2v5yKO5Ui/TEKuK2V
+Bfgk3S80PzwJg1EEH56OJE5ZYSvD2IhTRuBmxtg5sOYeJut2nnqlnHTDe1f5qkOI
+QyozCYXpP63ZOPiXCAih1Eo8CIbPAQo5uWi/rkkGj7ygapSKbDAzCdDuzlvAgytm
+qvLMQyOrDk7LmKt3o3LEv7MuGZ74uFDWRzaJEAP7URG3dGKtYNyco92n4VWy6g+p
+gNfolZQdXg+19d0eXvWt8VaHzHH3necNeX7JTpRyS6YrDRBwQQKCAQEA7p+qpAq2
+KKJ63R8N2aX+/GG1qdpJy5XGMniMYr8Jx+uuMVdnlqExs2wgE4MC4wQa5fyEz4uu
+mBuGnt7NogvnkIJo65MHxgafF9XeJquvwT+/4pCGcgwMr/XsMv2Z/rkbr2lwCZKg
+jTY5SXO3un197p+8D/WQGV9RN6O3HIKwJiw1SpUK6UtR68dVb0tLch7duILc1rXW
+KqQVLftQtZ9WTkJWqcvuZ4+fpwl+mGvKevJd7OmcS+QKFDOxgkrAZSZW+tn/GAHc
+AAHaPVOT/dPwTlvbYaj6b+CAgvEhFH/wFQ+lbGRWaUowS+Yv9msUDEO6JvbGWZ9/
+D6ZTUVC+7r0QVQKCAQEA2a+JiurngT6rqojr2lFxlMauexRxngYQqt+CxuIrC3Cb
+Anh493PAkT0WUmF7WowPt1Miw7juOMfoa50Jvn9HKIRQCuWbY8tZCVjOPD0o3l1b
+JjyKDYJph4bpDNoxZoJvbnn3iRiL5m0NmuMaCZH81YMAZNNhp5tmD0UksvLioMV/
+ulV7e9D+vpizD/L95wr/Q5Mi4grSqXKiXYVvJJeW6cC4rLF86OIU+xwkZmz99aeC
+xILJYItldlH9cpcKX/gdSd45rDIT2K+aVS/6dk52swdtCwm62bBmD6taroPhmI9i
+oKSHEXO4A1nCrPcK4CBXErsP9S+eUhrFsRd0qksvWwKCAQEAlbDjwvRVQThsCrqo
+XZicVIaXB25ATM4v/wlQR8G/yQI3zAwgl4WXQA7cMGFHNlIk7ZFzXx8o75KU6KSs
+KrN9GFI2r1EU10zgEHvBWFDreDcdkGtJa9HTQ67p9TLRn9FPZMKn3dl1jiAt374P
+y5Vdoovh1cEeHEyHDnhNLj1tcwTYiWjl52OwiFALcD2znmtue4jcMHTxXN6Bys6U
+2tqRsZY791hOvfiDFq4GFGfKJUZVVYFW4uSyzel/uVRbTRi4B7UpKU5BTF/dIAuG
+Ev0ZCo7lGGaAdB5Jf9rz/YAkg5HFHDH1Yyd/FJ3aCKMzeF4kML0twJslghO8wI3+
+uJUx4QKCAQEAx6O9OLIGbvnS5it8YlSfHhq4mhg9uvdFAfDKNyvk3jD/eFyUVBzM
+Vmb3ucW9I2WgZDjSgT1w/JIaDdePwC1qTTZLUjMRN4yes3vGaGiOuqBTn9WVpp4b
+ujd4NFlHRQQKvf8NjaX9Z+5Ls+jjUDOa9RWXnuBdhyF1kDuRVKx8O4XlhjYvcXZS
+qunQDqiDQwlK4eZm73eNi+meDrb5H04HEYm11GtSayIsq787gtQidNCTlTV9ChXN
+j53SGu16jlk2QzCTI+EpYmhp2gaOZUHAiqAc2SqrOkoUz/oOyE4a75dQlJNPbCn8
+cNY5O/e0+aevM3ZrRCnPwOzcsXUZgbRCUQKCAQAY1JMi2YMZHKdO9bU+3C3r+3S0
+Egee/rtNAZi6ndKTjjDJaA2IsCsUXzBcqCVZw4gADAOftyMZlAy34WVlEqmKtkhD
+IcZ1upnCVxdWtuk/vpsN6sNyBEgdQIXMEsBBFupIRQndgi8UvZ/5H3s1iLbk7CGW
+REOPLDpjjswwTwjUWijfNRzJNyPw9DG1gLO+vonztMoqbAHM94BWLMhWh6zdW4NJ
+dXWLAcIw4aOytm9MZTMER7I8T5nsfFpPaSL5rd6/LarePRfPT/zcynjSmoOJvOxd
+zUjLytqzwwYkOnSdSAuN5n3tz8eTPlN+6km5NfVaa9wkTvM95ogwd6PVxmu4
+-----END RSA PRIVATE KEY-----

slt2020_pub.pem

+-----BEGIN CERTIFICATE-----
+MIIE1TCCAr2gAwIBAgIJAK64ZK1NcRaTMA0GCSqGSIb3DQEBCwUAMAAwIBcNMTkw
+MjEyMTIzNTE0WhgPMjI5MjExMjcxMjM1MTRaMAAwggIiMA0GCSqGSIb3DQEBAQUA
+A4ICDwAwggIKAoICAQC0tTJycCAa5/mnPPrLiKrDY9H7+IWa7jsUmpj3pbb07c4L
+kNXjD4FkKlhqglzy97W5wvPviTYAA0Wl5kyRHhCXxadMW+6p+sP0OhvSDS76ujUt
+HqNp91v7qIZtOeAalufpsydQwUTBzl483chdU4nPosWHFnVY6uKTNU0+XYxcFt6j
+y7UU0/AHkXZQUztncXXfVs4ZHLWf1VSdZ9M25ma/R5pPMBwjWdV5657adyExnklt
+iCybz49MJeyW9lQV7LRLFz/XgwlLKf9tsBF8sFFb4oT/g4rLdYd0Lt7QaHJD4EiF
+Kgj49WDLxcObHUBoZE3ySsLYe8ZCSkU/M1hVQfVb9m8kRA/226fznElJAVKsRsvm
+wxTvXE5E0r4TSe5upHv2nZtO4TBBqSqpgcqQ5g7IZTqZgZb1B9Ao+Vr0lNMFnr4r
+Ol/yM9da1D5ucR1WgQT0jVUWlz3sh9gUyycD62L2PCvTUOhBoawFV5OkyBsq0vmr
+FTVwONPm4eGKUSflBjeLNPaoiqcp122lkONbx4YfcQHAjbEEx1HK471UT3jW+tu+
+nXqWf53SzoxUFCQAxGIHZ72mr5TB01vzdPfrgVOY2ZW2t7x1NJ4jSswEDnZcGUsz
+xyGlq51eQC26QEogKI5ak+EY3Y/R0gLAJqID320IxNTVvDKoSn57i7GvGeqUnwID
+AQABo1AwTjAdBgNVHQ4EFgQUsLRC9E70hT+JgOjDh5Clfex/s3QwHwYDVR0jBBgw
+FoAUsLRC9E70hT+JgOjDh5Clfex/s3QwDAYDVR0TBAUwAwEB/zANBgkqhkiG9w0B
+AQsFAAOCAgEASkgPmO31GRIBUCioiDs+LhCwa9BMfwEa9jl+OqGX3apezVIRxbIn
+lu3O9L1BQGCGNV+jN4vi4xy6I1K9h3xMxV02Oy3XJoqU1XnAdeo72e5Ri9BevlcQ
+JXiaPKKjDWRxy6Ktaoh40ZmKZrLA/tG4NFxVRIjcKvQJ7PggZmykNjhRbouElIyq
+ud3A7IYpRj6HlnHsIC4c8GqDsZB7f8nuJlhzd1tizJv3clnpbo1Jt1YNQG7zwY1I
+s5nytM6K4Zg8q68rgx1OKJ5vk5H6OrSEiDxy01Rr+wU+yveLGpII5zOrIVNMI1ca
+kY6rRjSoH8Hn9bwePxf6GvN1WriowXH7zTWqm/FPIjnc0L4yGEp20PE8AjseeRup
+xr3iR6tSekDX+Y2IaxUoPsXnbOPTST0kiTivvZVv7hh9xCMhi5wonz3QFQOuLGyN
+K8G9W0e2I9iKWAc0jhDv7pvZBVE99FXUCBG+w88wFGoiExCxiEFUE+KV1C9w6L7K
+ZoItUM1bMzYASSnxLy8+3rulJwdOrUDOz2gkQth+W1y8o4rAOXh8gBImYD8MLKTk
+QkposJ/KCpKKHp9Pk2Apl7m/8DShKEEYqcb9B76nhFPDUkkAtT3dKaFryBgDM8v1
+K9Vu2XWpEP+i5HHu+CyP7qy9FGjaQJ/bYV9bx4X+R+PmnNy59AfAFDA=
+-----END CERTIFICATE-----