To receive notifications about scheduled maintenance, please subscribe to the mailing-list gitlab-operations@sympa.ethz.ch. You can subscribe to the mailing-list at https://sympa.ethz.ch

Commit ca4cc860 authored by Ard Kastrati's avatar Ard Kastrati
Browse files

Merge branch 'master' of https://gitlab.ethz.ch/kard/dl-project

parents b71629ce 67275090
......@@ -39,7 +39,7 @@ def cross_validate_SVC(X, y):
def cross_validate_RFC(X, y):
logging.info("Cross-validation RFC...")
classifier = RandomForestClassifier(max_features='auto', random_state=42, n_jobs=-1)
parameters_RFC = {'n_estimators': [10, 100, 1000, 5000], 'max_depth': [5, 10, 50, 100, 500]}
parameters_RFC = {'n_estimators': [10, 50, 100, 1000], 'max_depth': [5, 10, 50, 100, 500], 'min_samples_split' : [0.1, 0.4, 0.7, 1.0], 'min_samples_leaf' : [0.1, 0.5]}
cross_validate(classifier=classifier, parameters=parameters_RFC, X=X, y=y)
def cross_validate(classifier, parameters, X, y):
......
......@@ -51,7 +51,7 @@ def main():
try_sklearn_classifiers(trainX, trainY)
# cross_validate_kNN(trainX, trainY)
# cross_validate_SVC(trainX, trainY)
# cross_validate_RFC(trainX, trainY)
cross_validate_RFC(trainX, trainY)
else:
# tune(trainX,trainY)
run(trainX,trainY)
......
BEST ESTIMATOR,BEST SCORE,BEST PARAMS
"RandomForestClassifier(max_depth=5, min_samples_leaf=0.1, min_samples_split=0.1,
n_estimators=1000, n_jobs=-1, random_state=42)",0.6598846369794981,"{'max_depth': 5, 'min_samples_leaf': 0.1, 'min_samples_split': 0.1, 'n_estimators': 1000}"
(36223, 500, 129)
(36223, 1)
Fitting 2 folds for each of 160 candidates, totalling 320 fits
INFO:root:Started the Logging
INFO:root:X training loaded.
INFO:root:(129, 500, 36223)
INFO:root:y training loaded.
INFO:root:(1, 36223)
INFO:root:Setting the shapes
INFO:root:(36223, 500, 129)
INFO:root:(36223, 1)
INFO:root:Cross-validation RFC...
INFO:root:--- Runtime: 6324.672133684158 seconds ---
INFO:root:Finished Logging
This diff is collapsed.
Model,Score,Runtime
Nearest Neighbors,0.5412008281573499,3658.430173397064
Linear SVM,0.7055900621118012,30067.27211046219
Random Forest,0.6946859903381642,1354.794748544693
Naive Bayes,0.5421670117322291,57.323140382766724
KNeighborsClassifier(n_neighbors=100, weights='uniform', algorithm='auto', leaf_size=100, n_jobs=-1),
LinearSVC(tol=1e-5, C=1, random_state=42, max_iter=10000),
RandomForestClassifier(n_estimators=1000, max_depth=50, max_features='auto', random_state=42, n_jobs=-1),
GaussianNB()
INFO:root:Started the Logging
INFO:root:X training loaded.
INFO:root:(129, 500, 36223)
INFO:root:y training loaded.
INFO:root:(1, 36223)
INFO:root:Setting the shapes
INFO:root:(36223, 500, 129)
INFO:root:(36223, 1)
INFO:root:Training the simple classifiers: kNN, Linear SVM, Random Forest and Naive Bayes.
INFO:root:Nearest Neighbors
INFO:root:--- Score: 0.5412008281573499
INFO:root:--- Runtime: 3658.430173397064 for seconds ---
INFO:root:Linear SVM
INFO:root:--- Score: 0.7055900621118012
INFO:root:--- Runtime: 30067.27211046219 for seconds ---
INFO:root:Random Forest
INFO:root:--- Score: 0.6946859903381642
INFO:root:--- Runtime: 1354.794748544693 for seconds ---
INFO:root:Naive Bayes
INFO:root:--- Score: 0.5421670117322291
INFO:root:--- Runtime: 57.323140382766724 for seconds ---
INFO:root:--- Runtime: 35383.67445778847 seconds ---
INFO:root:Finished Logging
Sender: LSF System <lsfadmin@lo-s4-062>
Subject: Job 15337755: <python /cluster/home/mplomecka/dl-project/main.py> in cluster <leonhard> Done
Job <python /cluster/home/mplomecka/dl-project/main.py> was submitted from host <lo-login-02> by user <mplomecka> in cluster <leonhard> at Tue Mar 23 17:49:39 2021
Job was executed on host(s) <5*lo-s4-062>, in queue <gpu.24h>, as user <mplomecka> in cluster <leonhard> at Tue Mar 23 17:49:48 2021
</cluster/home/mplomecka> was used as the home directory.
</cluster/home/mplomecka/dl-project> was used as the working directory.
Started at Tue Mar 23 17:49:48 2021
Terminated at Wed Mar 24 03:39:47 2021
Results reported at Wed Mar 24 03:39:47 2021
Your job looked like:
------------------------------------------------------------
# LSBATCH: User input
python /cluster/home/mplomecka/dl-project/main.py
------------------------------------------------------------
Successfully completed.
Resource usage summary:
CPU time : 77840.79 sec.
Max Memory : 94853 MB
Average Memory : 90371.99 MB
Total Requested Memory : 125000.00 MB
Delta Memory : 30147.00 MB
Max Swap : -
Max Processes : 3
Max Threads : 17
Run time : 35422 sec.
Turnaround time : 35408 sec.
The output (if any) follows:
2021-03-23 17:49:52.399853: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
(36223, 500, 129)
(36223, 1)
/cluster/apps/python/3.8.5_gpu_gcc630/x86_64/lib64/python3.8/site-packages/sklearn/svm/_base.py:976: ConvergenceWarning: Liblinear failed to converge, increase the number of iterations.
warnings.warn("Liblinear failed to converge, increase "
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment