To receive notifications about scheduled maintenance, please subscribe to the mailing-list gitlab-operations@sympa.ethz.ch. You can subscribe to the mailing-list at https://sympa.ethz.ch

Commit c9612ae7 authored by holukas's avatar holukas
Browse files

Update to v0.18.0-alpha

parent d68ad61a
......@@ -2,6 +2,36 @@
![DIIVE](images/logo_diive1_256px.png)
## v0.18.0-alpha | 20 Apr 2021
### Lag Features And Improved Off-season Uptake Correction
![DIIVE v0.18.0-alpha](images/v0.18.0-alpha_off-season_uptake_correction.png)
**NEW FEATURES**:
- `Create Variable > Lag Features`: Create lagged variants of variables
**ADDITIONS**:
- `Eddy Covariance > Off-season Uptake Correction`:
- Data can now be divided into classes of sonic temperature
- The division into sonic temperature classes is done separately for daytime and nighttime
- Results can be saved to a text file
- Previous results can be loaded from a text file
- `Eddy Covariance > Flux Quality Control`: Results can now be saved to a text file
- Added file type: DIIVE csv in daily time resolution
**CHANGES**:
- `Eddy Covariance > Flux Quality Control`: (z-d)/L stability check is no longer selected as default check
- The file extension of the DIIVE file format is now *.diive.csv (changed from *.amp.csv)
- Changed color of the histogram in overview plots (it is now, let's say, mint green)
**FRONTEND**:
- DIIVE should now start with the window maximized
- `File > File Import Settings`: Filetypes should now be shown in alphabetical order
- `Plots > Heatmap`: Added header
**BUGFIXES**:
- `Analyses > Feature Selection`: Fixed axis labels for Boruta results
## v0.17.0-alpha | 30 Mar 2021
### Feature Selection, Improved Random Forest and more
......@@ -12,22 +42,22 @@
- Amp was renamed to **DIIVE**, who would have thought
**NEW FEATURES**:
- Analyses > Feature Selection: Allows to find out which variables are important. Currently
- `Analyses > Feature Selection`: Allows to find out which variables are important. Currently
implemented are `Boruta` and `Recursive Feature Elimination With Cross-Validation`
- Modifications > Span Correction: First version of span correction function. Compares a target
- `Modifications > Span Correction`: First version of span correction function. Compares a target
variable to a reference variable calculates correction factors.
- Plots > Diel Cycles: First version of diel cycle plotting, will be expanded in the next versions
- `Plots > Diel Cycles`: First version of diel cycle plotting, will be expanded in the next versions
**ADDITIONS**
- Eddy Covariance > Off-season Uptake Correction: implemented optimization algorithm for fraction
- `Eddy Covariance > Off-season Uptake Correction`: implemented optimization algorithm for fraction
parameter. Optimization aims to minimize the difference between a target (e.g. CO2 fluxes from
an open path gas analyzer) and a reference variable (e.g. CO2 fluxes from an enclosed/closed path
analyzer).
- Gap-filling > Random Forest: added more parameters that can be adjusted via the settings panel,
- `Gap-filling > Random Forest`: added more parameters that can be adjusted via the settings panel,
based on `scikit-learn`
- Gap-filling > Random Forest: refined usage of time-based variables
- Reactivated Gap-filling > Simple Running
- File formats: SUTRON meteo .filetype
- `Gap-filling > Random Forest`: refined usage of time-based variables
- `Gap-filling > Simple Running`: reactivated
- Added filetype: SUTRON meteo (.filetype)
**FRONTEND**
- Added tab icons, they even have different colors
......
......@@ -64,6 +64,7 @@ Recent releases: [Releases](https://gitlab.ethz.ch/holukas/diive/-/releases)
- Combine Columns
- Define Seasons
- (*planned*) Flag
- Lag Features
- Time Since
### Eddy Covariance
......
......@@ -2,7 +2,7 @@
"app_name": "DIIVE",
"author": "Grassland Sciences ETH Zurich",
"main_module": "src/main/python/main.py",
"version": "0.17.0-alpha",
"version": "0.18.0-alpha",
"extra_pyinstaller_args": [
"--additional-hooks-dir", "hooks"
],
......
fit_start,fit_end,fit_slope_k,fit_offset_d
2001-04-27 11:30:00,2001-06-01 00:30:00,-0.00016369454303612874,120.57058726103725
fit_start,fit_end,fit_slope_k,fit_offset_d
2001-04-27 11:30:00,2001-06-01 00:30:00,2.6502323283417395e-05,-18.372262018833595
fit_start,fit_end,fit_slope_k,fit_offset_d
2001-04-27 11:30:00,2001-05-09 00:30:00,-0.00022021750283104968,161.69160940503195
2001-05-10 11:30:00,2001-05-25 00:30:00,0.0047217338162864105,-3448.9297487540807
fit_start,fit_end,fit_slope_k,fit_offset_d
2001-04-27 11:30:00,2001-06-01 00:30:00,-2.924549665372746e-05,21.373107297728033
fit_start,fit_end,fit_slope_k,fit_offset_d
2001-04-27 11:30:00,2001-06-01 00:30:00,-2.924549665372746e-05,21.373107297728033
fit_start,fit_end,fit_slope_k,fit_offset_d
2001-04-27 11:30:00,2001-06-01 00:30:00,-2.924549665372746e-05,21.373107297728033
fit_start,fit_end,fit_slope_k,fit_offset_d
2001-04-27 11:30:00,2001-06-01 00:30:00,4.690578137399326e-05,-33.27096980739532
fit_start,fit_end,fit_slope_k,fit_offset_d
2001-04-27 11:30:00,2001-06-01 00:30:00,190.72961715115457,-139349855.16649526
fit_start,fit_end,fit_slope_k,fit_offset_d
2001-04-27 11:30:00,2001-06-01 00:30:00,-0.00012425478129013436,91.74960246131826
fit_start,fit_end,fit_slope_k,fit_offset_d
2001-04-27 11:30:00,2001-06-01 00:30:00,0.007812494773510142,-5707.117444879526
FOCUS VARIABLE
co2_flux [mol+1s-1m-2]
888 total records
4 missing records
884 available records (100%)
_QCF_SSITC_qc_co2_flux [2=bad]
... Flag 1: 381 (43.1%)
... Flag 0: 471 (53.3%)
... Flag 2: 32 (3.6%)
_QCF_SCF_co2_scf [2=bad]
... Flag 0: 879 (99.4%)
... Flag 1: 4 (0.5%)
... Flag 2: 1 (0.1%)
_QCF_ABSLIM_co2_flux [2=bad]
... Flag 0: 883 (99.9%)
... Flag 2: 1 (0.1%)
_QCF_STABILITY_(z-d)/L [2=bad]
... Flag 0: 882 (99.8%)
... Flag 2: 2 (0.2%)
_QCF_COMPLETENESS_file_records [2=bad]
... Flag 0: 884 (100.0%)
_QCF_RAWDATA_spikes_hf_co2 [2=bad]
... Flag 0: 884 (100.0%)
_QCF_RAWDATA_drop_out_hf_co2 [2=bad]
... Flag 0: 884 (100.0%)
_QCF_RAWDATA_absolute_limits_hf_co2 [2=bad]
... Flag 0: 884 (100.0%)
... Flag 2: 0 (0.0%)
QCF_co2_flux [2=bad]
... Flag 1: 380 (43.0%)
... Flag 0: 469 (53.1%)
... Flag 2: 35 (4.0%)
FOCUS VARIABLE
co2_mean --
888 total records
0 missing records
888 available records (100%)
_QCF_SSITC_qc_H [2=bad]
... Flag 1: 337 (38.0%)
... Flag 0: 480 (54.1%)
... Flag 2: 71 (8.0%)
_QCF_SCF_co2_scf [2=bad]
... Flag 0: 879 (99.0%)
... Flag 1: 4 (0.5%)
... Flag 2: 1 (0.1%)
_QCF_ABSLIM_co2_mean [2=bad]
... Flag 0: 885 (99.7%)
... Flag 2: 3 (0.3%)
_QCF_STABILITY_(z-d)/L [2=bad]
... Flag 0: 886 (99.8%)
... Flag 2: 2 (0.2%)
_QCF_COMPLETENESS_file_records [2=bad]
... Flag 0: 888 (100.0%)
_QCF_RAWDATA_spikes_hf_co2 [2=bad]
... Flag 0: 888 (100.0%)
_QCF_RAWDATA_drop_out_hf_co2 [2=bad]
... Flag 0: 888 (100.0%)
_QCF_RAWDATA_absolute_limits_hf_co2 [2=bad]
... Flag 0: 886 (99.8%)
... Flag 2: 2 (0.2%)
QCF_co2_mean [2=bad]
... Flag 1: 336 (37.8%)
... Flag 0: 475 (53.5%)
... Flag 2: 77 (8.7%)
FOCUS VARIABLE
co2_mean --
888 total records
0 missing records
888 available records (100%)
_QCF_SSITC_qc_H [2=bad]
... Flag 1: 337 (38.0%)
... Flag 0: 480 (54.1%)
... Flag 2: 71 (8.0%)
_QCF_SCF_co2_scf [2=bad]
... Flag 0: 879 (99.0%)
... Flag 1: 4 (0.5%)
... Flag 2: 1 (0.1%)
_QCF_ABSLIM_co2_mean [2=bad]
... Flag 0: 885 (99.7%)
... Flag 2: 3 (0.3%)
_QCF_STABILITY_(z-d)/L [2=bad]
... Flag 0: 886 (99.8%)
... Flag 2: 2 (0.2%)
_QCF_COMPLETENESS_file_records [2=bad]
... Flag 0: 888 (100.0%)
_QCF_RAWDATA_spikes_hf_co2 [2=bad]
... Flag 0: 888 (100.0%)
_QCF_RAWDATA_drop_out_hf_co2 [2=bad]
... Flag 0: 888 (100.0%)
_QCF_RAWDATA_absolute_limits_hf_co2 [2=bad]
... Flag 0: 886 (99.8%)
... Flag 2: 2 (0.2%)
QCF_co2_mean [2=bad]
... Flag 1: 336 (37.8%)
... Flag 0: 475 (53.5%)
... Flag 2: 77 (8.7%)
FOCUS VARIABLE
co2_mean --
888 total records
0 missing records
888 available records (100%)
_QCF_SSITC_qc_H [2=bad]
... Flag 1: 337 (38.0%)
... Flag 0: 480 (54.1%)
... Flag 2: 71 (8.0%)
_QCF_SCF_co2_scf [2=bad]
... Flag 0: 879 (99.0%)
... Flag 1: 4 (0.5%)
... Flag 2: 1 (0.1%)
_QCF_ABSLIM_co2_mean [2=bad]
... Flag 0: 885 (99.7%)
... Flag 2: 3 (0.3%)
_QCF_STABILITY_(z-d)/L [2=bad]
... Flag 0: 886 (99.8%)
... Flag 2: 2 (0.2%)
_QCF_COMPLETENESS_file_records [2=bad]
... Flag 0: 888 (100.0%)
_QCF_RAWDATA_spikes_hf_co2 [2=bad]
... Flag 0: 888 (100.0%)
_QCF_RAWDATA_drop_out_hf_co2 [2=bad]
... Flag 0: 888 (100.0%)
_QCF_RAWDATA_absolute_limits_hf_co2 [2=bad]
... Flag 0: 886 (99.8%)
... Flag 2: 2 (0.2%)
QCF_co2_mean [2=bad]
... Flag 1: 336 (37.8%)
... Flag 0: 475 (53.5%)
... Flag 2: 77 (8.7%)
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment