Step 8: Challenge
Apr 22 – May 13 | Challenge
Apr 22 – May 13 | Challenge
Welcome to the final step of the MEDomicsLab Testing Phase! We appreciate your engagement throughout this journey.
Download the new learning set provided in MEDomicsLab_TestingPhase_Step8.zip.
Train, optimize, and test models.
Compare different data combinations.
Choose a learning hypothesis and create a final model.
However, to facilitate the Evaluation process of the models submitted by the participants, we please ask the following:
Only use the data we provided in the MEDomicsLab_TestingPhase_Step8.zip file.
Therefore, you should not be able to use the Extraction Module or the MEDprofiles package.
Do not change column names in the data we provided (this includes the use of the Groupping/Tagging tool).
Do not merge the time point CSV files together.
Dot not use the "Transform Columns tool".
Do not use the "PCA" utility of the "Feature Reduction tool".
If you use the "Spearman" utility of the "Feature Reduction tool", make sure to keep the subject_id and target columns in your dataset by enabling the "Merge unselected columns in the result dataset" and "Keep target in dataset" options.
If these instructions are not followed, we will not be able to evaluate your submission, and it will unfortunately be discarded.
Content
In Step 8 - Challenge, you will leverage the knowledge you have gained from the MEDomicsLab platform in the preceding steps of the Testing Phase. You are the master here !
The objective here is that participants design their own model via the use of the . These models will be evaluated by the MEDomicsLab team using a fresh, private holdout set from the database.
Considering the insights we have gained during the Testing Phase, we have now updated the rules for this step. In contrast to what we initially planned, there will be a single challenge that involves manipulations in the only.
We are continuously working on enhancing the MEDomicsLab platform, and we would like to inform you that there may still be some missing options and tooltips in the , which we intend to implement in the future.
Before proceeding with Step 8 - Challenge of the MEDomicsLab Testing Phase, we recommend revisiting the documentation related to .
Create a model similarly to the one we created in using the . Follow these guidelines for creating your best possible model:
Once you have trained your best model, send it to with "Step 8 - Challenge | Submission" as the Subject of your email. You are allowed to send multiple submissions, but please note that we will only evaluate your latest submission.
If you wish, you can let us know in the email the name that we should use for the public ranking of your submission (e.g. MLrocks ). If not specified, we will use your full name.
For this ML Challenge, most of your work will therefore be done inside the . However, you are also welcome to use the other capabilities of the MEDomicsLab platform. For example, you may want to use the to continue to gain useful insights about the dataset prior to the learning step.
Note that you new dataset will be placed in the reduced_features folder and that you will have to move it in your learning folder to retrieve it in the .
Also, note that to create a model in the , your CSV files must be placed under a "learning" folder and have the prefix "TX_" (e.g., T1_new_learning) as in the data we provided you.
Intro
Rules
Dealing with Server Errors
Documentation
The Optimize node
General Advice
Following this, we will make the ranking public and reveal the winners of both the ML Challenge and the Bug Finder Challenge at the wrap-up meeting scheduled for May 17. An invitation to this meeting will be sent out soon.