Spaces:
Runtime error
Public Leaderboard finalized ?
Hello,
I thought we would have some additional information after the public leaderboard is finalized, but as it's not the case, I am here.
In the competition description, we can read :
- October 20, 2023 - Public phase concludes. Public leaderboard is finalized.
- October 21, 2023 - Private leaderboard opens. Participants can make final submissions for evaluation on the full test set.
And in another discussion, this has been said :
"As for the private phase, participants will be provided with a fresh test set. When this phase begins, you will need to submit distinct files specifically tailored for this new test set."
So where can we download the new test set to make a private submission ? In the competition files, we can only dowload the old files until now (22th October).
Thanks,
Vincent
I think the actual way it is working is that the test set is being sliced for evaluation in the public leaderboard, and the full test set will be used for the private one. You can select from your already made submissions for evaluation on the private leaderboard so it makes sense you don't have to download a new test dataset. The wording is confusing but that's more normal anyways. I do hope someone confirms this though. Cheers
Thanks for your answer. What you describe is usually done in other competitions, so it would make sense. But the wording in this competition is indeed so confusing, I'm not 100% sure ... !
But I assume you're right, since no new test set has been uploaded.
Hi,
Thank you for reaching out. As this is our first competition on the HF website, the transition to the private phase was a new process for us. To facilitate this phase, we've uploaded the private test files named test_rule_private.csv and test_device_private.csv to the primary dataset repository at https://huggingface.co/datasets/wyzelabs/RuleRecommendation/tree/main. You can access and download these datasets from this location to make your submissions for the private phase. We apologize for any confusion and the delay in releasing the private data. If you have any questions, please don't hesitate to ask.