Documentation
Submission Policy
The scans of the 3RScan dataset release may be used for learning the parameters of the algorithms. The test data should be used strictly for reporting the final results -- this benchmark is not meant for iterative testing sessions or parameter tweaking.
Parameter tuning is only allowed on the training data. Evaluating on the test data via this evaluation server must only be done once for the final system. It is not permitted to use it to train systems, for example by trying out different parameter values and choosing the best. Only one version must be evaluated (which performed best on the training data). This is to avoid overfitting on the test data. Results of different parameter settings of an algorithm can therefore only be reported on the training set. To help enforcing this policy, we block updates to the test set results of a method for two weeks after a test set submission. You can split up the training data into training and validation sets yourself as you wish.
It is not permitted to register on this webpage with multiple e-mail addresses. We will ban users or domains if required.
Data
Download: If you would like to download the 3RScan data, please fill out this form 3RScan Terms of Use. For questions please contact us via our group email the 3RScan group email. For more information regarding the 3RScan dataset, please see our git repo (coming soon).
Tasks Data Requirements: For all tasks, both 2D and 3D data modalities can be used as input.
Data Formats
3D Data: 3D data is provided with the RGB-D video sequences (depth-color aligned) as well as reconstructed meshes as
Submission format
Results for a method must be uploaded as a single .json file, which must contain the prediction as follows
E.g., a file could look like:
[{
"scan": "531cff08-0021-28f6-8e08-ba2eeb945e09",
"predictions": [
{
"instance": 35,
"transform": [0.4, -0.8, -0.1, 0, 0.8, 0.4, 0.1, 0, 0.1, -0.1, 0.9, 0, -2.1, 1.4, -0.1, 1]
},
{
"instance": 4,
"transform": [-0.9, 0.4, 0.1, 0, -0.4, -0.9, -0.1, 0, -0.1, -0.1, 1.0, 0, 0.2, 3.4, 0.1, 1]
}
]
},{ "scan": ...
},{ "scan": ...
}]