Documentation

Changelog

Submission Policy

Data Format

Submission Format

Changelog

Submission Policy

Code and Data: The scans of the dataset release may be used for learning the parameters of the algorithms. The test data should be used strictly for reporting the final results -- this benchmark is not meant for iterative testing sessions or parameter tweaking.

Parameter tuning is only allowed on the training data. Evaluating on the test data via this evaluation server must only be done once for the final system. It is not permitted to use it to train systems, for example by trying out different parameter values and choosing the best. Only one version must be evaluated (which performed best on the training data). This is to avoid overfitting on the test data. Results of different parameter settings of an algorithm can therefore only be reported on the training set. To help enforcing this policy, we block updates to the test set results of a method for two weeks after a test set submission. You can split up the training data into training and validation sets yourself as you wish.

It is not permitted to register on this webpage with multiple e-mail addresses. We will ban users or domains if required.

Data

Download: If you would like to download the data, please fill out this form RIO Terms of Use. For questions please contact us here. For more information regarding the dataset, please see our git repo.

Submission format

Results for Camera Re-Localization must be uploaded as a single .txt file which must contain the prediction as follows

e.g., a file could look like: