Repository navigation
Conversation
B1ueber2y
approved these changes
Sep 15, 2026
This was referenced Oct 7, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR introduces a fix to the control point triangulation and evaluation pipeline. We thank Roham (@rzninvo) and Mahbod (@Ace3Z) for their microSLAM submission and for bringing this issue to our attention, which allowed us to identify and address the problem. We also apologize for the confusion this issue has caused regarding the recently reported microSLAM results.
The issue originated from an overlooked behavioral change introduced during a refactor in early October 2025 and affects all submissions evaluated after that change. The results reported in the paper and on the initial leaderboard are unaffected and remain correct. We have re-evaluated the affected submissions using the fix introduced in this PR and updated their corresponding leaderboard entries accordingly.
Specifically, during Sim(3) refinement, the triangulated control points were passed to Ceres as free parameter blocks. After optimization, those same point arrays were then used for scoring. As a result, the triangulated points themselves could be modified during the robust alignment phase, rather than remaining fixed.
This behavior becomes particularly problematic when the poses surrounding the control points are not geometrically consistent. In such cases, the triangulation has high uncertainty, allowing the control points to be pulled toward their target locations during alignment and thereby producing an overly favorable evaluation. As shown below, this issue has no measurable effect on highly robust systems such as Aria SLAM and only a marginal effect on the off-the-shelf systems we evaluated.
Scores per challenge with the old and fixed evaluation code. Recall is unaffected. Submissions were affected since October 5 2025.