Skip to content

Commit

Permalink
Merge pull request #41 from openxrlab/xrslam-parsac
Browse files Browse the repository at this point in the history
add imu-parsac algorithm
  • Loading branch information
huanggan52 authored Jan 5, 2024
2 parents dfd32ac + 8831471 commit 3bbe63f
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions docs/en/benchmark.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,15 +2,15 @@

We run our algorithm on EuRoC dataset on Ubuntu18.04 and macOS 10.14. And make comparisons with the state-of-the-art VIO systems. We analyze the accuracy of the algorithm by comparing the root mean squared error (RMSE) of the absolute trajectory error (ATE). ATE is given by the simple difference between the estimated trajectory and ground truth after it has been aligned so that it has a minimal error, and RMSE is the standard deviation of the residuals (prediction errors). The lower the RMSE, the better a given trajectory is able to fit its ground truth. We use "evo" tool to evaluate and compare the trajectory output of odometry and SLAM algorithms, and for more information please refer to [euroc evaluation](./tutorials/euroc_evaluation.md). We have achieved obvious better results on EuRoc and ADVIO datasets, which proves the effectiveness of our system.

**XRSLAM** showed significant improvements on many sequences on EuRoC dataset. **XRSLAM(w. RD)** adopts a dynamic object removal strategy, which can be enabled in the configuration parameter `parsac_flag`. As shown in the following tables, the best results for visual-inertial algorithms are bolded. Comparing with other systems, Thanks to the additional stabilization effect, the significant drifts are canceled when using the subframe strategy in our system.
**XRSLAM** showed significant improvements on many sequences on EuRoC dataset. **XRSLAM(w/ RD)** adopts a dynamic object removal strategy, which can be enabled in the configuration parameter `parsac_flag`. As shown in the following tables, the best results for visual-inertial algorithms are bolded. Comparing with other systems, Thanks to the additional stabilization effect, the significant drifts are canceled when using the subframe strategy in our system.

As a challenging dataset in real-world settings, ADVIO offers 23 diverse scenarios, encompassing indoor and outdoor environments, varying lighting conditions, and dynamic elements such as pedestrians and vehicles. Aided with the dynamic object removal scheme, XRSLAM(w. RD) showed significantly better RMSEs on ADVIO dataset.

**Tracking Accuracy (RMSE in meters) on the EuRoC Dataset.**
| Algorithm | MH-01 | MH-02 | MH-03 | MH-04 | MH-05 | V1-01 | V1-02 | V1-03 | V2-01 | V2-02 | V2-03 | AVG |
|-------------|-------|-------|-------|-------|-------|-------|-------|-------|-------|-------|-------|-------|
| **XRSLAM** | 0.109 | 0.147 | **0.131** | 0.189 | 0.240 | **0.056** | 0.101 | 0.134 | 0.066 | 0.089 | **0.122** | **0.125** |
| **XRSLAM(w. RD)** | **0.109** | 0.115 | 0.141 | 0.247 | 0.267 | 0.060 | 0.091 | 0.168 | 0.058 | 0.100 | 0.147 | 0.136 |
| **XRSLAM(w/ RD)** | **0.109** | 0.115 | 0.141 | 0.247 | 0.267 | 0.060 | 0.091 | 0.168 | 0.058 | 0.100 | 0.147 | 0.136 |
| **LARVIO** | 0.132 | 0.137 | 0.168 | 0.237 | 0.314 | 0.083 | **0.064** | 0.086 | 0.148 | 0.077 | 0.168 | 0.147 |
| **Open-VINS**| 0.111| 0.287 | 0.181 | **0.182** | 0.365 | 0.059 | 0.084 | **0.075** | 0.086 | **0.074** | 0.145 | 0.150 |
| **VI-DSO** | 0.125 | **0.072** | 0.285 | 0.343 | **0.202** | 0.197 | 0.135 | 4.073 | 0.242 | 0.202 | 0.212 | 0.553 |
Expand All @@ -23,7 +23,7 @@ As a challenging dataset in real-world settings, ADVIO offers 23 diverse scenari
<br>

**Accuracy on the ADVIO Dataset**
| Sequence | **XRSLAM** | **XRSLAM(w. RD)** | **VINS-Fusion(VIO)** | **LARVIO** |
| Sequence | **XRSLAM** | **XRSLAM(w/ RD)** | **VINS-Fusion(VIO)** | **LARVIO** |
| :------: | :--------: | :--------: | :------------------: | :--------: |
| 01 | 2.177 | **1.788** | 2.339 | 5.049 |
| 02 | **1.679** | 1.695 | 1.914 | 4.242 |
Expand Down

0 comments on commit 3bbe63f

Please sign in to comment.