Skip to content

A project of Visual Inertial Odometry for Autonomous Vehicle

Notifications You must be signed in to change notification settings

ganlumomo/VisualInertialOdometry

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

VisualInertialOdometry

Introduction

This project is designed for students to learn the front-end and back-end in a Simultaneous Localization and Mapping (SLAM) system. The objective is that using feature_tracker in VINS-MONO as front-end, and GTSAM as back-end to implement a visual inertial odometry (VIO) algorithm for real-data collected by a vehicle: The MVSEC Dataset. The code is modified based on original code from CPI.

Specifically, we are learning how to utilize a front-end package and use IMUFactor, SmartProjectionPoseFactor and ISAM2 optimizer in GTSAM to achieve a simple but straight-forward VIO system.

Instruction

Step 1

Install ROS:

Ubuntu 18.04: http://wiki.ros.org/melodic/Installation/Ubuntu.

Ubuntu 16.04: http://wiki.ros.org/kinetic/Installation/Ubuntu.

Install GTSAM as a thirdparty: https://github.com/borglab/gtsam.

Step 2

Clone this ros workspace:

$ git clone https://github.com/ganlumomo/VisualInertialOdometry.git

Try out the feature_tracker package to see how does it work and what does it output.

Step 3

Refer examples ImuFactorsExample.cpp and ISAM2Example_SmartFactor.cpp to implement the following functions defined in GraphSolver.h:

// For IMU preintegration
set_imu_preintegration
create_imu_factor
get_predicted_state
reset_imu_integration

// For smart vision factor
process_feat_smart

You are free to change the function signature, but make sure change other places accordingly.

Step 4

Build the code and launch the ros node with rosbag data:

$ cd VisualInertialOdometry
$ catkin_make
$ source devel/setup.bash
$ roslaunch launch/mvsec_test.launch
$ rosbag play mvsec_test.bag

Test data can be downloaded here: mvsec_test.bag.

Expected Results

Write one-page project summary about your implementation and result.

References

VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator (PDF)

IMU Preintegration on Manifold for Efficient Visual-Inertial Maximum-a-Posteriori Estimation (PDF)

Eliminating conditionally independent sets in factor graphs: A unifying perspective based on smart factors (PDF)

The Multivehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception (PDF)

About

A project of Visual Inertial Odometry for Autonomous Vehicle

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published