Coder Social home page Coder Social logo

hku-mars / fast-livo2 Goto Github PK

View Code? Open in Web Editor NEW
317.0 46.0 20.0 84.05 MB

FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometry

3d-reconstruction colored-point-cloud gaussian-splatting lidar-camera-fusion lidar-inertial-odometry lidar-slam mesh-reconstruction nerf sensor-fusion slam

fast-livo2's Introduction

FAST-LIVO2

FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometry

1. Related video

Our accompanying video is now available on YouTube.

2. Related paper

Related paper will be available on arxiv soon.

3. Codes & Datasets & Application

Our paper is currently undergoing peer review. The code, dataset, and application will be released once the paper is accepted.

4. Preview

This section showcases representative results of FAST-LIVO2 with high-resolution screenshots, allowing for easier observation of details.

4.1 Online point cloud mapping results (Partial)

All sequences in FAST-LIVO2 private dataset are captured using low-cost Livox Avia LiDAR + pinhole camera.

CBD_Building_03

"CBD Building 03" sequence (severe LiDAR and camera degeneration)

Retail_Street

"Retail Street" sequence

Bright_Screen_Wall

"Bright Screen Wall" sequence (severe LiDAR degeneration)

HIT_Graffiti_Wall_01 HIT_Graffiti_Wall_02

"HIT Graffiti Wall" sequence (severe LiDAR degeneration)

HKU_Centennial_Garden

"HKU Centennial Garden" sequence

SYSU_01

"SYSU 01" sequence

Banner_Wall CBD_Building_02

Left: "Banner Wall" sequence (severe LiDAR degeneration), Right: "CBD Building 02" sequence (severe LiDAR degeneration)

HKU_Landmark HKUST_Red_Sculpture

Left: "HKU Landmark" sequence, Right: "HKUST Red Sculpture" sequence

Mining_Tunnel_01

"Mining Tunnel" sequence (severe LiDAR and camera degeneration)

HKisland01_2 HKisland01

"HKisland01" sequence

HKairport01 HKairport01_2

"HKairport01" Sequence (LiDAR degeneration)

4.2 Mesh and texture reconstruction based on our dense colored point clouds

mesh

(a) and (b) are the mesh and texture mapping of “CBD Building 01”, respectively. (c) is the texture mapping of “Retail Street”, with (c1) and (c2) showing local details.

4.3 Gaussian Splatting based on our dense colored point clouds

nerf

Comparison of ground-truth image, COLMAP+3DGS, and FAST-LIVO2+3DGS in terms of render details, computational time (time for generating point clouds and estimating poses + training time), and PSNR for a random frame in “CBD Building 01”.

4.4 Fully Onboard Autonomous UAV Navigation

We mark a pioneering instance of employing a LiDAR-inertial-visual system for real-world autonomous UAV flights. Our UAV, equipped with LiDAR, a camera, and an inertial sensor, performs online state estimation (i.e., FAST-LIVO2), trajectory planning, and tracking control, all managed entirely by its onboard computer.

uav_exp1

(a) shows the overall point map of the "Basement" experiment. In (a1)-(a4), white points indicate the LiDAR scan at that moment, and colored lines depict the planned trajectory. (a1) and (a4) mark areas of LiDAR degeneration. (a2) and (a3) show obstacle avoidance. (a5) and (a6) depict the camera first-person view from indoor to outdoor, highlighting large illumination variation from sudden overexposure to normal.

uav_exp2

(a) and (b) show the enlarged point maps of the "Woods" and "Narrow Opening" experiments, respectively. The red points in (a1), (a3), and (b4) represent the LiDAR scan at that moment. (a2) and (a4) represent the first-person view at the corresponding locations. (b1)-(b3) depict the third-person view.

fast-livo2's People

Contributors

xuankuzcr avatar

Stargazers

TheCATwhoknowsSLAM avatar Yixin F avatar  avatar  avatar KAI-AutoNavigation avatar  avatar Yiming Luo avatar Matthew avatar weihao avatar  avatar  avatar Wenqiang Du avatar  avatar SongQiang avatar HONG Yuncong avatar Yixiao Feng avatar Yue Pan  avatar Jiarong.Lin avatar Cris.Wei avatar zhe xie avatar AndreaLu avatar Tejas Salian avatar  avatar  avatar coolfeel avatar  avatar  avatar  avatar KasperCJ avatar  avatar  avatar  avatar tanghai avatar  avatar By Zhou avatar sxq avatar  avatar  avatar Zhao Wenquan avatar  avatar ShunYang avatar  avatar RosenYin avatar ShiauweiZhao avatar  avatar Ally avatar dark_water avatar Wang_bowen avatar Mingkang Xiong avatar Guiyong Zheng avatar  avatar moon avatar  avatar Jiayuan Du avatar Shaofeng Tan avatar Oscar Poudel avatar  avatar 前尘旧梦 avatar  avatar sindo avatar Tomato1107 avatar Muhamad Sharifuddin Bin Abd Rahim avatar  avatar graphic-zhang avatar  avatar Xiyuan Liu avatar  avatar  avatar  avatar  avatar  avatar Andrey Penkovskiy avatar  avatar Linzhen Cheng avatar Gihyeon Lee avatar  avatar ailab-cwx avatar Hu Xue avatar SunshineWYC avatar  avatar Iron man avatar  avatar Wen Li avatar 李琦 avatar saehan Lee/SLAM in the hazardous environments avatar  avatar  avatar Dizzy_Slamer avatar Xiao Hu avatar  avatar Jian HUANG avatar Universe Lau avatar  avatar DONG Haonan avatar  avatar Moyuan Han avatar  avatar Max Weng avatar 电弧 avatar  avatar

Watchers

Max Weng avatar  avatar  avatar Wilson avatar Andre Nguyen avatar Xiaoliang Jiao avatar  avatar Charlie avatar Jiaming Sun avatar  avatar  avatar  avatar  avatar yeren avatar Robotics_Qi avatar 贾文权 avatar liyunlong avatar  avatar Xiaosheng ZHU avatar  avatar singfun avatar  avatar  avatar zhangnanyue avatar  avatar happymoon avatar he junjie avatar  avatar  avatar Zihong Yan avatar A sad joker avatar  avatar dark_water avatar Alex Beh avatar  avatar Tejas Salian avatar Andrey Penkovskiy avatar  avatar Tianyong Ye avatar Zewei Liu avatar  avatar  avatar  avatar  avatar  avatar  avatar

fast-livo2's Issues

When will the source code be available to the public?

Hello,
I'm excited about FAST-LIVO2 and would love to try FAST-LIVO2 with my devices.

Would you mind informing us when might the source code be available to the public?

Could this be available by this summer?

Thank you.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.