Comments (8)
Hi @hu2011, can you post a few examples of the bad fusion results with the raw KITTI data. I used the Stereo 2015 dataset for this work because the "bad" LiDAR measurements have been removed from the Ground Truth measurements, whereas I believe the raw data is not filtered. This could potentially cause poor disparity images. If you post a few examples I'm happy to take a look.
from stereo_sparse_depth_fusion.
Hi @ShreyasSkandanS yes, you are right. There is big difference between the obtained disparity from raw lidar and ground truth disparity. For example(2011_09_26_drive_0009_sync frame 384, is 000010_10.png in stereo2015), here are 22 thousand points on left image from lidar, but only 9 thousand efficent points on the same coordinates on ground truth disparity. It is almost impossible to get the same results from the raw lidar data.
The bad fused image (from diffusion )is like this:
from stereo_sparse_depth_fusion.
Hi @ShreyasSkandanS , I'm so sorry for getting wrong velodyne frame by pykitti(384). The new result is shown below, and it looks a little better, still need some process.
using the obtained disparity from lidar and the gt_disparity as evaluation reference. the run results:
{EVALUATION A:} -- SEMI GLOBAL MATCHING --
{status} no fusion. Semi global matching only..
Total ground truth points: 111664
{SGM} avg error: 1.2602{EVALUATION B:} -- NAIVE LIDAR FUSION --
Total ground truth points: 111664
{NAIVE FUSION} avg error: 1.20339{EVALUATION C:} -- DIFFUSION BASED --
Total ground truth points: 111664
{DB} avg error: 0.953724{EVALUATION D:} -- NEIGHBORHOOD SUPPORT --
Total ground truth points: 111664
{NS} avg error: 0.9042
This looks more reasonable, but the output of this - is this from SGM only? or is this one Evaluation C or Evaluation D?
from stereo_sparse_depth_fusion.
Hi @ShreyasSkandanS , this result is from DIFFUSION BASED FUSION (evaluation C). Do you have any suggestions to get a better disparity image like in your paper? Thanks
from stereo_sparse_depth_fusion.
Hi @hu2011,
Could you post pictures of the following: Input RGB image, Sparse Depth input, Semi Global Matching and Diffusion Based fusion?
Best regards,
Shreyas
from stereo_sparse_depth_fusion.
@ShreyasSkandanS hi, sorry for late reply.
Input left RGB
right RGB image
Input sparse depth (from lidar, maybe too sparse to see)
output of diffusion based fusion. It is strange that here is very bright area (disparity values > 240) on the right signal light.
from stereo_sparse_depth_fusion.
This might have something to do with the input LiDAR scan. But the fusion seems to be working (if you look at the circular arrow sign). The errors at the top of the image appear to just be problems with SGM in those regions. They aren't improved because there are no LiDAR points there.
from stereo_sparse_depth_fusion.
Since this is no longer an issue related to this work, I am proceeding to close this. If you have any other issues, please feel free to raise another issue. Best regards, SS.
from stereo_sparse_depth_fusion.
Related Issues (6)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from stereo_sparse_depth_fusion.