Original source code of the paper:
Shang, Z., Bradley, J., & Shen, Z. (2020). A co-optimal coverage path planning method for aerial scanning of complex structures. Expert Systems with Applications, 158, 113535. https://doi.org/10.1016/j.eswa.2020.113535
Abstract: The utilization of unmanned aerial vehicles (UAVs) in survey and inspection of civil infrastructure has been growing rapidly. However, computationally efficient solvers that find optimal flight paths while ensuring high-quality data acquisition of the complete 3D structure remains a difficult problem. Existing solvers typically prioritize efficient flight paths, or coverage, or reducing computational complexity of the algorithm – but these objectives are not co-optimized holistically. In this work we introduce a co-optimal coverage path planning (CCPP) method that simultaneously co-optimizes the UAV path, the quality of the captured images, and reducing computational complexity of the solver all while adhering to safety and inspection requirements. The result is a highly parallelizable algorithm that produces more efficient paths where quality of the useful image data is improved. The path optimization algorithm utilizes a particle swarm optimization (PSO) framework which iteratively optimizes the coverage paths without needing to discretize the motion space or simplify the sensing models as is done in similar methods. The core of the method consists of a cost function that measures both the quality and efficiency of a coverage inspection path, and a greedy heuristic for the optimization enhancement by aggressively exploring the viewpoints search spaces. To assess the proposed method, a coverage path quality evaluation method is also presented in this research, which can be utilized as the benchmark for assessing other CPP methods for structural inspection purpose. The effectiveness of the proposed method is demonstrated by comparing the quality and efficiency of the proposed approach with the state-of-art through both synthetic and real-world scenes. The experiments show that our method enables significant performance improvement in coverage inspection quality while preserving the path efficiency on different test geometries.
- Numpy
- LKH http://webhotel4.ruc.dk/~keld/research/LKH/
- Deap https://deap.readthedocs.io/en/master/
- VTK
Code was originally developed under Ubuntu 16.04 python 3.4, tested in Ubuntu 20.04 python 3.8.
Four models can be found in /meshes folder, including three models used in SIP (https://github.com/ethz-asl/StructuralInspectionPlanner.git) and the paper
Parameters are stored in param.py
- View and select the models in /meshes folder
- Use the default parameters or select your own in param.py
- Run main.py
HoaHakanaia (pop=30, iter=30)
- Best efficinecy (ε=1.0)
![](https://private-user-images.githubusercontent.com/10392640/296712186-1ff8fc05-c1e7-47d9-b9c0-f3c582336846.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM4NjQzOTcsIm5iZiI6MTcyMzg2NDA5NywicGF0aCI6Ii8xMDM5MjY0MC8yOTY3MTIxODYtMWZmOGZjMDUtYzFlNy00N2Q5LWI5YzAtZjNjNTgyMzM2ODQ2LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDAzMDgxN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTVmYjE4YmZiN2Y3NDljY2Y1MTFhNWQyNDJhMjRlMDcxNDMyOTRmZTJiYjU4Njg5OTYwYThkOTExNjBmNThjY2QmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.8E6pUqxw5wG8x-8XPki9ICu8X2C69dIgoXRXHXNyT54)
![](https://private-user-images.githubusercontent.com/10392640/296708041-0788bc2a-e8c7-4fae-bbdf-08d8d9d97c67.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM4NjQzOTcsIm5iZiI6MTcyMzg2NDA5NywicGF0aCI6Ii8xMDM5MjY0MC8yOTY3MDgwNDEtMDc4OGJjMmEtZThjNy00ZmFlLWJiZGYtMDhkOGQ5ZDk3YzY3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDAzMDgxN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWI1ZWQ5NGUzNzFjMTVkNDFiNjZlYjc0NTczYWVmNTAwY2QwNmMyZWRkMmIyZjczZjY1MGUxNjAyODliODgyZTImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.8hLO3ebMoRAyjF0FY6hBnv9V27wZ3mhJPiE-G_zRaJM)
- Quality-efficiency co-optimization (ε=0.5)
![](https://private-user-images.githubusercontent.com/10392640/296707985-f76c8a1c-141a-4f96-9104-83b5c6c42b72.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM4NjQzOTcsIm5iZiI6MTcyMzg2NDA5NywicGF0aCI6Ii8xMDM5MjY0MC8yOTY3MDc5ODUtZjc2YzhhMWMtMTQxYS00Zjk2LTkxMDQtODNiNWM2YzQyYjcyLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDAzMDgxN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTM1NGViNGFiMTVlZTdjMTIwZjdjNTMzOWQ5YTA0M2JiNGViNzI2ZGY5Y2JmYWZkYmZiYjM0YzRkNGRmM2M4N2ImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.HqFjadCPzpzIFwx4DaEAVzuIu3mz46Jr9cFEADQhKQg)
![](https://private-user-images.githubusercontent.com/10392640/296708004-88af7f1d-455d-44e1-9ff3-5d83517789be.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM4NjQzOTcsIm5iZiI6MTcyMzg2NDA5NywicGF0aCI6Ii8xMDM5MjY0MC8yOTY3MDgwMDQtODhhZjdmMWQtNDU1ZC00NGUxLTlmZjMtNWQ4MzUxNzc4OWJlLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDAzMDgxN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTVhMjQ1N2UxYjJhYjlmMmE4ZDcxNjAyNTM0ZjYwZDU4NjBkYTVjNzYwNzc0M2FiYWJlOTM0NTZiNWMyNzFkNjcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.MGGC-f0loNClncdqyfhTGIWIwvcYF5J14uzH18ce86M)
- Best quality (ε=0.0)
![](https://private-user-images.githubusercontent.com/10392640/296708089-3286fe4e-8d31-4467-973d-b7fb1774680e.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM4NjQzOTcsIm5iZiI6MTcyMzg2NDA5NywicGF0aCI6Ii8xMDM5MjY0MC8yOTY3MDgwODktMzI4NmZlNGUtOGQzMS00NDY3LTk3M2QtYjdmYjE3NzQ2ODBlLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDAzMDgxN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWVlYmJmODFkZGNhZTdlYzU5YWFkN2E5NzE3OTk2MWI4NWZjOTg2ZmUwM2ZiNDgzOWNlMGY3NTk4MzZmNjU0ODUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.4Z3-PLIExWnO5CWSXbIbd8NO1fUCR6Zt5BKBC-V844A)
![](https://private-user-images.githubusercontent.com/10392640/296708104-846a2137-b369-440a-b22a-c8e082df8c64.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM4NjQzOTcsIm5iZiI6MTcyMzg2NDA5NywicGF0aCI6Ii8xMDM5MjY0MC8yOTY3MDgxMDQtODQ2YTIxMzctYjM2OS00NDBhLWIyMmEtYzhlMDgyZGY4YzY0LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDAzMDgxN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWViZjU1YmI4ZjMyYzM1NWQ0ZmJiN2Y4MzkxOGViOTg4NDdkOTNhMGUxMGNiZmU2Zjc2NDU5MzFmOTdkNjZiMjUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.JkZ1jlqXSmQKw9fXmmHYJ2ApPvrGEwzgOw00ILpFzSU)
This repository is still under development. The following fucntions are not included in the current update.
- OBBTree
- RRT*
- Quality evaluation/visualization
- etc.
This algorithm was developed by Zhexiong Shang under the supervison and support from Prof. Zhigang Shen and Prof. Justin Bradley at the University of Nebraska-Lincoln