maciejiwan / signdetector

Tools to recornanize speedlimit signs in real time camera, or video file using C++, OpenCV, Tesseract, GTest, CMake

Sign Detector

About

This project is a software application that can recognize traffic signs in video streams. By leveraging OpenCV and Tesseract OCR, the program focuses on identifying speed limit signs and displaying them on the GUI to remind drivers to follow the speed limit.

Project structure

• src/ - source files
• include/ - header files
• resources/ - imgs, videos for testing
• test/ - test files
• tools - helpful mini programs like:
  • Threshold.cpp - script for thresholding images and livetime preview

Requirements

• OpenCV >=4.0
• CMake >=3.16
• g++ =>9.3.0
• tessaract >=4.0

Install requirements on Ubuntu 20.04

sudo apt install build-essential
sudo apt-get install cmake
sudo apt install tesseract-ocr
sudo apt install libtesseract-dev
sudo apt install libopencv-dev
sudo apt-get install libmpg123-dev
sudo apt install qt5-default
sudo apt-get install qtmultimedia5-dev
sudo apt-get install libqt5multimedia5-plugins

Build

To build project to ./build directory run:

cmake -B build

then go to build directory and run:

make

Run program

./main [options]
# f.e ./main -h 720 -w 1280 -t camera -s 2
# f.e ./main -s video/valgrind.mp4 -t video -b 1
# f.e ./main -s video/speed_limit_seqence_1.mp4 -t video -b 1

• -s : filename or camera id. Default is "video/speed_limit_seqence_1.mp4".
• t : put "camera" or "video". Default is "video".
• -b : number of frames stored in the buffer. The default buffer size is 1.
• -h : Camera resolution height. The default value is 720.
• -w : Camera resolution width. The default value is 1280.
• -r : FrameRate for camera. The default value is 30.

Usefull comands

Here are some useful commands related to video processing that can be used in the project:

# Execute in no_resize directory
# This command resizes videos to 720p resolution (960x720 px).
for file in *.mp4; do ffmpeg -i "$file" -vf scale=-2:720 "../${file%.*}_720p.mp4"; done 


# Run video using ffplay
# Useful for checking the framePreviewLabel number when the sign is visible.
# To stop the video, press the spacebar.
ffplay -loop 0 speed_limit_night_12.mp4 -vf "drawtext=fontfile=Arial.ttf: \
text=%{n}: x=(w-tw)/2: y=h-(2*lh): \
fontcolor=white: fontsize=100: box=1: \
boxcolor=0x00000099"

To run automated tests:

# in build directory
./tests
./tests --gtest_filter=RoiOcrTest* # to run example ts
./tests --gtest_filter=VideoTest* # to run tests for all videos
./tests --gtest_filter=VideoTest.speed_limit_night_19 # to run tests for video

To list avaible cameras:

v4l2-ctl --list-devices

or

ls -ltrh /dev/video*