myzhar / lepton3_jetson

Library and examples to connect the FLIR Lepton3 thermal camera to Nvidia Jetson embedded boards

Hi there 👋

This is my personal Github repository where you can find many past projects I worked on and all the projects that I'm facing currently.

You can follow my works on my social channels: Blog - Instagram - LinkedIn - Facebook

I'm proudly part of the 🍕 Pizza Robotics 🤖 robotics enthusiast Italian group.

lepton3_jetson's Issues

Qt crosscompilation

Hi. thank you fro your work. I have followed your tutorials and tried to connect the Lepton in brekout board v2.0 to both Nvidia Jetson nano and Nvidia jetson nano 2gb dev kits, however I did not manage to establish connection. I have tried to enable spi2 on pins 13, 16, 18, 22 and 37 and tried to make the connection there, but to no effect. Could this be anything other than HW malfunction of the Lepton camera?

Assertion failed + forcing RESYNC

Hi

I am making a SAR drone and in order to detect people I was determined to use the FLIR Lepton 3.5 with its breakout pin v2 board.
I have wired it as written below:
FLIR pin1 - GND - pin 6 Jetson NANO
FLIR pin5 - SDA - pin 27 Jetson NANO
FLIR pin7 - SPI_CLK - pin 23 Jetson NANO
FLIR pin8 - SCL - pin 28 Jetson NANO
FLIR pin10 - CS - pin 24 Jetson NANO
FLIR pin12 - SPI_MISO - pin 21 Jetson NANO

I am providing J3 pin 2 the +3.3V as written in the datasheet.

But after two days I didnt get any results. When I use the opencv demo, it gives a forcing resync error, when I'm using the fever app, it givis assertion failed error.

I did not get any results.

black video stream output in Lepton3

Hi,
I am using Lepton3 with jetson nano with Jetpack4.3.

I was doing testing continuously with Radiomatric output. I found following results-

1. All of sudden Radiometric output video goes and complete black screen appears with no error.
2. When i switch to RGB mode then RGB video output is there with no issue. As i click "R" button to enable Radiometric output again then radiometric video out is there for 1/2 seconds and again whole thing gets black with no error.
3. When i do FFC with "f/F" button, then radiometric output video appears.

I have following doubts-

1. Is there effect of FFC in Radiometric output?
2. I am not sure with this term "Radiometric" as Lepton3 is being used not Lepton3.5
3. What if i do FFC on top every time when i start capturing Radiometric stream. Is there any problem?

Thanks.

Breakout Board v2.0 on Jetson Nano

Hello,
Thank you for this brilliant repo, but I’ve tried connecting my breakout v2 (lepton 3.5) with the jetson nano, the link for the guide in your read me is broken but I followed the picture for connection and I connected VSYNC to pin 11.

I can detect i2c but it keeps looping “Forcing Resync”, also pylepton doesn’t just gets garbage frames. It’s worth noting that pylepton works perfectly on my RPi 4.

Am I missing something? Any ideas? Thank you

I didn't run your project but simul_temp is manual set right?

I am a python coder guy so i didn't try to run your project!
I'm having problem with reading Lepton 3.5 temperature! It is not constant!
FFC refresh make it a little higher and the accuracy problem appeared!
I'm fiding solutions! What do you think?

Automatic alerts/screenshots

Hi,

I would like to try buy the parts and put this in an office setting, do you think it'd be possible to add like a way to make an alarm and take a screenshot if the person is detected over the degree threshold?

Thanks

Make error

After cmake was completed and ran make, this error appeared:

/home/jacobmayhew27/Documents/ECE_3509/Lepton3_Jetson/opencv_demo/opencv_demo.cpp:20:13: error: ‘bool close’ redeclared as different kind of entity
20 | static bool close = false;
| ^~~~~
In file included from /usr/include/x86_64-linux-gnu/bits/sigstksz.h:24,
from /usr/include/signal.h:328,
from /home/jacobmayhew27/Documents/ECE_3509/Lepton3_Jetson/opencv_demo/opencv_demo.cpp:3:
/usr/include/unistd.h:358:12: note: previous declaration ‘int close(int)’
358 | extern int close (int __fd);
| ^~~~~
/home/jacobmayhew27/Documents/ECE_3509/Lepton3_Jetson/opencv_demo/opencv_demo.cpp: In function ‘int main(int, char**)’:
/home/jacobmayhew27/Documents/ECE_3509/Lepton3_Jetson/opencv_demo/opencv_demo.cpp:107:22: error: assignment of function ‘int close(int)’
107 | close=true;
| ~~~~~^~~~~
/home/jacobmayhew27/Documents/ECE_3509/Lepton3_Jetson/opencv_demo/opencv_demo.cpp: In function ‘void close_handler(int)’:
/home/jacobmayhew27/Documents/ECE_3509/Lepton3_Jetson/opencv_demo/opencv_demo.cpp:133:15: error: assignment of function ‘int close(int)’
133 | close = true;
| ~~~~~~^~~~~~
make[2]: *** [opencv_demo/CMakeFiles/opencv_demo.dir/build.make:76: opencv_demo/CMakeFiles/opencv_demo.dir/opencv_demo.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:204: opencv_demo/CMakeFiles/opencv_demo.dir/all] Error 2
make: *** [Makefile:91: all] Error 2

I have PureThermal mini

I have only PureThermal mini , FLIR Lepton 2.5 and Jetson nano
I don't have breakout board v2
So can I use your project

I know how to get Thermal video from Lepton 2.5 By OpenCV (python)
but I don't know how to get temperature value

Thanks

Infinite Forcing RESYNC error

"Forcing RESYNC" message never ends. Even for different SPI ports, and frequency values.
Debug mode prints "Wrong Packet ID for TTT in segment".
Seems like Lepton3.cpp line 336
uint8_t pktNumber = segmentAddr[20*mPacketSize+1];
allways 0.
Any idea?

Jetson clocks has to be set to on, for better performance

I noticed when I run my code with jetson clocks turned off (variable CPU frequency), the conversion to the RAW16 format sometimes takes too long. Depending on the CPU clock frequency, it takes 1ms to 5ms, or even longer (compiler set to debug, in release mode it is in between 0.5-2ms). 5ms is too long, and the next segment is read out too late and causes the communication to go out of sync and therefor you lose some frames.
If you set the jetson clocks on, the CPU stays at the max frequency and the conversion takes constantly 1ms (compiler set to debug, in release mode it is 0.5ms) and the loss of sync is less likely.

I think it would be nice if this information is added to the README.

can it run 15fps up?

it's so cool and useful, is it possible 15fps up ?

Cmake Error

When running 'cmake ..' inside the build directory which was created inside the Lepton3_Jetson git repository, this error appears? Is there something I am doing wrong or how can I go about fixing this? My system already has CMake version 3.26.1.

CMake Error at opencv_demo/CMakeLists.txt:3 (find_package):
By not providing "FindOpenCV.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "OpenCV", but
CMake did not find one.

Could not find a package configuration file provided by "OpenCV" with any
of the following names:

OpenCVConfig.cmake
opencv-config.cmake

Add the installation prefix of "OpenCV" to CMAKE_PREFIX_PATH or set
"OpenCV_DIR" to a directory containing one of the above files. If "OpenCV"
provides a separate development package or SDK, be sure it has been
installed.

Skin temperature readings between 32 to 33 C.

Hello, Do you know why my lepton sensor senses skin temperatures in a range between 32 to 33 grades instead of 35 to 37?

Just wanting to know what I am doing wrong or if my sensor is defective... I know about the +-5C error

Thank you!

get temperature of each pixel.

Hi,
Thanks for the great tutorial and support.

I am using Lepton3 with Jetson nano JP4.3.
I am using opencv_demo with Radiometric enable.
I want the temperature readings for each pixels. How can i get that? I can see there is an API called "getSensorTemperatureK()" but it seems the sensor temperature only.
Any suggestions?
Thanks.

inaccurate radiometric data - Lepton 3.5