2021年2月9日 星期二

dragon-eye - F3F real-time electronic judging system with Jetson Nano

 F3F is an radio control aeromodelling sport, slope soaring gliders.

F3F - SLOPE SOARING GLIDERS

As the name depicts, this event is flown in front of a slope, taking advantage of the updrafts created by the wind. In the single Speed task the pilot tries to fly its model over a 1000m course (composed of 10 X 100 meter legs) in the shortest possible time.

At least four rounds should be completed in order to determine the winner.

F3F glider
F3F human judging

dragon-eye is an F3F real-time electronic judging system with Jetson Nano. It's base on technology of computer vision, capture video stream from camera then detect moving objects and keeps tracking them, once one of the tracking target across central vertical line, trigger out a signal. 




Feature
- Multi moving targets tracking base on technology of background subtraction (MOG2)
- Camera resolution is 720p and frame rate is limited to 30 fps
- Supports selection 1 of 2 cameras with different angle of view
- Trigger out GPIO / UART / UDP when target across central line
- Record video files to SD card with or without tracking result
- Built-in wifi AP for connectivity
- Built-in RTSP video server (H.265 codec)
- Video output can be one of the following option HDMI / RTP / HLS / RTSP (Prefer RTSP)
- Android APP to start / stop / config / play RTSP video stream
- Written in c/c++ for running performance
- Background subtraction runnung by GPU to improve real-time performance
- Camera settings for different scenes such as dim light or over exposure
- Adjustable MOG2 threshold to reduce nosie or improve object detection 

Source code and more detail please refer to dragon-eye

Android APP dragon-eye-rc
- Remote control dragon-eye from Android phone
- Connect dragon-eye through wifi
- Start / Stop dragon-eye
- System config / Camera config
- Play video from RTSP server of dragon-eye
- Play sound with trigger

System Steeings screenshot

Camera Settings screenshot

Main screenshot



RTSP video stream screenshot




- An program running on PC Ubuntu desktop for development of dragon-eye
- It process video file from dragon-eye and output result on screen or to file

Demo video : Good result of glider go through complex background under horizon 

Demo video : Glider flying in far distance. There's a bug make false trigger

Demo video : High speed pass by


Demo video : Birds across screen and varios bugs fool around

Demo video : Record video with result



Full scale test


Update (May 20)


沒有留言:

張貼留言