On-Satellite Implementation of Real-Time Multi-Object Moving Vehicle Tracking with Complex Moving Backgrounds

On-Satellite Implementation of Real-Time Multi-Object Moving Vehicle Tracking with Complex Moving Backgrounds

On-satellite information processing enables all-weather target tracking. The background of videos from satellite sensors exhibits an affine transformation due to their motion relative to the Earth. In complex moving backgrounds, moving vehicles have a small number of pixels and weak texture features...

Full description

Saved in:
Bibliographic Details
Main Authors: Jingyi Yu, Siyuan Wei, Yuxiao Wen, Danshu Zhou, Runjiang Dou, Xiuyu Wang, Jiangtao Xu, Jian Liu, Nanjian Wu, Liyuan Liu
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Remote Sensing
Subjects:
multi-object tracking (MOT)
detection–association framework
moving vehicle targets
on-satellite implementation
FPGA
Online Access:https://www.mdpi.com/2072-4292/17/3/418
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:On-satellite information processing enables all-weather target tracking. The background of videos from satellite sensors exhibits an affine transformation due to their motion relative to the Earth. In complex moving backgrounds, moving vehicles have a small number of pixels and weak texture features. At the same time, the resources and performance of on-satellite equipment are limited. To address these issues, we propose a multi-object tracking (MOT) algorithm with a detection–association framework for moving vehicles in complex moving backgrounds and implement the algorithm on a satellite to achieve real-time MOT. We use feature matching to effectively eliminate the effects of background motion and use the neighborhood pixel difference method to extract moving vehicle targets in the detection stage. The accurate extraction of motion targets ensures the effectiveness of target association to achieve MOT of moving vehicles in complex moving backgrounds. Additionally, we use a Field-Programmable Gate Array (FPGA) to implement the algorithm completely on a satellite. We propose a pixel-level stream processing mode and a cache access processing mode, given the characteristics of on-satellite equipment and sensors. According to the experimental results, the prototype on-satellite implementation method proposed in this paper can achieve real-time processing at 1024 × 1024 px@47 fps.
ISSN:2072-4292

Similar Items