NCS-LVTF: A Layered Vision–Temporal Fusion Framework for Continuous 6-DoF Tracking of Non-Cooperative Satellites in Close-Range Proximity NCS-LVTF:面向近距逼近的非合作卫星连续 6-DoF 跟踪分层视觉–时序融合框架

论文 · 2027

发表IEEE 国际机器人与自动化会议(ICRA 2027) · 审稿中

作者Jiaqing Chen, ShaSha Fan, Jiaming Liu, Haomin Gu, Tianshu Wang, Yonghe Zhang, Chengyu Ma

署名说明第一作者

关键词Non-cooperative satellite, continuous 6-DoF tracking, close-range proximity, layered vision–temporal fusion, B-ESKF, OoV-aware perception, depth-consistency gating, learned-gated ICP, NCS-Prox, on-orbit servicing

  1. 提出 NCS-LVTF(Non-Cooperative Satellite Layered Vision–Temporal Fusion)分层流水线,面向非合作卫星近距逼近的连续 6-DoF 跟踪:融合多模态视觉、基于动力学的时序先验、B-ESKF(时序偏置误差状态卡尔曼滤波)融合,以及学习门控的 ICP 精修,在 NCS-Prox Tier 3 测试集上显著优于外部基线。
  2. 构建面向近距视野塌缩的稳健视觉模块:训练阶段采用 OoV 感知微调(可见性掩码热力图监督与距离/可见度样本重加权),推理阶段以深度一致性门控(DCR)拒识不可靠 PnP,并回退至回归分支,使近距误差显著低于独立骨干与先前架构。
  3. 发布 NCS-Prox 三层数据集以填补公开基准空白:Tier 1 大规模静态视觉语料(约 10 万帧)用于模块训练,Tier 2 翻滚动力学语料(1000 条轨迹)用于时序模型验证,Tier 3 含 70 个连续逼近场景(同步 RGB-D、点云、IMU 与轨迹真值)用于端到端系统评测;完整配置在 Tier 3 Test 上达到 eR=1.72°、et=4.57 cm。

摘要

Continuous 6-DoF pose tracking is essential for non-cooperative satellite proximity operations and on-orbit servicing; nevertheless, dedicated methods for the close-range rendezvous phase remain scarce. At close range, neither modality alone is reliable: out-of-view (OoV) conditions can cause catastrophic visual failures, while dynamics-only propagation inevitably accumulates drift under model mismatch and long-horizon extrapolation. Most existing fusion pipelines inject temporal information through filtering alone and do not exploit the physical structure implicit in motion history. We propose NCS-LVTF (Non-Cooperative Satellite Layered Vision–Temporal Fusion), a layered vision–temporal fusion framework for continuous 6-DoF tracking of non-cooperative satellites in close-range proximity. OoV-robust, depth-gated multimodal visual observations form the core sensing stream, while physics-based tumbling propagation supplies a temporal prior periodically assimilated through B-ESKF (temporally-biased ESKF) with adaptive observation noise, along with learned-gated ICP geometric refinement and a series of supporting modules and system-level optimizations. We also introduce NCS-Prox, a unified three-tier dataset for close-range non-cooperative proximity tracking: Tier 1 provides a large-scale static visual corpus for module training, Tier 2 a tumbling-dynamics corpus for temporal-model validation, and Tier 3 comprises 70 continuous approach scenarios with synchronized RGB-D imagery, point clouds, IMU, and trajectory ground truth for end-to-end system evaluation. Under the NCS-Prox Tier 3 evaluation protocol, experiments show that NCS-LVTF consistently outperforms vision-only and dynamics-only baselines, achieving eR=1.72° and et=4.57 cm on the held-out Tier 3 test split.