Of different model-based methods in vision based human tracking,many state of the art works focus on the stochastic optimization method to search in a very high dimensional space and try to find the optimal solution a...Of different model-based methods in vision based human tracking,many state of the art works focus on the stochastic optimization method to search in a very high dimensional space and try to find the optimal solution according to a proper likelihood function.Seldom works perform a framework of interactive multiple models (IMM) to track a human for challenging problems,such as uncertainty of motion styles,imprecise detection of feature points and ambiguity of joint location.This paper presents a two-layer filter framework based on IMM to track human motion.First,a method of model based points location is proposed to detect key feature points automatically and the filter in the first layer is performed to estimate the undetected points.Second,multiple models of motion are learned by the prior motion data with ridge regression and the IMM algorithm is used to estimate the quaternion vectors of joints rotation.Finally,experiments using real images sequences,simulation videos and 3D voxel data demonstrate that this human tracking framework is efficient.展开更多
文摘利用深度学习实现遥感影像耕地区域自动化检测,取代人工解译,能有效提升耕地面积统计效率。针对目前存在分割目标尺度大且连续导致分割区域存在欠分割现象,边界区域情况复杂导致边缘分割困难等问题,提出了语义分割算法——Swin Transformer,TransFuse and U-Net(SF-Unet)。为强化网络不同层次特征提取和信息融合能力,提升边缘分割性能,使用U-Net网络替代TransFuse网络中的ResNet50模块;将Vision Transformer(ViT)替换为改进后的Swin Transformer网络,解决大区域的欠分割问题;通过注意力机制构建的Fusion融合模块将2个网络输出特征进行融合,增强模型对目标的语义表示,提高分割的精度。实验表明,SF-Unet语义分割网络在Gaofen Image Dataset(GID)数据集上的交并比(Intersection over Union,IoU)达到了90.57%,分别比U-Net和TransFuse网络提升了6.48%和6.09%,明显提升了耕地遥感影像分割的准确性。
基金the Research Fund for the Young Teacher of Shanghai(No.Z-2009-12)the New Teacher Fund of Shanghai University of Electric Power (No.K-2010-16)
文摘Of different model-based methods in vision based human tracking,many state of the art works focus on the stochastic optimization method to search in a very high dimensional space and try to find the optimal solution according to a proper likelihood function.Seldom works perform a framework of interactive multiple models (IMM) to track a human for challenging problems,such as uncertainty of motion styles,imprecise detection of feature points and ambiguity of joint location.This paper presents a two-layer filter framework based on IMM to track human motion.First,a method of model based points location is proposed to detect key feature points automatically and the filter in the first layer is performed to estimate the undetected points.Second,multiple models of motion are learned by the prior motion data with ridge regression and the IMM algorithm is used to estimate the quaternion vectors of joints rotation.Finally,experiments using real images sequences,simulation videos and 3D voxel data demonstrate that this human tracking framework is efficient.
