A HEVC Video Steganalysis Method Using the Optimality of Motion Vector Prediction

Among steganalysis techniques,detection against MV(motion vector)domain-based video steganography in the HEVC(High Efficiency Video Coding)standard remains a challenging issue.For the purpose of improving the detection performance,this paper proposes a steganalysis method that can perfectly detectMV-based steganography in HEVC.Firstly,we define the local optimality of MVP(Motion Vector Prediction)based on the technology of AMVP(Advanced Motion Vector Prediction).Secondly,we analyze that in HEVC video,message embedding either usingMVP index orMVD(Motion Vector Difference)may destroy the above optimality of MVP.And then,we define the optimal rate of MVP as a steganalysis feature.Finally,we conduct steganalysis detection experiments on two general datasets for three popular steganographymethods and compare the performance with four state-ofthe-art steganalysis methods.The experimental results demonstrate the effectiveness of the proposed feature set.Furthermore,our method stands out for its practical applicability,requiring no model training and exhibiting low computational complexity,making it a viable solution for real-world scenarios.

Vision-based fatigue crack detection using global motion compensation and video feature tracking

Fatigue cracks that develop in civil infrastructure such as steel bridges due to repetitive loads pose a major threat to structural integrity.Despite being the most common practice for fatigue crack detection,human visual inspection is known to be labor intensive,time-consuming,and prone to error.In this study,a computer vision-based fatigue crack detection approach using a short video recorded under live loads by a moving consumer-grade camera is presented.The method detects fatigue crack by tracking surface motion and identifies the differential motion pattern caused by opening and closing of the fatigue crack.However,the global motion introduced by a moving camera in the recorded video is typically far greater than the actual motion associated with fatigue crack opening/closing,leading to false detection results.To overcome the challenge,global motion compensation(GMC)techniques are introduced to compensate for camera-induced movement.In particular,hierarchical model-based motion estimation is adopted for 2D videos with simple geometry and a new method is developed by extending the bundled camera paths approach for 3D videos with complex geometry.The proposed methodology is validated using two laboratory test setups for both in-plane and out-of-plane fatigue cracks.The results confirm the importance of motion compensation for both 2D and 3D videos and demonstrate the effectiveness of the proposed GMC methods as well as the subsequent crack detection algorithm.

Motion connectivity-based initial video object extraction

In order to obtain the initial video objects from the video sequences, an improved initial video object extraction algorithm based on motion connectivity is proposed. Moving objects in video sequences are highly connected and structured, which makes motion connectivity an advanced feature for segmentation. Accordingly, after sharp noise elimination, the cumulated difference image, which exhibits the coherent motion of the moving object, is adaptively thresholded. Then the maximal connected region is labeled, post-processed and output as the final segmenting mask. Hence the initial video object is effectively extracted. Comparative experimental results show that the proposed algorithm extracts the initial video object automatically, promptly and properly, thereby achieving satisfactory subjective and objective performance.

VR/AR-AdaptFace:面向虚拟现实与增强现实的自适应多模态面部替换模型

随着VR/AR技术的迅猛发展,用户对于沉浸式体验的需求日益增长。同时,虚拟人脸技术亦趋成熟。基于此,本文探索将高度拟真的虚拟人脸融入VR/AR,以增强用户体验的自然度与沉浸感。然而,在虚拟数字人领域,图像生成及换脸技术在VR/AR环境下仍遇诸多挑战,尤其是唇形合成模型在动态场景及多语言环境下的性能需进一步优化。为解决上述问题,本文提出VR/AR-AdaptFace模型,一个面向虚拟现实与增强现实的自适应多模态面部替换方案。该模型由两大模块构成:“文颜绘真”模块,采用先进的文本至图像转换技术和特定类别先验保存策略,优化虚拟人脸生成,并通过注意力机制大幅提升图像质量;“语唇映生”模块,依托强大的生成器、唇形同步判别器及视觉质量判别器,实现语音与唇形的精准同步,为VR/AR场景中的动态交互带来更加逼真的体验。

Hierarchical Search Motion Estimation Algorithms for Real-time Video Coding

ＨｉｅｒａｒｃｈｉｃａｌＳｅａｒｃｈＭｏｔｉｏｎＥｓｔｉｍａｔｉｏｎＡｌｇｏｒｉｔｈｍｓｆｏｒＲｅａｌｔｉｍｅＶｉｄｅｏＣｏｄｉｎｇＺｈａｎｇＹｏｎｇＹｕＬｕＺｈｏｕＦｅｎｇＹａｏＱｉｎｇｄｏｎｇ（ＺｈｅｊｉａｎｇＵｎｉｖｅｒｓｉｔｙ，Ｈａｎｇｚｈ...

Multiresolution Video Watermarking Algorithm Exploiting the Block-Based Motion Estimation

This paper presents a novel technique for embedding a digital watermark into video frames based on motion vectors and discrete wavelet transform (DWT). In the proposed scheme, the binary image watermark is divided into blocks and each watermark block is embedded several times in each selected video frame at different locations. The block-based motion estimation algorithm is used to select the video frame blocks having the greatest motion vectors magnitude. The DWT is applied to the selected frame blocks, and then, the watermark block is hidden into these blocks by modifying the coefficients of the Horizontal sub-bands (HL). Adding the watermark at different locations in the same video frame makes the scheme more robust against different types of attacks. The method was tested on different types of videos. The average peak signal to noise ratio (PSNR) and the normalized correlation (NC) are used to measure the performance of the proposed method. Experimental results show that the proposed algorithm does not affect the visual quality of video frames and the scheme is robust against a variety of attacks.

Camera Independent Motion Deblurring in Videos Using Machine Learning

In this paper, we will be looking at our efforts to find a novel solution for motion deblurring in videos. In addition, our solution has the requirement of being camera-independent. This means that the solution is fully implemented in software and is not aware of any of the characteristics of the camera. We found a solution by implementing a Convolutional Neural Network-Long Short Term Memory (CNN-LSTM) hybrid model. Our CNN-LSTM is able to deblur video without any knowledge of the camera hardware. This allows it to be implemented on any system that allows the camera to be swapped out with any camera model with any physical characteristics.

Real-time traffic information extraction based on compressed video with interframe motion vector

Extraction of traffic information from image or video sequence is a hot research topic in intelligenttransportation system and computer vision. A real-time traffic information extraction method based on com-pressed video with interframe motion vectors for speed, density and flow detection, has been proposed for ex-traction of traffic information under fixed camera setting and well-defined environment. The motion vectors arefirst separated from the compressed video streams, and then filtered to eliminate incorrect and noisy vectors u-sing the well-defined environmental knowledge. By applying the projective transform and using the filtered mo-tion vectors, speed can be calculated from motion vector statistics, density can be estimated using the motionvector occupancy, and flow can be detected using the combination of speed and density. The embodiment of aprototype system for sky camera traffic monitoring using the MPEG video has been implemented, and experi-mental results proved the effectiveness of the method proposed.

Video Compression USING a New Active Mesh Based Motion Compensation Algorithm in Wavelet Sub-Bands

In this paper, a new mesh based algorithm is applied for motion estimation and compensation in the wavelet domain. The first major contribution of this work is the introduction of a new active mesh based method for motion estimation and compensation. The proposed algorithm is based on the mesh energy minimization with novel sets of energy functions. The proposed energy functions have appropriate features, which improve the accuracy of motion estimation and compensation algorithm. We employ the proposed motion estimation algorithm in two different manners for video compression. In the first approach, the proposed algorithm is employed for motion estimation of consecutive frames. In the second approach, the algorithm is applied for motion estimation and compensation in the wavelet sub-bands. The experimental results reveal that the incorporation of active mesh based motion-compensated temporal filtering into wavelet sub-bands significantly improves the distortion performance rate of the video compression. We also use a new wavelet coder for the coding of the 3D volume of coefficients based on the retained energy criteria. This coder gives the maximum retained energy in all sub-bands. The proposed algorithm was tested with some video sequences and the results showed that the use of the proposed active mesh method for motion compensation and its implementation in sub-bands yields significant improvement in PSNR performance.

基于Motion-JPEG2000的视频处理

通过与现行视频压缩标准的比较,阐述Motion-JPEG2000的主要特点及优势,讨论了其核心算法并介绍了一种在网络中有效传输视频码流的策略。

新一代视频压缩标准Motion-JPEG2000

Motion -JPEG2 0 0 0是一种全新的视频压缩标准 ,与现行视频压缩标准 (MPEG - 2 ,MPEG - 4,MJPEG等 )相比 ,Motion -JPEG2 0 0 0表现了较强的优势。分析了其主要特点和优势 ,讨论了其核心算法 。

A New Fire Detection Method Using a Multi-Expert System Based on Color Dispersion, Similarity and Centroid Motion in Indoor Environment

In this paper, a video fire detection method is proposed, which demonstrated good performance in indoor environment. Three main novel ideas have been introduced. Firstly, a flame color model in RGB and HIS color space is used to extract pre-detected regions instead of traditional motion differential method, as it’s more suitable for fire detection in indoor environment. Secondly, according to the flicker characteristic of the flame, similarity and two main values of centroid motion are proposed. At the same time, a simple but effective method for tracking the same regions in consecutive frames is established. Thirdly,a multi-expert system consisting of color component dispersion,similarity and centroid motion is established to identify flames.The proposed method has been tested on a very large dataset of fire videos acquired both in real indoor environment tests and from the Internet. The experimental results show that the proposed approach achieved a balance between the false positive rate and the false negative rate, and demonstrated a better performance in terms of overall accuracy and F standard with respect to other similar fire detection methods in indoor environment.

Robust Video Stabilization Based on Motion Vectors

This paper proposes a new robust video stabilization algorithm to remove unwanted vibrations in video sequences. A complete theoretical analysis is first established for video stabilization, providing a basis for new stabilization algorithm. Secondly, a new robust global motion estimation (GME) algorithm is proposed. Different from classic methods, the GME algorithm is based on spatial-temporal filtered motion vectors computed by block-matching methods. In addition, effective schemes are employed in correction phase to prevent boundary artifacts and error accumulation. Experiments show that the proposed algorithm has satisfactory stabilization effects while maintaining good tradeoff between speed and precision.

MULTI-RESOLUTION MOTION ESTIMATION AND COMPENSATION BASED ON ADJACENT PREDICTION OF FRAME DIFFERENCE IN WAVELET DOMAIN

Aiming at the higher bit-rate occupation of motion vector encoding and more time load of full-searching strategies, a multi-resolution motion estimation and compensation algorithm based on adjacent prediction of frame difference was proposed.Differential motion detection was employed to image sequences and proper threshold was adopted to identify the connected region.Then the motion region was extracted to carry out motion estimation and motion compensation on it.The experiment results show that the encoding efficiency of motion vector is promoted, the complexity of motion estimation is reduced and the quality of the reconstruction image at the same bit-rate as Multi-Resolution Motion Estimation(MRME) is improved.

Forward flight of a model butterfly: Simulation by equations of motion coupled with the Navier-Stokes equations

The forward flight of a model butterfly was stud- ied by simulation using the equations of motion coupled with the Navier-Stokes equations. The model butterfly moved under the action of aerodynamic and gravitational forces, where the aerodynamic forces were generated by flapping wings which moved with the body, allowing the body os- cillations of the model butterfly to be simulated. The main results are as follows： （1） The aerodynamic force produced by the wings is approximately perpendicular to the long-axis of body and is much larger in the downstroke than in the up- stroke. In the downstroke the body pitch angle is small and the large aerodynamic force points up and slightly backward, giving the weight-supporting vertical force and a small neg- ative horizontal force, whilst in the upstroke, the body an- gle is large and the relatively small aerodynamic force points forward and slightly downward, giving a positive horizon- tal force which overcomes the body drag and the negative horizontal force generated in the downstroke. （2） Pitching oscillation of the butterfly body plays an equivalent role of the wing-rotation of many other insects. （3） The body-mass- specific power of the model butterfly is 33.3 W/kg, not very different from that of many other insects, e.g., fruitflies and dragonflies.

MOTION-BASED REGION GROWING SEGMENTATION OF IMAGE SEQUENCES

This paper proposes a motion-based region growing segmentation scheme for the object-based video coding, which segments an image into homogeneous regions characterized by a coherent motion. It adopts a block matching algorithm to estimate motion vectors and uses morphological tools such as open-close by reconstruction and the region-growing version of the watershed algorithm for spatial segmentation to improve the temporal segmentation. In order to determine the reliable motion vectors, this paper also proposes a change detection algorithm and a multi-candidate pro- screening motion estimation method. Preliminary simulation results demonstrate that the proposed scheme is feasible. The main advantage of the scheme is its low computational load.

A software-defined networking approach for handover management with real-time video in WLANs

To achieve high performance and reliability in video streaming over wireless local area networks （WLANs）, one must jointly consider both optimized association to access points （APs） and handover management based on dynamic scanning of alternate APs. In this article, we propose a new architecture within the software-defined networking （SDN） framework, which allows stations to be connected to several APs simultaneously and to switch fast between them. We evaluate our system in a real-time testbed and demonstrate that our SDN-based handover mechanism significantly reduces the number and duration of video freeze events and allows for smaller playout buffers.

Effect of varying normal stress on stability and dynamic motion of a spring-slider system with rate- and state-dependent friction

Incorporating rate and state friction laws, stability of linearly stable （i.e., with stiffness greater than the critical value） spring-slider systems subjected to triggering perturbations was analyzed under variable normal stress condition, and comparison was made between our results and that of fixed normal stress cases revealed in previous studies. For systems associated with the slip law, the critical mag- nitude of rate steps for triggering unstable slips are found to have a similar pattern to the fixed normal stress case, and the critical velocity steps scale with a/（b - a） when k = kcr for both cases. The rate-step boundaries for the variable normal stress cases are revealed to be lower than the fixed normal stress case by 7 %-16 % for a relatively large ct = 0.56 with （b - a）/a ranging from 0.25 to 1, indicating easier triggering under the variable normal stress condition with rate steps. The difference between fixed and variable normal stress cases decreases when the α value is smaller. In the same slip- law-type systems, critical displacements to trigger instability are revealed to be little affected by the variable normal stress condition. When k 〉 kcr（V,）, a spring-slider system with the slowness law is much more stable than with the slip law,suggesting that the slowness law fits experimental data better when a single state variable is adopted. In stick-slip motions, the variable normal stress case has larger stress drops than the constant normal stress case. The variable normal stress has little effect on the range of slip velocity in systems associated with the slowness law, whereas systems associated with the slip law have a slowest slip velocity immensely smaller than the fixed normal stress case, by ~ 10 orders of magnitude.

Numerical study on wave loads and motions of two ships advancing in waves by using three-dimensional translating-pulsating source

A frequency domain analysis method based on the three-dimensional translating-pulsating （3DTP） source Green function is developed to investigate wave loads and free motions of two ships advancing on parallel course in waves. Two experiments are carried out respectively to mea- sure the wave loads and the free motions for a pair of side-by- side arranged ship models advancing with an identical speed in head regular waves. For comparison, each model is also tested alone. Predictions obtained by the present solution are found in favorable agreement with the model tests and are more accurate than the traditional method based on the three dimensional pulsating （3DP） source Green function. Numer- ical resonances and peak shift can be found in the 3DP pre- dictions, which result from the wave energy trapped in the gap between two ships and the extremely inhomogeneous wave load distribution on each hull. However, they can be eliminated by 3DTP, in which the speed affects the free sur- face and most of the wave energy can be escaped from the gap. Both the experiment and the present prediction show that hydrodynamic interaction effects on wave loads and free motions are significant. The present solver may serve as a validated tool to predict wave loads and motions of two ves- sels under replenishment at sea, and may help to evaluate the hydrodynamic interaction effects on the ships safety in replenishment operation.

Minimum Distortion Direction Prediction-based Fast Half-pixel Motion Vector Search Algorithm

A minimum distortion direction prediction-based novel fast half-pixel motion vector search algorithm is proposed, which can reduce considerably the computation load of half-pixel search. Based on the single valley characteristic of half-pixel error matching function inside search grid, the minimum distortion direction is predicted with the help of comparative results of sum of absolute difference(SAD) values of four integer-pixel points around integer-pixel motion vector. The experimental results reveal that, to all kinds of video sequences, the proposed algorithm can obtain almost the same video quality as that of the half-pixel full search algorithm with a decrease of computation cost by more than 66%.