This paper proposes an adaptive hybrid forward error correction(AH-FEC)coding scheme for coping with dynamic packet loss events in video and audio transmission.Specifically,the proposed scheme consists of a hybrid Ree...This paper proposes an adaptive hybrid forward error correction(AH-FEC)coding scheme for coping with dynamic packet loss events in video and audio transmission.Specifically,the proposed scheme consists of a hybrid Reed-Solomon and low-density parity-check(RS-LDPC)coding system,combined with a Kalman filter-based adaptive algorithm.The hybrid RS-LDPC coding accommodates a wide range of code length requirements,employing RS coding for short codes and LDPC coding for medium-long codes.We delimit the short and medium-length codes by coding performance so that both codes remain in the optimal region.Additionally,a Kalman filter-based adaptive algorithm has been developed to handle dynamic alterations in a packet loss rate.The Kalman filter estimates packet loss rate utilizing observation data and system models,and then we establish the redundancy decision module through receiver feedback.As a result,the lost packets can be perfectly recovered by the receiver based on the redundant packets.Experimental results show that the proposed method enhances the decoding performance significantly under the same redundancy and channel packet loss.展开更多
Abts ract A wireless mutl i-hop videot ransmission experiment system is designed and implemented for vehiculra ad-hoc networks VANET and the rt ansm ission control protocol and routing protocol are proposed. This syst...Abts ract A wireless mutl i-hop videot ransmission experiment system is designed and implemented for vehiculra ad-hoc networks VANET and the rt ansm ission control protocol and routing protocol are proposed. This system in tegrates the embedded Linux system witha n ARM kernel and oc ns ists of a S3C6410 main control module a wirel ss local arean etwork WLAN card a LCD screne and so on.In the scenario of a wireless multi-hop video transmission both the H.264 and JPEG are used and their performances such as the compression rate delay and frame loss rate are analyzed in theory andc ompared in the experiment.The system is tested in the real indoor and outdoor environment.The results show that the scheme of the multi-hop video transmission experiment system can be applicable for VANET and multiple scenes and the transmission control protocol and routing protocol proposed can achieve real-time transmission and meet multi-hop requirements.展开更多
To improve the performance of MIMO-OFDM video transmission systems on the limitation of wireless bandwidth and transmitting power,we propose an adaptive joint resource allocation algorithm with unequal error protectio...To improve the performance of MIMO-OFDM video transmission systems on the limitation of wireless bandwidth and transmitting power,we propose an adaptive joint resource allocation algorithm with unequal error protection(UEP) based on joint source-channel coding(JSCC) according to H.264 video compression standard and RCPT channel coding.According to different thresholds of the average SNR of subchannels,the algorithm dynamically allocates the source coding parameters of original video data and the channel coding parameters of RCPT,which realizes UEP for the compressed video data of different importance.Through the bit and power allocation based on MQAM modulation and the subspace allocation based on beamforming technology for different subcarriers,an adaptive joint resource allocation making full use of space-frequency domain resources have been realized.The simulation results indicate that the algorithm improves the adaptability of video transmission systems in different wireless environments and the quality of video retrieval.展开更多
The transmission delay of realtime video packet mainly depends on the sensing time delay(short-term factor) and the entire frame transmission delay(long-term factor).Therefore,the optimization problem in the spectrum ...The transmission delay of realtime video packet mainly depends on the sensing time delay(short-term factor) and the entire frame transmission delay(long-term factor).Therefore,the optimization problem in the spectrum handoff process should be formulated as the combination of microscopic optimization and macroscopic optimization.In this paper,we focus on the issue of combining these two optimization models,and propose a novel Evolution Spectrum Handoff(ESH)strategy to minimize the expected transmission delay of real-time video packet.In the microoptimized model,considering the tradeoff between Primary User's(PU's) allowable collision percentage of each channel and transmission delay of video packet,we propose a mixed integer non-linear programming scheme.The scheme is able to achieve the minimum sensing time which is termed as an optimal stopping time.In the macro-optimized model,using the optimal stopping time as reward function within the partially observable Markov decision process framework,the EHS strategy is designed to search an optimal target channel set and minimize the expected delay of packet in the long-term real-time video transmission.Meanwhile,the minimum expected transmission delay is obtained under practical cognitive radio networks' conditions,i.e.,secondary user's mobility,PU's random access,imperfect sensing information,etc..Theoretical analysis and simulation results show that the ESH strategy can effectively reduce the transmission delay of video packet in spectrum handoff process.展开更多
When wireless hosts use different rates to transmit data in IEEE 802.11 networks, it will take on the state of performance anomaly which will severely decrease the throughputs of all the higher rate hosts. Hence, it i...When wireless hosts use different rates to transmit data in IEEE 802.11 networks, it will take on the state of performance anomaly which will severely decrease the throughputs of all the higher rate hosts. Hence, it is bad for video service transmission. Considering that video is very sensitive to packet delivery delay but can tolerate some packet losses, we propose a novel cross-layer scheme which takes these two characteristics into consideration. Firstly, the maximum number of retransmissions for a video Medium Access Control (MAC) frame is computed in MAC layer according to video frame rate requirement of application layer and current access delay of MAC layer. Secondly, within the margin of the tolerant Packet Loss Rate (PLR) of application layer, several video MAC frames are allowed to drop so that we can adaptively select the transmission rate as high as possible for the rest of video MAC frames in terms of current channel quality and the maximum number of retransmissions. Experiment results show that the proposed method can reduce the delay and jitter of video service and improve the throughputs of fast hosts. Therefore, it increases the quality of reconstructed video to a certain extent and relieves the performance anomaly of network effectively.展开更多
With the development of IP multicast technology, the best use of network bandwidth can be achieved, and IP video broadcasting can be implemented. This paper introduces the principle of IP multicast technology, and pre...With the development of IP multicast technology, the best use of network bandwidth can be achieved, and IP video broadcasting can be implemented. This paper introduces the principle of IP multicast technology, and presents an implementation of IP video multicasting in LAN based on Winsock2. Problems in IP multicast are also analyzed in brief.展开更多
A novel joint optimization strategy for the secondary user( SU) was proposed to consider the short-term and long-term video transmissions over distributed cognitive radio networks( DCRNs).Since the long-term video tra...A novel joint optimization strategy for the secondary user( SU) was proposed to consider the short-term and long-term video transmissions over distributed cognitive radio networks( DCRNs).Since the long-term video transmission consisted of a series of shortterm transmissions, the optimization problem in the video transmission was a composite optimization process. Firstly,considering some factors like primary user's( PU's) collision limitations,non-synchronization between SU and PU,and SU's limited buffer size, the short-term optimization problem was formulated as a mixed integer non-linear program( MINLP) to minimize the block probability of video packets. Secondly,combining the minimum packet block probability obtained in shortterm optimization and SU's constraint on hardware complexity,the partially observable Markov decision process( POMDP) framework was proposed to learn PU's statistic information over DCRNs.Moreover,based on the proposed framework,joint optimization strategy was designed to obtain the minimum packet loss rate in long-term video transmission. Numerical simulation results were provided to demonstrate validity of our strategies.展开更多
With the development of multimedia communication services, robust video transmission over wireless environment poses many challenges. A new UEP_BTC_STBC_OFDM system is proposed to provide unequal error protection for ...With the development of multimedia communication services, robust video transmission over wireless environment poses many challenges. A new UEP_BTC_STBC_OFDM system is proposed to provide unequal error protection for the source coded video stream in dispersive fading channel. The scheme concatenates the Block Turbo Code (BTC) with the Space-Time Block Code (STBC) for an OFDM system. With the proposed system, both the good error correcting capability of BTC and the concurrent large diversity gain characteristic of STBC can be achieved simultaneously with low encoding and decoding complexity. Furthermore, by combining with the data partition of H. 264 and different BTC codes, this system can guarantee high QoS control of video transmission. Simulation result shows that the proposed system outoerforms other reported schemes and has good performance of video transmission.展开更多
The transmission characteristics of video transmission mediums,coaxial ca ble and optical fiber,are discussed in the paper. The formulas for frequency bandwidth are given to evaluate the video transmission distance. F...The transmission characteristics of video transmission mediums,coaxial ca ble and optical fiber,are discussed in the paper. The formulas for frequency bandwidth are given to evaluate the video transmission distance. For typical video transmission systems with BB/IM and PFM/IM tising optical fiber as the channel, expressions and calculating results for both S/N and sensitivity are given. Finally, the principle for se lecting different type of transmission systems according to transmission distances of the industrial TV is presented.展开更多
In recent years,Software Defined Networking(SDN)has become an important candidate for communication infrastructure in smart cities.It produces a drastic increase in the need for delivery of video services that are of ...In recent years,Software Defined Networking(SDN)has become an important candidate for communication infrastructure in smart cities.It produces a drastic increase in the need for delivery of video services that are of high resolution,multiview,and large-scale in nature.However,this entity gets easily influenced by heterogeneous behaviour of the user’s wireless link features that might reduce the quality of video stream for few or all clients.The development of SDN allows the emergence of new possibilities for complicated controlling of video conferences.Besides,multicast routing protocol with multiple constraints in terms of Quality of Service(QoS)is a Nondeterministic Polynomial time(NP)hard problem which can be solved only with the help of metaheuristic optimization algorithms.With this motivation,the current research paper presents a new Improved BlackWidow Optimization with Levy Distribution model(IBWO-LD)-based multicast routing protocol for smart cities.The presented IBWO-LD model aims at minimizing the energy consumption and bandwidth utilization while at the same time accomplish improved quality of video streams that the clients receive.Besides,a priority-based scheduling and classifier model is designed to allocate multicast request based on the type of applications and deadline constraints.A detailed experimental analysis was carried out to ensure the outcomes improved under different aspects.The results from comprehensive comparative analysis highlighted the superiority of the proposed IBWO-LD model over other compared methods.展开更多
The emerging new services in the sixth generation(6G)communication system impose increasingly stringent requirements and challenges on video transmission.Semantic communications are envisioned as a promising solution ...The emerging new services in the sixth generation(6G)communication system impose increasingly stringent requirements and challenges on video transmission.Semantic communications are envisioned as a promising solution to these challenges.This paper provides a highly-efficient solution to video transmission by proposing a scalable semantic transmission algorithm,named scalable semantic transmission framework for video(SST-V),which jointly considers the semantic importance and channel conditions.Specifically,a semantic importance evaluation module is designed to extract more informative semantic features according to the estimated importance level,facilitating high-efficiency semantic coding.By further considering the channel condition,a cascaded learning based scalable joint semanticchannel coding algorithm is proposed,which autonomously adapts the semantic coding and channel coding strategies to the specific signalto-noise ratio(SNR).Simulation results show that SST-V achieves better video reconstruction performance,while significantly reducing the transmission overhead.展开更多
Recently,there have been significant advancements in the study of semantic communication in single-modal scenarios.However,the ability to process information in multi-modal environments remains limited.Inspired by the...Recently,there have been significant advancements in the study of semantic communication in single-modal scenarios.However,the ability to process information in multi-modal environments remains limited.Inspired by the research and applications of natural language processing across different modalities,our goal is to accurately extract frame-level semantic information from videos and ultimately transmit high-quality videos.Specifically,we propose a deep learning-basedMulti-ModalMutual Enhancement Video Semantic Communication system,called M3E-VSC.Built upon a VectorQuantized Generative AdversarialNetwork(VQGAN),our systemaims to leverage mutual enhancement among different modalities by using text as the main carrier of transmission.With it,the semantic information can be extracted fromkey-frame images and audio of the video and performdifferential value to ensure that the extracted text conveys accurate semantic information with fewer bits,thus improving the capacity of the system.Furthermore,a multi-frame semantic detection module is designed to facilitate semantic transitions during video generation.Simulation results demonstrate that our proposed model maintains high robustness in complex noise environments,particularly in low signal-to-noise ratio conditions,significantly improving the accuracy and speed of semantic transmission in video communication by approximately 50 percent.展开更多
A method of transmission and monitoring in local area network(LAN) for the welding seam video information of binocular vision welding robot is proposed.This paper uses MPEG-4 video CODEC functions of DivX,video for Wi...A method of transmission and monitoring in local area network(LAN) for the welding seam video information of binocular vision welding robot is proposed.This paper uses MPEG-4 video CODEC functions of DivX,video for Windows(VFW) video capture technology,multi-threaded network communication idea and WinSock Socket in Visual C++ 6.0.In the end,client/server(C/S) communication model based on TCP/IP protocol has been developed.Experimental results show that the method can achieve the multiple welding seam video's real-time transmission in LAN.Moreover,the Canny operator is used to realize the edge feature extraction of the seam image which is captured by the client,so that the edge of the seam extracted is continuous and clear.展开更多
In this article, a spatio-temporal post-processing error concealment algorithm designed initially for a H.264 video-streaming scheme over packet-lossy networks has been presented. It aims at optimizing subjective qual...In this article, a spatio-temporal post-processing error concealment algorithm designed initially for a H.264 video-streaming scheme over packet-lossy networks has been presented. It aims at optimizing subjective quality of restored video and the conventional objective metric, peak signal-to-noise ratio (PSNR), as well, under the constraints of low delay and computational complexity, which are critical to real-time applications and portable devices having limited resources. Specifically, it takes into consideration physical property of motion to achieve more meaningful perceptual video quality. Further, a content-adaptive bilinear spatial interpolation approach and a temporal error concealment approach are combined under a unified boundary match criterion based on texture and motion activity analysis. Extensive experiments have demonstrated that the proposal not only result in better reconstruction, objectively and subjectively, than the reference software model benchmark, but also results in better robustness to different video sequences.展开更多
An approach based on adaptive congestion control and adaptive error recovery with RS (Reed-Solomon) coding method is presented for efficient video transmission over the Internet. Featured by weighted moving average ra...An approach based on adaptive congestion control and adaptive error recovery with RS (Reed-Solomon) coding method is presented for efficient video transmission over the Internet. Featured by weighted moving average rate control and TCP-friendliness, AVSP, a novel adaptive video streaming protocol, is designed with adjustable rate control parameters so as to respond quickly to the QoS status fluctuation during video transmission over the Internet. Combined with congestion control policy, an adaptive RS coding error recovery scheme with variable parameters is presented to enhance the robustness of MPEG video transmission over the Internet with restriction to the total system bandwidth .展开更多
The video transmission in the Internet-of-Things(IoT)system must guarantee the video quality and reduce the packet loss rate and the delay with limited resources to satisfy the requirement of multimedia services.In th...The video transmission in the Internet-of-Things(IoT)system must guarantee the video quality and reduce the packet loss rate and the delay with limited resources to satisfy the requirement of multimedia services.In this paper,we propose a reinforcement learning based energy-efficient IoT video transmission scheme that protects against interference,in which the base station controls the transmission action of the IoT device including the encoding rate,the modulation and coding scheme,and the transmit power.A reinforcement learning algorithm state-action-reward-state-action is applied to choose the transmission action based on the observed state(the queue length of the buffer,the channel gain,the previous bit error rate,and the previous packet loss rate)without knowledge of the transmission channel model at the transmitter and the receiver.We also propose a deep reinforcement learning based energy-efficient IoT video transmission scheme that uses a deep neural network to approximate Q value to further accelerate the learning process involved in choosing the optimal transmission action and improve the video transmission performance.Moreover,both the performance bounds of the proposed schemes and the computational complexity are theoretically derived.Simulation results show that the proposed schemes can increase the peak signal-to-noise ratio and decrease the packet loss rate,the delay,and the energy consumption relative to the benchmark scheme.展开更多
With the advancement of cloud computing technology,many service providers are combining with cloud service providers to build a highly available streaming video-on-demand cloud platform and provide video services to e...With the advancement of cloud computing technology,many service providers are combining with cloud service providers to build a highly available streaming video-on-demand cloud platform and provide video services to end users.Generally,cloud service providers deploy many edge cloud CDN nodes in different geographic areas and provide video services to end users.However,when an end-user wants to watch certain videos and request video resources from surrounding edge cloud CDN nodes,the edge cloud CDN node will request missing video clips from other cloud nodes.Therefore,this will generate a large amount of additional video transmission costs and reduce the quality of service of the cloud service provider.To reduce or even minimize the video transmission cost of edge cloud CDN nodes while ensuring the quality of service(QoS).We designed a video transmission algorithm called Netdmc to ensure transmission quality.The algorithm can be divided into two parts.The first part is a low-latency video request algorithm based on ensuring service quality,and the second part is a video request algorithm based on minimizing video transmission costs.The simulation results demonstrate that the Netdmc algorithm can effectively reduce the cost of cloud service providers and ensure the quality of video services.展开更多
To combat packet loss and realize robust video transmission over Intemet and wireless networks, a new multiple description (MD) video coding method is proposed. In the method, two descriptions for each video frame i...To combat packet loss and realize robust video transmission over Intemet and wireless networks, a new multiple description (MD) video coding method is proposed. In the method, two descriptions for each video frame is first created by group of blocks (GOB) alternation. Motion information is then duplicated in both the descriptions and a process called low quality macroblock update is designed to redundantly encode textures in each frame using standard bit stream syntax. In this way, the output bit streams are standard compliant and better trade-offs between redundancy and single charmel reconstruction distortion are achieved. The proposed method has much better performance than the well-known MD transform coding (MDTC) method both in terms of redundancy rate distortion, and in the packet loss scenario.展开更多
Classical unequal erasure protection schemes split data to be protected into classes which are encoded independently. The unequal protection scheme presented in this paper is based on an erasure code which encodes all...Classical unequal erasure protection schemes split data to be protected into classes which are encoded independently. The unequal protection scheme presented in this paper is based on an erasure code which encodes all the data together according to the existing dependencies. A simple algorithm generates dynamically the generator matrix of the erasure code according to the packets streams structure, i.e., the dependencies between the packets, and the rate of the code. This proposed erasure code was applied to a packetized MPEG4 stream transmitted over a packet erasure channel and compared with other classical protection schemes in terms of PSNR and MOS. It is shown that the proposed code allows keeping a high video quality-level in a larger packet loss rate range than the other protection schemes.展开更多
This paper introduces an end-to-end robust approach for scalable video over the Internet. The traditional method only considers congestion control, error control and is unable to achieve end-to-end high-quality video ...This paper introduces an end-to-end robust approach for scalable video over the Internet. The traditional method only considers congestion control, error control and is unable to achieve end-to-end high-quality video transmission in the error-prone environment like the Internet since it does not consider the packetization behavior, network conditions and the media characteristics simultaneously. This paper presents an end-to-end approach for scalable video over the Internet, combining network adaptive congestion control and unequal error control. Considering requirements of multimedia transmission, this paper introduces multimedia congestion control to estimate available bandwidth and smooth the media sending rate. Specially in the transport layer we propose unequal interleaving packetization method and unequal error protection scheme, which can alleviate the effect of the packet loss well. Further we develop the rate-distortion theory for the scalable video over the Internet. Thereafter the optimal bit allocation is presented to determine the bits budgets for the source part and error control part. Simulation shows our scheme can achieve good performance for scalable video over the Internet.展开更多
文摘This paper proposes an adaptive hybrid forward error correction(AH-FEC)coding scheme for coping with dynamic packet loss events in video and audio transmission.Specifically,the proposed scheme consists of a hybrid Reed-Solomon and low-density parity-check(RS-LDPC)coding system,combined with a Kalman filter-based adaptive algorithm.The hybrid RS-LDPC coding accommodates a wide range of code length requirements,employing RS coding for short codes and LDPC coding for medium-long codes.We delimit the short and medium-length codes by coding performance so that both codes remain in the optimal region.Additionally,a Kalman filter-based adaptive algorithm has been developed to handle dynamic alterations in a packet loss rate.The Kalman filter estimates packet loss rate utilizing observation data and system models,and then we establish the redundancy decision module through receiver feedback.As a result,the lost packets can be perfectly recovered by the receiver based on the redundant packets.Experimental results show that the proposed method enhances the decoding performance significantly under the same redundancy and channel packet loss.
基金The National Natural Science Foundation of China(No.61201175,61171081)Transformation Program of Science and Technology Achievements of Jiangsu Province(No.BA2010023)
文摘Abts ract A wireless mutl i-hop videot ransmission experiment system is designed and implemented for vehiculra ad-hoc networks VANET and the rt ansm ission control protocol and routing protocol are proposed. This system in tegrates the embedded Linux system witha n ARM kernel and oc ns ists of a S3C6410 main control module a wirel ss local arean etwork WLAN card a LCD screne and so on.In the scenario of a wireless multi-hop video transmission both the H.264 and JPEG are used and their performances such as the compression rate delay and frame loss rate are analyzed in theory andc ompared in the experiment.The system is tested in the real indoor and outdoor environment.The results show that the scheme of the multi-hop video transmission experiment system can be applicable for VANET and multiple scenes and the transmission control protocol and routing protocol proposed can achieve real-time transmission and meet multi-hop requirements.
基金Sponsored by the Fundamental Research Funds for the Central Universities (Grant No. HIT. NSRIF. 201149)the National Natural Science Foundation of China (Grant No. 61071104)
文摘To improve the performance of MIMO-OFDM video transmission systems on the limitation of wireless bandwidth and transmitting power,we propose an adaptive joint resource allocation algorithm with unequal error protection(UEP) based on joint source-channel coding(JSCC) according to H.264 video compression standard and RCPT channel coding.According to different thresholds of the average SNR of subchannels,the algorithm dynamically allocates the source coding parameters of original video data and the channel coding parameters of RCPT,which realizes UEP for the compressed video data of different importance.Through the bit and power allocation based on MQAM modulation and the subspace allocation based on beamforming technology for different subcarriers,an adaptive joint resource allocation making full use of space-frequency domain resources have been realized.The simulation results indicate that the algorithm improves the adaptability of video transmission systems in different wireless environments and the quality of video retrieval.
基金supported by the National Natural Science Foundation of China under Grant No.61301101
文摘The transmission delay of realtime video packet mainly depends on the sensing time delay(short-term factor) and the entire frame transmission delay(long-term factor).Therefore,the optimization problem in the spectrum handoff process should be formulated as the combination of microscopic optimization and macroscopic optimization.In this paper,we focus on the issue of combining these two optimization models,and propose a novel Evolution Spectrum Handoff(ESH)strategy to minimize the expected transmission delay of real-time video packet.In the microoptimized model,considering the tradeoff between Primary User's(PU's) allowable collision percentage of each channel and transmission delay of video packet,we propose a mixed integer non-linear programming scheme.The scheme is able to achieve the minimum sensing time which is termed as an optimal stopping time.In the macro-optimized model,using the optimal stopping time as reward function within the partially observable Markov decision process framework,the EHS strategy is designed to search an optimal target channel set and minimize the expected delay of packet in the long-term real-time video transmission.Meanwhile,the minimum expected transmission delay is obtained under practical cognitive radio networks' conditions,i.e.,secondary user's mobility,PU's random access,imperfect sensing information,etc..Theoretical analysis and simulation results show that the ESH strategy can effectively reduce the transmission delay of video packet in spectrum handoff process.
基金Supported by the National Natural Science Foundation of China(No.61071091,No.60802021)the Research and Innovation Program for University Postgraduates of Jiangsu Province(CX10B_188Z)
文摘When wireless hosts use different rates to transmit data in IEEE 802.11 networks, it will take on the state of performance anomaly which will severely decrease the throughputs of all the higher rate hosts. Hence, it is bad for video service transmission. Considering that video is very sensitive to packet delivery delay but can tolerate some packet losses, we propose a novel cross-layer scheme which takes these two characteristics into consideration. Firstly, the maximum number of retransmissions for a video Medium Access Control (MAC) frame is computed in MAC layer according to video frame rate requirement of application layer and current access delay of MAC layer. Secondly, within the margin of the tolerant Packet Loss Rate (PLR) of application layer, several video MAC frames are allowed to drop so that we can adaptively select the transmission rate as high as possible for the rest of video MAC frames in terms of current channel quality and the maximum number of retransmissions. Experiment results show that the proposed method can reduce the delay and jitter of video service and improve the throughputs of fast hosts. Therefore, it increases the quality of reconstructed video to a certain extent and relieves the performance anomaly of network effectively.
文摘With the development of IP multicast technology, the best use of network bandwidth can be achieved, and IP video broadcasting can be implemented. This paper introduces the principle of IP multicast technology, and presents an implementation of IP video multicasting in LAN based on Winsock2. Problems in IP multicast are also analyzed in brief.
基金National Natural Science Foundation of China(No.61301101)
文摘A novel joint optimization strategy for the secondary user( SU) was proposed to consider the short-term and long-term video transmissions over distributed cognitive radio networks( DCRNs).Since the long-term video transmission consisted of a series of shortterm transmissions, the optimization problem in the video transmission was a composite optimization process. Firstly,considering some factors like primary user's( PU's) collision limitations,non-synchronization between SU and PU,and SU's limited buffer size, the short-term optimization problem was formulated as a mixed integer non-linear program( MINLP) to minimize the block probability of video packets. Secondly,combining the minimum packet block probability obtained in shortterm optimization and SU's constraint on hardware complexity,the partially observable Markov decision process( POMDP) framework was proposed to learn PU's statistic information over DCRNs.Moreover,based on the proposed framework,joint optimization strategy was designed to obtain the minimum packet loss rate in long-term video transmission. Numerical simulation results were provided to demonstrate validity of our strategies.
基金Supported by the High Technology Research and Development Programme of China (No.2003AA103810) and the National Natural Science Foundation of China (No.60202006).
文摘With the development of multimedia communication services, robust video transmission over wireless environment poses many challenges. A new UEP_BTC_STBC_OFDM system is proposed to provide unequal error protection for the source coded video stream in dispersive fading channel. The scheme concatenates the Block Turbo Code (BTC) with the Space-Time Block Code (STBC) for an OFDM system. With the proposed system, both the good error correcting capability of BTC and the concurrent large diversity gain characteristic of STBC can be achieved simultaneously with low encoding and decoding complexity. Furthermore, by combining with the data partition of H. 264 and different BTC codes, this system can guarantee high QoS control of video transmission. Simulation result shows that the proposed system outoerforms other reported schemes and has good performance of video transmission.
文摘The transmission characteristics of video transmission mediums,coaxial ca ble and optical fiber,are discussed in the paper. The formulas for frequency bandwidth are given to evaluate the video transmission distance. For typical video transmission systems with BB/IM and PFM/IM tising optical fiber as the channel, expressions and calculating results for both S/N and sensitivity are given. Finally, the principle for se lecting different type of transmission systems according to transmission distances of the industrial TV is presented.
基金The authors extend their appreciation to the Deanship of Scientific Research at King Khalid University for funding this work under Grant Number(RGP.1/282/42)Princess Nourah bint Abdulrahman University Researchers Supporting Project Number(PNURSP2022R191),Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia.
文摘In recent years,Software Defined Networking(SDN)has become an important candidate for communication infrastructure in smart cities.It produces a drastic increase in the need for delivery of video services that are of high resolution,multiview,and large-scale in nature.However,this entity gets easily influenced by heterogeneous behaviour of the user’s wireless link features that might reduce the quality of video stream for few or all clients.The development of SDN allows the emergence of new possibilities for complicated controlling of video conferences.Besides,multicast routing protocol with multiple constraints in terms of Quality of Service(QoS)is a Nondeterministic Polynomial time(NP)hard problem which can be solved only with the help of metaheuristic optimization algorithms.With this motivation,the current research paper presents a new Improved BlackWidow Optimization with Levy Distribution model(IBWO-LD)-based multicast routing protocol for smart cities.The presented IBWO-LD model aims at minimizing the energy consumption and bandwidth utilization while at the same time accomplish improved quality of video streams that the clients receive.Besides,a priority-based scheduling and classifier model is designed to allocate multicast request based on the type of applications and deadline constraints.A detailed experimental analysis was carried out to ensure the outcomes improved under different aspects.The results from comprehensive comparative analysis highlighted the superiority of the proposed IBWO-LD model over other compared methods.
基金supported in part by the National Natural Science Founda⁃tion of China under Grant No.62293485the Fundamental Research Funds for the Central Universities under Grant No.2022RC18.
文摘The emerging new services in the sixth generation(6G)communication system impose increasingly stringent requirements and challenges on video transmission.Semantic communications are envisioned as a promising solution to these challenges.This paper provides a highly-efficient solution to video transmission by proposing a scalable semantic transmission algorithm,named scalable semantic transmission framework for video(SST-V),which jointly considers the semantic importance and channel conditions.Specifically,a semantic importance evaluation module is designed to extract more informative semantic features according to the estimated importance level,facilitating high-efficiency semantic coding.By further considering the channel condition,a cascaded learning based scalable joint semanticchannel coding algorithm is proposed,which autonomously adapts the semantic coding and channel coding strategies to the specific signalto-noise ratio(SNR).Simulation results show that SST-V achieves better video reconstruction performance,while significantly reducing the transmission overhead.
基金supported by the National Key Research and Development Project under Grant 2020YFB1807602Key Program of Marine Economy Development Special Foundation of Department of Natural Resources of Guangdong Province(GDNRC[2023]24)the National Natural Science Foundation of China under Grant 62271267.
文摘Recently,there have been significant advancements in the study of semantic communication in single-modal scenarios.However,the ability to process information in multi-modal environments remains limited.Inspired by the research and applications of natural language processing across different modalities,our goal is to accurately extract frame-level semantic information from videos and ultimately transmit high-quality videos.Specifically,we propose a deep learning-basedMulti-ModalMutual Enhancement Video Semantic Communication system,called M3E-VSC.Built upon a VectorQuantized Generative AdversarialNetwork(VQGAN),our systemaims to leverage mutual enhancement among different modalities by using text as the main carrier of transmission.With it,the semantic information can be extracted fromkey-frame images and audio of the video and performdifferential value to ensure that the extracted text conveys accurate semantic information with fewer bits,thus improving the capacity of the system.Furthermore,a multi-frame semantic detection module is designed to facilitate semantic transitions during video generation.Simulation results demonstrate that our proposed model maintains high robustness in complex noise environments,particularly in low signal-to-noise ratio conditions,significantly improving the accuracy and speed of semantic transmission in video communication by approximately 50 percent.
基金the National Natural Science Foundation of China (No.61165008)the Natural Science Foundation of Jiangxi Province (No.20114BAB206004)the Project of Jiangxi Provincial Education Department(No.GJJ12038)
文摘A method of transmission and monitoring in local area network(LAN) for the welding seam video information of binocular vision welding robot is proposed.This paper uses MPEG-4 video CODEC functions of DivX,video for Windows(VFW) video capture technology,multi-threaded network communication idea and WinSock Socket in Visual C++ 6.0.In the end,client/server(C/S) communication model based on TCP/IP protocol has been developed.Experimental results show that the method can achieve the multiple welding seam video's real-time transmission in LAN.Moreover,the Canny operator is used to realize the edge feature extraction of the seam image which is captured by the client,so that the edge of the seam extracted is continuous and clear.
文摘In this article, a spatio-temporal post-processing error concealment algorithm designed initially for a H.264 video-streaming scheme over packet-lossy networks has been presented. It aims at optimizing subjective quality of restored video and the conventional objective metric, peak signal-to-noise ratio (PSNR), as well, under the constraints of low delay and computational complexity, which are critical to real-time applications and portable devices having limited resources. Specifically, it takes into consideration physical property of motion to achieve more meaningful perceptual video quality. Further, a content-adaptive bilinear spatial interpolation approach and a temporal error concealment approach are combined under a unified boundary match criterion based on texture and motion activity analysis. Extensive experiments have demonstrated that the proposal not only result in better reconstruction, objectively and subjectively, than the reference software model benchmark, but also results in better robustness to different video sequences.
文摘An approach based on adaptive congestion control and adaptive error recovery with RS (Reed-Solomon) coding method is presented for efficient video transmission over the Internet. Featured by weighted moving average rate control and TCP-friendliness, AVSP, a novel adaptive video streaming protocol, is designed with adjustable rate control parameters so as to respond quickly to the QoS status fluctuation during video transmission over the Internet. Combined with congestion control policy, an adaptive RS coding error recovery scheme with variable parameters is presented to enhance the robustness of MPEG video transmission over the Internet with restriction to the total system bandwidth .
基金This work was supported by the National Natural Science Foundation of China(Nos.61971366,61671396,and 61901403)the Youth Innovation Fund of Xiamen(No.3502Z20206039)the Natural Science Foundation of Fujian Province of China(No.2020J01430).
文摘The video transmission in the Internet-of-Things(IoT)system must guarantee the video quality and reduce the packet loss rate and the delay with limited resources to satisfy the requirement of multimedia services.In this paper,we propose a reinforcement learning based energy-efficient IoT video transmission scheme that protects against interference,in which the base station controls the transmission action of the IoT device including the encoding rate,the modulation and coding scheme,and the transmit power.A reinforcement learning algorithm state-action-reward-state-action is applied to choose the transmission action based on the observed state(the queue length of the buffer,the channel gain,the previous bit error rate,and the previous packet loss rate)without knowledge of the transmission channel model at the transmitter and the receiver.We also propose a deep reinforcement learning based energy-efficient IoT video transmission scheme that uses a deep neural network to approximate Q value to further accelerate the learning process involved in choosing the optimal transmission action and improve the video transmission performance.Moreover,both the performance bounds of the proposed schemes and the computational complexity are theoretically derived.Simulation results show that the proposed schemes can increase the peak signal-to-noise ratio and decrease the packet loss rate,the delay,and the energy consumption relative to the benchmark scheme.
基金supported by the national key research and development program of China (No.2020YFF0305300)National Natural Science Foundation (No.61762029,No.61662012,No.U1811264)Guangxi Key Laboratory of Trusted Software (No.kx201726).
文摘With the advancement of cloud computing technology,many service providers are combining with cloud service providers to build a highly available streaming video-on-demand cloud platform and provide video services to end users.Generally,cloud service providers deploy many edge cloud CDN nodes in different geographic areas and provide video services to end users.However,when an end-user wants to watch certain videos and request video resources from surrounding edge cloud CDN nodes,the edge cloud CDN node will request missing video clips from other cloud nodes.Therefore,this will generate a large amount of additional video transmission costs and reduce the quality of service of the cloud service provider.To reduce or even minimize the video transmission cost of edge cloud CDN nodes while ensuring the quality of service(QoS).We designed a video transmission algorithm called Netdmc to ensure transmission quality.The algorithm can be divided into two parts.The first part is a low-latency video request algorithm based on ensuring service quality,and the second part is a video request algorithm based on minimizing video transmission costs.The simulation results demonstrate that the Netdmc algorithm can effectively reduce the cost of cloud service providers and ensure the quality of video services.
文摘To combat packet loss and realize robust video transmission over Intemet and wireless networks, a new multiple description (MD) video coding method is proposed. In the method, two descriptions for each video frame is first created by group of blocks (GOB) alternation. Motion information is then duplicated in both the descriptions and a process called low quality macroblock update is designed to redundantly encode textures in each frame using standard bit stream syntax. In this way, the output bit streams are standard compliant and better trade-offs between redundancy and single charmel reconstruction distortion are achieved. The proposed method has much better performance than the well-known MD transform coding (MDTC) method both in terms of redundancy rate distortion, and in the packet loss scenario.
文摘Classical unequal erasure protection schemes split data to be protected into classes which are encoded independently. The unequal protection scheme presented in this paper is based on an erasure code which encodes all the data together according to the existing dependencies. A simple algorithm generates dynamically the generator matrix of the erasure code according to the packets streams structure, i.e., the dependencies between the packets, and the rate of the code. This proposed erasure code was applied to a packetized MPEG4 stream transmitted over a packet erasure channel and compared with other classical protection schemes in terms of PSNR and MOS. It is shown that the proposed code allows keeping a high video quality-level in a larger packet loss rate range than the other protection schemes.
文摘This paper introduces an end-to-end robust approach for scalable video over the Internet. The traditional method only considers congestion control, error control and is unable to achieve end-to-end high-quality video transmission in the error-prone environment like the Internet since it does not consider the packetization behavior, network conditions and the media characteristics simultaneously. This paper presents an end-to-end approach for scalable video over the Internet, combining network adaptive congestion control and unequal error control. Considering requirements of multimedia transmission, this paper introduces multimedia congestion control to estimate available bandwidth and smooth the media sending rate. Specially in the transport layer we propose unequal interleaving packetization method and unequal error protection scheme, which can alleviate the effect of the packet loss well. Further we develop the rate-distortion theory for the scalable video over the Internet. Thereafter the optimal bit allocation is presented to determine the bits budgets for the source part and error control part. Simulation shows our scheme can achieve good performance for scalable video over the Internet.