Text perception is crucial for understanding the semantics of outdoor scenes,making it a key requirement for building intelligent systems for driver assistance or autonomous driving.Text information in car-mounted vid...Text perception is crucial for understanding the semantics of outdoor scenes,making it a key requirement for building intelligent systems for driver assistance or autonomous driving.Text information in car-mounted videos can assist drivers in making decisions.However,Car-mounted video text images pose challenges such as complex backgrounds,small fonts,and the need for real-time detection.We proposed a robust Car-mounted Video Text Detector(CVTD).It is a lightweight text detection model based on ResNet18 for feature extraction,capable of detecting text in arbitrary shapes.Our model efficiently extracted global text positions through the Coordinate Attention Threshold Activation(CATA)and enhanced the representation capability through stacking two Feature Pyramid Enhancement Fusion Modules(FPEFM),strengthening feature representation,and integrating text local features and global position information,reinforcing the representation capability of the CVTD model.The enhanced feature maps,when acted upon by Text Activation Maps(TAM),effectively distinguished text foreground from non-text regions.Additionally,we collected and annotated a dataset containing 2200 images of Car-mounted Video Text(CVT)under various road conditions for training and evaluating our model’s performance.We further tested our model on four other challenging public natural scene text detection benchmark datasets,demonstrating its strong generalization ability and real-time detection speed.This model holds potential for practical applications in real-world scenarios.展开更多
In order to reduce the number of surface mining accidents related to low visibility conditions and blind spots of trucks and to provide 3D information for truck drivers and real time monitored truck information for th...In order to reduce the number of surface mining accidents related to low visibility conditions and blind spots of trucks and to provide 3D information for truck drivers and real time monitored truck information for the remote dispatcher, a 3D assisted driving system (3D-ADS) based on the GPS, mesh-wireless networks and the Google-Earth engine as the graphic interface and mine-mapping server, was developed at Virginia Tech. The research results indicate that this 3D-ADS system has the potential to increase reliability and reduce uncertainty in open pit mining operations by customizing the local 3D digital mining map, con-structing 3D truck models, tracking vehicles in real time using a 3D interface and indicating available escape routes for driver safety.展开更多
The Assisted Driving System (ADS) for haul trucks operating in surface mining and construction sites is to reduce accidents related to low visibility conditions. This system is based on the GPS, Zigbee, and the Google...The Assisted Driving System (ADS) for haul trucks operating in surface mining and construction sites is to reduce accidents related to low visibility conditions. This system is based on the GPS, Zigbee, and the Google-Earth engine as the graphic interface and mine-mapping server. The system has the capability to pin-point and track vehicles in real time using a 3D interface, which is based on user-based AutoCAD mine maps using the Google-Earth graphics interface. All equipped vehicles are shown in a 3D mine map stored in a local server through a wireless network. When low visibility conditions are present, the system indicates available exit/escape routes for driver safety. The ADS potentially increases reliability and reduces uncertainty in open pit mining operations.展开更多
In our recent work we showed, by investigating the initialization of some unusual forms of assisted driving Hamiltonians, that the addition of an assisted driving Hamiltonian is not always useful in quantum adiabatic ...In our recent work we showed, by investigating the initialization of some unusual forms of assisted driving Hamiltonians, that the addition of an assisted driving Hamiltonian is not always useful in quantum adiabatic evolution. These unusual forms are those that are not the relatively fixed ones that are widely used in the literature. In this paper, we continue this study, providing further evidence for the validity of the conclusion above by researching some relatively more complex forms of assisted driving scheme, which generalize the ones studied in our previous work.展开更多
Dynamic speed guidance for vehicles in on-ramp merging zones is instrumental in alleviating traffic congestion on urban expressways.To enhance compliance with recommended speeds,the development of a dynamic speed-guid...Dynamic speed guidance for vehicles in on-ramp merging zones is instrumental in alleviating traffic congestion on urban expressways.To enhance compliance with recommended speeds,the development of a dynamic speed-guidance mechanism that accounts for heterogeneity in human driving styles is pivotal.Utilizing intelligent connected technologies that provide real-time vehicular data in these merging locales,this study proposes such a guidance system.Initially,we integrate a multi-agent consensus algorithm into a multi-vehicle framework operating on both the mainline and the ramp,thereby facilitating harmonized speed and spacing strategies.Subsequently,we conduct an analysis of the behavioral traits inherent to drivers of varied styles to refine speed planning in a more efficient and reliable manner.Lastly,we investigate a closed-loop feedback approach for speed guidance that incorporates the driver’s execution rate,thereby enabling dynamic recalibration of advised speeds and ensuring fluid vehicular integration into the mainline.Empirical results substantiate that a dynamic speed guidance system incorporating driving styles offers effective support for human drivers in seamless mainline merging.展开更多
The feature bends and tunnels of mountainous expressways are often affected by bad weather,specif-ically rain and fog,which significantly threaten expressway safety and traffic efficiency.In order to solve this proble...The feature bends and tunnels of mountainous expressways are often affected by bad weather,specif-ically rain and fog,which significantly threaten expressway safety and traffic efficiency.In order to solve this problem,a vehicle–road coordination system based on the Internet of Things(IoT)is developed that can share vehicle–road information in real time,expand the environmental perception range of vehicles,and realize vehicle–road collaboration.It helps improve traffic safety and efficiency.Further,a vehicle–road cooperative driving assistance system model is introduced in this study,and it is based on IoT for improving the driving safety of mountainous expressways.Considering the influence of rain and fog on driving safety,the interaction between rainfall,water film,and adhesion coefficient is analyzed.An intelligent vehicle–road coordination assistance system is constructed that takes in information on weather,road parameters,and vehicle status,and takes the stopping sight distance model as well as rollover and sideslip model as boundary constraints.Tests conducted on a real expressway demonstrated that the assistance system model is helpful in bad weather conditions.This system could promote intelligent development of mountainous expressways.展开更多
Recently, virtual realities and simulations play important roles in the development of automated driving functionalities. By an appropriate abstraction, they help to design, investigate and communicate real traffic sc...Recently, virtual realities and simulations play important roles in the development of automated driving functionalities. By an appropriate abstraction, they help to design, investigate and communicate real traffic scenario complexity. Especially, for edge cases investigations of interactions between vulnerable road users (VRU) and highly automated driving functions, valid virtual models are essential for the quality of results. The aim of this study is to measure, process and integrate real human movement behaviour into a virtual test environment for highly automated vehicle functionalities. The overall system consists of a georeferenced virtual city model and a vehicle dynamics model, including probabilistic sensor descriptions. By motion capture hardware, real humanoid behaviour is applied to a virtual human avatar in the test environment. Through retargeting methods, which enable the independency of avatar and person under test (PuT) dimensions, the virtual avatar diversity is increased. To verify the biomechanical behaviour of the virtual avatars, a qualitative study is performed, which funds on a representative movement sequence. The results confirm the functionality of the used methodology and enable PuT independence control of the virtual avatars in real-time.展开更多
Realizing automation of the chassis dynamometer and the unmanned test workshop is an inevitable trend in the development of new tractor products.The accuracy of the speed control of the test tractor directly affects t...Realizing automation of the chassis dynamometer and the unmanned test workshop is an inevitable trend in the development of new tractor products.The accuracy of the speed control of the test tractor directly affects the accuracy of the test loading force.In order to meet the purpose of precise control of the test tractor speed on the chassis dynamometer,a fuzzy PID control strategy was developed according to the working principle of assisted driving.On the basis of traditional PID control,the parameters of fuzzy inference module were added for real-time adjustment to achieve faster response to tractor speed changes and more precise control of tractor speed.The Matlab-Cruise co-simulation platform was established for simulation,and the experiment was verified by the tractor chassis dynamometer using the NEDC working condition and tractor ploughing working condition.The results show that both PID control and fuzzy PID control can achieve tractor speed following accuracy of±0.5 km/h.Fuzzy PID control has higher tractor speed following accuracy,faster response when speed changes,less tractor speed fluctuation,and overall control effect is better than PID control.The research results can provide a reference for the realization of the chassis dynamometer unmanned test workshop.展开更多
Purpose–Advanced driving assistance system(ADAS)has been applied in commercial vehicles.This paper aims to evaluate the influence factors of commercial vehicle drivers’acceptance on ADAS and explore the characteristi...Purpose–Advanced driving assistance system(ADAS)has been applied in commercial vehicles.This paper aims to evaluate the influence factors of commercial vehicle drivers’acceptance on ADAS and explore the characteristics of each key factors.Two most widely used functions,forward collision warning(FCW)and lane departure warning(LDW),were considered in this paper.Design/methodology/approach–A random forests algorithm was applied to evaluate the influence factors of commercial drivers’acceptance.ADAS data of 24 commercial vehicles were recorded from 1 November to 21 December 2018,in Jiangsu province.Respond or not was set as dependent variables,while six influence factors were considered.Findings–The acceptance rate for FCW and LDW systems was 69.52%and 38.76%,respectively.The accuracy of random forests model for FCW and LDW systems is 0.816 and 0.820,respectively.For FCW system,vehicle speed,duration time and warning hour are three key factors.Drivers prefer to respond in a short duration during daytime and low vehicle speed.While for LDW system,duration time,vehicle speed and driver age are three key factors.Older drivers have higher respond probability under higher vehicle speed,and the respond time is longer than FCW system.Originality/value–Few research studies have focused on the attitudes of commercial vehicle drivers,though commercial vehicle accidents were proved to be more severe than passenger vehicles.The results of this study can help researchers to better understand the behavior of commercial vehicle drivers and make corresponding recommendations for ADAS of commercial vehicles.展开更多
A large number of reported road collisions are caused by driver inattention,and inappropriate driving behaviour.This study investigated the effectiveness and acceptance of Advanced Driving Assistance Systems(ADAS)for ...A large number of reported road collisions are caused by driver inattention,and inappropriate driving behaviour.This study investigated the effectiveness and acceptance of Advanced Driving Assistance Systems(ADAS)for driver age groups,gender,occupation(professional/non-professional),and road type(expressway,urban roads,and semi-urban road)based on the Field Operational Test(FOT).The ADAS is provided with assistance features,such as Lane Departure Warning(LDW),Forward Collision Warning(FCW),and Traffic Speed Recognition Warning(TSRW).In total,the FOT involved 30 participants who drove the test vehicle twice(once in the stealth phase and once in the active phase).The FOT included three sections:expressway(20.60 km),urban road(7.2 km),and semi-urban road(13.35 km).A questionnaire was used to determine user acceptance of the ADAS technology.In addition,parametric and non-parametric statistical tests were carried out to determine ADAS's significant effects.The FOT results showed statistically significant differences in the LDW’s acceptance and effectiveness for gender,age group,occupation,and road type before and after exposure to ADAS.Male participants showed significant lateral behavior improvement compared to female participants.Old-aged drivers scored the highest acceptance score for the technology compared to middle and young-aged drivers.The subjective ratings ranked the assistance features in descending order as TSRW,LDW,and FCW.This study’s findings can support policy development and induce trust in the public for the technology adoption to improve road traffic safety.展开更多
Purpose–The purpose of this paper is to develop a proof-of-concept(POC)Forward Collision Warning(FWC)system for the motorcyclist,which determines a potential clash based on time-to-collision and trajectory of both th...Purpose–The purpose of this paper is to develop a proof-of-concept(POC)Forward Collision Warning(FWC)system for the motorcyclist,which determines a potential clash based on time-to-collision and trajectory of both the detected and ego vehicle(motorcycle).Design/methodology/approach–This comes in three approaches.First,time-to-collision value is to be calculated based on low-cost camera video input.Second,the trajectory of the detected vehicle is predicted based on video data in the 2 D pixel coordinate.Third,the trajectory of the ego vehicle is predicted via the lean direction of the motorcycle from a low-cost inertial measurement unit sensor.Findings–This encompasses a comprehensive Advanced FWC system which is an amalgamation of the three approaches mentioned above.First,to predict time-to-collision,nested Kalmanfilter and vehicle detection is used to convert image pixel matrix to relative distance,velocity and time-to-collision data.Next,for trajectory prediction of detected vehicles,a few algorithms were compared,and it was found that long short-term memory performs the best on the data set.The lastfinding is that to determine the leaning direction of the ego vehicle,it is better to use lean angle measurement compared to riding pattern classification.Originality/value–The value of this paper is that it provides a POC FWC system that considers time-to-collision and trajectory of both detected and ego vehicle(motorcycle).展开更多
基金This work is supported in part by the National Natural Science Foundation of China(Grant Number 61971078)which provided domain expertise and computational power that greatly assisted the activity+1 种基金This work was financially supported by Chongqing Municipal Education Commission Grants forMajor Science and Technology Project(KJZD-M202301901)the Science and Technology Research Project of Jiangxi Department of Education(GJJ2201049).
文摘Text perception is crucial for understanding the semantics of outdoor scenes,making it a key requirement for building intelligent systems for driver assistance or autonomous driving.Text information in car-mounted videos can assist drivers in making decisions.However,Car-mounted video text images pose challenges such as complex backgrounds,small fonts,and the need for real-time detection.We proposed a robust Car-mounted Video Text Detector(CVTD).It is a lightweight text detection model based on ResNet18 for feature extraction,capable of detecting text in arbitrary shapes.Our model efficiently extracted global text positions through the Coordinate Attention Threshold Activation(CATA)and enhanced the representation capability through stacking two Feature Pyramid Enhancement Fusion Modules(FPEFM),strengthening feature representation,and integrating text local features and global position information,reinforcing the representation capability of the CVTD model.The enhanced feature maps,when acted upon by Text Activation Maps(TAM),effectively distinguished text foreground from non-text regions.Additionally,we collected and annotated a dataset containing 2200 images of Car-mounted Video Text(CVT)under various road conditions for training and evaluating our model’s performance.We further tested our model on four other challenging public natural scene text detection benchmark datasets,demonstrating its strong generalization ability and real-time detection speed.This model holds potential for practical applications in real-world scenarios.
基金Financial support for this work, provided by the Key Programs of the National Science and Technology Foundation during the 11th Five-Year Plan Period (No.2006BAK04B04) the State Scholarship Fund (No.2007104096), is gratefully acknowledged
文摘In order to reduce the number of surface mining accidents related to low visibility conditions and blind spots of trucks and to provide 3D information for truck drivers and real time monitored truck information for the remote dispatcher, a 3D assisted driving system (3D-ADS) based on the GPS, mesh-wireless networks and the Google-Earth engine as the graphic interface and mine-mapping server, was developed at Virginia Tech. The research results indicate that this 3D-ADS system has the potential to increase reliability and reduce uncertainty in open pit mining operations by customizing the local 3D digital mining map, con-structing 3D truck models, tracking vehicles in real time using a 3D interface and indicating available escape routes for driver safety.
文摘The Assisted Driving System (ADS) for haul trucks operating in surface mining and construction sites is to reduce accidents related to low visibility conditions. This system is based on the GPS, Zigbee, and the Google-Earth engine as the graphic interface and mine-mapping server. The system has the capability to pin-point and track vehicles in real time using a 3D interface, which is based on user-based AutoCAD mine maps using the Google-Earth graphics interface. All equipped vehicles are shown in a 3D mine map stored in a local server through a wireless network. When low visibility conditions are present, the system indicates available exit/escape routes for driver safety. The ADS potentially increases reliability and reduces uncertainty in open pit mining operations.
基金Project supported by the China Postdoctoral Science Foundation(Grant No.2017M620322)the National Natural Science Foundation of China(Grant No.61402188)+1 种基金Priority for the Postdoctoral Scientific and Technological Program of Hubei Province,China in 2017the Science and Technology Program of Shenzhen of China(Grant Nos.JCYJ 20170818160208570 and JCYJ 20170307160458368)
文摘In our recent work we showed, by investigating the initialization of some unusual forms of assisted driving Hamiltonians, that the addition of an assisted driving Hamiltonian is not always useful in quantum adiabatic evolution. These unusual forms are those that are not the relatively fixed ones that are widely used in the literature. In this paper, we continue this study, providing further evidence for the validity of the conclusion above by researching some relatively more complex forms of assisted driving scheme, which generalize the ones studied in our previous work.
基金supported by National Start-up Research Fund at Southeast University(Grant No.5721002303)Science and Technology Program of Suzhou(Grant No.SYC2022078)+2 种基金Natural Science Foundation of Jiangsu Province(Grant No.BK20220243)China Postdoctoral Science Foundation(Grant No.2023M742033)Key R&D Program Projects of Hubei Province(Grant No.2023DJC195).
文摘Dynamic speed guidance for vehicles in on-ramp merging zones is instrumental in alleviating traffic congestion on urban expressways.To enhance compliance with recommended speeds,the development of a dynamic speed-guidance mechanism that accounts for heterogeneity in human driving styles is pivotal.Utilizing intelligent connected technologies that provide real-time vehicular data in these merging locales,this study proposes such a guidance system.Initially,we integrate a multi-agent consensus algorithm into a multi-vehicle framework operating on both the mainline and the ramp,thereby facilitating harmonized speed and spacing strategies.Subsequently,we conduct an analysis of the behavioral traits inherent to drivers of varied styles to refine speed planning in a more efficient and reliable manner.Lastly,we investigate a closed-loop feedback approach for speed guidance that incorporates the driver’s execution rate,thereby enabling dynamic recalibration of advised speeds and ensuring fluid vehicular integration into the mainline.Empirical results substantiate that a dynamic speed guidance system incorporating driving styles offers effective support for human drivers in seamless mainline merging.
基金the Project of Zhejiang Provincial Transportation Department(No.2020059)。
文摘The feature bends and tunnels of mountainous expressways are often affected by bad weather,specif-ically rain and fog,which significantly threaten expressway safety and traffic efficiency.In order to solve this problem,a vehicle–road coordination system based on the Internet of Things(IoT)is developed that can share vehicle–road information in real time,expand the environmental perception range of vehicles,and realize vehicle–road collaboration.It helps improve traffic safety and efficiency.Further,a vehicle–road cooperative driving assistance system model is introduced in this study,and it is based on IoT for improving the driving safety of mountainous expressways.Considering the influence of rain and fog on driving safety,the interaction between rainfall,water film,and adhesion coefficient is analyzed.An intelligent vehicle–road coordination assistance system is constructed that takes in information on weather,road parameters,and vehicle status,and takes the stopping sight distance model as well as rollover and sideslip model as boundary constraints.Tests conducted on a real expressway demonstrated that the assistance system model is helpful in bad weather conditions.This system could promote intelligent development of mountainous expressways.
文摘Recently, virtual realities and simulations play important roles in the development of automated driving functionalities. By an appropriate abstraction, they help to design, investigate and communicate real traffic scenario complexity. Especially, for edge cases investigations of interactions between vulnerable road users (VRU) and highly automated driving functions, valid virtual models are essential for the quality of results. The aim of this study is to measure, process and integrate real human movement behaviour into a virtual test environment for highly automated vehicle functionalities. The overall system consists of a georeferenced virtual city model and a vehicle dynamics model, including probabilistic sensor descriptions. By motion capture hardware, real humanoid behaviour is applied to a virtual human avatar in the test environment. Through retargeting methods, which enable the independency of avatar and person under test (PuT) dimensions, the virtual avatar diversity is increased. To verify the biomechanical behaviour of the virtual avatars, a qualitative study is performed, which funds on a representative movement sequence. The results confirm the functionality of the used methodology and enable PuT independence control of the virtual avatars in real-time.
基金supported by the 2016 national key research and development plan(Grant No.2016YFD070100).
文摘Realizing automation of the chassis dynamometer and the unmanned test workshop is an inevitable trend in the development of new tractor products.The accuracy of the speed control of the test tractor directly affects the accuracy of the test loading force.In order to meet the purpose of precise control of the test tractor speed on the chassis dynamometer,a fuzzy PID control strategy was developed according to the working principle of assisted driving.On the basis of traditional PID control,the parameters of fuzzy inference module were added for real-time adjustment to achieve faster response to tractor speed changes and more precise control of tractor speed.The Matlab-Cruise co-simulation platform was established for simulation,and the experiment was verified by the tractor chassis dynamometer using the NEDC working condition and tractor ploughing working condition.The results show that both PID control and fuzzy PID control can achieve tractor speed following accuracy of±0.5 km/h.Fuzzy PID control has higher tractor speed following accuracy,faster response when speed changes,less tractor speed fluctuation,and overall control effect is better than PID control.The research results can provide a reference for the realization of the chassis dynamometer unmanned test workshop.
基金sponsored by the National Natural Science Foundation of China(number 52072070)the Foundation for Jiangsu Key Laboratory of Traffic and Transportation Security(TTS2020-04)the Fundamental Research Funds for the Central Universities(number 2242021R10112).
文摘Purpose–Advanced driving assistance system(ADAS)has been applied in commercial vehicles.This paper aims to evaluate the influence factors of commercial vehicle drivers’acceptance on ADAS and explore the characteristics of each key factors.Two most widely used functions,forward collision warning(FCW)and lane departure warning(LDW),were considered in this paper.Design/methodology/approach–A random forests algorithm was applied to evaluate the influence factors of commercial drivers’acceptance.ADAS data of 24 commercial vehicles were recorded from 1 November to 21 December 2018,in Jiangsu province.Respond or not was set as dependent variables,while six influence factors were considered.Findings–The acceptance rate for FCW and LDW systems was 69.52%and 38.76%,respectively.The accuracy of random forests model for FCW and LDW systems is 0.816 and 0.820,respectively.For FCW system,vehicle speed,duration time and warning hour are three key factors.Drivers prefer to respond in a short duration during daytime and low vehicle speed.While for LDW system,duration time,vehicle speed and driver age are three key factors.Older drivers have higher respond probability under higher vehicle speed,and the respond time is longer than FCW system.Originality/value–Few research studies have focused on the attitudes of commercial vehicle drivers,though commercial vehicle accidents were proved to be more severe than passenger vehicles.The results of this study can help researchers to better understand the behavior of commercial vehicle drivers and make corresponding recommendations for ADAS of commercial vehicles.
文摘A large number of reported road collisions are caused by driver inattention,and inappropriate driving behaviour.This study investigated the effectiveness and acceptance of Advanced Driving Assistance Systems(ADAS)for driver age groups,gender,occupation(professional/non-professional),and road type(expressway,urban roads,and semi-urban road)based on the Field Operational Test(FOT).The ADAS is provided with assistance features,such as Lane Departure Warning(LDW),Forward Collision Warning(FCW),and Traffic Speed Recognition Warning(TSRW).In total,the FOT involved 30 participants who drove the test vehicle twice(once in the stealth phase and once in the active phase).The FOT included three sections:expressway(20.60 km),urban road(7.2 km),and semi-urban road(13.35 km).A questionnaire was used to determine user acceptance of the ADAS technology.In addition,parametric and non-parametric statistical tests were carried out to determine ADAS's significant effects.The FOT results showed statistically significant differences in the LDW’s acceptance and effectiveness for gender,age group,occupation,and road type before and after exposure to ADAS.Male participants showed significant lateral behavior improvement compared to female participants.Old-aged drivers scored the highest acceptance score for the technology compared to middle and young-aged drivers.The subjective ratings ranked the assistance features in descending order as TSRW,LDW,and FCW.This study’s findings can support policy development and induce trust in the public for the technology adoption to improve road traffic safety.
文摘Purpose–The purpose of this paper is to develop a proof-of-concept(POC)Forward Collision Warning(FWC)system for the motorcyclist,which determines a potential clash based on time-to-collision and trajectory of both the detected and ego vehicle(motorcycle).Design/methodology/approach–This comes in three approaches.First,time-to-collision value is to be calculated based on low-cost camera video input.Second,the trajectory of the detected vehicle is predicted based on video data in the 2 D pixel coordinate.Third,the trajectory of the ego vehicle is predicted via the lean direction of the motorcycle from a low-cost inertial measurement unit sensor.Findings–This encompasses a comprehensive Advanced FWC system which is an amalgamation of the three approaches mentioned above.First,to predict time-to-collision,nested Kalmanfilter and vehicle detection is used to convert image pixel matrix to relative distance,velocity and time-to-collision data.Next,for trajectory prediction of detected vehicles,a few algorithms were compared,and it was found that long short-term memory performs the best on the data set.The lastfinding is that to determine the leaning direction of the ego vehicle,it is better to use lean angle measurement compared to riding pattern classification.Originality/value–The value of this paper is that it provides a POC FWC system that considers time-to-collision and trajectory of both detected and ego vehicle(motorcycle).