Pedestrian detection in driver assistance using SSD and PS-GAN

Pedestrian detection is a critical challenge in the field of general object detection,the performance of object detection has advanced with the development of deep learning.However,considerable improvement is still required for pedestrian detection,considering the differences in pedestrian wears,action,and posture.In the driver assistance system,it is necessary to further improve the intelligent pedestrian detection ability.We present a method based on the combination of SSD and GAN to improve the performance of pedestrian detection.Firstly,we assess the impact of different kinds of methods which can detect pedestrians based on SSD and optimize the detection for pedestrian characteristics.Secondly,we propose a novel network architecture,namely data synthesis PS-GAN to generate diverse pedestrian data for verifying the effectiveness of massive training data to SSD detector.Experimental results show that the proposed manners can improve the performance of pedestrian detection to some extent.At last,we use the pedestrian detector to simulate a specific application of motor vehicle assisted driving which would make the detector focus on specific pedestrians according to the velocity of the vehicle.The results establish the validity of the approach.

Seroprevalence Survey of HIV and Hepatitis B Virus and Behavioral Characteristics among Heavy Truck Drivers along Port Sudan-Khartoum Highways

The prevalence of human immunodeficiency virus (AIDS) and hepatitis B virus among heavy truck drivers and their assistants has been well documented globally in correlation with their behavioral characteristics. The present study aimed to screen for human immunodeficiency virus (HIV), hepatitis B virus (HBV), and behavioral characteristics among heavy truck drivers in Port Sudan. A cross-sectional study was conducted on 274 heavy truck drivers and their assistants who used the highway Port Sudan-Khartoum in Port Sudan city during 2019-2021. Data on behavioral characteristics and substance use habits were collected using a structured questionnaire, and an ELISA test was used to screen for HIV and HBV infections in the study participants. The chi-square test, odds ratio, and confidence intervals were used to find the association between behavioral characteristics and seropositive HIV/HBV. Of the 274 enrolled participants, the seroprevalence rates of HIV were 2.7% and HBV was 23.7%. Ninety-four (34.3%) of them had a history of high-risk sexual behavior outside of marriage;only two (0.7%) used condoms;14.2% of participants reported alcohol use;and 1.1% reported drug use. Univariate analysis revealed that having a sex history outside of marriage with ≥1 sex partner and never using a condom with a spouse or casual partner were significant risk factors for HIV and HBV among drivers. Fortunately, we found that most of the drivers reported low alcohol and drug use. Concerning this study, the seroprevalence of HIV and HBV is highly associated with a history of having sex outside of marriage and sexual behavior among truck drivers and assistances. Additional studies are needed to further investigate other STIs and behavioral characteristics associated with factors in truck drivers/assistance in different truck stop regions in Sudan.

Subjective assessment for an advanced driver assistance system:a case study in China

Purpose–This study aims to propose a novel subjective assessment(SA)method for level 2 or level 21 advanced driver assistance system(ADAS)with a customized case study in China.Design/methodology/approach–The proposed SA method contains six dimensions,including perception,driveability and stability,riding comfort,human–machine interaction,driver workload and trustworthiness and exceptional operating case,respectively.And each dimension subordinates several subsections,which describe the corresponding details under this dimension.Findings–Based on the proposed SA,a case study in China is conducted.Six drivers with different driving experiences are invited to give their subjective ratings for each subsection according to a predefined rating standard.The rating results show that the ADAS from Tesla outperforms the upcoming electric vehicle in most cases.Originality/value–The proposed SA method is beneficial for the original equipment manufacturers developing related technologies in the future.

A Survey and Tutorial of EEG-Based Brain Monitoring for Driver State Analysis

The driver’s cognitive and physiological states affect his/her ability to control the vehicle.Thus,these driver states are essential to the safety of automobiles.The design of advanced driver assistance systems(ADAS)or autonomous vehicles will depend on their ability to interact effectively with the driver.A deeper understanding of the driver state is,therefore,paramount.Electroencephalography(EEG)is proven to be one of the most effective methods for driver state monitoring and human error detection.This paper discusses EEG-based driver state detection systems and their corresponding analysis algorithms over the last three decades.First,the commonly used EEG system setup for driver state studies is introduced.Then,the EEG signal preprocessing,feature extraction,and classification algorithms for driver state detection are reviewed.Finally,EEG-based driver state monitoring research is reviewed in-depth,and its future development is discussed.It is concluded that the current EEGbased driver state monitoring algorithms are promising for safety applications.However,many improvements are still required in EEG artifact reduction,real-time processing,and between-subject classification accuracy.

Vehicles, Advanced Features, Driver Behavior, and Safety: A Systematic Review of the Literature

Driver errors contribute to more than 94% of traffic crashes. Automotive companies are striving to enhance their vehicles to eliminate driver errors and reduce the number of crashes. Various advanced features like lane departure warning (LDW), blind spot warning (BSW), over speed warning (OSW), forward collision warning (FCW), lane keep assist (LKA), adaptive cruise control (ACC), cooperative ACC (CACC), and automated emergency braking (AEB) are designed to assist with, or in some cases take over, certain driving maneuvers. They can be broadly categorized into advanced driver assistance system (ADAS) and automated features. Each of these advanced features focuses on addressing a particular task of driving, thereby, aiding the driver, influencing their behavior, and enhancing safety. Many vehicles with these advanced features are penetrating into the market, yet the total reported number of crashes has increased in recent years. This paper presents a systematic review of these advanced features on driver behavior and safety. The review is categorized into 1) survey and mathematical methods to assess driver behavior, 2) field test methods to assess driver behavior, 3) microsimulation methods to assess driver behavior, 4) driving simulator methods to assess driver behavior, and 5) driver understanding and the effectiveness of advanced features. It is followed by conclusions, knowledge gaps, and need for further research.

Approach for improved development of advanced driver assistance systems for future smart mobility concepts

To use the benefits of Advanced Driver Assistance Systems(ADAS)-Tests in simulation and reality a new approach for using Augmented Reality(AR)in an automotive vehicle for testing ADAS is presented in this paper.Our procedure provides a link between simulation and reality and should enable a faster development process for future increasingly complex ADAS tests and future mobility solutions.Test fields for ADAS offer a small number of orientation points.Furthermore,these must be detected and processed at high vehicle speeds.That requires high computational power both for developing our method and its subsequent use in testing.Using image segmentation(IS),artificial intelligence(AI)for object recognition,and visual simultaneous localization and mapping(vSLAM),we aim to create a three-dimensional model with accurate information about the test site.It is expected that using AI and IS will significantly improve performance as computational speed and accuracy for AR applications in automobiles.

Improving the Accuracy of Under-Fog Driving Assistance System

Driving in fog condition is dangerous. Fog causes poor visibility on roads leading to road traffic accident (RTA). RTA in Albaha is common because of its rough terrain, in addition to the climate that is mainly rainy and foggy. The rain season in Albaha region begins in October to February characterized by rainfall and fog. Many studies have reported the adverse effects of the rain on RTA which results in an increased rate of crashes. On the other hand, Albaha region is not supported by a proper intelligent transportation system and infrastructure. Thus, a Driver Assistance System (DAS) that requires minimum infrastructure is needed. A DAS under fog called No_Collision has been developed by a researcher in Albaha University. This paper discusses an implementation of adaptive Kalman Filter by utilizing Fuzzy logic system with the aim to improve the accuracy of position and velocity prediction of the No_Collision system. The experiment results show a promising adaptive system that reduces the error percentage of the prediction up to 56.58%.

Braking distance prediction for vehicle consist in low-speed on-sight operation:a Monte Carlo approach

The first and last mile of a railway journey, in both freight and transit applications, constitutes a high effort and is either non-productive(e.g. in the case of depot operations) or highly inefficient(e.g. in industrial railways). These parts are typically managed on-sight, i.e. with no signalling and train protection systems ensuring the freedom of movement. This is possible due to the rather short braking distances of individual vehicles and shunting consists. The present article analyses the braking behaviour of such shunting units. For this purpose, a dedicated model is developed. It is calibrated on published results of brake tests and validated against a high-definition model for lowspeed applications. Based on this model, multiple simulations are executed to obtain a Monte Carlo simulation of the resulting braking distances. Based on the distribution properties and established safety levels, the risk of exceeding certain braking distances is evaluated and maximum braking distances are derived. Together with certain parameters of the system, these can serve in the design and safety assessment of driver assistance systems and automation of these processes.

Intelligent speed adaptation for visibility technology affects drivers’speed selection along curves with sight limitations

Sight obstructions along road curves can lead to a crash if the driver is not able to stop the vehicle in time.This is a particular issue along curves with limited available sight,where speed management is necessary to avoid unsafe situations(e.g.,driving off the road or invading the other traffic lane).To solve this issue,we proposed a novel intelligent speed adaptation(ISA)system for visibility,called V-ISA(intelligent speed adaptation for visibility).It estimates the real-time safe speed limits based on the prevailing sight conditions.V-ISA comes with three variants with specific feedback modalities(1)visual and(2)auditory information,and(3)direct intervention to assume control over the vehicle speed.Here,we investigated the efficiency of each of the three V-ISA variants on driving speed choice and lateral behavioural response along road curves with limited and unsafe available sight distances,using a driving simulator.We also considered curve road geometry(curve direction:rightward vs.leftward).Sixty active drivers were recruited for the study.While half of them(experimental group)tested the three V-ISA variants(and a V-ISA off condition),the other half always drove with the V-ISA off(validation group).We used a linear mixed-effect model to evaluate the influence of V-ISA on driver behaviour.All V-ISA variants were efficient at reducing speeds at entrance points,with no discernible negative impact on driver lateral behaviour.On rightward curves,the V-ISA intervening variant appeared to be the most effective at adapting to sight limitations.Results of the current study implies that V-ISA might assist drivers to adjust their operating speed as per prevailing sight conditions and,consequently,establishes safer driving conditions.

Advances in Vision-Based Lane Detection：Algorithms,Integration,Assessment,and Perspectives on ACP-Based Parallel Vision

Lane detection is a fundamental aspect of most current advanced driver assistance systems(ADASs). A large number of existing results focus on the study of vision-based lane detection methods due to the extensive knowledge background and the low-cost of camera devices. In this paper, previous visionbased lane detection studies are reviewed in terms of three aspects, which are lane detection algorithms, integration, and evaluation methods. Next, considering the inevitable limitations that exist in the camera-based lane detection system, the system integration methodologies for constructing more robust detection systems are reviewed and analyzed. The integration methods are further divided into three levels, namely, algorithm, system,and sensor. Algorithm level combines different lane detection algorithms while system level integrates other object detection systems to comprehensively detect lane positions. Sensor level uses multi-modal sensors to build a robust lane recognition system. In view of the complexity of evaluating the detection system, and the lack of common evaluation procedure and uniform metrics in past studies, the existing evaluation methods and metrics are analyzed and classified to propose a better evaluation of the lane detection system. Next, a comparison of representative studies is performed. Finally, a discussion on the limitations of current lane detection systems and the future developing trends toward an Artificial Society, Computational experiment-based parallel lane detection framework is proposed.

Methodical Approach to the Development of a Radar Sensor Model for the Detection of Urban Traffic Participants Using a Virtual Reality Engine

New approaches for testing of autonomous driving functions are using Virtual Reality (VR) to analyze the behavior of automated vehicles in various scenarios. The real time simulation of the environment sensors is still a challenge. In this paper, the conception, development and validation of an automotive radar raw data sensor model is shown. For the implementation, the Unreal VR engine developed by Epic Games is used. The model consists of a sending antenna, a propagation and a receiving antenna model. The microwave field propagation is simulated by a raytracing approach. It uses the method of shooting and bouncing rays to cover the field. A diffused scattering model is implemented to simulate the influence of rough structures on the reflection of rays. To parameterize the model, simple reflectors are used. The validation is done by a comparison of the measured radar patterns of pedestrians and cyclists with simulated values. The outcome is that the developed model shows valid results, even if it still has deficits in the context of performance. It shows that the bouncing of diffuse scattered field can only be done once. This produces inadequacies in some scenarios. In summary, the paper shows a high potential for real time simulation of radar sensors by using ray tracing in a virtual reality.

Real Time Speed Bump Detection Using Gaussian Filtering and Connected Component Approach

An Intelligent Transportation System (ITS) is a new system developed for the betterment of user in traffic and transport management domain area for smart and safe driving. ITS subsystems are Emergency vehicle notification systems, Automatic road enforcement, Collision avoidance systems, Automatic parking, Map database management, etc. Advance Driver Assists System (ADAS) belongs to ITS which provides alert or warning or information to the user during driving. The proposed method uses Gaussian filtering and Median filtering to remove noise in the image. Subsequently image subtraction is achieved by subtracting Median filtered image from Gaussian filtered image. The resultant image is converted to binary image and the regions are analyzed using connected component approach. The prior work on speed bump detection is achieved using sensors which are failed to detect speed bumps that are constructed with small height and the detection rate is affected due to erroneous identification. And the smartphone and accelerometer methodologies are not perfectly suitable for real time scenario due to GPS error, network overload, real-time delay, accuracy and battery running out. The proposed system goes very well for the roads which are constructed with proper painting irrespective of their dimension.

Methodical Approach to Integrate Human Movement Diversity in Real-Time into a Virtual Test Field for Highly Automated Vehicle Systems

Recently, virtual realities and simulations play important roles in the development of automated driving functionalities. By an appropriate abstraction, they help to design, investigate and communicate real traffic scenario complexity. Especially, for edge cases investigations of interactions between vulnerable road users (VRU) and highly automated driving functions, valid virtual models are essential for the quality of results. The aim of this study is to measure, process and integrate real human movement behaviour into a virtual test environment for highly automated vehicle functionalities. The overall system consists of a georeferenced virtual city model and a vehicle dynamics model, including probabilistic sensor descriptions. By motion capture hardware, real humanoid behaviour is applied to a virtual human avatar in the test environment. Through retargeting methods, which enable the independency of avatar and person under test (PuT) dimensions, the virtual avatar diversity is increased. To verify the biomechanical behaviour of the virtual avatars, a qualitative study is performed, which funds on a representative movement sequence. The results confirm the functionality of the used methodology and enable PuT independence control of the virtual avatars in real-time.

First Approach to a Framework for Regional Road-Traffic Accidents Reduction System

Several conditions as driver imprudence, road conditions and obstacles are the main factors that will cause road accidents. The most important automotive industries are incorporating technology to reduce risk in vehicles. Their products are expensive and lack flexibility to incorporate new features. This work presented a first approach to increase vehicle safety based on regional features. A framework was implemented, incorporating lane analysis and obstacle detection through image processing. The framework was tested using image datasets and real captures with satisfactory results.

A New Speed Limit Recognition Methodology Based on Ensemble Learning:Hardware Validation

Advanced DriverAssistance Systems(ADAS)technologies can assist drivers or be part of automatic driving systems to support the driving process and improve the level of safety and comfort on the road.Traffic Sign Recognition System(TSRS)is one of themost important components ofADAS.Among the challengeswith TSRS is being able to recognize road signs with the highest accuracy and the shortest processing time.Accordingly,this paper introduces a new real time methodology recognizing Speed Limit Signs based on a trio of developed modules.Firstly,the Speed Limit Detection(SLD)module uses the Haar Cascade technique to generate a new SL detector in order to localize SL signs within captured frames.Secondly,the Speed Limit Classification(SLC)module,featuring machine learning classifiers alongside a newly developed model called DeepSL,harnesses the power of a CNN architecture to extract intricate features from speed limit sign images,ensuring efficient and precise recognition.In addition,a new Speed Limit Classifiers Fusion(SLCF)module has been developed by combining trained ML classifiers and the DeepSL model by using the Dempster-Shafer theory of belief functions and ensemble learning’s voting technique.Through rigorous software and hardware validation processes,the proposedmethodology has achieved highly significant F1 scores of 99.98%and 99.96%for DS theory and the votingmethod,respectively.Furthermore,a prototype encompassing all components demonstrates outstanding reliability and efficacy,with processing times of 150 ms for the Raspberry Pi board and 81.5 ms for the Nano Jetson board,marking a significant advancement in TSRS technology.

A surface electromyography controlled steering assistance interface

Purpose–Two-handed automobile steering at low vehicle speeds may lead to reduced steering ability at large steering wheel angles and shoulder injury at high steering wheel rates(SWRs).As afirst step toward solving these problems,this study aims,firstly,to design a surface electromyography(sEMG)controlled steering assistance interface that enables hands-free steering wheel rotation and,secondly,to validate the effect of this rotation on path-following accuracy.Design/methodology/approach–A total of 24 drivers used biceps brachii sEMG signals to control the steering assistance interface at a maximized SWR in three driving simulator scenarios:U-turn,908 turn and 458 turn.For comparison,the scenarios were repeated with a slower SWR and a game steering wheel in place of the steering assistance interface.The path-following accuracy of the steering assistance interface would be validated if it was at least comparable to that of the game steering wheel.Findings–Overall,the steering assistance interface with a maximized SWR was comparable to a game steering wheel.For the U-turn,908 turn and 458 turn,the sEMG-based human–machine interface(HMI)had median lateral errors of 0.55,0.3 and 0.2 m,respectively,whereas the game steering wheel,respectively,had median lateral errors of 0.7,0.4 and 0.3 m.The higher accuracy of the sEMG-based HMI was statistically significant in the case of the U-turn.Originality/value–Although production automobiles do not use sEMG-based HMIs,and few studies have proposed sEMG controlled steering,the results of the current study warrant further development of a sEMG-based HMI for an actual automobile.

Behavioral adaptation of drivers when driving among automated vehicles

Purpose–This paper aims to explore whether drivers would adapt their behavior when they drive among automated vehicles(AVs)compared to driving among manually driven vehicles(MVs).Understanding behavioral adaptation of drivers when they encounter AVs is crucial for assessing impacts of AVs in mixed-traffic situations.Here,mixed-traffic situations refer to situations where AVs share the roads with existing nonautomated vehicles such as conventional MVs.Design/methodology/approach–A driving simulator study is designed to explore whether such behavioral adaptations exist.Two different driving scenarios were explored on a three-lane highway:driving on the main highway and merging from an on-ramp.For this study,18 research participants were recruited.Findings–Behavioral adaptation can be observed in terms of car-following speed,car-following time gap,number of lane change and overall driving speed.The adaptations are dependent on the driving scenario and whether the surrounding traffic was AVs or MVs.Although significant differences in behavior were found in more than 90%of the research participants,they adapted their behavior differently,and thus,magnitude of the behavioral adaptation remains unclear.Originality/value–The observed behavioral adaptations in this paper were dependent on the driving scenario rather than the time gap between surrounding vehicles.This finding differs from previous studies,which have shown that drivers tend to adapt their behaviors with respect to the surrounding vehicles.Furthermore,the surrounding vehicles in this study are more“free flow’”compared to previous studies with a fixed formation such as platoons.Nevertheless,long-term observations are required to further support this claim.

Influence of automated driving on driver’s own localization:a driving simulator study

Purpose–Level 3 automated driving,which has been defined by the Society of Automotive Engineers,may cause driver drowsiness or lack of situation awareness,which can make it difficult for the driver to recognize where he/she is.Therefore,the purpose of this study was to conduct an experimental study with a driving simulator to investigate whether automated driving affects the driver’s own localization compared to manual driving.Design/methodology/approach–Seventeen drivers were divided into the automated operation group and manual operation group.Drivers in each group were instructed to travel along the expressway and proceed to the specified destinations.The automated operation group was forced to select a course after receiving a Request to Intervene(RtI)from an automated driving system.Findings–A driver who used the automated operation system tended to not take over the driving operation correctly when a lane change is immediately required after the RtI.Originality/value–This is a fundamental research that examined how the automated driving operation affects the driver's own localization.The experimental results suggest that it is not enough to simply issue an RtI,and it is necessary to tell the driver what kind of circumstances he/she is in and what they should do next through the HMI.This conclusion can be taken into consideration for engineers who design automatic driving vehicles.

Analysis of drivers’characteristic driving operations based on combined features

Purpose–Analysis of characteristic driving operations can help develop supports for drivers with different driving skills.However,the existing knowledge on analysis of driving skills only focuses on single driving operation and cannot reflect the differences on proficiency of coordination of driving operations.Thus,the purpose of this paper is to analyze driving skills from driving coordinating operations.There are two main contributions:the first involves a method for feature extraction based on AdaBoost,which selects features critical for coordinating operations of experienced drivers and inexperienced drivers,and the second involves a generating method for candidate features,called the combined features method,through which two or more different driving operations at the same location are combined into a candidate combined feature.A series of experiments based on driving simulator and specific course with several different curves were carried out,and the result indicated the feasibility of analyzing driving behavior through AdaBoost and the combined features method.Design/methodology/approach–AdaBoost was used to extract features and the combined features method was used to combine two or more different driving operations at the same location.Findings–A series of experiments based on driving simulator and specific course with several different curves were carried out,and the result indicated the feasibility of analyzing driving behavior through AdaBoost and the combined features method.Originality/value–There are two main contributions:the first involves a method for feature extraction based on AdaBoost,which selects features critical for coordinating operations of experienced drivers and inexperienced drivers,and the second involves a generating method for candidate features,called the combined features method,through which two or more different driving operations at the same location are combined into a candidate combined feature.

Evaluation of the Effectiveness of Awareness Messages for Road Traffic Hazards in Experimental Tests

Advanced driver assistance systems, especially autonomous emergency braking and forward collision warnings, have becomepopular in Japan. To reduce the number of road traffic accidents, safety information should be provided to a driver earlier thanavoidance or warning messages so as to avoid a risky situation. A series of actual running tests was conducted to evaluate theactivation timing and effectiveness of awareness messages. Objective analysis showed that the drivers could avoid an obstaclewith a sufficient safety margin thanks to any of the awareness messages. Subjective ratings showed that the best timing is 10 sbefore encountering the obstacle. The results of objective analysis are limited in the present paper, and further analyses arerequired.