This paper presents the implementation of an embedded automotive system that detects and recognizes traffic signs within a video stream. In addition, it discusses the recent advances in driver assistance technologies ...This paper presents the implementation of an embedded automotive system that detects and recognizes traffic signs within a video stream. In addition, it discusses the recent advances in driver assistance technologies and highlights the safety motivations for smart in-car embedded systems. An algorithm is presented that processes RGB image data, extracts relevant pixels, filters the image, labels prospective traffic signs and evaluates them against template traffic sign images. A reconfigurable hardware system is described which uses the Virtex-5 Xilinx FPGA and hardware/software co-design tools in order to create an embedded processor and the necessary hardware IP peripherals. The implementation is shown to have robust performance results, both in terms of timing and accuracy.展开更多
现有高级辅助驾驶系统(Advanced Driver Assistance Systems,ADAS)功能不断增多且系统复杂性不断提高,不可避免带来了预期功能安全(Safety of the Intended Functionality,SOTIF)问题。触发条件的识别与生成是预期功能安全活动中重要的...现有高级辅助驾驶系统(Advanced Driver Assistance Systems,ADAS)功能不断增多且系统复杂性不断提高,不可避免带来了预期功能安全(Safety of the Intended Functionality,SOTIF)问题。触发条件的识别与生成是预期功能安全活动中重要的一环,然而现有对触发条件识别仅借助系统过程理论分析方法(System Theoretic Process Analysis,STPA)进行分析,未充分考虑系统功能状态转换中存在的问题。本文以知识驱动的方式构建触发条件识别机制,将STPA及有限状态机(Finite State Machine,FSM)理论融合构建拓展型系统控制结构,针对拓展型控制架构及功能状态转换进行安全分析,根据系统存在的功能局限及人为误用,完成触发条件的识别、生成、规范化描述、分类及标签化。最后将本文提出的触发条件生成机制应用于集成式巡航辅助系统(Integrated Cruise Assistance,ICA),得到了该系统的触发条件及其分类,并将本文所提出的生成机制与现有相关触发条件生成方法进行对比分析,证明了本机制的实用性、可行性及有效性。展开更多
Driver errors contribute to more than 94% of traffic crashes. Automotive companies are striving to enhance their vehicles to eliminate driver errors and reduce the number of crashes. Various advanced features like lan...Driver errors contribute to more than 94% of traffic crashes. Automotive companies are striving to enhance their vehicles to eliminate driver errors and reduce the number of crashes. Various advanced features like lane departure warning (LDW), blind spot warning (BSW), over speed warning (OSW), forward collision warning (FCW), lane keep assist (LKA), adaptive cruise control (ACC), cooperative ACC (CACC), and automated emergency braking (AEB) are designed to assist with, or in some cases take over, certain driving maneuvers. They can be broadly categorized into advanced driver assistance system (ADAS) and automated features. Each of these advanced features focuses on addressing a particular task of driving, thereby, aiding the driver, influencing their behavior, and enhancing safety. Many vehicles with these advanced features are penetrating into the market, yet the total reported number of crashes has increased in recent years. This paper presents a systematic review of these advanced features on driver behavior and safety. The review is categorized into 1) survey and mathematical methods to assess driver behavior, 2) field test methods to assess driver behavior, 3) microsimulation methods to assess driver behavior, 4) driving simulator methods to assess driver behavior, and 5) driver understanding and the effectiveness of advanced features. It is followed by conclusions, knowledge gaps, and need for further research.展开更多
To use the benefits of Advanced Driver Assistance Systems(ADAS)-Tests in simulation and reality a new approach for using Augmented Reality(AR)in an automotive vehicle for testing ADAS is presented in this paper.Our pr...To use the benefits of Advanced Driver Assistance Systems(ADAS)-Tests in simulation and reality a new approach for using Augmented Reality(AR)in an automotive vehicle for testing ADAS is presented in this paper.Our procedure provides a link between simulation and reality and should enable a faster development process for future increasingly complex ADAS tests and future mobility solutions.Test fields for ADAS offer a small number of orientation points.Furthermore,these must be detected and processed at high vehicle speeds.That requires high computational power both for developing our method and its subsequent use in testing.Using image segmentation(IS),artificial intelligence(AI)for object recognition,and visual simultaneous localization and mapping(vSLAM),we aim to create a three-dimensional model with accurate information about the test site.It is expected that using AI and IS will significantly improve performance as computational speed and accuracy for AR applications in automobiles.展开更多
Purpose–This study aims to propose a novel subjective assessment(SA)method for level 2 or level 21 advanced driver assistance system(ADAS)with a customized case study in China.Design/methodology/approach–The propose...Purpose–This study aims to propose a novel subjective assessment(SA)method for level 2 or level 21 advanced driver assistance system(ADAS)with a customized case study in China.Design/methodology/approach–The proposed SA method contains six dimensions,including perception,driveability and stability,riding comfort,human–machine interaction,driver workload and trustworthiness and exceptional operating case,respectively.And each dimension subordinates several subsections,which describe the corresponding details under this dimension.Findings–Based on the proposed SA,a case study in China is conducted.Six drivers with different driving experiences are invited to give their subjective ratings for each subsection according to a predefined rating standard.The rating results show that the ADAS from Tesla outperforms the upcoming electric vehicle in most cases.Originality/value–The proposed SA method is beneficial for the original equipment manufacturers developing related technologies in the future.展开更多
With the support by the National Natural Science Foundation of China,Prof.Hua Chunsheng and his research mates(Prof.Han Jianda and Associate Prof.Song Dalei)in the State Key Lab of Robotics,Shenyang Institute of Autom...With the support by the National Natural Science Foundation of China,Prof.Hua Chunsheng and his research mates(Prof.Han Jianda and Associate Prof.Song Dalei)in the State Key Lab of Robotics,Shenyang Institute of Automation,Chinese Academy of Sciences,have reported a long-range pedestrian detection method with monocular camera for the advanced driver assistance system(ADAS),which was pub-展开更多
Advanced DriverAssistance Systems(ADAS)technologies can assist drivers or be part of automatic driving systems to support the driving process and improve the level of safety and comfort on the road.Traffic Sign Recogn...Advanced DriverAssistance Systems(ADAS)technologies can assist drivers or be part of automatic driving systems to support the driving process and improve the level of safety and comfort on the road.Traffic Sign Recognition System(TSRS)is one of themost important components ofADAS.Among the challengeswith TSRS is being able to recognize road signs with the highest accuracy and the shortest processing time.Accordingly,this paper introduces a new real time methodology recognizing Speed Limit Signs based on a trio of developed modules.Firstly,the Speed Limit Detection(SLD)module uses the Haar Cascade technique to generate a new SL detector in order to localize SL signs within captured frames.Secondly,the Speed Limit Classification(SLC)module,featuring machine learning classifiers alongside a newly developed model called DeepSL,harnesses the power of a CNN architecture to extract intricate features from speed limit sign images,ensuring efficient and precise recognition.In addition,a new Speed Limit Classifiers Fusion(SLCF)module has been developed by combining trained ML classifiers and the DeepSL model by using the Dempster-Shafer theory of belief functions and ensemble learning’s voting technique.Through rigorous software and hardware validation processes,the proposedmethodology has achieved highly significant F1 scores of 99.98%and 99.96%for DS theory and the votingmethod,respectively.Furthermore,a prototype encompassing all components demonstrates outstanding reliability and efficacy,with processing times of 150 ms for the Raspberry Pi board and 81.5 ms for the Nano Jetson board,marking a significant advancement in TSRS technology.展开更多
Sight obstructions along road curves can lead to a crash if the driver is not able to stop the vehicle in time.This is a particular issue along curves with limited available sight,where speed management is necessary t...Sight obstructions along road curves can lead to a crash if the driver is not able to stop the vehicle in time.This is a particular issue along curves with limited available sight,where speed management is necessary to avoid unsafe situations(e.g.,driving off the road or invading the other traffic lane).To solve this issue,we proposed a novel intelligent speed adaptation(ISA)system for visibility,called V-ISA(intelligent speed adaptation for visibility).It estimates the real-time safe speed limits based on the prevailing sight conditions.V-ISA comes with three variants with specific feedback modalities(1)visual and(2)auditory information,and(3)direct intervention to assume control over the vehicle speed.Here,we investigated the efficiency of each of the three V-ISA variants on driving speed choice and lateral behavioural response along road curves with limited and unsafe available sight distances,using a driving simulator.We also considered curve road geometry(curve direction:rightward vs.leftward).Sixty active drivers were recruited for the study.While half of them(experimental group)tested the three V-ISA variants(and a V-ISA off condition),the other half always drove with the V-ISA off(validation group).We used a linear mixed-effect model to evaluate the influence of V-ISA on driver behaviour.All V-ISA variants were efficient at reducing speeds at entrance points,with no discernible negative impact on driver lateral behaviour.On rightward curves,the V-ISA intervening variant appeared to be the most effective at adapting to sight limitations.Results of the current study implies that V-ISA might assist drivers to adjust their operating speed as per prevailing sight conditions and,consequently,establishes safer driving conditions.展开更多
文摘This paper presents the implementation of an embedded automotive system that detects and recognizes traffic signs within a video stream. In addition, it discusses the recent advances in driver assistance technologies and highlights the safety motivations for smart in-car embedded systems. An algorithm is presented that processes RGB image data, extracts relevant pixels, filters the image, labels prospective traffic signs and evaluates them against template traffic sign images. A reconfigurable hardware system is described which uses the Virtex-5 Xilinx FPGA and hardware/software co-design tools in order to create an embedded processor and the necessary hardware IP peripherals. The implementation is shown to have robust performance results, both in terms of timing and accuracy.
文摘现有高级辅助驾驶系统(Advanced Driver Assistance Systems,ADAS)功能不断增多且系统复杂性不断提高,不可避免带来了预期功能安全(Safety of the Intended Functionality,SOTIF)问题。触发条件的识别与生成是预期功能安全活动中重要的一环,然而现有对触发条件识别仅借助系统过程理论分析方法(System Theoretic Process Analysis,STPA)进行分析,未充分考虑系统功能状态转换中存在的问题。本文以知识驱动的方式构建触发条件识别机制,将STPA及有限状态机(Finite State Machine,FSM)理论融合构建拓展型系统控制结构,针对拓展型控制架构及功能状态转换进行安全分析,根据系统存在的功能局限及人为误用,完成触发条件的识别、生成、规范化描述、分类及标签化。最后将本文提出的触发条件生成机制应用于集成式巡航辅助系统(Integrated Cruise Assistance,ICA),得到了该系统的触发条件及其分类,并将本文所提出的生成机制与现有相关触发条件生成方法进行对比分析,证明了本机制的实用性、可行性及有效性。
文摘Driver errors contribute to more than 94% of traffic crashes. Automotive companies are striving to enhance their vehicles to eliminate driver errors and reduce the number of crashes. Various advanced features like lane departure warning (LDW), blind spot warning (BSW), over speed warning (OSW), forward collision warning (FCW), lane keep assist (LKA), adaptive cruise control (ACC), cooperative ACC (CACC), and automated emergency braking (AEB) are designed to assist with, or in some cases take over, certain driving maneuvers. They can be broadly categorized into advanced driver assistance system (ADAS) and automated features. Each of these advanced features focuses on addressing a particular task of driving, thereby, aiding the driver, influencing their behavior, and enhancing safety. Many vehicles with these advanced features are penetrating into the market, yet the total reported number of crashes has increased in recent years. This paper presents a systematic review of these advanced features on driver behavior and safety. The review is categorized into 1) survey and mathematical methods to assess driver behavior, 2) field test methods to assess driver behavior, 3) microsimulation methods to assess driver behavior, 4) driving simulator methods to assess driver behavior, and 5) driver understanding and the effectiveness of advanced features. It is followed by conclusions, knowledge gaps, and need for further research.
文摘To use the benefits of Advanced Driver Assistance Systems(ADAS)-Tests in simulation and reality a new approach for using Augmented Reality(AR)in an automotive vehicle for testing ADAS is presented in this paper.Our procedure provides a link between simulation and reality and should enable a faster development process for future increasingly complex ADAS tests and future mobility solutions.Test fields for ADAS offer a small number of orientation points.Furthermore,these must be detected and processed at high vehicle speeds.That requires high computational power both for developing our method and its subsequent use in testing.Using image segmentation(IS),artificial intelligence(AI)for object recognition,and visual simultaneous localization and mapping(vSLAM),we aim to create a three-dimensional model with accurate information about the test site.It is expected that using AI and IS will significantly improve performance as computational speed and accuracy for AR applications in automobiles.
文摘Purpose–This study aims to propose a novel subjective assessment(SA)method for level 2 or level 21 advanced driver assistance system(ADAS)with a customized case study in China.Design/methodology/approach–The proposed SA method contains six dimensions,including perception,driveability and stability,riding comfort,human–machine interaction,driver workload and trustworthiness and exceptional operating case,respectively.And each dimension subordinates several subsections,which describe the corresponding details under this dimension.Findings–Based on the proposed SA,a case study in China is conducted.Six drivers with different driving experiences are invited to give their subjective ratings for each subsection according to a predefined rating standard.The rating results show that the ADAS from Tesla outperforms the upcoming electric vehicle in most cases.Originality/value–The proposed SA method is beneficial for the original equipment manufacturers developing related technologies in the future.
文摘With the support by the National Natural Science Foundation of China,Prof.Hua Chunsheng and his research mates(Prof.Han Jianda and Associate Prof.Song Dalei)in the State Key Lab of Robotics,Shenyang Institute of Automation,Chinese Academy of Sciences,have reported a long-range pedestrian detection method with monocular camera for the advanced driver assistance system(ADAS),which was pub-
文摘Advanced DriverAssistance Systems(ADAS)technologies can assist drivers or be part of automatic driving systems to support the driving process and improve the level of safety and comfort on the road.Traffic Sign Recognition System(TSRS)is one of themost important components ofADAS.Among the challengeswith TSRS is being able to recognize road signs with the highest accuracy and the shortest processing time.Accordingly,this paper introduces a new real time methodology recognizing Speed Limit Signs based on a trio of developed modules.Firstly,the Speed Limit Detection(SLD)module uses the Haar Cascade technique to generate a new SL detector in order to localize SL signs within captured frames.Secondly,the Speed Limit Classification(SLC)module,featuring machine learning classifiers alongside a newly developed model called DeepSL,harnesses the power of a CNN architecture to extract intricate features from speed limit sign images,ensuring efficient and precise recognition.In addition,a new Speed Limit Classifiers Fusion(SLCF)module has been developed by combining trained ML classifiers and the DeepSL model by using the Dempster-Shafer theory of belief functions and ensemble learning’s voting technique.Through rigorous software and hardware validation processes,the proposedmethodology has achieved highly significant F1 scores of 99.98%and 99.96%for DS theory and the votingmethod,respectively.Furthermore,a prototype encompassing all components demonstrates outstanding reliability and efficacy,with processing times of 150 ms for the Raspberry Pi board and 81.5 ms for the Nano Jetson board,marking a significant advancement in TSRS technology.
文摘Sight obstructions along road curves can lead to a crash if the driver is not able to stop the vehicle in time.This is a particular issue along curves with limited available sight,where speed management is necessary to avoid unsafe situations(e.g.,driving off the road or invading the other traffic lane).To solve this issue,we proposed a novel intelligent speed adaptation(ISA)system for visibility,called V-ISA(intelligent speed adaptation for visibility).It estimates the real-time safe speed limits based on the prevailing sight conditions.V-ISA comes with three variants with specific feedback modalities(1)visual and(2)auditory information,and(3)direct intervention to assume control over the vehicle speed.Here,we investigated the efficiency of each of the three V-ISA variants on driving speed choice and lateral behavioural response along road curves with limited and unsafe available sight distances,using a driving simulator.We also considered curve road geometry(curve direction:rightward vs.leftward).Sixty active drivers were recruited for the study.While half of them(experimental group)tested the three V-ISA variants(and a V-ISA off condition),the other half always drove with the V-ISA off(validation group).We used a linear mixed-effect model to evaluate the influence of V-ISA on driver behaviour.All V-ISA variants were efficient at reducing speeds at entrance points,with no discernible negative impact on driver lateral behaviour.On rightward curves,the V-ISA intervening variant appeared to be the most effective at adapting to sight limitations.Results of the current study implies that V-ISA might assist drivers to adjust their operating speed as per prevailing sight conditions and,consequently,establishes safer driving conditions.
