This paper presents the implementation of an embedded automotive system that detects and recognizes traffic signs within a video stream. In addition, it discusses the recent advances in driver assistance technologies ...This paper presents the implementation of an embedded automotive system that detects and recognizes traffic signs within a video stream. In addition, it discusses the recent advances in driver assistance technologies and highlights the safety motivations for smart in-car embedded systems. An algorithm is presented that processes RGB image data, extracts relevant pixels, filters the image, labels prospective traffic signs and evaluates them against template traffic sign images. A reconfigurable hardware system is described which uses the Virtex-5 Xilinx FPGA and hardware/software co-design tools in order to create an embedded processor and the necessary hardware IP peripherals. The implementation is shown to have robust performance results, both in terms of timing and accuracy.展开更多
现有高级辅助驾驶系统(Advanced Driver Assistance Systems,ADAS)功能不断增多且系统复杂性不断提高,不可避免带来了预期功能安全(Safety of the Intended Functionality,SOTIF)问题。触发条件的识别与生成是预期功能安全活动中重要的...现有高级辅助驾驶系统(Advanced Driver Assistance Systems,ADAS)功能不断增多且系统复杂性不断提高,不可避免带来了预期功能安全(Safety of the Intended Functionality,SOTIF)问题。触发条件的识别与生成是预期功能安全活动中重要的一环,然而现有对触发条件识别仅借助系统过程理论分析方法(System Theoretic Process Analysis,STPA)进行分析,未充分考虑系统功能状态转换中存在的问题。本文以知识驱动的方式构建触发条件识别机制,将STPA及有限状态机(Finite State Machine,FSM)理论融合构建拓展型系统控制结构,针对拓展型控制架构及功能状态转换进行安全分析,根据系统存在的功能局限及人为误用,完成触发条件的识别、生成、规范化描述、分类及标签化。最后将本文提出的触发条件生成机制应用于集成式巡航辅助系统(Integrated Cruise Assistance,ICA),得到了该系统的触发条件及其分类,并将本文所提出的生成机制与现有相关触发条件生成方法进行对比分析,证明了本机制的实用性、可行性及有效性。展开更多
Driver errors contribute to more than 94% of traffic crashes. Automotive companies are striving to enhance their vehicles to eliminate driver errors and reduce the number of crashes. Various advanced features like lan...Driver errors contribute to more than 94% of traffic crashes. Automotive companies are striving to enhance their vehicles to eliminate driver errors and reduce the number of crashes. Various advanced features like lane departure warning (LDW), blind spot warning (BSW), over speed warning (OSW), forward collision warning (FCW), lane keep assist (LKA), adaptive cruise control (ACC), cooperative ACC (CACC), and automated emergency braking (AEB) are designed to assist with, or in some cases take over, certain driving maneuvers. They can be broadly categorized into advanced driver assistance system (ADAS) and automated features. Each of these advanced features focuses on addressing a particular task of driving, thereby, aiding the driver, influencing their behavior, and enhancing safety. Many vehicles with these advanced features are penetrating into the market, yet the total reported number of crashes has increased in recent years. This paper presents a systematic review of these advanced features on driver behavior and safety. The review is categorized into 1) survey and mathematical methods to assess driver behavior, 2) field test methods to assess driver behavior, 3) microsimulation methods to assess driver behavior, 4) driving simulator methods to assess driver behavior, and 5) driver understanding and the effectiveness of advanced features. It is followed by conclusions, knowledge gaps, and need for further research.展开更多
To use the benefits of Advanced Driver Assistance Systems(ADAS)-Tests in simulation and reality a new approach for using Augmented Reality(AR)in an automotive vehicle for testing ADAS is presented in this paper.Our pr...To use the benefits of Advanced Driver Assistance Systems(ADAS)-Tests in simulation and reality a new approach for using Augmented Reality(AR)in an automotive vehicle for testing ADAS is presented in this paper.Our procedure provides a link between simulation and reality and should enable a faster development process for future increasingly complex ADAS tests and future mobility solutions.Test fields for ADAS offer a small number of orientation points.Furthermore,these must be detected and processed at high vehicle speeds.That requires high computational power both for developing our method and its subsequent use in testing.Using image segmentation(IS),artificial intelligence(AI)for object recognition,and visual simultaneous localization and mapping(vSLAM),we aim to create a three-dimensional model with accurate information about the test site.It is expected that using AI and IS will significantly improve performance as computational speed and accuracy for AR applications in automobiles.展开更多
Advanced DriverAssistance Systems(ADAS)technologies can assist drivers or be part of automatic driving systems to support the driving process and improve the level of safety and comfort on the road.Traffic Sign Recogn...Advanced DriverAssistance Systems(ADAS)technologies can assist drivers or be part of automatic driving systems to support the driving process and improve the level of safety and comfort on the road.Traffic Sign Recognition System(TSRS)is one of themost important components ofADAS.Among the challengeswith TSRS is being able to recognize road signs with the highest accuracy and the shortest processing time.Accordingly,this paper introduces a new real time methodology recognizing Speed Limit Signs based on a trio of developed modules.Firstly,the Speed Limit Detection(SLD)module uses the Haar Cascade technique to generate a new SL detector in order to localize SL signs within captured frames.Secondly,the Speed Limit Classification(SLC)module,featuring machine learning classifiers alongside a newly developed model called DeepSL,harnesses the power of a CNN architecture to extract intricate features from speed limit sign images,ensuring efficient and precise recognition.In addition,a new Speed Limit Classifiers Fusion(SLCF)module has been developed by combining trained ML classifiers and the DeepSL model by using the Dempster-Shafer theory of belief functions and ensemble learning’s voting technique.Through rigorous software and hardware validation processes,the proposedmethodology has achieved highly significant F1 scores of 99.98%and 99.96%for DS theory and the votingmethod,respectively.Furthermore,a prototype encompassing all components demonstrates outstanding reliability and efficacy,with processing times of 150 ms for the Raspberry Pi board and 81.5 ms for the Nano Jetson board,marking a significant advancement in TSRS technology.展开更多
The driver’s cognitive and physiological states affect his/her ability to control the vehicle.Thus,these driver states are essential to the safety of automobiles.The design of advanced driver assistance systems(ADAS)...The driver’s cognitive and physiological states affect his/her ability to control the vehicle.Thus,these driver states are essential to the safety of automobiles.The design of advanced driver assistance systems(ADAS)or autonomous vehicles will depend on their ability to interact effectively with the driver.A deeper understanding of the driver state is,therefore,paramount.Electroencephalography(EEG)is proven to be one of the most effective methods for driver state monitoring and human error detection.This paper discusses EEG-based driver state detection systems and their corresponding analysis algorithms over the last three decades.First,the commonly used EEG system setup for driver state studies is introduced.Then,the EEG signal preprocessing,feature extraction,and classification algorithms for driver state detection are reviewed.Finally,EEG-based driver state monitoring research is reviewed in-depth,and its future development is discussed.It is concluded that the current EEGbased driver state monitoring algorithms are promising for safety applications.However,many improvements are still required in EEG artifact reduction,real-time processing,and between-subject classification accuracy.展开更多
文摘This paper presents the implementation of an embedded automotive system that detects and recognizes traffic signs within a video stream. In addition, it discusses the recent advances in driver assistance technologies and highlights the safety motivations for smart in-car embedded systems. An algorithm is presented that processes RGB image data, extracts relevant pixels, filters the image, labels prospective traffic signs and evaluates them against template traffic sign images. A reconfigurable hardware system is described which uses the Virtex-5 Xilinx FPGA and hardware/software co-design tools in order to create an embedded processor and the necessary hardware IP peripherals. The implementation is shown to have robust performance results, both in terms of timing and accuracy.
文摘现有高级辅助驾驶系统(Advanced Driver Assistance Systems,ADAS)功能不断增多且系统复杂性不断提高,不可避免带来了预期功能安全(Safety of the Intended Functionality,SOTIF)问题。触发条件的识别与生成是预期功能安全活动中重要的一环,然而现有对触发条件识别仅借助系统过程理论分析方法(System Theoretic Process Analysis,STPA)进行分析,未充分考虑系统功能状态转换中存在的问题。本文以知识驱动的方式构建触发条件识别机制,将STPA及有限状态机(Finite State Machine,FSM)理论融合构建拓展型系统控制结构,针对拓展型控制架构及功能状态转换进行安全分析,根据系统存在的功能局限及人为误用,完成触发条件的识别、生成、规范化描述、分类及标签化。最后将本文提出的触发条件生成机制应用于集成式巡航辅助系统(Integrated Cruise Assistance,ICA),得到了该系统的触发条件及其分类,并将本文所提出的生成机制与现有相关触发条件生成方法进行对比分析,证明了本机制的实用性、可行性及有效性。
文摘Driver errors contribute to more than 94% of traffic crashes. Automotive companies are striving to enhance their vehicles to eliminate driver errors and reduce the number of crashes. Various advanced features like lane departure warning (LDW), blind spot warning (BSW), over speed warning (OSW), forward collision warning (FCW), lane keep assist (LKA), adaptive cruise control (ACC), cooperative ACC (CACC), and automated emergency braking (AEB) are designed to assist with, or in some cases take over, certain driving maneuvers. They can be broadly categorized into advanced driver assistance system (ADAS) and automated features. Each of these advanced features focuses on addressing a particular task of driving, thereby, aiding the driver, influencing their behavior, and enhancing safety. Many vehicles with these advanced features are penetrating into the market, yet the total reported number of crashes has increased in recent years. This paper presents a systematic review of these advanced features on driver behavior and safety. The review is categorized into 1) survey and mathematical methods to assess driver behavior, 2) field test methods to assess driver behavior, 3) microsimulation methods to assess driver behavior, 4) driving simulator methods to assess driver behavior, and 5) driver understanding and the effectiveness of advanced features. It is followed by conclusions, knowledge gaps, and need for further research.
文摘To use the benefits of Advanced Driver Assistance Systems(ADAS)-Tests in simulation and reality a new approach for using Augmented Reality(AR)in an automotive vehicle for testing ADAS is presented in this paper.Our procedure provides a link between simulation and reality and should enable a faster development process for future increasingly complex ADAS tests and future mobility solutions.Test fields for ADAS offer a small number of orientation points.Furthermore,these must be detected and processed at high vehicle speeds.That requires high computational power both for developing our method and its subsequent use in testing.Using image segmentation(IS),artificial intelligence(AI)for object recognition,and visual simultaneous localization and mapping(vSLAM),we aim to create a three-dimensional model with accurate information about the test site.It is expected that using AI and IS will significantly improve performance as computational speed and accuracy for AR applications in automobiles.
文摘Advanced DriverAssistance Systems(ADAS)technologies can assist drivers or be part of automatic driving systems to support the driving process and improve the level of safety and comfort on the road.Traffic Sign Recognition System(TSRS)is one of themost important components ofADAS.Among the challengeswith TSRS is being able to recognize road signs with the highest accuracy and the shortest processing time.Accordingly,this paper introduces a new real time methodology recognizing Speed Limit Signs based on a trio of developed modules.Firstly,the Speed Limit Detection(SLD)module uses the Haar Cascade technique to generate a new SL detector in order to localize SL signs within captured frames.Secondly,the Speed Limit Classification(SLC)module,featuring machine learning classifiers alongside a newly developed model called DeepSL,harnesses the power of a CNN architecture to extract intricate features from speed limit sign images,ensuring efficient and precise recognition.In addition,a new Speed Limit Classifiers Fusion(SLCF)module has been developed by combining trained ML classifiers and the DeepSL model by using the Dempster-Shafer theory of belief functions and ensemble learning’s voting technique.Through rigorous software and hardware validation processes,the proposedmethodology has achieved highly significant F1 scores of 99.98%and 99.96%for DS theory and the votingmethod,respectively.Furthermore,a prototype encompassing all components demonstrates outstanding reliability and efficacy,with processing times of 150 ms for the Raspberry Pi board and 81.5 ms for the Nano Jetson board,marking a significant advancement in TSRS technology.
文摘The driver’s cognitive and physiological states affect his/her ability to control the vehicle.Thus,these driver states are essential to the safety of automobiles.The design of advanced driver assistance systems(ADAS)or autonomous vehicles will depend on their ability to interact effectively with the driver.A deeper understanding of the driver state is,therefore,paramount.Electroencephalography(EEG)is proven to be one of the most effective methods for driver state monitoring and human error detection.This paper discusses EEG-based driver state detection systems and their corresponding analysis algorithms over the last three decades.First,the commonly used EEG system setup for driver state studies is introduced.Then,the EEG signal preprocessing,feature extraction,and classification algorithms for driver state detection are reviewed.Finally,EEG-based driver state monitoring research is reviewed in-depth,and its future development is discussed.It is concluded that the current EEGbased driver state monitoring algorithms are promising for safety applications.However,many improvements are still required in EEG artifact reduction,real-time processing,and between-subject classification accuracy.
