Operating System(OS)is a critical piece of software that manages a computer’s hardware and resources,acting as the intermediary between the computer and the user.The existing OS is not designed for Big Data and Cloud...Operating System(OS)is a critical piece of software that manages a computer’s hardware and resources,acting as the intermediary between the computer and the user.The existing OS is not designed for Big Data and Cloud Computing,resulting in data processing and management inefficiency.This paper proposes a simplified and improved kernel on an x86 system designed for Big Data and Cloud Computing purposes.The proposed algorithm utilizes the performance benefits from the improved Input/Output(I/O)performance.The performance engineering runs the data-oriented design on traditional data management to improve data processing speed by reducing memory access overheads in conventional data management.The OS incorporates a data-oriented design to“modernize”various Data Science and management aspects.The resulting OS contains a basic input/output system(BIOS)bootloader that boots into Intel 32-bit protected mode,a text display terminal,4 GB paging memory,4096 heap block size,a Hard Disk Drive(HDD)I/O Advanced Technology Attachment(ATA)driver and more.There are also I/O scheduling algorithm prototypes that demonstrate how a simple Sweeping algorithm is superior to more conventionally known I/O scheduling algorithms.A MapReduce prototype is implemented using Message Passing Interface(MPI)for big data purposes.An attempt was made to optimize binary search using modern performance engineering and data-oriented design.展开更多
The implementation of artificial intelligence(AI)in a smart society,in which the analysis of human habits is mandatory,requires automated data scheduling and analysis using smart applications,a smart infrastructure,sm...The implementation of artificial intelligence(AI)in a smart society,in which the analysis of human habits is mandatory,requires automated data scheduling and analysis using smart applications,a smart infrastructure,smart systems,and a smart network.In this context,which is characterized by a large gap between training and operative processes,a dedicated method is required to manage and extract the massive amount of data and the related information mining.The method presented in this work aims to reduce this gap with near-zero-failure advanced diagnostics(AD)for smart management,which is exploitable in any context of Society 5.0,thus reducing the risk factors at all management levels and ensuring quality and sustainability.We have also developed innovative applications for a humancentered management system to support scheduling in the maintenance of operative processes,for reducing training costs,for improving production yield,and for creating a human–machine cyberspace for smart infrastructure design.The results obtained in 12 international companies demonstrate a possible global standardization of operative processes,leading to the design of a near-zero-failure intelligent system that is able to learn and upgrade itself.Our new method provides guidance for selecting the new generation of intelligent manufacturing and smart systems in order to optimize human–machine interactions,with the related smart maintenance and education.展开更多
As a global financial center, the transportation system in New York City (NYC) has always been studied from various aspects. Since 2009, NYC Taxi and Limousine Commission have made public the information on NYC taxi o...As a global financial center, the transportation system in New York City (NYC) has always been studied from various aspects. Since 2009, NYC Taxi and Limousine Commission have made public the information on NYC taxi operations, offering an opportunity for detailed analysis. Thus, this research project investigates taxi operations in New York City based on big data analysis. The correlation between taxi operations and different types of weather, including precipitation, snow depth, and snowfall is discussed in this paper. The research also evaluates taxi trip distribution in each NTA area using Geopandas, and presents its density on an NYC map.展开更多
In the context of intelligent manufacturing,machine tools,as core equipment,directly influence production efficiency and product quality through their operational reliability.Traditional maintenance methods for machin...In the context of intelligent manufacturing,machine tools,as core equipment,directly influence production efficiency and product quality through their operational reliability.Traditional maintenance methods for machine tools,often characterized by low efficiency and high costs,fail to meet the demands of modern manufacturing industries.Therefore,leveraging intelligent manufacturing technologies,this paper proposes a solution optimized for the diagnosis and maintenance of machine tool faults.Initially,the paper introduces sensor-based data acquisition technologies combined with big data analytics and machine learning algorithms to achieve intelligent fault diagnosis of machine tools.Subsequently,it discusses predictive maintenance strategies by establishing an optimized model for maintenance strategy and resource allocation,thereby enhancing maintenance efficiency and reducing costs.Lastly,the paper explores the architectural design,integration,and testing evaluation methods of intelligent manufacturing systems.The study indicates that optimization of machine tool fault diagnosis and maintenance in an intelligent manufacturing environment not only enhances equipment reliability but also significantly reduces maintenance costs,offering broad application prospects.展开更多
In this paper, we conduct research on the database technology under the basic operation of the IOT huge amounts of data. Spatial data service is the process of basic customer application system service request, direct...In this paper, we conduct research on the database technology under the basic operation of the IOT huge amounts of data. Spatial data service is the process of basic customer application system service request, directory service system according to the request is mapped into physical addresses, according to the data block physical disk server address block of data read from the disk in parallel and sent to the client the process of application system. In addition, spatial data distribution system should possess unloading, transfer, replication, and optimization of spatial data, and other functions, to achieve comprehensive management and maintenance of spatial data. Under this basis, we propose the enhanced database technology that optimizes the operation with better performance.展开更多
The operation time of external trucks in a container terminal is one of port operation key performance indicators concerned by port operators,external truck operators and related government authorities.With the traffi...The operation time of external trucks in a container terminal is one of port operation key performance indicators concerned by port operators,external truck operators and related government authorities.With the traffic big data combined with the operation characteristics of the container terminal,the system dynamics method is used to build the simulation model of the operation system for external trucks.The simulation results of the operation time of external trucks are consistent with the actual situation,which provides an effective way to eliminate the“black box”of the operation time of the external trucks.The model can also be applied in multiple scenarios by using the traffic big data,and the simulation results can be adopted by the relevant organizations.展开更多
Big data has emerged as the next technological revolution in IT industry after cloud computing and the Internet of Things.With the development of climate observing systems,particularly satellite meteorological observa...Big data has emerged as the next technological revolution in IT industry after cloud computing and the Internet of Things.With the development of climate observing systems,particularly satellite meteorological observation and high-resolution climate models,and the rapid growth in the volume of climate data,climate prediction is now entering the era of big data.The application of big data will provide new ideas and methods for the continuous development of climate prediction.The rapid integration,cloud storage,cloud computing,and full-sample analysis of massive climate data makes it possible to understand climate states and their evolution more objectively,thus predicting the future climate more accurately.This paper describes the application status of big data in operational climate prediction in China;it analyzes the key big data technologies,discusses the future development of climate prediction operations from the perspective of big data,speculates on the prospects for applying climatic big data in cloud computing and data assimilation,and puts forward the notion of big data-based super-ensemble climate prediction methods and computerbased deep learning climate prediction methods.展开更多
In last few years,big data and deep learning technologies have been successfully applied in various fields of civil engineering with the great progress of machine learning techniques.However,until now,there has been n...In last few years,big data and deep learning technologies have been successfully applied in various fields of civil engineering with the great progress of machine learning techniques.However,until now,there has been no comprehensive review on its applications in civil engineering.To fill this gap,this paper reviews the application and development of artificial intelligence in civil engineering in recent years,including intelligent algorithms,big data and deep learning.Through the work of this paper,the research direction and difficulties of artificial intelligence in civil engineering for the past few years can be known.It is shown that the studies of artificial intelligence in civil engineering mainly focus on structural maintenance and management,and the design optimization.展开更多
With the emergence of digital transformation success stories,more and more enterprises are launching digital solutions to improve business efficiency or achieve optimal revenue growth.The traditional communication mar...With the emergence of digital transformation success stories,more and more enterprises are launching digital solutions to improve business efficiency or achieve optimal revenue growth.The traditional communication market tends to be saturated,and the digital transformation of telecom operators is imminent.This article combining the development trend of telecom operators’product business and the application situation of the pilot summarizes the innovative application categories that telecom operators continue to launch based on their own advantages and in response to the needs of the industry.This article focuses on the transformation of security capabilities in communication services,big data,Internet of Things,artificial intelligence,unified authentication and network information security,and deeply analyzes the business characteristics and application modes from the aspects of resource integration,open platform construction,new connection construction,and innovative business development.This article puts forward suggestions for the security development of telecom operators,and provides basic research content for the subsequent research on the innovative application of telecom operators’capability openness.展开更多
针对大数据传输中的数据机密性、完整性和数据丢失等问题,提出一种基于简化数据加密标准(Simplified Data Encryption Standard,SDES)和双轮差错控制的大数据集成安全系统。使用SDES加密算法生成加密字符串,并设计意外数据丢失备份系统...针对大数据传输中的数据机密性、完整性和数据丢失等问题,提出一种基于简化数据加密标准(Simplified Data Encryption Standard,SDES)和双轮差错控制的大数据集成安全系统。使用SDES加密算法生成加密字符串,并设计意外数据丢失备份系统以提高机密性和防止意外数据丢失。基于双轮差错控制以较低的空间开销控制传输过程中包含的任意数量的离散或连续错误位,基于固定长度编码(Fixed Length Coding,FLC)的无损压缩技术来减少数据开销。该算法具有较高的AE值、熵和压缩百分比,具有提供更高的数据机密性和完整性的潜力。展开更多
文摘Operating System(OS)is a critical piece of software that manages a computer’s hardware and resources,acting as the intermediary between the computer and the user.The existing OS is not designed for Big Data and Cloud Computing,resulting in data processing and management inefficiency.This paper proposes a simplified and improved kernel on an x86 system designed for Big Data and Cloud Computing purposes.The proposed algorithm utilizes the performance benefits from the improved Input/Output(I/O)performance.The performance engineering runs the data-oriented design on traditional data management to improve data processing speed by reducing memory access overheads in conventional data management.The OS incorporates a data-oriented design to“modernize”various Data Science and management aspects.The resulting OS contains a basic input/output system(BIOS)bootloader that boots into Intel 32-bit protected mode,a text display terminal,4 GB paging memory,4096 heap block size,a Hard Disk Drive(HDD)I/O Advanced Technology Attachment(ATA)driver and more.There are also I/O scheduling algorithm prototypes that demonstrate how a simple Sweeping algorithm is superior to more conventionally known I/O scheduling algorithms.A MapReduce prototype is implemented using Message Passing Interface(MPI)for big data purposes.An attempt was made to optimize binary search using modern performance engineering and data-oriented design.
文摘The implementation of artificial intelligence(AI)in a smart society,in which the analysis of human habits is mandatory,requires automated data scheduling and analysis using smart applications,a smart infrastructure,smart systems,and a smart network.In this context,which is characterized by a large gap between training and operative processes,a dedicated method is required to manage and extract the massive amount of data and the related information mining.The method presented in this work aims to reduce this gap with near-zero-failure advanced diagnostics(AD)for smart management,which is exploitable in any context of Society 5.0,thus reducing the risk factors at all management levels and ensuring quality and sustainability.We have also developed innovative applications for a humancentered management system to support scheduling in the maintenance of operative processes,for reducing training costs,for improving production yield,and for creating a human–machine cyberspace for smart infrastructure design.The results obtained in 12 international companies demonstrate a possible global standardization of operative processes,leading to the design of a near-zero-failure intelligent system that is able to learn and upgrade itself.Our new method provides guidance for selecting the new generation of intelligent manufacturing and smart systems in order to optimize human–machine interactions,with the related smart maintenance and education.
文摘As a global financial center, the transportation system in New York City (NYC) has always been studied from various aspects. Since 2009, NYC Taxi and Limousine Commission have made public the information on NYC taxi operations, offering an opportunity for detailed analysis. Thus, this research project investigates taxi operations in New York City based on big data analysis. The correlation between taxi operations and different types of weather, including precipitation, snow depth, and snowfall is discussed in this paper. The research also evaluates taxi trip distribution in each NTA area using Geopandas, and presents its density on an NYC map.
文摘In the context of intelligent manufacturing,machine tools,as core equipment,directly influence production efficiency and product quality through their operational reliability.Traditional maintenance methods for machine tools,often characterized by low efficiency and high costs,fail to meet the demands of modern manufacturing industries.Therefore,leveraging intelligent manufacturing technologies,this paper proposes a solution optimized for the diagnosis and maintenance of machine tool faults.Initially,the paper introduces sensor-based data acquisition technologies combined with big data analytics and machine learning algorithms to achieve intelligent fault diagnosis of machine tools.Subsequently,it discusses predictive maintenance strategies by establishing an optimized model for maintenance strategy and resource allocation,thereby enhancing maintenance efficiency and reducing costs.Lastly,the paper explores the architectural design,integration,and testing evaluation methods of intelligent manufacturing systems.The study indicates that optimization of machine tool fault diagnosis and maintenance in an intelligent manufacturing environment not only enhances equipment reliability but also significantly reduces maintenance costs,offering broad application prospects.
文摘In this paper, we conduct research on the database technology under the basic operation of the IOT huge amounts of data. Spatial data service is the process of basic customer application system service request, directory service system according to the request is mapped into physical addresses, according to the data block physical disk server address block of data read from the disk in parallel and sent to the client the process of application system. In addition, spatial data distribution system should possess unloading, transfer, replication, and optimization of spatial data, and other functions, to achieve comprehensive management and maintenance of spatial data. Under this basis, we propose the enhanced database technology that optimizes the operation with better performance.
文摘The operation time of external trucks in a container terminal is one of port operation key performance indicators concerned by port operators,external truck operators and related government authorities.With the traffic big data combined with the operation characteristics of the container terminal,the system dynamics method is used to build the simulation model of the operation system for external trucks.The simulation results of the operation time of external trucks are consistent with the actual situation,which provides an effective way to eliminate the“black box”of the operation time of the external trucks.The model can also be applied in multiple scenarios by using the traffic big data,and the simulation results can be adopted by the relevant organizations.
基金Supported by the National(Key)Basic Research and Development(973)Program of China(2012CB955900)China Meteorological Administration Special Public Welfare Research Fund(GYHY201406017)
文摘Big data has emerged as the next technological revolution in IT industry after cloud computing and the Internet of Things.With the development of climate observing systems,particularly satellite meteorological observation and high-resolution climate models,and the rapid growth in the volume of climate data,climate prediction is now entering the era of big data.The application of big data will provide new ideas and methods for the continuous development of climate prediction.The rapid integration,cloud storage,cloud computing,and full-sample analysis of massive climate data makes it possible to understand climate states and their evolution more objectively,thus predicting the future climate more accurately.This paper describes the application status of big data in operational climate prediction in China;it analyzes the key big data technologies,discusses the future development of climate prediction operations from the perspective of big data,speculates on the prospects for applying climatic big data in cloud computing and data assimilation,and puts forward the notion of big data-based super-ensemble climate prediction methods and computerbased deep learning climate prediction methods.
基金This work has been supported by the Chinese National Natural Science Foundation(51208126,51578169)Guangzhou Municipal Science and Technology Bureau in China(201904010307).
文摘In last few years,big data and deep learning technologies have been successfully applied in various fields of civil engineering with the great progress of machine learning techniques.However,until now,there has been no comprehensive review on its applications in civil engineering.To fill this gap,this paper reviews the application and development of artificial intelligence in civil engineering in recent years,including intelligent algorithms,big data and deep learning.Through the work of this paper,the research direction and difficulties of artificial intelligence in civil engineering for the past few years can be known.It is shown that the studies of artificial intelligence in civil engineering mainly focus on structural maintenance and management,and the design optimization.
文摘With the emergence of digital transformation success stories,more and more enterprises are launching digital solutions to improve business efficiency or achieve optimal revenue growth.The traditional communication market tends to be saturated,and the digital transformation of telecom operators is imminent.This article combining the development trend of telecom operators’product business and the application situation of the pilot summarizes the innovative application categories that telecom operators continue to launch based on their own advantages and in response to the needs of the industry.This article focuses on the transformation of security capabilities in communication services,big data,Internet of Things,artificial intelligence,unified authentication and network information security,and deeply analyzes the business characteristics and application modes from the aspects of resource integration,open platform construction,new connection construction,and innovative business development.This article puts forward suggestions for the security development of telecom operators,and provides basic research content for the subsequent research on the innovative application of telecom operators’capability openness.