Big Data Application Simulation Platform Design for Onboard Distributed Processing of LEO Mega-Constellation Networks

Due to the restricted satellite payloads in LEO mega-constellation networks(LMCNs),remote sensing image analysis,online learning and other big data services desirably need onboard distributed processing(OBDP).In existing technologies,the efficiency of big data applications(BDAs)in distributed systems hinges on the stable-state and low-latency links between worker nodes.However,LMCNs with high-dynamic nodes and long-distance links can not provide the above conditions,which makes the performance of OBDP hard to be intuitively measured.To bridge this gap,a multidimensional simulation platform is indispensable that can simulate the network environment of LMCNs and put BDAs in it for performance testing.Using STK's APIs and parallel computing framework,we achieve real-time simulation for thousands of satellite nodes,which are mapped as application nodes through software defined network(SDN)and container technologies.We elaborate the architecture and mechanism of the simulation platform,and take the Starlink and Hadoop as realistic examples for simulations.The results indicate that LMCNs have dynamic end-to-end latency which fluctuates periodically with the constellation movement.Compared to ground data center networks(GDCNs),LMCNs deteriorate the computing and storage job throughput,which can be alleviated by the utilization of erasure codes and data flow scheduling of worker nodes.

Exploration and Practice of Big Data Introductory Courses for Big Data Management and Application Majors

As an introductory course for the emerging major of big data management and application,“Introduction to Big Data”has not yet formed a curriculum standard and implementation plan that is widely accepted and used by everyone.To this end,we discuss some of our explorations and attempts in the construction and teaching process of big data courses for the major of big data management and application from the perspective of course planning,course implementation,and course summary.After interviews with students and feedback from questionnaires,students are highly satisfied with some of the teaching measures and programs currently adopted.

Research on the Application of Big Data and Cloud Computing Technology in Smart Campus

The current education field is experiencing an innovation driven by big data and cloud technologies,and these advanced technologies play a central role in the construction of smart campuses.Big data technology has a wide range of applications in student learning behavior analysis,teaching resource management,campus safety monitoring,and decision support,which improves the quality of education and management efficiency.Cloud computing technology supports the integration,distribution,and optimal use of educational resources through cloud resource sharing,virtual classrooms,intelligent campus management systems,and Infrastructure-as-a-Service(IaaS)models,which reduce costs and increase flexibility.This paper comprehensively discusses the practical application of big data and cloud computing technologies in smart campuses,showing how these technologies can contribute to the development of smart campuses,and laying the foundation for the future innovation of education models.

The Influence of Social Media on College Choice among Undergraduates Majoring in Big Data Management and Application in China:Taking Guilin University of Electronic Technology as an Example

This study aims to investigate the influence of social media on college choice among undergraduates majoring in Big Data Management and Application in China.The study attempts to reveal how information on social media platforms such as Weibo,WeChat,and Zhihu influences the cognition and choice process of prospective students.By employing an online quantitative survey questionnaire,data were collected from the 2022 and 2023 classes of new students majoring in Big Data Management and Application at Guilin University of Electronic Technology.The aim was to evaluate the role of social media in their college choice process and understand the features and information that most attract prospective students.Social media has become a key factor influencing the college choice decision-making of undergraduates majoring in Big Data Management and Application in China.Students tend to obtain school information through social media platforms and use this information as an important reference in their decision-making process.Higher education institutions should strengthen their social media information dissemination,providing accurate,timely,and attractive information.It is also necessary to ensure effective management of social media platforms,maintain a positive reputation for the school on social media,and increase the interest and trust of prospective students.Simultaneously,educational decision-makers should consider incorporating social media analysis into their recruitment strategies to better attract new student enrollment.This study provides a new perspective for understanding higher education choice behavior in the digital age,particularly by revealing the importance of social media in the educational decision-making process.This has important practical and theoretical implications for higher education institutions,policymakers,and social media platform operators.

Improving Performance of Cloud Computing and Big Data Technologies and Applications

Cloud computing technology is changing the development and usage patterns of IT infrastructure and applications. Virtualized and distributed systems as well as unified management and scheduling has greatly im proved computing and storage. Management has become easier, andOAM costs have been significantly reduced. Cloud desktop technology is develop ing rapidly. With this technology, users can flexibly and dynamically use virtual ma chine resources, companies＇ efficiency of using and allocating resources is greatly improved, and information security is ensured. In most existing virtual cloud desk top solutions, computing and storage are bound together, and data is stored as im age files. This limits the flexibility and expandability of systems and is insufficient for meetinz customers＇ requirements in different scenarios.

Building a Productive Domain-Specific Cloud for Big Data Processing and Analytics Service

Cloud Computing as a disruptive technology, provides a dynamic, elastic and promising computing climate to tackle the challenges of big data processing and analytics. Hadoop and MapReduce are the widely used open source frameworks in Cloud Computing for storing and processing big data in the scalable fashion. Spark is the latest parallel computing engine working together with Hadoop that exceeds MapReduce performance via its in-memory computing and high level programming features. In this paper, we present our design and implementation of a productive, domain-specific big data analytics cloud platform on top of Hadoop and Spark. To increase user’s productivity, we created a variety of data processing templates to simplify the programming efforts. We have conducted experiments for its productivity and performance with a few basic but representative data processing algorithms in the petroleum industry. Geophysicists can use the platform to productively design and implement scalable seismic data processing algorithms without handling the details of data management and the complexity of parallelism. The Cloud platform generates a complete data processing application based on user’s kernel program and simple configurations, allocates resources and executes it in parallel on top of Spark and Hadoop.

Research on the Applications of Big Data on Artistic Designing and Its Infl uences on the Design Behavior

In this paper, we conduct research on the applications of big data on artistic designing and its infl uences on the design behavior. Modern art design enhance the grade of the product, increase the added value of products, promote the development of the economy, make the product of the aesthetic value and economic value of the perfect unity. In today’s society due to the value of the product are much more than the product itself contains the value of performance, usage, etc. is more of a product in gradually improve the aesthetic value, sometimes even more than the use of the product value and exchange value, therefore the product has become the dominant value. Under this basis, we propose the new idea on the design pattern that will be meaningful.

Research and Application Progress of Agricultural Big Data Technology and Resources

With the development of Internet of things, cloud computing, mobile Inter- net, the scale of the data shows an alarming growth trend. Agricultural information is an important part of modern agricultural construction, and the development of a- gricultural industry is becoming more and more deeply with the application of infor- mation technology. This paper reviewed the concept and characteristic of big data, development history of big data at home and abroad, and emphatically expounded the connotation of agricultural big data, development status of agricultural big data at home and abroad, as well as the applications of agricultural big data technology, agriculture big data resources and agricultural big data in various fields.

Research on the Application of Big Data Technology in the Integration of Enterprise Business and Finance

With the advent of the era of big data,traditional financial management has been unable to meet the needs of modern enterprise business.Enterprises hope that financial management has the function of improving the accuracy of corporate financial data,assisting corporate management to make decisions that are more in line with the actual development of the company,and optimizing corporate management systems,thereby comprehensively improving the overall level of the company and ensuring that the company can be in business with the assistance of financial integration,can better improve and develop themselves.Based on the investigation of enterprises and universities,this article analyzes the problem of accounting talent training from both the demand and supply ends,and puts forward some suggestions for the teaching reform of accounting integration with big data in financial colleges and universities,and strives to promote the integration of business and finance.The optimal allocation of enterprise resources will gradually enhance the market competitiveness of enterprises,and explore the application strategies of big data technology in the integration of enterprise business and finance.

Optimizing Healthcare Big Data Processing with Containerized PySpark and Parallel Computing: A Study on ETL Pipeline Efficiency

In this study, we delve into the realm of efficient Big Data Engineering and Extract, Transform, Load (ETL) processes within the healthcare sector, leveraging the robust foundation provided by the MIMIC-III Clinical Database. Our investigation entails a comprehensive exploration of various methodologies aimed at enhancing the efficiency of ETL processes, with a primary emphasis on optimizing time and resource utilization. Through meticulous experimentation utilizing a representative dataset, we shed light on the advantages associated with the incorporation of PySpark and Docker containerized applications. Our research illuminates significant advancements in time efficiency, process streamlining, and resource optimization attained through the utilization of PySpark for distributed computing within Big Data Engineering workflows. Additionally, we underscore the strategic integration of Docker containers, delineating their pivotal role in augmenting scalability and reproducibility within the ETL pipeline. This paper encapsulates the pivotal insights gleaned from our experimental journey, accentuating the practical implications and benefits entailed in the adoption of PySpark and Docker. By streamlining Big Data Engineering and ETL processes in the context of clinical big data, our study contributes to the ongoing discourse on optimizing data processing efficiency in healthcare applications. The source code is available on request.

On Application of Big Data Mining in Earthquake Precursor Observation

Research and application of big data mining,at present,is a hot issue. This paper briefly introduces the basic ideas of big data research, analyses the necessity of big data application in earthquake precursor observation,and probes certain issues and solutions when applying this technology to work in the seismic-related domain. By doing so,we hope it can promote the innovative use of big data in earthquake precursor observation data analysis.

The Development of Market Method of Asset Appraisal Based on the Application of Big Data

Big data could be utilized in work and life. Asset appraisal could also make full use of big data to improve the efficiency and effectiveness of appraisal. The paper is going to study the application of big data in different fields to learn how big data works in practices and what the effect is after utilizing the new tool. Then, the paper is going to apply big data in appraisal in specific work environment. By collecting information, researching literature and practicing with appraisers, this paper f＇mds some means to improve market method by making full use of big data. The article researched further by applying the method in different projects of asset appraisal. Real estate, intangible asset, corporate valuation and machines could be valued by the market method improved by big data. There are different details for appraisers to be careful in practical work. Some companies have already put the technology into practice and achieved great benefit, which makes the application of big data meaningful.

Research on the Application of Big Data in Logistics Management

With the high-speed development of China’s information technology,human society has ushered in the age of big data,imposing challenges to many logistics companies.With the continuous changes in the development environment,it requires relevant logistics companies to make reasonable self-adjustment to ensure their adaptability to the development environment.At present,many Chinese logistics companies with relatively lagged management model fail to effectively employ big data analysis technique,and have some shortcomings in talent team construction.Therefore,relevant logistics companies need to reasonably use big data technology,improve the quality of logistics management work,and effectively screen valuable part from mass information,thereby promoting rapid development of China’s logistics industry.In this paper,the application of big data in logistics management is analyzed.Firstly,the concepts and characteristics of big data are introduced and then this paper discusses the necessity of application of big data in logistics management,and proposes specific application countermeasures,in hope of providing some reference to relevant staff.

Application of Big Data Information Platform in Medical Equipment

The application of big data in the medical device industry mainly refers to the analysis and processing of various medical devices,so as to provide patients with better treatment and rehabilitation services.At present,our country already has a relatively mature and reliable large database system.This article studies the application of medical equipment in the big data information platform.The main methods used in this article are survey method,case analysis method,and interview method.The big data information platform and medical devices are studied from different aspects.The survey results show that 41%of people completely agree with the role of big data information platforms in medical devices.

Overview of Construction and Application of Big Data Analysis Platform

Big data technology is widely spread around the world,and is constantly developing and applying.In order to enhance the application value of big data analysis platform,it is necessary to constantly improve the data analysis and processing capacity of big data platform,so as to build a complete data analysis platform,realize resource sharing and real-time data collection.As a key point of contemporary information development,big data analysis platform is of great significance to promote social data exchange.Based on this,this paper focuses on two aspects:first,it describes the construction process and content of big data platform;second,it summarizes the relevant application and development of big data platform for reference.

The Study on the Economic Application of Financial Big Data

Big Data has become the focus of the Internet industry. With the development of various industries becoming more sophisticated, long-term accumulation of operational data, customer data displays exponential growth trend. The rapid development of financial big data both poses opportunities and challenges for financial industry and economic growth. This article explains the economic application of big data based on the perspective of economics.

Research on the Application of Big Data and Artificial Intelligence Technology in Computer Network

With the continuous development of social economy,science and technology are also in continuous progress,relying on the Internet technology of big data era has come in an all-round way.On the basis of the development of cloud computing and Internet technology,artificial intelligence technology has emerged as the times require.It also has more advantages.Applying it to computer network technology can effectively improve the data processing efficiency and quality of computer network technology,and improve the convenience for people’s life and production.This paper studies and analyzes the practical application requirements of computer network,and discusses the application characteristics and timeliness of artificial intelligence technology.

Protection of Basic Human Rights in the Application of Big Data to Counter Terrorism

In the era of big data,the ways people work,live and think have changed dramatically,and the social governance system is also being restructured.Achieving intelligent social governance has now become a national strategy.The application of big data technology to counterterrorism efforts has become a powerful weapon for all countries.However,due to the uncertainty,difficulty of interpretation and potential risk of discrimination in big data technology and algorithm models,basic human rights,freedom and even ethics are likely to be impacted and challenged.As a result,there is an urgent need to prioritize basic human rights and regulate the application of big data for counter terrorism purposes.The legislation and law enforcement regarding the use of big data to counter terrorism must be subject to constitutional and other legal reviews,so as to strike a balance between safeguarding national security and protecting basic human rights.

International Papers Contribution on Artificial Intelligence Promotes the Application and Development of Big Data in the Petroleum Industry

Artificial intelligence is a new technological science that researches and develops theories,methods,technologies and application systems for simulating,extending and expanding human intelligence.It simulates certain human thought processes and intelligent behaviors(such as learning,reasoning,thinking,planning,etc.),and produces a new type of intelligent machine that can respond in a similar way to human intelligence.In the past 30 years,it has achieved rapid development in various industries and related disciplines such as manufacturing,medical care,finance,and transportation.