Despite the rapid development of mobile and embedded hardware, directly executing computationexpensive and storage-intensive deep learning algorithms on these devices’ local side remains constrained for sensory data ...Despite the rapid development of mobile and embedded hardware, directly executing computationexpensive and storage-intensive deep learning algorithms on these devices’ local side remains constrained for sensory data analysis. In this paper, we first summarize the layer compression techniques for the state-of-theart deep learning model from three categories: weight factorization and pruning, convolution decomposition, and special layer architecture designing. For each category of layer compression techniques, we quantify their storage and computation tunable by layer compression techniques and discuss their practical challenges and possible improvements. Then, we implement Android projects using TensorFlow Mobile to test these 10 compression methods and compare their practical performances in terms of accuracy, parameter size, intermediate feature size,computation, processing latency, and energy consumption. To further discuss their advantages and bottlenecks,we test their performance over four standard recognition tasks on six resource-constrained Android smartphones.Finally, we survey two types of run-time Neural Network(NN) compression techniques which are orthogonal with the layer compression techniques, run-time resource management and cost optimization with special NN architecture,which are orthogonal with the layer compression techniques.展开更多
Lack of physical activity is becoming a killer of our healthy life. As a solution for this negative impact, we propose SmartCare to help users to set up a healthy physical activity habit. SmartCare can monitor a user...Lack of physical activity is becoming a killer of our healthy life. As a solution for this negative impact, we propose SmartCare to help users to set up a healthy physical activity habit. SmartCare can monitor a user's activities over a long time, and then provide activity quality assessment and suggestion. SmartCare consists of three parts, activity recognition, energy saving, and health feedback. Activity recognition can recognize nine kinds of daily activities. A hybrid classifier that uses less power and memory with satisfactory accuracy was designed and implemented by utilizing the periodicity of target activity. In addition, a learning-based energy saver was introduced to reduce energy consumption by adjusting sampling rates and the set of features adaptively. Based on the type and duration of the activity recorded, health feedback in terms of the calorie burned was given. The system could provide quantitative activity quality assessment and recommend future physical activity plans. Through extensive real-life testing, the system is shown to achieve an average recognition accuracy of 98.0% with a minimized energy expenditure.展开更多
基金supported by the National Key Research and Development Program of China (No. 2018YFB1003605)Foundations of CARCH (No. CARCH201704)+3 种基金the National Natural Science Foundation of China (No. 61472312)Foundations of Shaanxi Province and Xi’an ScienceTechnology Plan (Nos. B018230008 and BD34017020001)the Foundations of Xidian University (No. JBZ171002)
文摘Despite the rapid development of mobile and embedded hardware, directly executing computationexpensive and storage-intensive deep learning algorithms on these devices’ local side remains constrained for sensory data analysis. In this paper, we first summarize the layer compression techniques for the state-of-theart deep learning model from three categories: weight factorization and pruning, convolution decomposition, and special layer architecture designing. For each category of layer compression techniques, we quantify their storage and computation tunable by layer compression techniques and discuss their practical challenges and possible improvements. Then, we implement Android projects using TensorFlow Mobile to test these 10 compression methods and compare their practical performances in terms of accuracy, parameter size, intermediate feature size,computation, processing latency, and energy consumption. To further discuss their advantages and bottlenecks,we test their performance over four standard recognition tasks on six resource-constrained Android smartphones.Finally, we survey two types of run-time Neural Network(NN) compression techniques which are orthogonal with the layer compression techniques, run-time resource management and cost optimization with special NN architecture,which are orthogonal with the layer compression techniques.
基金partially supported by the National Natural Science Foundation of China (Nos. 61190110, 61272456, and 61472312)the open fund ITDU14004/KX142600011+1 种基金supported by the overall innovation project of Shaanxi Province Science and Technology Plan (No. 2012KTZD02-03-03)the Fundamental Research Funds for the Central Universities (Nos. JB151002, K5051323005, and BDY041409)
文摘Lack of physical activity is becoming a killer of our healthy life. As a solution for this negative impact, we propose SmartCare to help users to set up a healthy physical activity habit. SmartCare can monitor a user's activities over a long time, and then provide activity quality assessment and suggestion. SmartCare consists of three parts, activity recognition, energy saving, and health feedback. Activity recognition can recognize nine kinds of daily activities. A hybrid classifier that uses less power and memory with satisfactory accuracy was designed and implemented by utilizing the periodicity of target activity. In addition, a learning-based energy saver was introduced to reduce energy consumption by adjusting sampling rates and the set of features adaptively. Based on the type and duration of the activity recorded, health feedback in terms of the calorie burned was given. The system could provide quantitative activity quality assessment and recommend future physical activity plans. Through extensive real-life testing, the system is shown to achieve an average recognition accuracy of 98.0% with a minimized energy expenditure.