The paper is concerned with the basic properties of multivariate extreme value distribution (in the Logistic model). We obtain the characteristic function and recurrence formula of the density function. The explicit a...The paper is concerned with the basic properties of multivariate extreme value distribution (in the Logistic model). We obtain the characteristic function and recurrence formula of the density function. The explicit algebraic formula for Fisher information matrix is indicated. A simple and accurate procedure for generating random vector from multivariate extreme value distribution is presented.展开更多
卷积神经网络性能的快速提升是以不断堆叠的网络层数以及成倍增长的参数量和存储空间为代价,这不仅会使模型在训练过程中出现过拟合等问题,也不利于模型在资源受限的嵌入式设备上运行,因而提出模型压缩技术来解决上述问题,主要对模型压...卷积神经网络性能的快速提升是以不断堆叠的网络层数以及成倍增长的参数量和存储空间为代价,这不仅会使模型在训练过程中出现过拟合等问题,也不利于模型在资源受限的嵌入式设备上运行,因而提出模型压缩技术来解决上述问题,主要对模型压缩技术中的特征蒸馏算法进行了研究。针对特征蒸馏中利用教师网络特征图指导学生网络并不能很好地锻炼学生网络特征拟合能力的问题,提出基于特征分布蒸馏算法。该算法利用条件互信息的概念构建模型特征空间的概率分布,并引入最大平均差异(maximum mean discrepancy,MMD)设计损失函数以最小化教师网络和学生网络特征分布间的距离。在知识蒸馏的基础上利用toeplitz矩阵对学生网络进行权重共享操作,进一步节省了模型的存储空间。为验证在特征分布蒸馏算法训练下学生网络的特征拟合能力,在图像分类、目标检测和语义分割三种图像处理任务上进行了实验验证,实验表明所提算法在以上三种学习任务中的表现均优于对比算法且实现了不同网络架构间的蒸馏。展开更多
Power line carrier(PLC)technology plays an increasingly important role in the realization of cost-effective communication in a smart distribution grid.No current channel modeling method is universally applicable to mo...Power line carrier(PLC)technology plays an increasingly important role in the realization of cost-effective communication in a smart distribution grid.No current channel modeling method is universally applicable to more complex topologies that may emerge in smart grids,such as ring and mesh topologies.This paper presents a novel PLC channel modeling method based on the information node concept,and the universality and feasibility of the proposed method are demonstrated with applications in modeling networks with ring and mesh topologies.The factors that affect the channel characteristics of the networks and the laws that govern their behaviors for different types of topologies are analyzed.The validity and effectiveness of the proposed method are proven using simulation and laboratory tests.This paper provides the necessary theoretical basis and technical means to design the PLC modulation method for smart distribution grids.展开更多
文摘The paper is concerned with the basic properties of multivariate extreme value distribution (in the Logistic model). We obtain the characteristic function and recurrence formula of the density function. The explicit algebraic formula for Fisher information matrix is indicated. A simple and accurate procedure for generating random vector from multivariate extreme value distribution is presented.
文摘卷积神经网络性能的快速提升是以不断堆叠的网络层数以及成倍增长的参数量和存储空间为代价,这不仅会使模型在训练过程中出现过拟合等问题,也不利于模型在资源受限的嵌入式设备上运行,因而提出模型压缩技术来解决上述问题,主要对模型压缩技术中的特征蒸馏算法进行了研究。针对特征蒸馏中利用教师网络特征图指导学生网络并不能很好地锻炼学生网络特征拟合能力的问题,提出基于特征分布蒸馏算法。该算法利用条件互信息的概念构建模型特征空间的概率分布,并引入最大平均差异(maximum mean discrepancy,MMD)设计损失函数以最小化教师网络和学生网络特征分布间的距离。在知识蒸馏的基础上利用toeplitz矩阵对学生网络进行权重共享操作,进一步节省了模型的存储空间。为验证在特征分布蒸馏算法训练下学生网络的特征拟合能力,在图像分类、目标检测和语义分割三种图像处理任务上进行了实验验证,实验表明所提算法在以上三种学习任务中的表现均优于对比算法且实现了不同网络架构间的蒸馏。
文摘Power line carrier(PLC)technology plays an increasingly important role in the realization of cost-effective communication in a smart distribution grid.No current channel modeling method is universally applicable to more complex topologies that may emerge in smart grids,such as ring and mesh topologies.This paper presents a novel PLC channel modeling method based on the information node concept,and the universality and feasibility of the proposed method are demonstrated with applications in modeling networks with ring and mesh topologies.The factors that affect the channel characteristics of the networks and the laws that govern their behaviors for different types of topologies are analyzed.The validity and effectiveness of the proposed method are proven using simulation and laboratory tests.This paper provides the necessary theoretical basis and technical means to design the PLC modulation method for smart distribution grids.
