Mesh representation matters:investigating the influence of different mesh features on perceptual and spatial fidelity of deep 3D morphable models

Background Deep 3D morphable models(deep 3DMMs)play an essential role in computer vision.They are used in facial synthesis,compression,reconstruction and animation,avatar creation,virtual try-on,facial recognition systems and medical imaging.These applications require high spatial and perceptual quality of synthesised meshes.Despite their significance,these models have not been compared with different mesh representations and evaluated jointly with point-wise distance and perceptual metrics.Methods We compare the influence of different mesh representation features to various deep 3DMMs on spatial and perceptual fidelity of the reconstructed meshes.This paper proves the hypothesis that building deep 3DMMs from meshes represented with global representations leads to lower spatial reconstruction error measured with L_(1) and L_(2) norm metrics and underperforms on perceptual metrics.In contrast,using differential mesh representations which describe differential surface properties yields lower perceptual FMPD and DAME and higher spatial fidelity error.The influence of mesh feature normalisation and standardisation is also compared and analysed from perceptual and spatial fidelity perspectives.Results The results presented in this paper provide guidance in selecting mesh representations to build deep 3DMMs accordingly to spatial and perceptual quality objectives and propose combinations of mesh representations and deep 3DMMs which improve either perceptual or spatial fidelity of existing methods.

Effectiveness of anti-psychiatric treatment on visual and haptic perceptual disorder for a patient with Alzheimer’s disease: A case report

BACKGROUND Perception is frequently impaired in patients with Alzheimer’s disease(AD).Several patients exhibit visual or haptic hallucinations.CASE SUMMARY A 71-year-old Chinese man presented with visual and haptic hallucinations he had been experiencing for 2 weeks.The clinical manifestations were the feeling of insects crawling and biting the limbs and geison.He looked for the insects while itching and scratching,which led to skin breakage on the limbs.He was treated with topical and anti-allergic drugs in several dermatology departments without any significant improvement.After admission,the patient was administered risperidone(0.5 mg)and duloxetine(2 mg/day).One week later,the dose of risperidone was increased to 2 mg/day,and that of duloxetine was increased to 60 mg/day.After 2 weeks of treatment,the patient’s sensation of insects crawling and biting disappeared,and his mood stabilized.CONCLUSION This patient manifested psychiatric behavioral symptoms caused by AD brain atrophy.It was important to re-evaluate the patient’s cognitive-psychological status when the patient repeatedly went to the hospital for treatment.Follow-up attention to cognitive function and the consideration of perceptual deficits as early manifestations of AD should be considered.

Integrating Audio-Visual Features and Text Information for Story Segmentation of News Video

Video data are composed of multimodal information streams including visual, auditory and textual streams, so an approach of story segmentation for news video using multimodal analysis is described in this paper. The proposed approach detects the topic-caption frames, and integrates them with silence clips detection results, as well as shot segmentation results to locate the news story boundaries. The integration of audio-visual features and text information overcomes the weakness of the approach using only image analysis techniques. On test data with 135 400 frames, when the boundaries between news stories are detected, the accuracy rate 85.8% and the recall rate 97.5% are obtained. The experimental results show the approach is valid and robust.

A Review on Audio-visual Translation Studies

This paper is dedicated to a thorough review on the audio-visual related translations from both home and abroad.In reviewing the foreign achievements on this specific field of translation studies it can shed some lights on our national audio-visual practice and research.The review on the Chinese scholars’ audio-visual translation studies is to offer the potential developing direction and guidelines to the studies and aspects neglected as well.Based on the summary of relevant studies,possible topics for further studies are proposed.

Audio-visual emotion recognition with multilayer boosted HMM

Emotion recognition has become an important task of modern human-computer interac- tion. A multilayer boosted HMM （ MBHMM ） classifier for automatic audio-visual emotion recognition is presented in this paper. A modified Baum-Welch algorithm is proposed for component HMM learn- ing and adaptive boosting （AdaBoost） is used to train ensemble classifiers for different layers （cues）. Except for the first layer, the initial weights of training samples in current layer are decided by recognition results of the ensemble classifier in the upper layer. Thus the training procedure using current cue can focus more on the difficult samples according to the previous cue. Our MBHMM clas- sifier is combined by these ensemble classifiers and takes advantage of the complementary informa- tion from multiple cues and modalities. Experimental results on audio-visual emotion data collected in Wizard of Oz scenarios and labeled under two types of emotion category sets demonstrate that our approach is effective and promising.

The Audio-Visual Performance Highlighted Craze in Chicago During Chinese New Year

February 10 (US Central Time), 2019, China National Peking Opera Company (CNPOC) and the Hubei Chime Bells National Chinese Orchestra presented a fantastic audio-visual performance of Chinese Peking Opera and Chinese chime bells for the American audience at the world s top-level Buntrock Hall at Symphony Center.

Research on National Identity Based on National Audio-Visual Works: Taking Inner Mongolia as an Example

Mongolian audio-visual works are an important carrier of exploring the true significance to this national culture.This paper believes that the Mongolian people in Inner Mongolia constantly enhance the individual sense of identity to the overall ethnic group through the influence of film and television and music,and on this basis constantly evolve a new culture in line with modern and contemporary life to further enhance their sense of belonging to the ethnic nation.

Application of Task-based Teaching Method to College Audio-visual English Teaching

Based on the current situation of college audio-visual English teaching in China, this article points out that the avoidance in class is a serious phenomenon in the process of college audio-visual English teaching. After further analysis and combination with the characteristics of college English audio-visual teaching in China, it puts forward the application of task-based teaching method to college audio-visual English teaching and its steps, attempting to alleviate the avoidance phenomenon in students through task-based teaching method.

Perceptual Optimization for Point-Based Point Cloud Rendering

Point-based rendering is a common method widely used in point cloud rendering.It realizes rendering by turning the points into the base geometry.The critical step in point-based rendering is to set an appropriate rendering radius for the base geometry,usually calculated using the average Euclidean distance of the N nearest neighboring points to the rendered point.This method effectively reduces the appearance of empty spaces between points in rendering.However,it also causes the problem that the rendering radius of outlier points far away from the central region of the point cloud sequence could be large,which impacts the perceptual quality.To solve the above problem,we propose an algorithm for point-based point cloud rendering through outlier detection to optimize the perceptual quality of rendering.The algorithm determines whether the detected points are outliers using a combination of local and global geometric features.For the detected outliers,the minimum radius is used for rendering.We examine the performance of the proposed method in terms of both objective quality and perceptual quality.The experimental results show that the peak signal-to-noise ratio(PSNR)of the point cloud sequences is improved under all geometric quantization,and the PSNR improvement ratio is more evident in dense point clouds.Specifically,the PSNR of the point cloud sequences is improved by 3.6%on average compared with the original algorithm.The proposed method significantly improves the perceptual quality of the rendered point clouds and the results of ablation studies prove the feasibility and effectiveness of the proposed method.

Prioritized MPEG-4 Audio-Visual Objects Streaming over the DiffServ

The object-based scalable coding in MPEG-4 is investigated, and a prioritized transmission scheme of MPEG-4 audio-visual objects （AVOs） over the DiffServ network with the QoS guarantee is proposed. MPEG-4 AVOs are extracted and classified into different groups according to their priority values and scalable layers （visual importance）. These priority values are mapped to the 1P DiffServ per hop behaviors （PHB）. This scheme can selectively discard packets with low importance, in order to avoid the network congestion. Simulation results show that the quality of received video can gracefully adapt to network state, as compared with the ‘best-effort＇ manner. Also, by allowing the content provider to define prioritization of each audio-visual object, the adaptive transmission of object-based scalable video can be customized based on the content.

核心素养导向的学科实践:内在逻辑与学习进程

学科实践是核心素养导向下的学科学习新形态,指向学生应对复杂问题情境的胜任力与协作交往的道德力的培育。学科实践包含人类实践、专业实践和个体实践,其紧紧围绕着学科知识与学科实践、学科观念与学科实践的互通关系而展开,知识在人类实践中产生又在指导和规约实践中得以发展,个体观念则在经历学科知识生产和发展的思维过程和实践过程中得以建构,再应用于实际问题解决以发展学生的学科理解力与学科实践力。学科实践以感性实践为起点,在复杂问题解决学习中通过理性实践与协作探究深化知识理解,并在知行循环中实现知识迁移与知识应用。让学科实践在学校教育中得以真正落实,需明确“学用合一”的学习理念,以“学科心理”来融通系列学习活动,厘清进阶性学科问题与问题链的现实路径,并致力构建意义协商的学习共同体。

感性活动的进阶:感受性学习及其发展价值的表达

作为感性的存在物,人具有感觉与感受的能力,感受性是人的实践特性。充分发挥感性活动对学生发展的丰富价值是推进学习形态变革,发展学生核心素养的本质诉求。感受是人反映现实世界的重要方式,是人的感官、身体、心灵等对现实世界敞开的开放性态度,是对社会、道德和美的吸纳、包容与理解。通过感受人得以获取关于现实世界的体验,并完善认知,丰盈情感,从而不断实现自身的完整发展。感受是感性和理性的统一,感觉构成了感受生成的基础,人的感受性依赖于感性活动的深化。课堂学习必须克服过于强调知识的符号训练和孤立的理性认知、轻视学生感性发展、学习环境封闭、与真实情境和社会生活经验脱离的弊端,重视学生的感受能力培育。基于人的感受性,感受性学习是以感官为通道,以感觉、知觉等感性活动过程为基础,以感知、体验、感悟为基本方式的学习形态,是一种对象性的感性活动和实践活动。感受性学习的内在机制包括以感知觉和表象为基础的感性反映过程、感性向理性的进阶过程、认知和情感的双向互动过程。促进学生的感受性学习,发展学生的感受力,要真正进入学生内在的学习过程创设学习活动,解放学生的感官,基于真实情境丰富学生的体验与表达,在高度关切现实世界中实现知识和观念的活态化,引导学生走向感受性实践。

中文阅读中快速读者与慢速读者的知觉广度

在熟练的中文阅读中,不同阅读速度读者提取文本信息的范围(即知觉广度)是否存在差异?为解决该问题,本研究从熟练读者群体中选取快速读者与慢速读者,结合眼动技术和移动窗口范式比较两组读者在不同窗口(R0、L1R1、L1R2、L1R3、L1R4、FL)下阅读句子时的眼动模式。结果显示,在保证阅读理解准确的前提下,快速读者比慢速读者的知觉广度更大,符合E-Z读者模型的语言效率假说,支持个体差异性观点。

基于眼动追踪技术的哈尔滨地铁站入口设计造型审美意象研究

城市公共家具是城市便捷生活的助力产品,也是城市文化、城市形象的重要承载传播媒介。本文以哈尔滨地铁站入口为研究对象,采用眼动追踪技术、语义差分法、问卷调查、数据统计相结合的方法对哈尔滨城市公共家具造型审美意象进行定性定量化分析和研究。哈尔滨地铁站入口样本的兴趣区研究数据显示,地铁站入口造型的核心关注区域为站点标识牌、拱形造型、立柱等部位,地铁站入口类型对兴趣区观看时间影响不大,不同造型区域观看时间存在一定差别;哈尔滨城市公共家具会给人带来“厚重”“古典”的感觉。对于哈尔滨城市公共家具造型和审美认知的定量化研究,将模糊意识和主观评价转化为准确的数据化客观表达,为具有城市文化特色的公共家具造型设计创新提供科学参考依据。

社会情感能力对大学生社会适应能力的影响:领悟社会支持与积极应对的链式中介

为了探讨大学生社会情感能力对社会适应能力的影响及领悟社会支持和积极应对在两者之间的链式中介作用,采用大学生社会情感能力量表、领悟社会支持量表、积极应对方式量表和社会适应能力诊断量表对374名大学生进行问卷调查。结果发现:(1)大学生的社会情感能力、社会适应能力、领悟社会支持和积极应对方式均两两显著正相关;(2)大学生社会情感能力显著正向影响社会适应能力;(3)领悟社会支持和积极应对在大学生社会情感能力与社会适应能力之间均起部分中介作用;(4)领悟社会支持和积极应对在大学生社会情感能力与社会适应的关系中构成链式中介。研究扩充了社会情感能力影响学生社会适应能力的研究机制,同时为提升大学生的社会适应能力提供启示。

基于强弱感知设计的驾驶员危险感知状态识别模型研究

驾驶员危险感知能力对于预防和减少道路交通事故具有重要作用。针对目前研究中危险感知的特征向量表征不统一、算法对实际问题可解释性不足的弊端,通过人为控制的方式,设计了基于危险源、显隐性、强弱危险感知状态3个维度的3×2×2实验方案,实现对危险感知的预定分级;设计配对T检验和Wilcoxon符号秩检验结合的方式实现强弱感知状态下特征差异性的量化比较;建立基于十倍交叉参数调优SVM算法的危险感知状态二分类模型。研究结果表明:驾驶员在强危险感知状态下对危险的反应更主动,倾向于避免危险,而非紧急避险,并保持更低的车速,更倾向油门控制而非制动控制,注视和眼跳行为增加;驾驶员在隐性危险源场景中的操纵力度和频次更强,危险感知与显隐性影响程度及危险源类型有关,摩托车类危险源差异最大,行人类危险源差异最小;在C=1,γ=0.1,选择车头时距、车速标准差、最大制动踏板力、加速度标准差、预减速时间、车速均值、油门开度标准差、跳视次数、注视次数作为特征时,SVM模型具有最好的性能,准确率为89.2%,精准率为90.6%,召回率为87.8%,F1值为0.888。XGBoost模型对弱感知的识别能力低于SVM模型。该研究对于驾驶员危险感知状态的量化评估具有显著的指导意义。

语言符号与知觉符号表征对外语词汇习得的影响比较:来自行为与脑电的实验证据

通过行为与脑电实验技术,比较外语词汇学习过程中,语言符号与知觉符号表征对词汇记忆编码与再认的影响过程,从而考察语义表征对词汇习得的影响机制。行为结果表明,语言符号与知觉符号表征条件下被试对词汇学习效果的主观判断无显著差异,但后者比前者有更高的词汇再认正确率。脑电结果表明,对于词汇编码阶段,相较语言符号表征,知觉符号表征在编码晚期诱发更正的LPC成分;对于词汇再认阶段,知觉符号表征条件诱发更大N400成分,且脑电时频分析表明该条件下出现更为明显的μ波抑制及θ波功率增强现象。研究结果综合表明,与语言符号表征便捷但非模态化的语义加工相比,知觉符号表征加深了词汇晚期编码的深度,并通过知觉模拟,利用多模态信息提高了词汇的形象化再认,从而推动了再认阶段的语义检索,最终内隐性地提高了词汇学习效果。

不同人格特质消费者的产品造型意象认知差异研究

获取不同人格特质消费者产品造型意象感性认知与差异。以人格特质中的“大五”人格理论为基础,以家用小型宠物喂食器为例,采用语义差异法与问卷法获取消费者的造型意象认知信息,分析各群体的认知差异。研究发现在“普通与新颖”“实用与花哨”“简约与复杂”“协调与奇异”4个造型意象维度上,外倾性、神经质、开放性消费者群体的认知与其他群体的认知表现出了不同的差异性,这种差异与消费者认知经验、造型意象内涵相关。该分析结果为产品造型意象构建与设计创新提供了支撑。

知觉组织对时序知觉的影响:注意线索的作用

本研究探讨注意线索在知觉组织影响时序知觉中的作用。实验1和实验2采用2(图形朝向:图形对向、图形反向)×2(注意条件:有效线索、无效线索)×9(SOA:0ms、±15ms、±30ms、±45ms、±90ms)的实验设计,分别探讨外源性注意线索、内源性注意线索在知觉组织影响时序知觉中的作用。结果发现,在图形对向和图形反向条件中,被试在有效线索条件比无效线索条件中更倾向于判断注意线索一侧的刺激先出现;但是在有效和无效线索条件中,被试在图形对向条件均比图形反向条件更倾向于判断两个图形同时出现。结果表明,知觉组织对时序知觉的影响受到注意线索的调节,而且外源性和内源性注意线索的作用有差异,但是注意线索不能消除知觉组织对时序知觉的影响。

论“人机交互”式数字电影表演——以“恐惑谷”效应为中心

在数字时代的大银幕上,3D建模、虚拟摄影、动作表情捕捉、合成技术、AI成像等计算机CGI技术同真人表演相结合,创造出形态各异、风格多元的银幕形象。这样一种“人机交互”式数字表演,强调了有别于传统电影“照相写实主义”的“感觉写实主义”美学,也带给观众差异化的审美体验。一味追求“逼真”的数字表演,很容易陷入“恐惑谷”效应的深渊;也有一些影片能规避、利用或跨越“恐惑谷”,实现积极或正面的表演效果。数字时代银幕上的“恐惑谷”效应,彰显了人机交互、融合与协作的必然性和必要性。