Perceptual Optimization for Point-Based Point Cloud Rendering

Point-based rendering is a common method widely used in point cloud rendering.It realizes rendering by turning the points into the base geometry.The critical step in point-based rendering is to set an appropriate rendering radius for the base geometry,usually calculated using the average Euclidean distance of the N nearest neighboring points to the rendered point.This method effectively reduces the appearance of empty spaces between points in rendering.However,it also causes the problem that the rendering radius of outlier points far away from the central region of the point cloud sequence could be large,which impacts the perceptual quality.To solve the above problem,we propose an algorithm for point-based point cloud rendering through outlier detection to optimize the perceptual quality of rendering.The algorithm determines whether the detected points are outliers using a combination of local and global geometric features.For the detected outliers,the minimum radius is used for rendering.We examine the performance of the proposed method in terms of both objective quality and perceptual quality.The experimental results show that the peak signal-to-noise ratio(PSNR)of the point cloud sequences is improved under all geometric quantization,and the PSNR improvement ratio is more evident in dense point clouds.Specifically,the PSNR of the point cloud sequences is improved by 3.6%on average compared with the original algorithm.The proposed method significantly improves the perceptual quality of the rendered point clouds and the results of ablation studies prove the feasibility and effectiveness of the proposed method.

Perceptual learning for treating amblyopia in children based on activation of visual signal pathway Relationship of curative effects and time

BACKGROUND： Conventional methods （such as occlusion therapy, fine manipulation, complementary, and alternative medicine） take effects slowly, are time and labor consuming, and have uncertain curative effects in the treatment of amblyopia. Perceptual learning, a new method for treating amblyopia, improves the ability to process signals from the cerebral optic nerve system by specific visual stimulation and visual learning, as well as activation of the visual signal pathway utilizing brain nervous system plasticity. OBJECTIVE： This study investigated and evaluated the curative effects of perceptual learning, which can directionally increase brain plasticity, on the treatment of amblyopia in children. The relationship between curative effect and time was also analyzed. DESIGN： A self-control experiment. SETTING： Visual Science and Optometry Center, People＇s Hospital of Guangxi Zhuang Autonomous Region. PARTICIPANTS： A total of 125 amblyopic children （250 amblyopic eyes）, 73 males, 52 females, averaging （6±2） years of age, received treatment at the Visual Science and Optometry Center, People＇s Hospital of Guangxi Zhuang Autonomous Region between September 2006 and February 2007 and were recruited for this study. All children presented with no structural disease of the eyeballs. Written informed consent for therapeutic regiments was obtained from each child＇s parent. The protocol received approval from the Hospital＇s Ethics Committee. METHODS： Visual function was tested with a perceptual learning system （Research Center for Human Health and Development of Sun Yat-sen University, National Engineering Technique Research Center for Medical Care Implement） for visual noise, position noise, contour discrimination, contrast sensitivity, grating stereogram, and random-dot fusion. These tests helped to evaluate the efficiency of visual information processing of these children, and to determine the degree of defects of the optic nerve cells and the connections of visual cortical neurons. According to results of visual function tests, individualized treatment was adopted for each amblyopia patient using perceptual learning system. One course of treatment lasted one month, and treatment was performed twice every day with two training procedures （each training procedure lasted for ten minutes）. There was a ten-minute time interval between the two training procedures. The training treatment was performed in a quiet and dark environment. Visual acuity and recovery of visual function were tested every month. Original training procedure was continued or adjusted according to the results of visual function. MAIN OUTCOME MEASURES： Visual function change; relationship of curative effects and curative time. RESULTS： A total of 125 amblyopia children were included in the final analysis. The total efficiency of perceptual learning for treating amblyopia in children was 75.2%. Visual acuity began to greatly increase 3 months after treatment （P 〈 0.05）. Visual acuity was best corrected from 0.60 ± 0.23 before treatment to 0.86 ± 0.26 after treatment （P 〈 0.05）. The mean time to reach improved levels with curative effects was （2.82 ± 1.30） months, and to reach a basically cured level was （2.87 ±1.40） months. Percentage of improved visual acuity was the highest [98% （39/40）] in children that received 3 months of treatment and the lowest [55% （31/56）] in children that received 1 month of treatment （P 〈 0.05）. The percentage of basically cured levels with curative effects increased with length of learning time and was the greatest in children that received 4 months of treatment [67% （31/46）, P 〈 0.05]. CONCLUSION： Perceptual learning rapidly and remarkably improves visual function of amblyopia children; however, the curative effects are first apparent two and three months after intervention.

Recent development of perceptual image hashing

The easy generation, storage, transmission and reproduction of digital images have caused serious abuse and security problems. Assurance of the rightful ownership, integrity, and authenticity is a major concern to the academia as well as the industry. On the other hand, efficient search of the huge amount of images has become a great challenge. Image hashing is a technique suitable for use in image authentication and content based image retrieval （CBIR）. In this article, we review some representative image hashing techniques proposed in the recent years, with emphases on how to meet the conflicting requirements of perceptual robustness and security. Following a brief introduction to some earlier methods, we focus on a typical two-stage structure and some geometric-distortion resilient techniques. We then introduce two image hashing approaches developed in our own research, and reveal security problems in some existing methods due to the absence of secret keys in certain stage of the image feature extraction, or availability of a large quantity of images, keys, or the hash function to the adversary. More research efforts are needed in developing truly robust and secure image hashing techniques.

NEW VISUAL PERCEPTUAL POOLING STRATEGY FOR IMAGE QUALITY ASSESSMENT

Most of Image Quality Assessment (IQA) metrics consist of two processes. In the first process, quality map of image is measured locally. In the second process, the last quality score is converted from the quality map by using the pooling strategy. The first process had been made effective and significant progresses, while the second process was always done in simple ways. In the second process of the pooling strategy, the optimal perceptual pooling weights should be determined and computed according to Human Visual System (HVS). Thus, a reliable spatial pooling mathematical model based on HVS is an important issue worthy of study. In this paper, a new Visual Perceptual Pooling Strategy (VPPS) for IQA is presented based on contrast sensitivity and luminance sensitivity of HVS. Experimental results with the LIVE database show that the visual perceptual weights, obtained by the proposed pooling strategy, can effectively and significantly improve the performances of the IQA metrics with Mean Structural SIMilarity (MSSIM) or Phase Quantization Code (PQC). It is confirmed that the proposed VPPS demonstrates promising results for improving the performances of existing IQA metrics.

Polarization visualization for low-irradiance regions by perceptually uniform color space

Currently,polarization visualization strategies are accomplished by mapping polarization information into a perceptually uniform color appearance model CAM02-UCS.However,the deviation of the CAM02-UCS space from the lightness prediction results in an inaccurate match between the polarization information and the perceptual information.In this paper,we propose a novel polarization visualization strategy based on the perceptual uniform space Jzazbz.The polarization visualization be completed by placing the polarization information into the lightness Jz,colorfulness Cz and hue angle hz channels of the Jzazbz space.The experimental results show that the proposed method can significantly improve the lightness of the low irradiance and high polarization region,hence more polarization information can be sensed by human visual system.

Perceptual Gradient Similarity Deviation for Full Reference Image Quality Assessment

Perceptual image quality assessment(IQA)is one of the most indispensable yet challenging problems in image processing and computer vision.It is quite necessary to develop automatic and efficient approaches that can accurately predict perceptual image quality consistently with human subjective evaluation.To further improve the prediction accuracy for the distortion of color images,in this paper,we propose a novel effective and efficient IQA model,called perceptual gradient similarity deviation(PGSD).Based on the gradient magnitude similarity,we proposed a gradient direction selection method to automatically determine the pixel-wise perceptual gradient.The luminance and chrominance channels are both took into account to characterize the quality degradation caused by intensity and color distortions.Finally,a multi-scale strategy is utilized and pooled with different weights to incorporate image details at different resolutions.Experimental results on LIVE,CSIQ and TID2013 databases demonstrate the superior performances of the proposed algorithm.

Defend Against Adversarial Samples by Using Perceptual Hash

Image classifiers that based on Deep Neural Networks(DNNs)have been proved to be easily fooled by well-designed perturbations.Previous defense methods have the limitations of requiring expensive computation or reducing the accuracy of the image classifiers.In this paper,we propose a novel defense method which based on perceptual hash.Our main goal is to destroy the process of perturbations generation by comparing the similarities of images thus achieve the purpose of defense.To verify our idea,we defended against two main attack methods(a white-box attack and a black-box attack)in different DNN-based image classifiers and show that,after using our defense method,the attack-success-rate for all DNN-based image classifiers decreases significantly.More specifically,for the white-box attack,the attack-success-rate is reduced by an average of 36.3%.For the black-box attack,the average attack-success-rate of targeted attack and non-targeted attack has been reduced by 72.8%and 76.7%respectively.The proposed method is a simple and effective defense method and provides a new way to defend against adversarial samples.

A NEW ACOUSTIC PERCEPTUALl MODEL

On the basis of psychological acoustic theories and experiments, this paper proposes an acoustic model which is based on acoustic perceptual feature. Compared with the physiological acoustics based acoustic model, this model is more suitable to represent human’s perceptual features of continuous speech, so it is suitable for recognition of continuous speech.

Perceptual Contrast-Based Image Fusion: A Variational Approach

本地对比，或变化，在主要是从来源图象保存重要信息到熔化结果的图象熔化起一个重要作用。威伯的法律告诉我们在不同背景下面的一样的变化将引起不同感性的感情，因此，一个理想的图象处理器不得不考虑视觉心理学和心物学的效果。这份报纸考虑人的视觉系统(HVS ) 的性质并且从每幅来源图象把量的感性的变化转移到结果。把 just-noticeable-difference (JND ) 用作测量， multiband 图象的感性的对比作为一个目标被获得。我们构造一个功能的极值问题发现一幅单身的乐队图象，或熔化结果，它有最近感性的对比到目标一个。经由变化途径， Euler-Lagrange 方程被导出，并且一次坡度降下重复被采用。试验性的结果证明这个方法感性地好。

Campus Landscape Sculpture Construction Based on Perceptual Engineering: Taking Three Polytechnic Universities in Chengdu as an Example

Campus is a direct carrier for higher education and culture communication. Good landscape sculpture can produce great cohesion and impetus, and it can play an important role in campus landscape construction and cultural communication. Based on the premise of constructing a high-level experience campus culture, this paper analyzes and studies the landscape sculptures of three polytechnic universities in Chengdu from the perspective of perceptual engineering, and analyzes the historical inheritance and school-running characteristics of the three universities, to compare the campus spirit conveyed by the sculptures and the perceptual cognition felt by the teachers and students. The differences between the existing campus landscape sculptures and the campus culture construction goal are obtained, and the corresponding campus landscape sculpture promotion strategy is proposed.

Task analysis approach based on perceptual control theory

Based on perceptual control theory,a task analysis approach is proposed to describe more accurately user tasks in dynamic environments,which is of more powerful and flexible descriptive ability. Theoretically,a task meta model is established to describe the interactive process in an individual,dynamic,and flexible way.Methodologically,an implementation framework is illustrated to map the user-oriented description into implementation-oriented models,which will be as a technical tool to transform from a task model to a user interface prototype.

Perceptual Quality Assessment of Omnidirectional Images:Subjective Experiment and Objective Model Evaluation

Virtual reality(VR) environment can provide immersive experience to viewers.Under the VR environment, providing a good quality of experience is extremely important.Therefore, in this paper, we present an image quality assessment(IQA) study on omnidirectional images. We first build an omnidirectional IQA(OIQA) database, including 16 source images with their corresponding 320 distorted images. We add four commonly encountered distortions. These distortions are JPEG compression, JPEG2000 compression, Gaussian blur, and Gaussian noise. Then we conduct a subjective quality evaluation study in the VR environment based on the OIQA database. Considering that visual attention is more important in VR environment, head and eye movement data are also tracked and collected during the quality rating experiments. The 16 raw and their corresponding distorted images,subjective quality assessment scores, and the head-orientation data and eye-gaze data together constitute the OIQA database. Based on the OIQA database, we test some state-of-the-art full-reference IQA(FR-IQA) measures on equirectangular format or cubic formatomnidirectional images. The results show that applying FR-IQA metrics on cubic format omnidirectional images could improve their performance. The performance of some FR-IQA metrics combining the saliency weight of three different types are also tested based on our database. Some new phenomena different from traditional IQA are observed.

WATERMARKING WITH REFINED PERCEPTUAL MASKING TUNED FOR SYNTHETIC APERTURE RADAR IMAGES

A watermarking scheme designed for remote sensing images needs to meet the same demand of both invisibility as for ordinary digital images. Due to specific perceptual characteristics of Synthetic Aperture Radar(SAR) images, the watermarking algorithms with consideration of Human Vision System(HVS) modeling from optical images give poor performance when applied on SAR images. This paper examines a variety of factors affecting the noise sensitivity, and further proposes a refined pixel-wise masking approach for watermarking on SAR images. The proposed approach is applied on logarithmic transformed SAR images, and has increased the acceptable watermark embedding strength by about 6 dB to 10 dB while achieving the same levels of watermarked image visual quality. Experimental results show that this approach enhanced the perceptual invisibility of watermarking based on wavelet decomposition.

Mathematical Model of Embodied Symbols: Cognition and Perceptual Symbol System

A mathematical model of perceptual symbol system is developed. This development requires new mathematical methods of dynamic logic (DL), which have overcome limitations of classical artificial intelligence and connectionist approaches. The paper discusses these past limitations, relates them to combinatorial complexity (exponential explosion) of algorithms in the past, and relates it further to the static nature of classical logic. DL is a process-logic;its salient property is evolution of vague representations into crisp. We first consider one aspect of PSS: situation learning from object perceptions. Next DL is related to PSS mechanisms of concepts, simulators, grounding, embodiment, productiveity, binding, recursion, and to the mechanisms relating embodied-grounded and amodal symbols. We discuss DL capability for modeling cognition on multiple levels of abstraction. PSS is extended toward interaction between cognition and language. Experimental predictions of the theory are discussed. They might influence experimental psychology and impact future theoretical developments in cognitive science, including knowledge representation, and mechanisms of interaction between perception, cognition, and language. All mathematical equations are also discussed conceptually, so mathematical understanding is not required. Experimental evidence for DL and PSS in brain imaging is discussed as well as future research directions.

Genetic Algorithms for Perceptual Codes Extraction

In this work a new technique for global perceptual codes (GPCs) extraction using genetic algorithms (GA) is presented. GAs are employed to extract the GPCs in order to reduce the original number of features and to provide meaningful representations of the original data. In this technique the GPCs are build from a certain combination of elementary perceptual codes (EPCs) which are provided by the Beta-elliptic model for the generation of complex handwriting movements. Indeed, in this model each script is modelled by a set of elliptic arcs. We associate to each arc an EPC. In the proposed technique we defined four types of EPCs. The GPCs can be formed by many possible combinations of EPCs depending on their number and types. So that, the problem of choosing the right combination for each GPC can be regarded as a global optimization problem which is treated in this work using the GAs. Several simulation examples are presented to evaluate the interest and the efficiency of the proposed technique.

Implications of rare neurological disorders and perceptual errors in natural and synthetic consciousness

Recent theories on natural and synthetic consciousness overlook the geometric structure necessary for awareness of 3-dimensional space, as strikingly illustrated by left-neglect disorder. Furthermore, awareness of 3-dimensional space entails some surprisingly tenacious optical illusions, as demonstrated by an experiment in the text. Awareness of linear time is also crucial and complex. As a consequence, synthetic consciousness cannot be realized by simply intercomnecting a large number of electronic circuits constructed from ordinary chips and transistors. Since consciousness is a subjective experience, there is no sufficient condition for consciousness that can be experimentally confirmed. The most we can hope for is agreement on the necessary conditions for consciousness. Toward that end, this paper reviews some relevant clinical phenomena.

The Dimensions and Perceptual Meaning of Chinese New Year Painting as a Form of Visual Encirclement

As mankind was one kind of aesthetic species,the visual study of Marxist philosophy has profound enlightenment in understanding the New Year paintings' visual meaning,form,development,cultivation,and features etc.In essence,Chinese folk New Year paintings is a visual expression,its nature of being pasted at home makes it a visual encirclement for the Chinese people,this vision encirclement in the home space gradually expands,constitutes a spiritual home with different cultural space,living environment,image schema,and secular and religious faith scope,in this visual encirclement,people's home life achieves the satisfaction,peace and self–comfort in diversity.The"childrenization"of New Year paintings reveals a close relationship between the immature of folk art and the original art as human childhood,and from the both aspects of form and content reflects the visual encirclement is actually a kind of siege with cultural significance,this siege has multiple levels in value ideas,historical tradition,ethical order and life knowledge,aesthetic taste and so on,makes us have a new aesthetic anthropology on the New Year paintings.

Perceptually Lossless Compression for Mastcam Multispectral Images: A Comparative Study

The two mast cameras, Mastcams, onboard Mars rover Curiosity are multispectral imagers with nine bands in each. Currently, the images are compressed losslessly using JPEG, which can achieve only two to three times of compression. We present a comparative study of four approaches to compressing multispectral Mastcam images. The first approach is to divide the nine bands into three groups with each group having three bands. Since the multispectral bands have strong correlation, we treat the three groups of images as video frames. We call this approach the Video approach. The second approach is to compress each group separately and we call it the split band (SB) approach. The third one is to apply a two-step approach in which the first step uses principal component analysis (PCA) to compress a nine-band image cube to six bands and a second step compresses the six PCA bands using conventional codecs. The fourth one is to apply PCA only. In addition, we also present subjective and objective assessment results for compressing RGB images because RGB images have been used for stereo and disparity map generation. Five well-known compression codecs, including JPEG, JPEG-2000 (J2K), X264, X265, and Daala in the literature, have been applied and compared in each approach. The performance of different algorithms was assessed using four well-known performance metrics. Two are conventional and another two are known to have good correlation with human perception. Extensive experiments using actual Mastcam images have been performed to demonstrate the various approaches. We observed that perceptually lossless compression can be achieved at 10:1 compression ratio. In particular, the performance gain of the SB approach with Daala is at least 5 dBs in terms peak signal-to-noise ratio (PSNR) at 10:1 compression ratio over that of JPEG. Subjective comparisons also corroborated with the objective metrics in that perceptually lossless compression can be achieved even at 20 to 1 compression.

Perceptual hashing algorithms benchmark suite

Numerous perceptual hashing algorithms have been developed for identification and verification of multimedia objects in recent years. Many application schemes have been adopted for various commercial objects. Developers and users are looking for a benchmark tool to compare and evaluate their current algorithms or technologies. In this paper, a novel benchmark platform is presented. PHABS provides an open framework and lets its users define their own test strategy, perform tests, collect and analyze test data. With PHABS, various performance parameters of algorithms can be tested, and different algorithms or algorithms with different parameters can be evaluated and compared easily.