Visualization of isomorphism-synesthesia of colour and music

Music and colour,as human hearing and visual art,are closely related to human psychological feelings and symbolic associations.There is an isomorphic relationship between music and colour.The article uses the concept of“synesthesia”in psychology and the“co-construction”relationship in mathematics as a bridge,based on Kandinsky’s“inner sound”theory and Mallion’s“tone-colour system”,an interdisciplinary theoretical model of“timbre isomorphism synesthesia”(ISCM)is constructed.At the practical level,based on the ISCM theory,a set of timbre synesthesia visualization tools ASAH and visualization processes are designed,through music data input,graphics mapping visualization,colour mapping visualization,real-time interactive visualization,and finally output timbre synesthesia visualization works.In order to avoid the visual homogenization caused by algorithm design,ASHA has set up a custom editor,which emphasizes the individual differences and multi-sensory experience of tonal synesthesia visualization.

Novel Visualization Tool for Percutaneous Renal Puncture Training Using Augmented Reality Technology

We aim to develop a novel visualization tool for percutaneous renal puncture training based on augmented reality(AR)and compare the needle placement performance of this AR system with ultrasound-guidedfreehand navigation in phantoms.A head-mounted display-based AR navigation system was developed usingthe Unity3D software and Visual Studio to enable the overlay of the preoperative needle path and the complexanatomical structures onto a phantom in real time.The spatial location of the stationary phantom and the percutaneous instrument motion were traced by a Qualisys motion capture system.To evaluate the tracking accuracy,15 participants(7 males and 8 females)performed a single needle insertion using AR navigation(the number ofpunctures n=75)and ultrasound-guided freehand navigation(n=75).The needle placement error was measuredas the Euclidean distance between the actual needle tip and the virtual target by MicronTracker.All participantsdemonstrated a superior needle insertion efficiency when using the AR-assisted puncture method compared withthe ultrasound-guided freehand method.The needle insertion error of the ultrasound-guided method showed anincreased error compared with the AR method(5.54 mm±2.59 mm,4.34 mm±2.10 mm,respectively,p<0.05).The ultrasound-guided needle placements showed an increased time compared with the AR method(19.08 s±3.59 s,15.14 s±2.72 s,respectively,p<0.0001).Our AR training system facilitates the needle placement performance and solves hand-eye coordination problems.The system has the potential to increase efficiency andeffectiveness of percutaneous renal puncture training.

cFos-ANAB:A cFos-based Web Tool for Exploring Activated Neurons and Associated Behaviors

cFos is one of the most widely-studied genes in the field of neuroscience.Currently,there is no systematic database focusing on cFos in neuroscience.We developed a curated database-cFos-ANAB-a cFos-based web tool for exploring activated neurons and associated behaviors in rats and mice,comprising 398 brain nuclei and sub-nuclei,and five associated behaviors:pain,fear,feeding,aggression,and sexual behavior.Direct relationships among behaviors and nuclei(even cell types)under specific stimulating conditions were constructed based on cFos expression profiles extracted from original publications.Moreover,overlapping nuclei and sub-nuclei with potentially complex functions among different associated behaviors were emphasized,leading to results serving as important clues to the development of valid hypotheses for exploring as yet unknown circuits.Using the analysis function of cFos-ANAB,multi-layered pictures of networks and their relationships can quickly be explored depending on users’purposes.These features provide a useful tool and good reference for early exploration in neuroscience.The cFos-ANAB database is available at www.cfos-db.net.

AFExplorer:Visual analysis and interactive selection of audio features

Acoustic quality detection is vital in the manufactured products quality control field since it represents the conditions of machines or products.Recent work employed machine learning models in manufactured audio data to detect anomalous patterns.A major challenge is how to select applicable audio features to meliorate model’s accuracy and precision.To relax this challenge,we extract and analyze three audio feature types including Time Domain Feature,Frequency Domain Feature,and Cepstrum Feature to help identify the potential linear and non-linear relationships.In addition,we design a visual analysis system,namely AFExplorer,to assist data scientists in extracting audio features and selecting potential feature combinations.AFExplorer integrates four main views to present detailed distribution and relevance of the audio features,which helps users observe the impact of features visually in the feature selection.We perform the case study with AFExplore according to the ToyADMOS and MIMII Dataset to demonstrate the usability and effectiveness of the proposed system.

P-Lite: A study of parallel coordinate plot literacy

Visualization literacy,the ability to interpret and comprehend visual designs,is recognized as an essential skill by the visualization community.We identify and investigate barriers to comprehending parallel coordinates plots(PCPs),one of the advanced graphical representations for the display of multivariate and high-dimensional data.We develop a parallel coordinates literacy test with diverse images generated using popular PCP software tools.The test improves PCP literacy and evaluates the user’s literacy skills.We introduce an interactive educational tool that assists the teaching and learning of parallel coordinates by offering a more active learning experience.Using this pedagogical tool,we aim to advance novice users’parallel coordinates literacy skills.Based on the hypothesis that an interactive tool that links traditional Cartesian Coordinates with PCPs interactively will enhance PCP literacy further than static slides,we compare the learning experience using traditional slides with our novel software tool and investigate the efficiency of the educational software with an online,crowdsourced user-study.User-study results show that our pedagogical tool positively impacts a user’s PCP comprehension.