Direct volume rendering(DVR)is a technique that emphasizes structures of interest(SOIs)within a volume visually,while simultaneously depicting adjacent regional information,e.g.,the spatial location of a structure con...Direct volume rendering(DVR)is a technique that emphasizes structures of interest(SOIs)within a volume visually,while simultaneously depicting adjacent regional information,e.g.,the spatial location of a structure concerning its neighbors.In DVR,transfer function(TF)plays a key role by enabling accurate identification of SOIs interactively as well as ensuring appropriate visibility of them.TF generation typically involves non-intuitive trial-and-error optimization of rendering parameters,which is time-consuming and inefficient.Attempts at mitigating this manual process have led to approaches that make use of a knowledge database consisting of pre-designed TFs by domain experts.In these approaches,a user navigates the knowledge database to find the most suitable pre-designed TF for their input volume to visualize the SOIs.Although these approaches potentially reduce the workload to generate the TFs,they,however,require manual TF navigation of the knowledge database,as well as the likely fine tuning of the selected TF to suit the input.In this work,we propose a TF design approach,CBR-TF,where we introduce a new content-based retrieval(CBR)method to automatically navigate the knowledge database.Instead of pre-designed TFs,our knowledge database contains volumes with SOI labels.Given an input volume,our CBR-TF approach retrieves relevant volumes(with SOI labels)from the knowledge database;the retrieved labels are then used to generate and optimize TFs of the input.This approach largely reduces manual TF navigation and fine tuning.For our CBR-TF approach,we introduce a novel volumetric image feature which includes both a local primitive intensity profile along the SOIs and regional spatial semantics available from the co-planar images to the profile.For the regional spatial semantics,we adopt a convolutional neural network to obtain high-level image feature representations.For the intensity profile,we extend the dynamic time warping technique to address subtle alignment differences between similar profiles(SOIs).Finally,we propose a two-stage CBR scheme to enable the use of these two different feature representations in a complementary manner,thereby improving SOI retrieval performance.We demonstrate the capabilities of our CBR-TF approach with comparison with a conventional approach in visualization,where an intensity profile matching algorithm is used,and also with potential use-cases in medical volume visualization.展开更多
In this paper,we present a novel ocean visualization framework,which focuses on analyzing multidimensional and spatiotemporal ocean data.GPU-based visualization methods are explored to effectively visualize ocean data...In this paper,we present a novel ocean visualization framework,which focuses on analyzing multidimensional and spatiotemporal ocean data.GPU-based visualization methods are explored to effectively visualize ocean data.An improved ray casting algorithm for heterogeneous multisection ocean volume data is presented.A two-layer spherical shell is taken as the ocean data proxy geometry,which enables oceanographers to obtain a real geographic background based on global terrain.An efficient ray sampling technique including an adaptive sampling technique and a preintegrated transfer function is proposed to achieve high-effectiveness and high-efficiency rendering.Moreover,an interactive transfer function is also designed to analyze the 3D structure of ocean temperature and salinity anomaly phenomena.Based on the framework,an integrated visualization system called i4Ocean is created.The visualization of ocean temperature and salinity anomalies extracted interactively by the transfer function is demonstrated.展开更多
The authors have applied a systems analysis approach to describe the musculoskeletal system as consisting of a stack of superimposed kinematic hier-archical segments in which each lower segment tends to transfer its m...The authors have applied a systems analysis approach to describe the musculoskeletal system as consisting of a stack of superimposed kinematic hier-archical segments in which each lower segment tends to transfer its motion to the other superimposed segments. This segmental chain enables the derivation of both conscious perception and sensory control of action in space. This applied systems analysis approach involves the measurements of the complex motor behavior in order to elucidate the fusion of multiple sensor data for the reliable and efficient acquisition of the kinetic, kinematics and electromyographic data of the human spatial behavior. The acquired kinematic and related kinetic signals represent attributive features of the internal recon-struction of the physical links between the superimposed body segments. In-deed, this reconstruction of the physical links was established as a result of the fusion of the multiple sensor data. Furthermore, this acquired kinematics, kinetics and electromyographic data provided detailed means to record, annotate, process, transmit, and display pertinent information derived from the musculoskeletal system to quantify and differentiate between subjects with mobility-related disabilities and able-bodied subjects, and enabled an inference into the active neural processes underlying balance reactions. To gain insight into the basis for this long-term dependence, the authors have applied the fusion of multiple sensor data to investigate the effects of Cerebral Palsy, Multiple Sclerosis and Diabetic Neuropathy conditions, on biomechanical/neurophysiological changes that may alter the ability of the human loco-motor system to generate ambulation, balance and posture.展开更多
基金supported by the Korea Health Technology Research and Development Project through the Korea Health Industry Development Institute under Grant No.HI22C1651the National Research Foundation of Korea(NRF)under Grant No.2021R1F1A1059554the Culture,Sports and Tourism Research and Development Program through the Korea Creative Content Agency Grant funded by the Ministry of Culture,Sports and Tourism of Korea under Grant No.RS-2023-00227648.
文摘Direct volume rendering(DVR)is a technique that emphasizes structures of interest(SOIs)within a volume visually,while simultaneously depicting adjacent regional information,e.g.,the spatial location of a structure concerning its neighbors.In DVR,transfer function(TF)plays a key role by enabling accurate identification of SOIs interactively as well as ensuring appropriate visibility of them.TF generation typically involves non-intuitive trial-and-error optimization of rendering parameters,which is time-consuming and inefficient.Attempts at mitigating this manual process have led to approaches that make use of a knowledge database consisting of pre-designed TFs by domain experts.In these approaches,a user navigates the knowledge database to find the most suitable pre-designed TF for their input volume to visualize the SOIs.Although these approaches potentially reduce the workload to generate the TFs,they,however,require manual TF navigation of the knowledge database,as well as the likely fine tuning of the selected TF to suit the input.In this work,we propose a TF design approach,CBR-TF,where we introduce a new content-based retrieval(CBR)method to automatically navigate the knowledge database.Instead of pre-designed TFs,our knowledge database contains volumes with SOI labels.Given an input volume,our CBR-TF approach retrieves relevant volumes(with SOI labels)from the knowledge database;the retrieved labels are then used to generate and optimize TFs of the input.This approach largely reduces manual TF navigation and fine tuning.For our CBR-TF approach,we introduce a novel volumetric image feature which includes both a local primitive intensity profile along the SOIs and regional spatial semantics available from the co-planar images to the profile.For the regional spatial semantics,we adopt a convolutional neural network to obtain high-level image feature representations.For the intensity profile,we extend the dynamic time warping technique to address subtle alignment differences between similar profiles(SOIs).Finally,we propose a two-stage CBR scheme to enable the use of these two different feature representations in a complementary manner,thereby improving SOI retrieval performance.We demonstrate the capabilities of our CBR-TF approach with comparison with a conventional approach in visualization,where an intensity profile matching algorithm is used,and also with potential use-cases in medical volume visualization.
基金supported by the National Natural Science Foundation of China[grant number 42030406]the Marine Science&Technology Fund of Shandong Province for Pilot National Laboratory for Marine Science and Technology(Qingdao)[grant number 2018SDKJ0102]+2 种基金the National Key R&D Program of China[grant number 2016YFC1401008]the ESA-NRSCC Scientific Cooperation Project on Earth Observation Science and Applications:Dragon 5[grant number 58393]the Open Fund of Key Laboratory of Urban Land Resources Monitoring and Simulation,Ministry of Natural Resources[grant number KF-2020-05-085].
文摘In this paper,we present a novel ocean visualization framework,which focuses on analyzing multidimensional and spatiotemporal ocean data.GPU-based visualization methods are explored to effectively visualize ocean data.An improved ray casting algorithm for heterogeneous multisection ocean volume data is presented.A two-layer spherical shell is taken as the ocean data proxy geometry,which enables oceanographers to obtain a real geographic background based on global terrain.An efficient ray sampling technique including an adaptive sampling technique and a preintegrated transfer function is proposed to achieve high-effectiveness and high-efficiency rendering.Moreover,an interactive transfer function is also designed to analyze the 3D structure of ocean temperature and salinity anomaly phenomena.Based on the framework,an integrated visualization system called i4Ocean is created.The visualization of ocean temperature and salinity anomalies extracted interactively by the transfer function is demonstrated.
文摘The authors have applied a systems analysis approach to describe the musculoskeletal system as consisting of a stack of superimposed kinematic hier-archical segments in which each lower segment tends to transfer its motion to the other superimposed segments. This segmental chain enables the derivation of both conscious perception and sensory control of action in space. This applied systems analysis approach involves the measurements of the complex motor behavior in order to elucidate the fusion of multiple sensor data for the reliable and efficient acquisition of the kinetic, kinematics and electromyographic data of the human spatial behavior. The acquired kinematic and related kinetic signals represent attributive features of the internal recon-struction of the physical links between the superimposed body segments. In-deed, this reconstruction of the physical links was established as a result of the fusion of the multiple sensor data. Furthermore, this acquired kinematics, kinetics and electromyographic data provided detailed means to record, annotate, process, transmit, and display pertinent information derived from the musculoskeletal system to quantify and differentiate between subjects with mobility-related disabilities and able-bodied subjects, and enabled an inference into the active neural processes underlying balance reactions. To gain insight into the basis for this long-term dependence, the authors have applied the fusion of multiple sensor data to investigate the effects of Cerebral Palsy, Multiple Sclerosis and Diabetic Neuropathy conditions, on biomechanical/neurophysiological changes that may alter the ability of the human loco-motor system to generate ambulation, balance and posture.
