Advancing Wound Filling Extraction on 3D Faces:An Auto-Segmentation and Wound Face Regeneration Approach

Facial wound segmentation plays a crucial role in preoperative planning and optimizing patient outcomes in various medical applications.In this paper,we propose an efficient approach for automating 3D facial wound segmentation using a two-stream graph convolutional network.Our method leverages the Cir3D-FaIR dataset and addresses the challenge of data imbalance through extensive experimentation with different loss functions.To achieve accurate segmentation,we conducted thorough experiments and selected a high-performing model from the trainedmodels.The selectedmodel demonstrates exceptional segmentation performance for complex 3D facial wounds.Furthermore,based on the segmentation model,we propose an improved approach for extracting 3D facial wound fillers and compare it to the results of the previous study.Our method achieved a remarkable accuracy of 0.9999993% on the test suite,surpassing the performance of the previous method.From this result,we use 3D printing technology to illustrate the shape of the wound filling.The outcomes of this study have significant implications for physicians involved in preoperative planning and intervention design.By automating facial wound segmentation and improving the accuracy ofwound-filling extraction,our approach can assist in carefully assessing and optimizing interventions,leading to enhanced patient outcomes.Additionally,it contributes to advancing facial reconstruction techniques by utilizing machine learning and 3D bioprinting for printing skin tissue implants.Our source code is available at https://github.com/SIMOGroup/WoundFilling3D.

Drishti Paint 3.2:a new open-source tool for both 2D and 3D segmentation

X-ray computed tomography(CT)has been an important technology in paleontology for several decades.It helps researchers to acquire detailed anatomical structures of fossils non-destructively.Despite its widespread application,developing an efficient and user-friendly method for segmenting CT data continues to be a formidable challenge in the field.Most CT data segmentation software operates on 2D interfaces,which limits flexibility for real-time adjustments in 3D segmentation.Here,we introduce Curves Mode in Drishti Paint 3.2,an open-source tool for CT data segmentation.Drishti Paint 3.2 allows users to manually or semi-automatically segment the CT data in both 2D and 3D environments,providing a novel solution for revisualizing CT data in paleontological studies.

A network lightweighting method for difficult segmentation of 3D medical images

Currently,deep learning is widely used in medical image segmentation and has achieved good results.However,3D medical image segmentation tasks with diverse lesion characters,blurred edges,and unstable positions require complex networks with a large number of parameters.It is computationally expensive and results in high requirements on equipment,making it hard to deploy the network in hospitals.In this work,we propose a method for network lightweighting and applied it to a 3D CNN based network.We experimented on a COVID-19 lesion segmentation dataset.Specifically,we use three cascaded one-dimensional convolutions to replace a 3D convolution,and integrate instance normalization with the previous layer of one-dimensional convolutions to accelerate network inference.In addition,we simplify test-time augmentation and deep supervision of the network.Experiments show that the lightweight network can reduce the prediction time of each sample and the memory usage by 50%and reduce the number of parameters by 60%compared with the original network.The training time of one epoch is also reduced by 50%with the segmentation accuracy dropped within the acceptable range.

3D Instance Segmentation Using Deep Learning on RGB-D Indoor Data

3D object recognition is a challenging task for intelligent and robot systems in industrial and home indoor environments.It is critical for such systems to recognize and segment the 3D object instances that they encounter on a frequent basis.The computer vision,graphics,and machine learning fields have all given it a lot of attention.Traditionally,3D segmentation was done with hand-crafted features and designed approaches that didn’t achieve acceptable performance and couldn’t be generalized to large-scale data.Deep learning approaches have lately become the preferred method for 3D segmentation challenges by their great success in 2D computer vision.However,the task of instance segmentation is currently less explored.In this paper,we propose a novel approach for efficient 3D instance segmentation using red green blue and depth(RGB-D)data based on deep learning.The 2D region based convolutional neural networks(Mask R-CNN)deep learning model with point based rending module is adapted to integrate with depth information to recognize and segment 3D instances of objects.In order to generate 3D point cloud coordinates(x,y,z),segmented 2D pixels(u,v)of recognized object regions in the RGB image are merged into(u,v)points of the depth image.Moreover,we conducted an experiment and analysis to compare our proposed method from various points of view and distances.The experimentation shows the proposed 3D object recognition and instance segmentation are sufficiently beneficial to support object handling in robotic and intelligent systems.

Deep Learning-Based 3D Instance and Semantic Segmentation: A Review

The process of segmenting point cloud data into several homogeneous areas with points in the same region having the same attributes is known as 3D segmentation.Segmentation is challenging with point cloud data due to substantial redundancy,fluctuating sample density and lack of apparent organization.The research area has a wide range of robotics applications,including intelligent vehicles,autonomous mapping and navigation.A number of researchers have introduced various methodologies and algorithms.Deep learning has been successfully used to a spectrum of 2D vision domains as a prevailing A.I.methods.However,due to the specific problems of processing point clouds with deep neural networks,deep learning on point clouds is still in its initial stages.This study examines many strategies that have been presented to 3D instance and semantic segmentation and gives a complete assessment of current developments in deep learning-based 3D segmentation.In these approaches’benefits,draw backs,and design mechanisms are studied and addressed.This study evaluates the impact of various segmentation algorithms on competitiveness on various publicly accessible datasets,as well as the most often used pipelines,their advantages and limits,insightful findings and intriguing future research directions.

A novel technique of three-dimensional reconstruction segmentation and analysis for sliced images of biological tissues

A novel technique of three-dimensional (3D) reconstruction, segmentation, display and analysis of series slices of images including microscopic wide field optical sectioning by deconvolution method, cryo-electron microscope slices by Fou-rier-Bessel synthesis and electron tomography (ET), and a series of computed tomography (CT) was developed to perform si-multaneous measurement on the structure and function of biomedical samples. The paper presents the 3D reconstruction seg-mentation display and analysis results of pollen spore, chaperonin, virus, head, cervical bone, tibia and carpus. At the same time, it also puts forward some potential applications of the new technique in the biomedical realm.

Research on Automatic Elimination of Laptop Computer in Security CT Images Based on Projection Algorithm and YOLOv7-Seg

In civil aviation security screening, laptops, with their intricate structural composition, provide the potential for criminals to conceal dangerous items. Presently, the security process necessitates passengers to individually present their laptops for inspection. The paper introduced a method for laptop removal. By combining projection algorithms with the YOLOv7-Seg model, a laptop’s three views were generated through projection, and instance segmentation of these views was achieved using YOLOv7-Seg. The resulting 2D masks from instance segmentation at different angles were employed to reconstruct a 3D mask through angle restoration. Ultimately, the intersection of this 3D mask with the original 3D data enabled the successful extraction of the laptop’s 3D information. Experimental results demonstrated that the fusion of projection and instance segmentation facilitated the automatic removal of laptops from CT data. Moreover, higher instance segmentation model accuracy leads to more precise removal outcomes. By implementing the laptop removal functionality, the civil aviation security screening process becomes more efficient and convenient. Passengers will no longer be required to individually handle their laptops, effectively enhancing the efficiency and accuracy of security screening.

C1M2:a universal algorithm for 3D instance segmentation,annotation,and quantification of irregular cells

Cell instance segmentation is a fundamental task for many biological applications,especially for packed cells in three-dimensional(3D)microscope images that can fully display cellular morphology.Image processing algorithms based on neural networks and feature engineering have enabled great progress in two-dimensional(2D)instance segmentation.However,current methods cannot achieve high segmentation accuracy for irregular cells in 3D images.In this study,we introduce a universal,morphology-based 3D instance segmentation algorithm called Crop Once Merge Twice(C1M2),which can segment cells from a wide range of image types and does not require nucleus images.C1M2 can be extended to quantify the fluorescence intensity of fluorescent proteins and antibodies and automatically annotate their expression levels in individual cells.Our results suggest that C1M2 can serve as a tissue cytometry for 3D histopathological assays by quantifying fluorescence intensity with spatial localization and morphological information.

Semantic segmentation-assisted instance feature fusion for multi-level 3D part instance segmentation

Recognizing 3D part instances from a 3D point cloud is crucial for 3D structure and scene understanding.Several learning-based approaches use semantic segmentation and instance center prediction as training tasks and fail to further exploit the inherent relationship between shape semantics and part instances.In this paper,we present a new method for 3D part instance segmentation.Our method exploits semantic segmentation to fuse nonlocal instance features,such as center prediction,and further enhances the fusion scheme in a multi-and cross-level way.We also propose a semantic region center prediction task to train and leverage the prediction results to improve the clustering of instance points.Our method outperforms existing methods with a large-margin improvement in the PartNet benchmark.We also demonstrate that our feature fusion scheme can be applied to other existing methods to improve their performance in indoor scene instance segmentation tasks.

Defect detection and repair algorithm for structures generated by topology optimization based on 3D hierarchical fully convolutional network

Customized 3D-printed structural parts are widely used in surgical robotics.To satisfy the mechanical properties and kinematic functions of these structural parts,a topology optimization technique is adopted to obtain the optimal structural layout while meeting the constraints and objectives.However,topology optimization currently faces some practical challenges that must be addressed,such as ensuring that structures do not have significant defects when converted to additive manufacturing models.To address this problem,we designed a 3D hierarchical fully convolutional network(FCN)to predict the precise position of the defective structures.Based on the prediction results,an effective repair strategy is adopted to repair the defective structure.A series of experiments is conducted to demonstrate the effectiveness of our approach.Compared to the 2D fully convolutional network and the rule-based detection method,our approach can accurately capture most defect structures and achieve 89.88%precision and 95.59%recall.Furthermore,we investigate the impact of different ways to increase the receptive field of our model,as well as the trade-off between different defect-repairing strategies.The results of the experiment demonstrate that the hierarchical structure,which increases the receptive field,can substantially improve the defect detection performance.To the best of our knowledge,this paper is the first to investigate 3D defect prediction and repair for topology optimization in conjunction with deep learning algorithms,providing practical tools and new perspectives for the subsequent development of topology optimization techniques.

ArthroNet:a monocular depth estimation technique with 3D segmented maps for knee arthroscopy

Background Lack of depth perception from medical imaging systems is one of the long-standing technological limitations of minimally invasive surgeries.The ability to visualize anatomical structures in 3D can improve conventional arthroscopic surgeries,as a full 3D semantic representation of the surgical site can directly improve surgeons’ability.It also brings the possibility of intraoperative image registration with preoperative clinical records for the development of semi-autonomous,and fully autonomous platforms.This study aimed to present a novel monocular depth prediction model to infer depth maps from a single-color arthroscopic video frame.Methods We applied a novel technique that provides the ability to combine both supervised and self-supervised loss terms and thus eliminate the drawback of each technique.It enabled the estimation of edge-preserving depth maps from a single untextured arthroscopic frame.The proposed image acquisition technique projected artificial textures on the surface to improve the quality of disparity maps from stereo images.Moreover,following the integration of the attention-ware multi-scale feature extraction technique along with scene global contextual constraints and multiscale depth fusion,the model could predict reliable and accurate tissue depth of the surgical sites that complies with scene geometry.Results A total of 4,128 stereo frames from a knee phantom were used to train a network,and during the pre-trained stage,the network learned disparity maps from the stereo images.The fine-tuned training phase uses 12,695 knee arthroscopic stereo frames from cadaver experiments along with their corresponding coarse disparity maps obtained from the stereo matching technique.In a supervised fashion,the network learns the left image to the disparity map transformation process,whereas the self-supervised loss term refines the coarse depth map by minimizing reprojection,gradients,and structural dissimilarity loss.Together,our method produces high-quality 3D maps with minimum re-projection loss that are 0.0004132(structural similarity index),0.00036120156(L1 error distance)and 6.591908×10^(−5)(L1 gradient error distance).Conclusion Machine learning techniques for monocular depth prediction is studied to infer accurate depth maps from a single-color arthroscopic video frame.Moreover,the study integrates segmentation model hence,3D segmented maps are inferred that provides extended perception ability and tissue awareness.

Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method

A method based on 3D videos is proposed for multi-target segmentation and tracking with a moving viewing system. A spatiotemporal energy functional is built up to perform motion segmentation and estimation simultaneously. To overcome the limitation of the local minimum problem with the level set method, a convex relaxation method is applied to the 3D spatiotemporal segmentation model. The relaxed convex model is independent of the initial condition. A primal-dual algorithm is used to improve computational efficiency. Several indoor experiments show the validity of the proposed method.

CT-based Individualized Medical Implant Design

Most implantation cases are implemented using implants selected from the available standard set, but in some cases, only those implants conforming to individual patient's skeletal morphology can serve the purpose. This paper proposes a new approach to design and fabricate custom-made exact-fit medical implants. With a real surgical case as the example,technical design details are presented; and three algorithms are given respectively for segmentation based on object features, triangular mesh defragmentation and mesh cutting.

The use of the greater trochanter marker in the thigh segment model:Implications for hip and knee frontal and transverse plane motion

Background:The greater trochanter marker is commonly used in 3-dimensional(3D) models;however,its influence on hip and knee kinematics during gait is unclear.Understanding the influence of the greater trochanter marker is important when quantifying frontal and transverse plane hip and knee kinematics,parameters which are particularly relevant to investigate in individuals with conditions such as patellofemoral pain,knee osteoarthritis,anterior cruciate ligament(ACL) injury,and hip pain.The aim of this study was to evaluate the effect of including the greater trochanter in the construction of the thigh segment on hip and knee kinematics during gait.Methods:3D kinematics were collected in 19 healthy subjects during walking using a surface marker system.Hip and knee angles were compared across two thigh segment definitions(with and without greater trochanter) at two time points during stance:peak knee flexion(PKF) and minimum knee flexion(Min KF).Results:Hip and knee angles differed in magnitude and direction in the transverse plane at both time points.In the thigh model with the greater trochanter the hip was more externally rotated than in the thigh model without the greater trochanter(PKF:-9.34°± 5.21° vs.1.40°± 5.22°,Min KF:-5.68°± 4.24° vs.5.01°± 4.86°;p < 0.001).In the thigh model with the greater trochanter,the knee angle was more internally rotated compared to the knee angle calculated using the thigh definition without the greater trochanter(PKF:14.67°± 6.78° vs.4.33°± 4.18°,Min KF:10.54°± 6.71° vs.-0.01°± 2.69°;p < 0.001).Small but significant differences were detected in the sagittal and frontal plane angles at both time points(p < 0.001).Conclusion:Hip and knee kinematics differed across different segment definitions including or excluding the greater trochanter marker,especially in the transverse plane.Therefore when considering whether to include the greater trochanter in the thigh segment model when using a surface markers to calculate 3D kinematics for movement assessment,it is important to have a clear understanding of the effect of different marker sets and segment models in use.

Network level pavement evaluation with 1 mm 3D survey system

The latest iteration of PaveVision3D Ultra can obtain true 1 mm resolution 3D data at full- lane coverage in all 3 directions at highway speed up to 60 mph. This paper introduces the PaveVision3D Ultra technology for rapid network level pavement survey on approximately 1280 center miles of Oklahoma interstate highways. With sophisticated automated distress analyzer （ADA） software interface, the collected 1 mm 3D data provide Oklahoma Department of Transportation （ODOT） with comprehensive solutions for automated eval- uation of pavement surface including longitudinal profile for roughness, transverse profile for rutting, predicted hydroplaning speed for safety analysis, and cracking and various surface defects for distresses. The pruned exact linear time （PELT） method, an optimal partitioning algorithm, is implemented to identify change points and dynamically deter- mine homogeneous segments so as to assist ODOT effectively using the available 1 mm 3D pavement surface condition data for decision-making. The application of 1 mm 3D laser imaging technology for network survey is unprecedented. This innovative technology allows highway agencies to access its options in using the 1 mm 3D system for its design and management purposes, particularly to meet the data needs for pavement management system （PMS）, pavement ME design and highway performance monitoring system （HPMS）.