Deep matrix factorization(DMF)has been demonstrated to be a powerful tool to take in the complex hierarchical information of multi-view data(MDR).However,existing multiview DMF methods mainly explore the consistency o...Deep matrix factorization(DMF)has been demonstrated to be a powerful tool to take in the complex hierarchical information of multi-view data(MDR).However,existing multiview DMF methods mainly explore the consistency of multi-view data,while neglecting the diversity among different views as well as the high-order relationships of data,resulting in the loss of valuable complementary information.In this paper,we design a hypergraph regularized diverse deep matrix factorization(HDDMF)model for multi-view data representation,to jointly utilize multi-view diversity and a high-order manifold in a multilayer factorization framework.A novel diversity enhancement term is designed to exploit the structural complementarity between different views of data.Hypergraph regularization is utilized to preserve the high-order geometry structure of data in each view.An efficient iterative optimization algorithm is developed to solve the proposed model with theoretical convergence analysis.Experimental results on five real-world data sets demonstrate that the proposed method significantly outperforms stateof-the-art multi-view learning approaches.展开更多
BACKGROUND Cartilage defects are some of the most common causes of arthritis.Cartilage lesions caused by inflammation,trauma or degenerative disease normally result in osteochondral defects.Previous studies have shown...BACKGROUND Cartilage defects are some of the most common causes of arthritis.Cartilage lesions caused by inflammation,trauma or degenerative disease normally result in osteochondral defects.Previous studies have shown that decellularized extracellular matrix(ECM)derived from autologous,allogenic,or xenogeneic mesenchymal stromal cells(MSCs)can effectively restore osteochondral integrity.AIM To determine whether the decellularized ECM of antler reserve mesenchymal cells(RMCs),a xenogeneic material from antler stem cells,is superior to the currently available treatments for osteochondral defects.METHODS We isolated the RMCs from a 60-d-old sika deer antler and cultured them in vitro to 70%confluence;50 mg/mL L-ascorbic acid was then added to the medium to stimulate ECM deposition.Decellularized sheets of adipocyte-derived MSCs(aMSCs)and antlerogenic periosteal cells(another type of antler stem cells)were used as the controls.Three weeks after ascorbic acid stimulation,the ECM sheets were harvested and applied to the osteochondral defects in rat knee joints.RESULTS The defects were successfully repaired by applying the ECM-sheets.The highest quality of repair was achieved in the RMC-ECM group both in vitro(including cell attachment and proliferation),and in vivo(including the simultaneous regeneration of well-vascularized subchondral bone and avascular articular hyaline cartilage integrated with surrounding native tissues).Notably,the antler-stem-cell-derived ECM(xenogeneic)performed better than the aMSC-ECM(allogenic),while the ECM of the active antler stem cells was superior to that of the quiescent antler stem cells.CONCLUSION Decellularized xenogeneic ECM derived from the antler stem cell,particularly the active form(RMC-ECM),can achieve high quality repair/reconstruction of osteochondral defects,suggesting that selection of decellularized ECM for such repair should be focused more on bioactivity rather than kinship.展开更多
Deep learning has been a catalyst for a transformative revo-lution in machine learning and computer vision in the past decade.Within these research domains,methods grounded in deep learning have exhibited exceptional ...Deep learning has been a catalyst for a transformative revo-lution in machine learning and computer vision in the past decade.Within these research domains,methods grounded in deep learning have exhibited exceptional performance across a spectrum of tasks.The success of deep learning methods can be attributed to their capability to derive potent representations from data,integral for a myriad of downstream applications.These representations encapsulate the intrinsic structure,fea-tures,or latent variables characterising the underlying statistics of visual data.Despite these achievements,the challenge per-sists in effectively conducting representation learning of visual data with deep models,particularly when confronted with vast and noisy datasets.This special issue is a dedicated platform for researchers worldwide to disseminate their latest,high-quality articles,aiming to enhance readers'comprehension of the principles,limitations,and diverse applications of repre-sentation learning in computer vision.展开更多
Due to the structural dependencies among concurrent events in the knowledge graph and the substantial amount of sequential correlation information carried by temporally adjacent events,we propose an Independent Recurr...Due to the structural dependencies among concurrent events in the knowledge graph and the substantial amount of sequential correlation information carried by temporally adjacent events,we propose an Independent Recurrent Temporal Graph Convolution Networks(IndRT-GCNets)framework to efficiently and accurately capture event attribute information.The framework models the knowledge graph sequences to learn the evolutionary represen-tations of entities and relations within each period.Firstly,by utilizing the temporal graph convolution module in the evolutionary representation unit,the framework captures the structural dependency relationships within the knowledge graph in each period.Meanwhile,to achieve better event representation and establish effective correlations,an independent recurrent neural network is employed to implement auto-regressive modeling.Furthermore,static attributes of entities in the entity-relation events are constrained andmerged using a static graph constraint to obtain optimal entity representations.Finally,the evolution of entity and relation representations is utilized to predict events in the next subsequent step.On multiple real-world datasets such as Freebase13(FB13),Freebase 15k(FB15K),WordNet11(WN11),WordNet18(WN18),FB15K-237,WN18RR,YAGO3-10,and Nell-995,the results of multiple evaluation indicators show that our proposed IndRT-GCNets framework outperforms most existing models on knowledge reasoning tasks,which validates the effectiveness and robustness.展开更多
User representation learning is crucial for capturing different user preferences,but it is also critical challenging because user intentions are latent and dispersed in complex and different patterns of user-generated...User representation learning is crucial for capturing different user preferences,but it is also critical challenging because user intentions are latent and dispersed in complex and different patterns of user-generated data,and thus cannot be measured directly.Text-based data models can learn user representations by mining latent semantics,which is beneficial to enhancing the semantic function of user representations.However,these technologies only extract common features in historical records and cannot represent changes in user intentions.However,sequential feature can express the user’s interests and intentions that change time by time.But the sequential recommendation results based on the user representation of the item lack the interpretability of preference factors.To address these issues,we propose in this paper a novel model with Dual-Layer User Representation,named DLUR,where the user’s intention is learned based on two different layer representations.Specifically,the latent semantic layer adds an interactive layer based on Transformer to extract keywords and key sentences in the text and serve as a basis for interpretation.The sequence layer uses the Transformer model to encode the user’s preference intention to clarify changes in the user’s intention.Therefore,this dual-layer user mode is more comprehensive than a single text mode or sequence mode and can effectually improve the performance of recommendations.Our extensive experiments on five benchmark datasets demonstrate DLUR’s performance over state-of-the-art recommendation models.In addition,DLUR’s ability to explain recommendation results is also demonstrated through some specific cases.展开更多
Edge devices,due to their limited computational and storage resources,often require the use of compilers for program optimization.Therefore,ensuring the security and reliability of these compilers is of paramount impo...Edge devices,due to their limited computational and storage resources,often require the use of compilers for program optimization.Therefore,ensuring the security and reliability of these compilers is of paramount importance in the emerging field of edge AI.One widely used testing method for this purpose is fuzz testing,which detects bugs by inputting random test cases into the target program.However,this process consumes significant time and resources.To improve the efficiency of compiler fuzz testing,it is common practice to utilize test case prioritization techniques.Some researchers use machine learning to predict the code coverage of test cases,aiming to maximize the test capability for the target compiler by increasing the overall predicted coverage of the test cases.Nevertheless,these methods can only forecast the code coverage of the compiler at a specific optimization level,potentially missing many optimization-related bugs.In this paper,we introduce C-CORE(short for Clustering by Code Representation),the first framework to prioritize test cases according to their code representations,which are derived directly from the source codes.This approach avoids being limited to specific compiler states and extends to a broader range of compiler bugs.Specifically,we first train a scaled pre-trained programming language model to capture as many common features as possible from the test cases generated by a fuzzer.Using this pre-trained model,we then train two downstream models:one for predicting the likelihood of triggering a bug and another for identifying code representations associated with bugs.Subsequently,we cluster the test cases according to their code representations and select the highest-scoring test case from each cluster as the high-quality test case.This reduction in redundant testing cases leads to time savings.Comprehensive evaluation results reveal that code representations are better at distinguishing test capabilities,and C-CORE significantly enhances testing efficiency.Across four datasets,C-CORE increases the average of the percentage of faults detected(APFD)value by 0.16 to 0.31 and reduces test time by over 50% in 46% of cases.When compared to the best results from approaches using predicted code coverage,C-CORE improves the APFD value by 1.1% to 12.3% and achieves an overall time-saving of 159.1%.展开更多
Sparse representation is an effective data classification algorithm that depends on the known training samples to categorise the test sample.It has been widely used in various image classification tasks.Sparseness in ...Sparse representation is an effective data classification algorithm that depends on the known training samples to categorise the test sample.It has been widely used in various image classification tasks.Sparseness in sparse representation means that only a few of instances selected from all training samples can effectively convey the essential class-specific information of the test sample,which is very important for classification.For deformable images such as human faces,pixels at the same location of different images of the same subject usually have different intensities.Therefore,extracting features and correctly classifying such deformable objects is very hard.Moreover,the lighting,attitude and occlusion cause more difficulty.Considering the problems and challenges listed above,a novel image representation and classification algorithm is proposed.First,the authors’algorithm generates virtual samples by a non-linear variation method.This method can effectively extract the low-frequency information of space-domain features of the original image,which is very useful for representing deformable objects.The combination of the original and virtual samples is more beneficial to improve the clas-sification performance and robustness of the algorithm.Thereby,the authors’algorithm calculates the expression coefficients of the original and virtual samples separately using the sparse representation principle and obtains the final score by a designed efficient score fusion scheme.The weighting coefficients in the score fusion scheme are set entirely automatically.Finally,the algorithm classifies the samples based on the final scores.The experimental results show that our method performs better classification than conventional sparse representation algorithms.展开更多
The brain's extracellular matrix(ECM),which is comprised of protein and glycosaminoglycan(GAG)scaffolds,constitutes 20%-40% of the human brain and is considered one of the largest influencers on brain cell functio...The brain's extracellular matrix(ECM),which is comprised of protein and glycosaminoglycan(GAG)scaffolds,constitutes 20%-40% of the human brain and is considered one of the largest influencers on brain cell functioning(Soles et al.,2023).Synthesized by neural and glial cells,the brain's ECM regulates a myriad of homeostatic cellular processes,including neuronal plasticity and firing(Miyata et al.,2012),cation buffering(Moraws ki et al.,2015),and glia-neuron interactions(Anderson et al.,2016).Considering the diversity of functions,dynamic remodeling of the brain's ECM indicates that this understudied medium is an active participant in both normal physiology and neurological diseases.展开更多
Recent research advances in implicit neural representation have shown that a wide range of video data distributions are achieved by sharing model weights for Neural Representation for Videos(NeRV).While explicit metho...Recent research advances in implicit neural representation have shown that a wide range of video data distributions are achieved by sharing model weights for Neural Representation for Videos(NeRV).While explicit methods exist for accurately embedding ownership or copyright information in video data,the nascent NeRV framework has yet to address this issue comprehensively.In response,this paper introduces MarkINeRV,a scheme designed to embed watermarking information into video frames using an invertible neural network watermarking approach to protect the copyright of NeRV,which models the embedding and extraction of watermarks as a pair of inverse processes of a reversible network and employs the same network to achieve embedding and extraction of watermarks.It is just that the information flow is in the opposite direction.Additionally,a video frame quality enhancement module is incorporated to mitigate watermarking information losses in the rendering process and the possibility ofmalicious attacks during transmission,ensuring the accurate extraction of watermarking information through the invertible network’s inverse process.This paper evaluates the accuracy,robustness,and invisibility of MarkINeRV through multiple video datasets.The results demonstrate its efficacy in extracting watermarking information for copyright protection of NeRV.MarkINeRV represents a pioneering investigation into copyright issues surrounding NeRV.展开更多
Prior studies have demonstrated that deep learning-based approaches can enhance the performance of source code vulnerability detection by training neural networks to learn vulnerability patterns in code representation...Prior studies have demonstrated that deep learning-based approaches can enhance the performance of source code vulnerability detection by training neural networks to learn vulnerability patterns in code representations.However,due to limitations in code representation and neural network design,the validity and practicality of the model still need to be improved.Additionally,due to differences in programming languages,most methods lack cross-language detection generality.To address these issues,in this paper,we analyze the shortcomings of previous code representations and neural networks.We propose a novel hierarchical code representation that combines Concrete Syntax Trees(CST)with Program Dependence Graphs(PDG).Furthermore,we introduce a Tree-Graph-Gated-Attention(TGGA)network based on gated recurrent units and attention mechanisms to build a Hierarchical Code Representation learning-based Vulnerability Detection(HCRVD)system.This system enables cross-language vulnerability detection at the function-level.The experiments show that HCRVD surpasses many competitors in vulnerability detection capabilities.It benefits from the hierarchical code representation learning method,and outperforms baseline in cross-language vulnerability detection by 9.772%and 11.819%in the C/C++and Java datasets,respectively.Moreover,HCRVD has certain ability to detect vulnerabilities in unknown programming languages and is useful in real open-source projects.HCRVD shows good validity,generality and practicality.展开更多
In this paper, the matrix Riccati equation is considered. There is no general way for solving the matrix Riccati equation despite the many fields to which it applies. While scalar Riccati equation has been studied tho...In this paper, the matrix Riccati equation is considered. There is no general way for solving the matrix Riccati equation despite the many fields to which it applies. While scalar Riccati equation has been studied thoroughly, matrix Riccati equation of which scalar Riccati equations is a particular case, is much less investigated. This article proposes a change of variable that allows to find explicit solution of the Matrix Riccati equation. We then apply this solution to Optimal Control.展开更多
The systematic method for constructing Lewis representations is a method for representing chemical bonds between atoms in a molecule. It uses symbols to represent the valence electrons of the atoms involved in the bon...The systematic method for constructing Lewis representations is a method for representing chemical bonds between atoms in a molecule. It uses symbols to represent the valence electrons of the atoms involved in the bond. Using a number of rules in a defined order, it is often better suited to complicated cases than the Lewis representation of atoms. This method allows us to determine the formal charge and oxidation number of each atom in the edifice more efficiently than other methods.展开更多
Contrastive learning is a significant research direction in the field of deep learning.However,existing data augmentation methods often lead to issues such as semantic drift in generated views while the complexity of ...Contrastive learning is a significant research direction in the field of deep learning.However,existing data augmentation methods often lead to issues such as semantic drift in generated views while the complexity of model pre-training limits further improvement in the performance of existing methods.To address these challenges,we propose the Efficient Clustering Network based on Matrix Factorization(ECN-MF).Specifically,we design a batched low-rank Singular Value Decomposition(SVD)algorithm for data augmentation to eliminate redundant information and uncover major patterns of variation and key information in the data.Additionally,we design a Mutual Information-Enhanced Clustering Module(MI-ECM)to accelerate the training process by leveraging a simple architecture to bring samples from the same cluster closer while pushing samples from other clusters apart.Extensive experiments on six datasets demonstrate that ECN-MF exhibits more effective performance compared to state-of-the-art algorithms.展开更多
BACKGROUND Frey syndrome,also known as ototemporal nerve syndrome or gustatory sweating syndrome,is one of the most common complications of parotid gland surgery.This condition is characterized by abnormal sensations ...BACKGROUND Frey syndrome,also known as ototemporal nerve syndrome or gustatory sweating syndrome,is one of the most common complications of parotid gland surgery.This condition is characterized by abnormal sensations in the facial skin accompanied by episodes of flushing and sweating triggered by cognitive processes,visual stimuli,or eating.AIM To investigate the preventive effect of acellular dermal matrix(ADM)on Frey syndrome after parotid tumor resection and analyzed the effects of Frey syndrome across various surgical methods and other factors involved in parotid tumor resection.METHODS Retrospective data from 82 patients were analyzed to assess the correlation between sex,age,resection sample size,operation time,operation mode,ADM usage,and occurrence of postoperative Frey syndrome.RESULTS Among the 82 patients,the incidence of Frey syndrome was 56.1%.There were no significant differences in sex,age,or operation time between the two groups(P>0.05).However,there was a significant difference between ADM implantation and occurrence of Frey syndrome(P<0.05).ADM application could reduce the variation in the incidence of Frey syndrome across different operation modes.CONCLUSION ADM can effectively prevent Frey syndrome and delay its onset.展开更多
Autograft or metal implants are routinely used in skeletal repair.However,they fail to provide long-term clinical resolution,necessitating a functional biomimetic tissue engineering alternative.The use of native human...Autograft or metal implants are routinely used in skeletal repair.However,they fail to provide long-term clinical resolution,necessitating a functional biomimetic tissue engineering alternative.The use of native human bone tissue for synthesizing a biomimeticmaterial inkfor three-dimensional(3D)bioprintingof skeletal tissueis anattractivestrategyfor tissueregeneration.Thus,human bone extracellular matrix(bone-ECM)offers an exciting potential for the development of an appropriate microenvironment for human bone marrow stromal cells(HBMSCs)to proliferate and differentiate along the osteogenic lineage.In this study,we engineered a novel material ink(LAB)by blending human bone-ECM(B)with nanoclay(L,Laponite®)and alginate(A)polymers using extrusion-based deposition.The inclusion of the nanofiller and polymeric material increased the rheology,printability,and drug retention properties and,critically,the preservation of HBMSCs viability upon printing.The composite of human bone-ECM-based 3D constructs containing vascular endothelial growth factor(VEGF)enhanced vascularization after implantation in an ex vivo chick chorioallantoic membrane(CAM)model.The inclusion of bone morphogenetic protein-2(BMP-2)with the HBMSCs further enhanced vascularization and mineralization after only seven days.This study demonstrates the synergistic combination of nanoclay with biomimetic materials(alginate and bone-ECM)to support the formation of osteogenic tissue both in vitro and ex vivo and offers a promising novel 3D bioprinting approach to personalized skeletal tissue repair.展开更多
BACKGROUND Abdominal wall deficiencies or weakness are a common complication of tem-porary ostomies,and incisional hernias frequently develop after colostomy or ileostomy takedown.The use of synthetic meshes to reinfo...BACKGROUND Abdominal wall deficiencies or weakness are a common complication of tem-porary ostomies,and incisional hernias frequently develop after colostomy or ileostomy takedown.The use of synthetic meshes to reinforce the abdominal wall has reduced hernia occurrence.Biologic meshes have also been used to enhance healing,particularly in contaminated conditions.Reinforced tissue matrices(R-TMs),which include a biologic scaffold of native extracellular matrix and a syn-thetic component for added strength/durability,are designed to take advantage of aspects of both synthetic and biologic materials.To date,RTMs have not been reported to reinforce the abdominal wall following stoma reversal.METHODS Twenty-eight patients were selected with a parastomal and/or incisional hernia who had received a temporary ileostomy or colostomy for fecal diversion after rectal cancer treatment or trauma.Following hernia repair and proximal stoma closure,RTM(OviTex®1S permanent or OviTex®LPR)was placed to reinforce the abdominal wall using a laparoscopic,robotic,or open surgical approach.Post-operative follow-up was performed at 1 month and 1 year.Hernia recurrence was determined by physical examination and,when necessary,via computed tomo-graphy scan.Secondary endpoints included length of hospital stay,time to return to work,and hospital readmissions.Evaluated complications of the wound/repair site included presence of surgical site infection,seroma,hematoma,wound dehiscence,or fistula formation.RESULTS The observational study cohort included 16 male and 12 female patients with average age of 58.5 years±16.3 years and average body mass index of 26.2 kg/m^(2)±4.1 kg/m^(2).Patients presented with a parastomal hernia(75.0%),in-cisional hernia(14.3%),or combined parastomal/incisional hernia(10.7%).Using a laparoscopic(53.6%),robotic(35.7%),or open(10.7%)technique,RTMs(OviTex®LPR:82.1%,OviTex®1S:17.9%)were placed using sublay(82.1%)or intraperitoneal onlay(IPOM;17.9%)mesh positioning.At 1-month and 1-year follow-ups,there were no hernia recurrences(0%).Average hospital stays were 2.1 d±1.2 d and return to work occurred at 8.3 post-operative days±3.0 post-operative days.Three patients(10.7%)were readmitted before the 1-month follow up due to mesh infection and/or gastrointestinal issues.Fistula and mesh infection were observed in two patients each(7.1%),leading to partial mesh removal in one patient(3.6%).There were no complications between 1 month and 1 year(0%).CONCLUSION RTMs were used successfully to treat parastomal and incisional hernias at ileostomy reversal,with no hernia recurrences and favorable outcomes after 1-month and 1-year.展开更多
In regard to unconventional oil reservoirs,the transient dual-porosity and triple-porosity models have been adopted to describe the fluid flow in the complex fracture network.It has been proven to cause inaccurate pro...In regard to unconventional oil reservoirs,the transient dual-porosity and triple-porosity models have been adopted to describe the fluid flow in the complex fracture network.It has been proven to cause inaccurate production evaluations because of the absence of matrix-macrofracture communication.In addition,most of the existing models are solved analytically based on Laplace transform and numerical inversion.Hence,an approximate analytical solution is derived directly in real-time space considering variable matrix blocks and simultaneous matrix depletion.To simplify the derivation,the simultaneous matrix depletion is divided into two parts:one part feeding the macrofractures and the other part feeding the microfractures.Then,a series of partial differential equations(PDEs)describing the transient flow and boundary conditions are constructed and solved analytically by integration.Finally,a relationship between oil rate and production time in real-time space is obtained.The new model is verified against classical analytical models.When the microfracture system and matrix-macrofracture communication is neglected,the result of the new model agrees with those obtained with the dual-porosity and triple-porosity model,respectively.Certainly,the new model also has an excellent agreement with the numerical model.The model is then applied to two actual tight oil wells completed in western Canada sedimentary basin.After identifying the flow regime,the solution suitably matches the field production data,and the model parameters are determined.Through these output parameters,we can accurately forecast the production and even estimate the petrophysical properties.展开更多
In the case of massive data,matrix operations are very computationally intensive,and the memory limitation in standalone mode leads to the system inefficiencies.At the same time,it is difficult for matrix operations t...In the case of massive data,matrix operations are very computationally intensive,and the memory limitation in standalone mode leads to the system inefficiencies.At the same time,it is difficult for matrix operations to achieve flexible switching between different requirements when implemented in hardware.To address this problem,this paper proposes a matrix operation accelerator based on reconfigurable arrays in the context of the application of recommender systems(RS).Based on the reconfigurable array processor(APR-16)with reconfiguration,a parallelized design of matrix operations on processing element(PE)array is realized with flexibility.The experimental results show that,compared with the proposed central processing unit(CPU)and graphics processing unit(GPU)hybrid implementation matrix multiplication framework,the energy efficiency ratio of the accelerator proposed in this paper is improved by about 35×.Compared with blocked alternating least squares(BALS),its the energy efficiency ratio has been accelerated by about 1×,and the switching of matrix factorization(MF)schemes suitable for different sparsity can be realized.展开更多
In recent years,the allergy rate of oysters has surged,and daily food processing methods make it hard to reduce heat resistance and digestive allergy such as tropomyosin(TM).In this study,the Maillard reaction with xy...In recent years,the allergy rate of oysters has surged,and daily food processing methods make it hard to reduce heat resistance and digestive allergy such as tropomyosin(TM).In this study,the Maillard reaction with xylose significantly reduced the IgE binding capacity of Alectryonella plicatula food matrix(AFM),that reduced by(77.81±2.68)%.The study found the Maillard reaction changes the structure of the AFM,in which the content ofα-helix decreased by(24.64±1.46)%.Structural transformation further explains why the Maillard reaction alters the immunobinding activity of AFM.In addition,the Maillard reaction reduces the digestive stability of the AFM and makes TM in the A.plicatula food matrix Maillard reaction products(AFM-MRPs)more easily digested.Based on the above research,10 amino acids on the 7 IgE epitopes of TM were modified.This result indicates that the Maillard reaction reduces the immunobinding activity of the AFM by changing the structure and modifying the amino acids on the epitope.展开更多
基金This work was supported by the National Natural Science Foundation of China(62073087,62071132,61973090).
文摘Deep matrix factorization(DMF)has been demonstrated to be a powerful tool to take in the complex hierarchical information of multi-view data(MDR).However,existing multiview DMF methods mainly explore the consistency of multi-view data,while neglecting the diversity among different views as well as the high-order relationships of data,resulting in the loss of valuable complementary information.In this paper,we design a hypergraph regularized diverse deep matrix factorization(HDDMF)model for multi-view data representation,to jointly utilize multi-view diversity and a high-order manifold in a multilayer factorization framework.A novel diversity enhancement term is designed to exploit the structural complementarity between different views of data.Hypergraph regularization is utilized to preserve the high-order geometry structure of data in each view.An efficient iterative optimization algorithm is developed to solve the proposed model with theoretical convergence analysis.Experimental results on five real-world data sets demonstrate that the proposed method significantly outperforms stateof-the-art multi-view learning approaches.
基金National Natural Science Foundation of China,No.U20A20403This study was conducted in accordance with the Animal Ethics Committee of the Institute of Antler Science and Product Technology,Changchun Sci-Tech University(AEC No:CKARI202309).
文摘BACKGROUND Cartilage defects are some of the most common causes of arthritis.Cartilage lesions caused by inflammation,trauma or degenerative disease normally result in osteochondral defects.Previous studies have shown that decellularized extracellular matrix(ECM)derived from autologous,allogenic,or xenogeneic mesenchymal stromal cells(MSCs)can effectively restore osteochondral integrity.AIM To determine whether the decellularized ECM of antler reserve mesenchymal cells(RMCs),a xenogeneic material from antler stem cells,is superior to the currently available treatments for osteochondral defects.METHODS We isolated the RMCs from a 60-d-old sika deer antler and cultured them in vitro to 70%confluence;50 mg/mL L-ascorbic acid was then added to the medium to stimulate ECM deposition.Decellularized sheets of adipocyte-derived MSCs(aMSCs)and antlerogenic periosteal cells(another type of antler stem cells)were used as the controls.Three weeks after ascorbic acid stimulation,the ECM sheets were harvested and applied to the osteochondral defects in rat knee joints.RESULTS The defects were successfully repaired by applying the ECM-sheets.The highest quality of repair was achieved in the RMC-ECM group both in vitro(including cell attachment and proliferation),and in vivo(including the simultaneous regeneration of well-vascularized subchondral bone and avascular articular hyaline cartilage integrated with surrounding native tissues).Notably,the antler-stem-cell-derived ECM(xenogeneic)performed better than the aMSC-ECM(allogenic),while the ECM of the active antler stem cells was superior to that of the quiescent antler stem cells.CONCLUSION Decellularized xenogeneic ECM derived from the antler stem cell,particularly the active form(RMC-ECM),can achieve high quality repair/reconstruction of osteochondral defects,suggesting that selection of decellularized ECM for such repair should be focused more on bioactivity rather than kinship.
文摘Deep learning has been a catalyst for a transformative revo-lution in machine learning and computer vision in the past decade.Within these research domains,methods grounded in deep learning have exhibited exceptional performance across a spectrum of tasks.The success of deep learning methods can be attributed to their capability to derive potent representations from data,integral for a myriad of downstream applications.These representations encapsulate the intrinsic structure,fea-tures,or latent variables characterising the underlying statistics of visual data.Despite these achievements,the challenge per-sists in effectively conducting representation learning of visual data with deep models,particularly when confronted with vast and noisy datasets.This special issue is a dedicated platform for researchers worldwide to disseminate their latest,high-quality articles,aiming to enhance readers'comprehension of the principles,limitations,and diverse applications of repre-sentation learning in computer vision.
基金the National Natural Science Founda-tion of China(62062062)hosted by Gulila Altenbek.
文摘Due to the structural dependencies among concurrent events in the knowledge graph and the substantial amount of sequential correlation information carried by temporally adjacent events,we propose an Independent Recurrent Temporal Graph Convolution Networks(IndRT-GCNets)framework to efficiently and accurately capture event attribute information.The framework models the knowledge graph sequences to learn the evolutionary represen-tations of entities and relations within each period.Firstly,by utilizing the temporal graph convolution module in the evolutionary representation unit,the framework captures the structural dependency relationships within the knowledge graph in each period.Meanwhile,to achieve better event representation and establish effective correlations,an independent recurrent neural network is employed to implement auto-regressive modeling.Furthermore,static attributes of entities in the entity-relation events are constrained andmerged using a static graph constraint to obtain optimal entity representations.Finally,the evolution of entity and relation representations is utilized to predict events in the next subsequent step.On multiple real-world datasets such as Freebase13(FB13),Freebase 15k(FB15K),WordNet11(WN11),WordNet18(WN18),FB15K-237,WN18RR,YAGO3-10,and Nell-995,the results of multiple evaluation indicators show that our proposed IndRT-GCNets framework outperforms most existing models on knowledge reasoning tasks,which validates the effectiveness and robustness.
基金supported by the Applied Research Center of Artificial Intelligence,Wuhan College(Grant Number X2020113)the Wuhan College Research Project(Grant Number KYZ202009).
文摘User representation learning is crucial for capturing different user preferences,but it is also critical challenging because user intentions are latent and dispersed in complex and different patterns of user-generated data,and thus cannot be measured directly.Text-based data models can learn user representations by mining latent semantics,which is beneficial to enhancing the semantic function of user representations.However,these technologies only extract common features in historical records and cannot represent changes in user intentions.However,sequential feature can express the user’s interests and intentions that change time by time.But the sequential recommendation results based on the user representation of the item lack the interpretability of preference factors.To address these issues,we propose in this paper a novel model with Dual-Layer User Representation,named DLUR,where the user’s intention is learned based on two different layer representations.Specifically,the latent semantic layer adds an interactive layer based on Transformer to extract keywords and key sentences in the text and serve as a basis for interpretation.The sequence layer uses the Transformer model to encode the user’s preference intention to clarify changes in the user’s intention.Therefore,this dual-layer user mode is more comprehensive than a single text mode or sequence mode and can effectually improve the performance of recommendations.Our extensive experiments on five benchmark datasets demonstrate DLUR’s performance over state-of-the-art recommendation models.In addition,DLUR’s ability to explain recommendation results is also demonstrated through some specific cases.
文摘Edge devices,due to their limited computational and storage resources,often require the use of compilers for program optimization.Therefore,ensuring the security and reliability of these compilers is of paramount importance in the emerging field of edge AI.One widely used testing method for this purpose is fuzz testing,which detects bugs by inputting random test cases into the target program.However,this process consumes significant time and resources.To improve the efficiency of compiler fuzz testing,it is common practice to utilize test case prioritization techniques.Some researchers use machine learning to predict the code coverage of test cases,aiming to maximize the test capability for the target compiler by increasing the overall predicted coverage of the test cases.Nevertheless,these methods can only forecast the code coverage of the compiler at a specific optimization level,potentially missing many optimization-related bugs.In this paper,we introduce C-CORE(short for Clustering by Code Representation),the first framework to prioritize test cases according to their code representations,which are derived directly from the source codes.This approach avoids being limited to specific compiler states and extends to a broader range of compiler bugs.Specifically,we first train a scaled pre-trained programming language model to capture as many common features as possible from the test cases generated by a fuzzer.Using this pre-trained model,we then train two downstream models:one for predicting the likelihood of triggering a bug and another for identifying code representations associated with bugs.Subsequently,we cluster the test cases according to their code representations and select the highest-scoring test case from each cluster as the high-quality test case.This reduction in redundant testing cases leads to time savings.Comprehensive evaluation results reveal that code representations are better at distinguishing test capabilities,and C-CORE significantly enhances testing efficiency.Across four datasets,C-CORE increases the average of the percentage of faults detected(APFD)value by 0.16 to 0.31 and reduces test time by over 50% in 46% of cases.When compared to the best results from approaches using predicted code coverage,C-CORE improves the APFD value by 1.1% to 12.3% and achieves an overall time-saving of 159.1%.
文摘Sparse representation is an effective data classification algorithm that depends on the known training samples to categorise the test sample.It has been widely used in various image classification tasks.Sparseness in sparse representation means that only a few of instances selected from all training samples can effectively convey the essential class-specific information of the test sample,which is very important for classification.For deformable images such as human faces,pixels at the same location of different images of the same subject usually have different intensities.Therefore,extracting features and correctly classifying such deformable objects is very hard.Moreover,the lighting,attitude and occlusion cause more difficulty.Considering the problems and challenges listed above,a novel image representation and classification algorithm is proposed.First,the authors’algorithm generates virtual samples by a non-linear variation method.This method can effectively extract the low-frequency information of space-domain features of the original image,which is very useful for representing deformable objects.The combination of the original and virtual samples is more beneficial to improve the clas-sification performance and robustness of the algorithm.Thereby,the authors’algorithm calculates the expression coefficients of the original and virtual samples separately using the sparse representation principle and obtains the final score by a designed efficient score fusion scheme.The weighting coefficients in the score fusion scheme are set entirely automatically.Finally,the algorithm classifies the samples based on the final scores.The experimental results show that our method performs better classification than conventional sparse representation algorithms.
基金supported by National Institute on Aging(NIH-NIA)R21 AG074152(to KMA)National Institute of Allergy and Infectious Diseases(NIAID)grant DP2 AI171150(to KMA)Department of Defense(DoD)grant AZ210089(to KMA)。
文摘The brain's extracellular matrix(ECM),which is comprised of protein and glycosaminoglycan(GAG)scaffolds,constitutes 20%-40% of the human brain and is considered one of the largest influencers on brain cell functioning(Soles et al.,2023).Synthesized by neural and glial cells,the brain's ECM regulates a myriad of homeostatic cellular processes,including neuronal plasticity and firing(Miyata et al.,2012),cation buffering(Moraws ki et al.,2015),and glia-neuron interactions(Anderson et al.,2016).Considering the diversity of functions,dynamic remodeling of the brain's ECM indicates that this understudied medium is an active participant in both normal physiology and neurological diseases.
基金supported by the National Natural Science Foundation of China,with Fund Numbers 62272478,62102451the National Defense Science and Technology Independent Research Project(Intelligent Information Hiding Technology and Its Applications in a Certain Field)and Science and Technology Innovation Team Innovative Research Project“Research on Key Technologies for Intelligent Information Hiding”with Fund Number ZZKY20222102.
文摘Recent research advances in implicit neural representation have shown that a wide range of video data distributions are achieved by sharing model weights for Neural Representation for Videos(NeRV).While explicit methods exist for accurately embedding ownership or copyright information in video data,the nascent NeRV framework has yet to address this issue comprehensively.In response,this paper introduces MarkINeRV,a scheme designed to embed watermarking information into video frames using an invertible neural network watermarking approach to protect the copyright of NeRV,which models the embedding and extraction of watermarks as a pair of inverse processes of a reversible network and employs the same network to achieve embedding and extraction of watermarks.It is just that the information flow is in the opposite direction.Additionally,a video frame quality enhancement module is incorporated to mitigate watermarking information losses in the rendering process and the possibility ofmalicious attacks during transmission,ensuring the accurate extraction of watermarking information through the invertible network’s inverse process.This paper evaluates the accuracy,robustness,and invisibility of MarkINeRV through multiple video datasets.The results demonstrate its efficacy in extracting watermarking information for copyright protection of NeRV.MarkINeRV represents a pioneering investigation into copyright issues surrounding NeRV.
基金funded by the Major Science and Technology Projects in Henan Province,China,Grant No.221100210600.
文摘Prior studies have demonstrated that deep learning-based approaches can enhance the performance of source code vulnerability detection by training neural networks to learn vulnerability patterns in code representations.However,due to limitations in code representation and neural network design,the validity and practicality of the model still need to be improved.Additionally,due to differences in programming languages,most methods lack cross-language detection generality.To address these issues,in this paper,we analyze the shortcomings of previous code representations and neural networks.We propose a novel hierarchical code representation that combines Concrete Syntax Trees(CST)with Program Dependence Graphs(PDG).Furthermore,we introduce a Tree-Graph-Gated-Attention(TGGA)network based on gated recurrent units and attention mechanisms to build a Hierarchical Code Representation learning-based Vulnerability Detection(HCRVD)system.This system enables cross-language vulnerability detection at the function-level.The experiments show that HCRVD surpasses many competitors in vulnerability detection capabilities.It benefits from the hierarchical code representation learning method,and outperforms baseline in cross-language vulnerability detection by 9.772%and 11.819%in the C/C++and Java datasets,respectively.Moreover,HCRVD has certain ability to detect vulnerabilities in unknown programming languages and is useful in real open-source projects.HCRVD shows good validity,generality and practicality.
文摘In this paper, the matrix Riccati equation is considered. There is no general way for solving the matrix Riccati equation despite the many fields to which it applies. While scalar Riccati equation has been studied thoroughly, matrix Riccati equation of which scalar Riccati equations is a particular case, is much less investigated. This article proposes a change of variable that allows to find explicit solution of the Matrix Riccati equation. We then apply this solution to Optimal Control.
文摘The systematic method for constructing Lewis representations is a method for representing chemical bonds between atoms in a molecule. It uses symbols to represent the valence electrons of the atoms involved in the bond. Using a number of rules in a defined order, it is often better suited to complicated cases than the Lewis representation of atoms. This method allows us to determine the formal charge and oxidation number of each atom in the edifice more efficiently than other methods.
基金supported by the Key Research and Development Program of Hainan Province(Grant Nos.ZDYF2023GXJS163,ZDYF2024GXJS014)National Natural Science Foundation of China(NSFC)(Grant Nos.62162022,62162024)+3 种基金the Major Science and Technology Project of Hainan Province(Grant No.ZDKJ2020012)Hainan Provincial Natural Science Foundation of China(Grant No.620MS021)Youth Foundation Project of Hainan Natural Science Foundation(621QN211)Innovative Research Project for Graduate Students in Hainan Province(Grant Nos.Qhys2023-96,Qhys2023-95).
文摘Contrastive learning is a significant research direction in the field of deep learning.However,existing data augmentation methods often lead to issues such as semantic drift in generated views while the complexity of model pre-training limits further improvement in the performance of existing methods.To address these challenges,we propose the Efficient Clustering Network based on Matrix Factorization(ECN-MF).Specifically,we design a batched low-rank Singular Value Decomposition(SVD)algorithm for data augmentation to eliminate redundant information and uncover major patterns of variation and key information in the data.Additionally,we design a Mutual Information-Enhanced Clustering Module(MI-ECM)to accelerate the training process by leveraging a simple architecture to bring samples from the same cluster closer while pushing samples from other clusters apart.Extensive experiments on six datasets demonstrate that ECN-MF exhibits more effective performance compared to state-of-the-art algorithms.
文摘BACKGROUND Frey syndrome,also known as ototemporal nerve syndrome or gustatory sweating syndrome,is one of the most common complications of parotid gland surgery.This condition is characterized by abnormal sensations in the facial skin accompanied by episodes of flushing and sweating triggered by cognitive processes,visual stimuli,or eating.AIM To investigate the preventive effect of acellular dermal matrix(ADM)on Frey syndrome after parotid tumor resection and analyzed the effects of Frey syndrome across various surgical methods and other factors involved in parotid tumor resection.METHODS Retrospective data from 82 patients were analyzed to assess the correlation between sex,age,resection sample size,operation time,operation mode,ADM usage,and occurrence of postoperative Frey syndrome.RESULTS Among the 82 patients,the incidence of Frey syndrome was 56.1%.There were no significant differences in sex,age,or operation time between the two groups(P>0.05).However,there was a significant difference between ADM implantation and occurrence of Frey syndrome(P<0.05).ADM application could reduce the variation in the incidence of Frey syndrome across different operation modes.CONCLUSION ADM can effectively prevent Frey syndrome and delay its onset.
基金supported by grants from the Biotechnology and Biological Sciences Research Council(Nos.BBSRC LO21071/and BB/L00609X/1)UK Regenerative Medicine Platform Hub Acellular Approaches for Therapeutic Delivery(No.MR/K026682/1)+3 种基金Acellular Hub,SMART Materials 3D Architecture(No.MR/R015651/1)the UK Regenerative Medicine Platform(No.MR/L012626/1 Southampton Imaging)to ROCOMRCAMED Regenerative Medicine and Stem Cell Research Initiative(No.MR/V00543X/1)to JID,ROCO and YHKGC acknowledges funding from AIRC Aldi Fellowship under grant agreement No.25412.
文摘Autograft or metal implants are routinely used in skeletal repair.However,they fail to provide long-term clinical resolution,necessitating a functional biomimetic tissue engineering alternative.The use of native human bone tissue for synthesizing a biomimeticmaterial inkfor three-dimensional(3D)bioprintingof skeletal tissueis anattractivestrategyfor tissueregeneration.Thus,human bone extracellular matrix(bone-ECM)offers an exciting potential for the development of an appropriate microenvironment for human bone marrow stromal cells(HBMSCs)to proliferate and differentiate along the osteogenic lineage.In this study,we engineered a novel material ink(LAB)by blending human bone-ECM(B)with nanoclay(L,Laponite®)and alginate(A)polymers using extrusion-based deposition.The inclusion of the nanofiller and polymeric material increased the rheology,printability,and drug retention properties and,critically,the preservation of HBMSCs viability upon printing.The composite of human bone-ECM-based 3D constructs containing vascular endothelial growth factor(VEGF)enhanced vascularization after implantation in an ex vivo chick chorioallantoic membrane(CAM)model.The inclusion of bone morphogenetic protein-2(BMP-2)with the HBMSCs further enhanced vascularization and mineralization after only seven days.This study demonstrates the synergistic combination of nanoclay with biomimetic materials(alginate and bone-ECM)to support the formation of osteogenic tissue both in vitro and ex vivo and offers a promising novel 3D bioprinting approach to personalized skeletal tissue repair.
基金This study was reviewed and approved by the UT Health Houston Institutional Review Board(approval No.HSC-MS-23-0471).
文摘BACKGROUND Abdominal wall deficiencies or weakness are a common complication of tem-porary ostomies,and incisional hernias frequently develop after colostomy or ileostomy takedown.The use of synthetic meshes to reinforce the abdominal wall has reduced hernia occurrence.Biologic meshes have also been used to enhance healing,particularly in contaminated conditions.Reinforced tissue matrices(R-TMs),which include a biologic scaffold of native extracellular matrix and a syn-thetic component for added strength/durability,are designed to take advantage of aspects of both synthetic and biologic materials.To date,RTMs have not been reported to reinforce the abdominal wall following stoma reversal.METHODS Twenty-eight patients were selected with a parastomal and/or incisional hernia who had received a temporary ileostomy or colostomy for fecal diversion after rectal cancer treatment or trauma.Following hernia repair and proximal stoma closure,RTM(OviTex®1S permanent or OviTex®LPR)was placed to reinforce the abdominal wall using a laparoscopic,robotic,or open surgical approach.Post-operative follow-up was performed at 1 month and 1 year.Hernia recurrence was determined by physical examination and,when necessary,via computed tomo-graphy scan.Secondary endpoints included length of hospital stay,time to return to work,and hospital readmissions.Evaluated complications of the wound/repair site included presence of surgical site infection,seroma,hematoma,wound dehiscence,or fistula formation.RESULTS The observational study cohort included 16 male and 12 female patients with average age of 58.5 years±16.3 years and average body mass index of 26.2 kg/m^(2)±4.1 kg/m^(2).Patients presented with a parastomal hernia(75.0%),in-cisional hernia(14.3%),or combined parastomal/incisional hernia(10.7%).Using a laparoscopic(53.6%),robotic(35.7%),or open(10.7%)technique,RTMs(OviTex®LPR:82.1%,OviTex®1S:17.9%)were placed using sublay(82.1%)or intraperitoneal onlay(IPOM;17.9%)mesh positioning.At 1-month and 1-year follow-ups,there were no hernia recurrences(0%).Average hospital stays were 2.1 d±1.2 d and return to work occurred at 8.3 post-operative days±3.0 post-operative days.Three patients(10.7%)were readmitted before the 1-month follow up due to mesh infection and/or gastrointestinal issues.Fistula and mesh infection were observed in two patients each(7.1%),leading to partial mesh removal in one patient(3.6%).There were no complications between 1 month and 1 year(0%).CONCLUSION RTMs were used successfully to treat parastomal and incisional hernias at ileostomy reversal,with no hernia recurrences and favorable outcomes after 1-month and 1-year.
基金This study was supported by Basic Research Project from Jiangmen Science and Technology Bureau(Grant No.2220002000356)China University of Petroleum(Beijing)(Grand No.2462023BJRC007)The Guangdong Basic and Applied Basic Research Foundation(No.2022A1515110376).
文摘In regard to unconventional oil reservoirs,the transient dual-porosity and triple-porosity models have been adopted to describe the fluid flow in the complex fracture network.It has been proven to cause inaccurate production evaluations because of the absence of matrix-macrofracture communication.In addition,most of the existing models are solved analytically based on Laplace transform and numerical inversion.Hence,an approximate analytical solution is derived directly in real-time space considering variable matrix blocks and simultaneous matrix depletion.To simplify the derivation,the simultaneous matrix depletion is divided into two parts:one part feeding the macrofractures and the other part feeding the microfractures.Then,a series of partial differential equations(PDEs)describing the transient flow and boundary conditions are constructed and solved analytically by integration.Finally,a relationship between oil rate and production time in real-time space is obtained.The new model is verified against classical analytical models.When the microfracture system and matrix-macrofracture communication is neglected,the result of the new model agrees with those obtained with the dual-porosity and triple-porosity model,respectively.Certainly,the new model also has an excellent agreement with the numerical model.The model is then applied to two actual tight oil wells completed in western Canada sedimentary basin.After identifying the flow regime,the solution suitably matches the field production data,and the model parameters are determined.Through these output parameters,we can accurately forecast the production and even estimate the petrophysical properties.
基金the National Key R&D Program of China(No.2022ZD0119001)the National Natural Science Foundation of China(No.61834005)+3 种基金the Shaanxi Province Key R&D Plan(No.2022GY-027)the Key Scientific Research Project of Shaanxi Department of Education(No.22JY060)the Education Research Project of Xi'an University of Posts and Telecommunications(No.JGA202108)the Graduate Student Innovation Fund of Xi’an University of Posts and Telecommunications(No.CXJJYL2022035).
文摘In the case of massive data,matrix operations are very computationally intensive,and the memory limitation in standalone mode leads to the system inefficiencies.At the same time,it is difficult for matrix operations to achieve flexible switching between different requirements when implemented in hardware.To address this problem,this paper proposes a matrix operation accelerator based on reconfigurable arrays in the context of the application of recommender systems(RS).Based on the reconfigurable array processor(APR-16)with reconfiguration,a parallelized design of matrix operations on processing element(PE)array is realized with flexibility.The experimental results show that,compared with the proposed central processing unit(CPU)and graphics processing unit(GPU)hybrid implementation matrix multiplication framework,the energy efficiency ratio of the accelerator proposed in this paper is improved by about 35×.Compared with blocked alternating least squares(BALS),its the energy efficiency ratio has been accelerated by about 1×,and the switching of matrix factorization(MF)schemes suitable for different sparsity can be realized.
基金supported by the National Natural Scientific Foundation of China(32072336,31871720)the National Key R&D Program of China(2019YFD0901703).
文摘In recent years,the allergy rate of oysters has surged,and daily food processing methods make it hard to reduce heat resistance and digestive allergy such as tropomyosin(TM).In this study,the Maillard reaction with xylose significantly reduced the IgE binding capacity of Alectryonella plicatula food matrix(AFM),that reduced by(77.81±2.68)%.The study found the Maillard reaction changes the structure of the AFM,in which the content ofα-helix decreased by(24.64±1.46)%.Structural transformation further explains why the Maillard reaction alters the immunobinding activity of AFM.In addition,the Maillard reaction reduces the digestive stability of the AFM and makes TM in the A.plicatula food matrix Maillard reaction products(AFM-MRPs)more easily digested.Based on the above research,10 amino acids on the 7 IgE epitopes of TM were modified.This result indicates that the Maillard reaction reduces the immunobinding activity of the AFM by changing the structure and modifying the amino acids on the epitope.