Can ChatGPT evaluate research quality?

Purpose:Assess whether ChatGPT 4.0 is accurate enough to perform research evaluations on journal articles to automate this time-consuming task.Design/methodology/approach:Test the extent to which ChatGPT-4 can assess the quality of journal articles using a case study of the published scoring guidelines of the UK Research Excellence Framework(REF)2021 to create a research evaluation ChatGPT.This was applied to 51 of my own articles and compared against my own quality judgements.Findings:ChatGPT-4 can produce plausible document summaries and quality evaluation rationales that match the REF criteria.Its overall scores have weak correlations with my self-evaluation scores of the same documents(averaging r=0.281 over 15 iterations,with 8 being statistically significantly different from 0).In contrast,the average scores from the 15 iterations produced a statistically significant positive correlation of 0.509.Thus,averaging scores from multiple ChatGPT-4 rounds seems more effective than individual scores.The positive correlation may be due to ChatGPT being able to extract the author’s significance,rigour,and originality claims from inside each paper.If my weakest articles are removed,then the correlation with average scores(r=0.200)falls below statistical significance,suggesting that ChatGPT struggles to make fine-grained evaluations.Research limitations:The data is self-evaluations of a convenience sample of articles from one academic in one field.Practical implications:Overall,ChatGPT does not yet seem to be accurate enough to be trusted for any formal or informal research quality evaluation tasks.Research evaluators,including journal editors,should therefore take steps to control its use.Originality/value:This is the first published attempt at post-publication expert review accuracy testing for ChatGPT.

Research funding and citations in papers of Nobel Laureates in Physics, Chemistry and Medicine, 2019-2020

Purpose:The goal of this study is a comparative analysis of the relation between funding(a main driver for scientific research)and citations in papers of Nobel Laureates in physics,chemistry and medicine over 2019-2020 and the same relation in these research fields as a whole.Design/methodology/approach:This study utilizes a power law model to explore the relationship between research funding and citations of related papers.The study here analyzes 3,539 recorded documents by Nobel Laureates in physics,chemistry and medicine and a broader dataset of 183,016 documents related to the fields of physics,medicine,and chemistry recorded in the Web of Science database.Findings:Results reveal that in chemistry and medicine,funded researches published in papers of Nobel Laureates have higher citations than unfunded studies published in articles;vice versa high citations of Nobel Laureates in physics are for unfunded studies published in papers.Instead,when overall data of publications and citations in physics,chemistry and medicine are analyzed,all papers based on funded researches show higher citations than unfunded ones.Originality/value:Results clarify the driving role of research funding for science diffusion that are systematized in general properties:a)articles concerning funded researches receive more citations than(un)funded studies published in papers of physics,chemistry and medicine sciences,generating a high Matthew effect(a higher growth of citations with the increase in the number of papers);b)research funding increases the citations of articles in fields oriented to applied research(e.g.,chemistry and medicine)more than fields oriented towards basic research(e.g.,physics).Practical implications:The results here explain some characteristics of scientific development and diffusion,highlighting the critical role of research funding in fostering citations and the expansion of scientific knowledge.This finding can support decision-making of policymakers and R&D managers to improve the effectiveness in allocating financial resources in science policies to generate a higher positive scientific and societal impact.

Biobanks and biomarkers:Their current and future role in biomedical research

The importance and utility of biobanks has increased exponentially since their inception and creation.Initially used as part of translational research,they now contribute over 40%of data for all cancer research papers in the United States of America and play a crucial role in all aspects of healthcare.Multiple classification systems exist but a simplified approach is to either classify as population-based or disease-oriented entities.Whilst historically publicly funded institutions,there has been a significant increase in industry funded entities across the world which has changed the dynamic of biobanks offering new possibilities but also new challenges.Biobanks face legal questions over data sharing and intellectual property as well as ethical and sustainability questions particularly as the world attempts to move to a low-carbon economy.International collaboration is required to address some of these challenges but this in itself is fraught with complexity and difficulty.This review will examine the current utility of biobanks in the modern healthcare setting as well as the current and future challenges these vital institutions face.

Global trends in diabetic eye disease research from 2012 to 2021

Diabetic eye disease refers to a group of eye complications that occur in diabetic patients and include diabetic retinopathy, diabetic macular edema, diabetic cataracts, and diabetic glaucoma. However, the global epidemiology of these conditions has not been well characterized. In this study, we collected information on diabetic eye disease-related research grants from seven representative countries––the United States, China, Japan, the United Kingdom, Spain, Germany, and France––by searching for all global diabetic eye disease journal articles in the Web of Science and Pub Med databases, all global registered clinical trials in the Clinical Trials database, and new drugs approved by the United States, China, Japan, and EU agencies from 2012 to 2021. During this time period, diabetic retinopathy accounted for the vast majority(89.53%) of the 2288 government research grants that were funded to investigate diabetic eye disease, followed by diabetic macular edema(9.27%). The United States granted the most research funding for diabetic eye disease out of the seven countries assessed. The research objectives of grants focusing on diabetic retinopathy and diabetic macular edema differed by country. Additionally, the United States was dominant in terms of research output, publishing 17.53% of global papers about diabetic eye disease and receiving 22.58% of total citations. The United States and the United Kingdom led international collaborations in research into diabetic eye disease. Of the 415 clinical trials that we identified, diabetic macular edema was the major disease that was targeted for drug development(58.19%). Approximately half of the trials(49.13%) pertained to angiogenesis. However, few drugs were approved for ophthalmic(40 out of 1830;2.19%) and diabetic eye disease(3 out of 1830;0.02%) applications. Our findings show that basic and translational research related to diabetic eye disease in the past decade has not been highly active, and has yielded few new treatment methods and newly approved drugs.

Research Characteristics of Thermal Comfort of Urban Block Landscape Based on Knowledge Graph Analysis

The landscape environment of urban blocks plays a significant role in improving the comfort of urban thermal environment and promoting green and high-quality development.The 342 papers related to the research on the impact of urban block landscape environment on thermal comfort in China,collected by CNKI(China National Knowledge Infrastructure)from 2002 to 2022,are used as the research object.Through bibliometric statistical analysis,LLR algorithm,and cluster analysis,the current research status of the impact of urban block landscape environment on thermal comfort in China is analyzed and processed,and its external characteristics are identified.Using the information visualization software CiteSpace,the research topics in the field of the impact of urban block landscape environment on thermal comfort are presented in the form of knowledge graphs.Through co-occurrence analysis of keywords and trend of word frequency changes,the development trends of research hotspots and cutting-edge fields of the impact of urban block landscape environment on thermal comfort are determined,hoping to provide reference for future research in this field.

Visual Analysis of Domestic and Foreign Building Brick Skin Research Based on Citespace

With the progress of the times and the leap of science and technology,the application of brick materials and the research on the brick skin in modern architectural design have shown a dual-track development trend of returning to tradition and innovation.Based on the core collection database resources of Web of Science and the CiteSpace visual analysis tool,this paper constructed and analyzed the spatio-temporal map of keyword co-occurrence network,cluster structure,mutation phenomenon,time course and regional distribution map of building brick skin research.The study revealed that in recent years,the research on brick materials has spanned the study of single material properties and extensively involved in the broad world of construction,especially in the integration of green energy-saving technology,the innovation of fine construction technology of brick skin,and the frontier exploration of digital technology in brick masonry,which has shown particularly significant research vitality and development potential.

Brain Research on Mental Disorders: A Criticism

Objective: To expose the problems and inherent limitations of neuroscience-based brain research on mental disorders. Method: Discussion of the theory underlying brain research on mental disorders, followed by a systematic evaluation of typical studies. Results: The fundamental problem is that brain researchers fail to differentiate between biological mental disorders in which brain processes cause the disorder (notably schizophrenia, bipolar disorder, and melancholic depression) and learned mental disorders in which brain processes mediate but do not cause the disorder (which is the case with reactive depression, reactive anxiety, OCD, and PTSD). Researchers have been unsuccessful in identifying mechanisms in the brain that cause biological mental disorders, and will never be able to locate the innumerable specific neural connections that mediate learned mental disorders. Moreover, the author’s review of typical studies in this field shows that they have serious problems with theory, measurement, and data analysis, and that their findings cannot be trusted. Conclusions: Neuroscience-based brain research on mental disorders, unlike other neurological research, has been an expensive failure and it is not worth continuing.

New roles of research data infrastructure in research paradigm evolution

Research data infrastructures form the cornerstone in both cyber and physical spaces,driving the progression of the data-intensive scientific research paradigm.This opinion paper presents an overview of global research data infrastructure,drawing insights from national roadmaps and strategic documents related to research data infrastructure.It emphasizes the pivotal role of research data infrastructures by delineating four new missions aimed at positioning them at the core of the current scientific research and communication ecosystem.The four new missions of research data infrastructures are:(1)as a pioneer,to transcend the disciplinary border and address complex,cutting-edge scientific and social challenges with problem-and data-oriented insights;(2)as an architect,to establish a digital,intelligent,flexible research and knowledge services environment;(3)as a platform,to foster the high-end academic communication;(4)as a coordinator,to balance scientific openness with ethics needs.

Navigating interdisciplinary research:Historical progression and contemporary challenges

Interdisciplinary research plays a crucial role in addressing complex problems by integrating knowledge from multiple disciplines.This integration fosters innovative solutions and enhances understanding across various fields.This study explores the historical and sociological development of interdisciplinary research and maps its evolution through three distinct phases:pre-disciplinary,disciplinary,and post-disciplinary.It identifies key internal dynamics,such as disciplinary diversification,reorganization,and innovation,as primary drivers of this evolution.Additionally,this study highlights how external factors,particularly the urgency of World War II and the subsequent political and economic changes,have accelerated its advancement.The rise of interdisciplinary research has significantly reshaped traditional educational paradigms,promoting its integration across different educational levels.However,the inherent contradictions within interdisciplinary research present cognitive,emotional,and institutional challenges for researchers.Meanwhile,finding a balance between the breadth and depth of knowledge remains a critical challenge in interdisciplinary education.

Challenges and Suggestions of Ethical Review on Clinical Research Involving Brain-Computer Interfaces

Brain-computer interface(BCI)technology is rapidly advancing in medical research and application.As an emerging biomedical engineering technology,it has garnered significant attention in the clinical research of brain disease diagnosis and treatment,neurological rehabilitation,and mental health.However,BCI also raises several challenges and ethical concerns in clinical research.In this article,the authors investigate and discuss three aspects of BCI in medicine and healthcare:the state of international ethical governance,multidimensional ethical challenges pertaining to BCI in clinical research,and suggestive concerns for ethical review.Despite the great potential of frontier BCI research and development in the field of medical care,the ethical challenges induced by itself and the complexities of clinical research and brain function have put forward new special fields for ethics in BCI.To ensure"responsible innovation"in BCI research in healthcare and medicine,the creation of an ethical global governance framework and system,along with special guidelines for cutting-edge BCI research in medicine,is suggested.

Tracking direct and indirect impact on technology and policy of transformative research via ego citation network

Purpose:The disseminating of academic knowledge to nonacademic audiences partly relies on the transition of subsequent citing papers.This study aims to investigate direct and indirect impact on technology and policy originating from transformative research based on ego citation network.Design/methodology/approach:Key Nobel Prize-winning publications(NPs)in fields of gene engineering and astrophysics are regarded as a proxy for transformative research.In this contribution,we introduce a network-structural indicator of citing patents to measure technological impact of a target article and use policy citations as a preliminary tool for policy impact.Findings:The results show that the impact on technology and policy of NPs are higher than that of their subsequent citation generations in gene engineering but not in astrophysics.Research limitations:The selection of Nobel Prizes is not balanced and the database used in this study,Dimensions,suffers from incompleteness and inaccuracy of citation links.Practical implications:Our findings provide useful clues to better understand the characteristics of transformative research in technological and policy impact.Originality/value:This study proposes a new framework to explore the direct and indirect impact on technology and policy originating from transformative research.

Research progress on natural products against hepatocellular carcinoma

Hepatocellular carcinoma(HCC)remains a prevalent and challenging malignancy globally,characterized by its numerous causal factors and generally unfavorable prognosis.In the relentless pursuit of effective treatment modalities,natural products have emerged as a promising and relatively non-toxic alternative,garnering significant interest.The integration of natural products with contemporary medical research has yielded encouraging therapeutic outcomes in the management of HCC.This review offers a comprehensive overview of the causal factors underlying HCC,and the diverse treatment options available,and highlights the advancements made by natural products in anti-HCC research.Particularly,we provide an outline of the various types of natural products,their corresponding nomenclature,target molecules,and mechanisms of action that exhibit anti-HCC activities.Natural products are anticipated to play a pivotal role in future comprehensive treatment plans for liver cancer,potentially offering patients improved survival rates and an enhanced quality of life.

Enhancing competency of clinical research nurses:A comprehensive training and evaluation framework

The Sun et al's training program for clinical research nurses(CRNs)in the World Journal of Clinical Cases is a comprehensive and scientific approach.It includes structured frameworks for CRN training,aiming to improve CRN competency.This program emphasizes practical abilities,updates training content,and improves evaluation methods.The cultivation of CRN talents focuses on enhancing the training system,establishing a multifaceted evaluation framework,and continuously refining the training programs.Regular feedback and evalua-tion are essential to improve CRNs'competency in practical settings.

Research status and hotspots of tight junctions and colorectal cancer:A bibliometric and visualization analysis

BACKGROUND Colorectal cancer(CRC)is the third most common cancer worldwide and the second leading cause of cancer-related death.Over the past two decades,numerous researchers have provided important evidence regarding the role of tight junction(TJ)proteins in the occurrence and progression of CRC.The causal relationship between the presence of specific TJ proteins and the development of CRC has also been confirmed.Despite the large number of publications in this field,a bibliometric study to review the current state of research and highlight the research trends and hotspots in this field has not yet been performed.AIM To analyze research on TJs and CRC,summarize the field’s history and current status,and predict future research directions.METHODS We searched the Science Citation Index Expanded database for all literature on CRC and TJs from 2001-2023.We used bibliometrics to analyze the data of these papers,such as the authors,countries,institutions,and references.Co-authorship,co-citation,and co-occurrence analyses were the main methods of analysis.CiteSpace and VOSviewer were used to visualize the results.RESULTS A total of 205 studies were ultimately identified.The number of publications on this topic has steadily increased since 2007.China and the United States have made the largest contributions to this field.Anticancer Research was the most prolific journal,publishing 8 articles,while the journal Oncogene had the highest average citation rate(68.33).Professor Dhawan P was the most prolific and cited author in this field.Co-occurrence analysis of keywords revealed that“tight junction protein expression”,“colorectal cancer”,“intestinal microbiota”,and“inflammatory bowel disease”had the highest frequency of occurrence,revealing the research hotspots and trends in this field.CONCLUSION This bibliometric analysis evaluated the scope and trends of TJ proteins in CRC,providing valuable research perspectives and future directions for studying the connection between the two.It is recommended to focus on emerging research hotspots,such as the correlations among intestinal microbiota,inflammatory bowel disease,TJ protein expression,and CRC.

Research progress on venous thrombosis development in patients with malignant tumors

The coexistence of venous thromboembolism(VTE)within patients with cancer,known as cancer-associated thrombosis(CAT),stands as a prominent cause of mortality in this population.Over recent years,the incidence of VTE has demonstrated a steady increase across diverse tumor types,influenced by several factors such as patient management,tumor-specific risks,and treatment-related aspects.Furthermore,mutations in specific genes have been identified as potential contributors to increased CAT occurrence in particular cancer subtypes.We conducted an extensive review encompassing pivotal historical and ongoing studies on CAT.This review elucidates the risks,mechanisms,reliable markers,and risk assessment methodologies that can significantly guide effective interventions in clinical practice.

Patient-centric periodontal research:A pioneering application of patient-reported outcome measures

Conventional dentistry or periodontal research often ignores the human component in favor of clinical outcomes and biological causes.Clinical research is driven by the statistical significance of outcome parameters rather than the satisfaction level of the patient.In this context,patient-centric periodontal research(PCPR)is an approach that considers the patient´s feedback concerning their functional status,experience,clinical outcomes,and accessibility to their treatments.It is argued that data self-reported by the patient might have low reliability owing to the confounding effect of their personal belief,cultural background,and social and economic factors.However,literature has shown that the incorporation of“patient-centric outcome”components considerably enhances the validity and applicability of research findings.Variations in the results of different studies might be due to the use of different and non-standardized assessment tools.To overcome this problem,this editorial enlists various reliable tools available in the literature.In conclusion,we advocate that the focus of researchers should shift from mere periodontal research to PCPR so that the results can be effectively applied in clinical settings and the therapeutic strategy can also change from mere periodontal therapy to patient-centric periodontal therapy.

Research progress on dynamic monitoring of ctDNA and drug resistance related concomitant mutations in non-small cell lung cancer

Owing to significantly prolonged survival,targeted therapy has become standardized recommendation for advanced non-small cell lung cancer patients with mutated driver genes.However,the genetic status of lung cancer patients is dynamic.By dynamically monitoring the evolution of genes status,differential genes and concomitant genes related to progressive disease could be confirmed early,so as to achieve a more accurate and comprehensive insight of the whole process management of targeted therapy for lung cancer patients.Under the guidance of accurate genetic testing results,it is helpful to provide patients with more effective,long-term,and stable individualized targeted therapy.

Research Progress of Detection Methods for Microplastics

Microplastics are plastic particles or fibers with a diameter of less than 5 mm,and they widely exist in the environment and pose potential risks to the ecosystem and human health.Microplastics detection can provide basic data for formulating effective environmental protection strategies.In this paper,the physical,chemical and biological detection methods of microplastics are reviewed,and the advantages and disadvantages of different methods are analyzed.The problems and challenges encountered in microplastics detection are analyzed,and the future research is discussed.

Research progress in mitochondrial autophagy mediated by BNIP3

Mitochondrial autophagy is widely found in mammals,and plays an important role in maintaining mitochondrial balance and mitochondrial quality control in cells.In this review,we reviewed the research progress of BNIP3-mediated mitochondrial autophagy and diseases in recent 5 years,providing new ideas for clinical diagnosis and treatment.

Research Progress of QuEChERS Pretreatment Technique in the Detection of Multiple Pesticide Residues

The QuEChERS extraction technique is a pretreatment technique that has been rapidly applied in recent years and is widely used in the field of pesticide residues with many advantages. This technique is based on solid phase extraction (SPE), which uses the interaction between adsorbent and impurities in the matrix to achieve the purpose of purification. The method has easier operation and better purification effect than SPE. In this paper, the research progress of the QuEChERS technique in pesticide residue detection in different fields in recent years and its future development were reviewed, hoping to provide reference for further development and utilization of the QuEChERS technique in pesticide residue detection in the future.