Can ChatGPT evaluate research quality?

Purpose:Assess whether ChatGPT 4.0 is accurate enough to perform research evaluations on journal articles to automate this time-consuming task.Design/methodology/approach:Test the extent to which ChatGPT-4 can assess the quality of journal articles using a case study of the published scoring guidelines of the UK Research Excellence Framework(REF)2021 to create a research evaluation ChatGPT.This was applied to 51 of my own articles and compared against my own quality judgements.Findings:ChatGPT-4 can produce plausible document summaries and quality evaluation rationales that match the REF criteria.Its overall scores have weak correlations with my self-evaluation scores of the same documents(averaging r=0.281 over 15 iterations,with 8 being statistically significantly different from 0).In contrast,the average scores from the 15 iterations produced a statistically significant positive correlation of 0.509.Thus,averaging scores from multiple ChatGPT-4 rounds seems more effective than individual scores.The positive correlation may be due to ChatGPT being able to extract the author’s significance,rigour,and originality claims from inside each paper.If my weakest articles are removed,then the correlation with average scores(r=0.200)falls below statistical significance,suggesting that ChatGPT struggles to make fine-grained evaluations.Research limitations:The data is self-evaluations of a convenience sample of articles from one academic in one field.Practical implications:Overall,ChatGPT does not yet seem to be accurate enough to be trusted for any formal or informal research quality evaluation tasks.Research evaluators,including journal editors,should therefore take steps to control its use.Originality/value:This is the first published attempt at post-publication expert review accuracy testing for ChatGPT.

Quality Research on the Purple Leaf Mutant of Rice——PLM

[Objective] The aim was to carry out the quality research on a purple leaf mutant （PLM） of rice and provide the basis for applied research of purple rice.[Method] A newly discovered purple mutant of rice and its hybrid filial generations （F1 and F2） were employed as the experimental materials to determine its characteristic indexes,such as grain type,chalky grain rate,chalkiness,1 000-grain weight,brown rice percentage,protein content,amylose content,gelatinization temperature and consistency.[Result] The grain type and brown rice percentage of the parent （pro-Z） both reached standard of Ⅰ Grade,while chalky grain rate,chalkiness,amylose content and consistency did not meet the requirements of the standard.The F2 generation displayed some optimized properties,including larger grain,lower amylose content,reduced chalkiness,lower chalky grain rate and softened consistency.[Conclusion] The majority of the characteristic indexes of pro-Z did not meet the requirements of standard,but the qualities of F2 generation were all optimized to some extent.

Is big team research fair in national research assessments? The case of the UK Research Excellence Framework 2021

Collaborative research causes problems for research assessments because of the difficulty in fairly crediting its authors.Whilst splitting the rewards for an article amongst its authors has the greatest surface-level fairness,many important evaluations assign full credit to each author,irrespective of team size.The underlying rationales for this are labour reduction and the need to incentivise collaborative work because it is necessary to solve many important societal problems.This article assesses whether full counting changes results compared to fractional counting in the case of the UK’s Research Excellence Framework(REF)2021.For this assessment,fractional counting reduces the number of journal articles to as little as 10%of the full counting value,depending on the Unit of Assessment(UoA).Despite this large difference,allocating an overall grade point average(GPA)based on full counting or fractional counting gives results with a median Pearson correlation within UoAs of 0.98.The largest changes are for Archaeology(r=0.84)and Physics(r=0.88).There is a weak tendency for higher scoring institutions to lose from fractional counting,with the loss being statistically significant in 5 of the 34 UoAs.Thus,whilst the apparent over-weighting of contributions to collaboratively authored outputs does not seem too problematic from a fairness perspective overall,it may be worth examining in the few UoAs in which it makes the most difference.

Germplasm Resources and Quality Research of Three Species of Chrysanthemums in Bozhou

[Objective]The paper was to preliminarily study the pharmacognosy of three species of chrysanthemums cultivated in Bozhou,and to compare their similarities and differences.[Method]Organs of three species of chrysanthemum samples were dissected and made into integral slices,and surface morphology of each part was observed microscopically.Powder slices were developed in the same way and observed under a microscope.According to thin layer chromatography(TLC)test(Part I,Appendix VIB,2005 edition),2μL of sample solutions and reference solutions were absorbed respectively,and dripped on the same piece of silica gel G thin layer plate.With petroleum ether-acetone(2∶1)as the developing solvent,samples were developed and then dried.Slices were sprayed with chromogenic agent 2%aluminum trichloride,and examined under UV light at the wavelength of 365 nm.Whether fluorescent spots of the same color were displayed in the position corresponding to the chromatogram of reference solutions were observed.[Result]Non-glandular hairs were found in bract microstructures of three species of chrysanthemums.There were many T-shaped hairs and few multicellular sessile non-glandular hairs.The epidermal cell walls of bracts were parallel straight,and some were rectangular;stomas could be seen everywhere.Only Dendranthema morifolium(Ramat.)Tzvel.‘Boju’cv.nov.and Dendranthema morifolium(Ramat.)Tzvel.‘Da maya’cv.nov.displayed fluorescent spots of the same color in the position corresponding to the chromatogram of reference sample acacetin in TLC test,and the spots of D.morifolium(Ramat.)Tzvel.‘Da maya’cv.nov.were light in color;there were no spots observed in Chrysanthemum morifolium Ramat.[Conclusion]The external characters,internal forms and internal components of D.morifolium(Ramat.)Tzvel.‘Boju’cv.nov.,D.morifolium(Ramat.)Tzvel.‘Da maya’cv.nov.and C.morifolium Ramat are all related to germplasm resources of chrysanthemum species.The contents of acacetin,one of the components of D.morifolium(Ramat.)Tzvel.‘Boju’cv.nov.and D.morifolium(Ramat.)Tzvel.‘Da maya’cv.nov.,remain to be further studied.

The Theory and Methods Research on Ecological Quality Control of Enterprises

So far, most theories of economics and management are under the same premisethat the natural resources are never exhausted and regenerated repeatedly. The magic of technologybrought by industrial revolution endowed human with power that they can do anything they want. Italso turns natural resources into industrial energy and enhances the development of human societyand civilization. Human uses direct comparison of input and output and the satisfaction degree ofdemands to measure the production activities, the economic benefit and management performance,regardless of the change of ecology that serves as the natural resources. However, since theecological environment has been changing worse recently and natural disaster happened frequentlyhuman's dream of conquering the nature has been broken. The nature implements reprisal against humanagain and again, and human is faced with the development limit because of the environmentalrestriction.

External validation of the Moroccan Arabic version of the European Organization for Research and Treatment of Cancer colorectal(CR29)module:Monocentric study

BACKGROUND Quality of life(QoL)outcomes are a focal endpoint of cancer treatment strategies.AIM To externally validate the Moroccan Arabic version of the European Organization for Research and Treatment of Cancer(EORTC)QoL Questionnaire(QLQ)for colorectal cancer(CRC)patients(CR29).METHODS Both Moroccan Arabic modules of QLQ-CR29 and QLQ-C30 were administered to Moroccan CRC.Psychometric properties were retested by measuring Cronbach’s alpha coefficient for reliability and Intraclass correlation coefficient(ICC)to examine test-retest reproducibility.The multitrait-scaling analysis was performed to demonstrate the validity of the instrument and known-groups comparison was used to test the score’s ability to discriminate between different groups of patients.RESULTS In total,221 patients were included in our study and 34 patients completed the questionnaire twice.The Urinary Frequency scale and Stool Frequency scale had good internal consistency with alpha Cronbach coefficients of 0.79 and 0.83 respectively,while the same coefficients were moderately lower for the Blood and Mucus in Stool scale(0.61)and the Body Image scale(0.67).The ICCs ranged from 0.88 to 1 indicating good to excellent reproducibility.In multitrait scaling analyses,the criterion for item convergent and divergent validity was satisfactory.The known-group comparison showed statistically significant differences between patients according to age,gender,stoma status,tumor location,and radiotherapy.CONCLUSION The Moroccan Arabic version of the EORTC QLQ-CR29 is a valid and reliable tool that can be used safely for research and clinical purposes in Moroccan CRC patients.

Health-related quality of life in patients that have undergone liver resection:A systematic review and meta-analysis

BACKGROUND Mortality after hepatectomy has decreased,and the quality of various surgical approaches to hepatectomy have been evaluated.Various assessments of quality of life(QOL)after hepatectomy have been developed and investigated in different clinical settings.AIM To conduct a systematic review and meta-analysis to examine two clinical topics:Laparoscopic hepatectomy vs open hepatectomy,and preoperative QOL status vs postoperative QOL status.METHODS A systematic literature search was performed using PubMed and MEDLINE,including the Cochrane Library Central.The following inclusion criteria were set for inclusion in this meta-analysis:(1)Studies comparing preoperative QOL and postoperative QOL;and(2)Studies comparing QOL between laparoscopic hepatectomy and open hepatectomy.RESULTS A total of 8 articles were included in this meta-analysis.QOL was better after laparoscopic hepatectomy than after open hepatectomy.CONCLUSION The outcomes of evaluations of QOL after hepatectomy can depend on the type of questionnaire used,the timing of the assessment,and the etiology of the hepatic disease.

Creating the Foundation of a Healthcare Research Project

The research topic of this paper develops a case study approach that builds on the foundations of Yin＇s ＂linear model＂ and ＂the best practice＂ used in theoretical case studies at international research literature. It discusses the case study method and its role and focusing on research questions like healthcare branding, research design, and methodic. Also presents the case study research theory for a research case study. The methods used in this paper are based on hypothesis of a generic hospital branding strategy for the Romanian Private Hospital and also may apply to the Romanian strategy of development of public healthcare entities and partnerships between public and private healthcare entities. An empirical test of the relationships among branding loyalty and awareness, customer satisfaction, trust and relationship commitment suggests that Romanian hospitals can be successful in creating an image and positive brand equity if they can manage their customer relationships well. This can be done through a coordinated strategy of management and marketing development of healthcare entities. The results highlight the dominance of case-study research in qualitative marketing healthcare and highlight the importance of customer relationships in the branding practice of healthcare marketing. It also shows that marketing managers can succeed in creating positive brand equity and image if they can manage relationships with their customers well.

Qualitycontrol of research data during thepandemic:A case study of retracted COVID-19 papers

The utilization of research papers has been crucial in facilitating pandemic decision-making and management.Despite the unprecedented surge of scientific publications in response to the COVID-19 outbreak,the retraction of papers related to data has been increasingly frequent,indicating shortcomings in the quality control of current research data.In this study,we aim to examine the root causes and characteristics of data-related retractions amidst the deluge of pandemic research papers,with a particular focus on articles that contain flaws stemming from issues related to research data quality.Our findings suggest that retractions related to data quality deficiencies indicate a dearth of actors and mechanisms within the research quality management landscape.The monitoring and control of data quality cannot be left solely to the self-regulation of the academic community.Hence,our study proposes recommendations for ensuring research data quality in pandemic publications from three perspectives:the management of scientific research quality,data sharing and evaluation mechanisms;publication and dissemination scrutiny mechanisms;and academic early warning and tolerance mechanisms.

Development trend and prospect of solid phase extraction technology

Solid phase extraction is widely used in sample pretreatment,concentration and analysis processes due to high selectivity and suitability for low concentration sample system.In this review,we systematically summarized and discussed the development trends of solid phase extraction by bibliometrics method.By analyzing papers output scale,the research and development direction of solid phase extraction technology is prospected.We also give an overview on current strategies of novel solid phase extraction from the separation medium and separation technology.The paper aims to describe the global research profile and the development trends of solid phase extraction,to help researchers to accurately grasp the research trend and to provide support for scientific research institutions to formulate scientific policies and strategic plans.Furthermore,the prospect of the development and application of solid phase extraction is also discussed.

Quality Marker Concept Inspires the Quality Research of Traditional Chinese Medicines

Traditional Chinese medicines （TCMs） have been used in China for thousands of years for the treatment of various diseases, highly treated as the Chinese cultural heritage. It has played the pivotal role in maintaining the health of Chinese people and even the entire globe.

State Key Laboratory of Quality Research in Chinese Medicine(Macao University of Science and Technology)

The State Key Laboratory of Quality Research in Chinese Medicine （Macao University of Science and Technology） was formally established on January 25, 2011 upon approval from the Ministry of Science and Technology of China. It is so far the only State Key Laboratory （SKL） specifically in the field of Traditional Chinese Medicine （TCM） over the country. It is also the jothed-laboratory partner of the State Key Laboratory of Natural and Biomimetic Drugs at the Peking University.

State Key Laboratory of Quality Research in Chinese Medicine(Macao University of Science and Technology)

The State Key Laboratory of Quality Research in Chinese Medicine （Macao University of Science and Technology） was formally established on January 25, 2011 upon approval from the Ministry of Science and Technology of China. It is so far the only State Key Laboratory （SKL） specifically in the field of Traditional Chinese Medicine （TCM） over the country. It is also the joined-laboratory partner of the State Key Laboratory of Natural and Bimnimetic Drugs at the Peking University.

Network Pharmacology in Research of Chinese Medicine Formula: Methodology, Application and Prospective

Chinese medicine(CM) is usually prescribed as CM formula to treat disease. The lack of effective research approach makes it difficult to elucidate the molecular mechanisms of CM formula owing to its complicated chemical compounds. Network pharmacology is increasingly applied in CM formula research in recent years, which is identified suitable for the study of CM formula. In this review, we summarized the methodology of network pharmacology, including network construction, network analysis and network verification. The aim of constructing a network is to achieve the interaction between the bioactive compounds and targets and the interaction between various targets, and then find out and validate the key nodes via network analysis and network verification. Besides, we reviewed the application in CM formula research, mainly including targets discovery, bioactive compounds screening, toxicity evaluation, mechanism research and quality control research. Finally, we proposed prospective in the future and limitations of network pharmacology, expecting to provide new strategy and thinking on study for CM formula.

Quality Assessment of Clinical Practice Guidelines for Integrative Medicine in China:A Systematic Review

Objective： To assess the quality of integrative medicine clinical practice guidelines（CPGs） published before 2014. Methods： A systematic search of the scientific literature published before 2014 was conducted to select integrative medicine CPGs. Four major Chinese integrated databases and one guideline database were searched： the Chinese Biomedical Literature Database（CBM）, the China National Knowledge Infrastructure（CNKI）, China Science and Technology Journal Database（VIP）, Wanfang Data, and the China Guideline Clearinghouse（CGC）. Four reviewers independently assessed the quality of the included guidelines using the Appraisal of Guidelines for Research and Evaluation（AGREE） Ⅱ Instrument. Overall consensus among the reviewers was assessed using the intra-class correlation coefficient（ICC）. Results： A total of 41 guidelines published from 2003 to 2014 were included. The overall consensus among the reviewers was good [ICC： 0.928; 95% confidence interval（CI）： 0.920 to 0.935]. The scores on the 6 AGREE domains were： 17% for scope and purpose（range： 6% to 32%）, 11% for stakeholder involvement（range： 0 to 24%）, 10% for rigor of development（range： 3% to 22%）, 39% for clarity and presentation（range： 25% to 64%）, 11% for applicability（range： 4% to 24%）, and 1% for editorial independence（range： 0 to 15%）. Conclusions： The quality of integrative medicine CPGs was low, the development of integrative medicine CPGs should be guided by systematic methodology. More emphasis should be placed on multi-disciplinary guideline development groups, quality of evidence, management of funding and conflicts of interest, and guideline updates in the process of developing integrative medicine CPGs in China.

Large inter annual variation in air quality during the annual festival ‘Diwali' in an Indian megacity

A network of air quality and weather monitoring stations was established under the System of Air Quality Forecasting and Research（SAFAR） project in Delhi. We report observations of ozone（O_3）, nitrogen oxides（NO_x）, carbon monoxide（CO） and particulate matter（PM_2.5and PM_（10）） before, during and after the Diwali in two consecutive years, i.e., November 2010 and October 2011. The Diwali days are characterised by large firework displays throughout India. The observations show that the background concentrations of particulate matter are between 5 and 10 times the permissible limits in Europe and the United States. During the Diwali-2010, the highest observed PM_（10） and PM_2.5mass concentration is as high as2070 μg/m^3 and 1620 μg/m3, respectively（24 hr mean）, which was about 20 and 27 times to National Ambient Air Quality Standards（NAAQS）. For Diwali-2011, the increase in PM_（10） and PM_2.5mass concentrations was much less with their peaks of 600 and of 390 μg/m^3 respectively, as compared to the background concentrations. Contrary to previous reports,firework display was not found to strongly influence the NO_x, and O_3 mixing ratios, with the increase within the observed variability in the background. CO mixing ratios showed an increase. We show that the large difference in 2010 and 2011 pollutant concentrations is controlled by weather parameters.