Using the Delphi method to propose foods for special medical purposes health effect evaluation indicators

Objective:The Delphi method was used to propose health effect evaluation indicators to assess foods for special medical purposes(FSMPs).This lays the foundation for the formation of a big data model for human health testing,as well as a big data platform for the health and safety evaluation of special medical foods.Methods:The Delphi method was used to conduct two rounds of expert consultation on the constructed FSMP health effect evaluation indicators.Results:Ten major items were identified after two rounds of expert consultation.Among these,there were 10 primary entries,32 secondary entries,50 tertiary entries,and 28 quaternary entries.Conclusion:The complete list of evaluation indicators contains 10 entries,which can comprehensively and systematically monitor adverse reactions to the use of FSMPs.The present findings lay the foundation for a big data platform to evaluate the health and safety of special foods.

Construction of the First Certification Evaluation Index System for Diabetes Specialist Nurses by Delphi Method

Objective: To establish an evaluation index system for the first-time certification of diabetes specialist nurses in line with the clinical nursing practice in China, and to provide a reference basis for government administrations and hospitals to formulate unified standards. Methods: After the research team has determined the theme, it will consult the development of A) specialist nursing through the library, Internet and electronic literature database;B) the history of the development of specialist nurses in diabetes and other fields;C) the selection criteria of specialist nurses;D) the training of specialist nurses system, assessment method;E) Specialist nurse certification body, evaluation standards and certification standards and other related documents, literature, books and report materials. The author established the preliminary index system through literature review, specialist interview and group discussion and used Delphi method to organize three rounds of 30 experts’ consultations. Results: A first certification evaluation index system including 8 fundamental indicators, 5 first-level indicators, 19 second-level indicators and 99 third-level indicators was constructed for diabetes nurses. Conclusion: The results of three rounds of expert consultation and demonstration are reliable, and the constructed index system is suitable for comprehensive evaluation of diabetes specialist nurses, which provides a basis for the effective management of nursing resources.

基于Delphi法构建手术室围术期低体温预防管理评价指标体系

目的 构建手术室围术期低体温预防管理评价指标体系。方法 2022年2月,以结构-过程-结果三维质量评价模式为理论框架,参考相关文献拟定手术室围术期低体温预防管理评价指标体系,采用德尔菲法对来自手术室护理管理、院内感染、麻醉领域的23名专家进行2轮专家函询,采用优序图法确定指标权重系数。结果 2轮专家函询的积极系数分别为100.0%和95.7%,专家权威系数分别为0.946和0.934,各项指标变异系数(CV)均<0.25,Kendall’s W值分别为0.419和0.359(均P<0.001),最终构建了包含3项一级指标、9项二级指标、53项三级指标的手术室围术期低体温预防管理评价指标体系。结论基于Delphi法构建手术室围术期低体温预防管理评价指标体系有较好的科学性和可靠性,可为手术室护理管理者提供参考,有利于临床开展科学、规范、统一的质量评价。

基于Delphi-AHP法的高职专业课教师课程思政能力评价指标体系建构

专业课教师的课程思政能力是高职院校全面推进课程思政工作的关键。针对高职专业课教师课程思政能力结构尚不明晰,评价体系粗放等问题,采用Delphi-AHP法构建高职专业课教师课程思政能力评价指标体系。通过文献三级编码、专家咨询和研究小组讨论,拟定高职专业课教师课程思政能力评价指标体系草案,然后经过两轮德尔菲(Delphi)专家咨询,确定了包含5个一级指标、17个二级指标和58个三级指标的评价指标体系,再采用层次分析法(AHP),构建各级指标判断矩阵,计算各指标权重并检验判断矩阵的一致性,确定各指标的合理权重。研究结果在理论上为探究高职专业课教师课程思政能力内涵拓展了新的认知视角,在实践上为高职院校教师课程思政能力测评提供了可操作的依据和方向。

基于Delphi法构建全科住院医师规范化培训教学查房细化评分量表

目的探索构建标准化全科住院医师规范化培训教学查房细化评分量表。方法采用焦点小组法组织从事全科医学工作10年以上的专家进行讨论,初步构建《全科住院医师规范化培训教学查房细化评分表》。然后,由10名全科教学查房指导专家,根据指标的重要性、可行性及专家的积极性、协调性等进行两轮Delphi问卷咨询。最后,运用层次分析法计算各级指标的权重,确定评价指标体系。结果共进行2轮焦点小组讨论,5名成员对各级指标进行讨论修改分类,初步建立教学查房评估指标体系。10名咨询专家共进行2轮问卷咨询,问卷回收率均为100%。第一轮、第二轮专家咨询的权威系数分别为0.93,0.97,协调系数Kendall’s W分别为0.522,0.421,P<0.001。根据两轮专家咨询结果构建7项一级指标、20项二级指标、119项三级指标,其中一级指标的权重分别为0.0327、0.0464、0.1599、0.2815、0.1599、0.1599、0.1599,所有指标判断矩阵的一致性比率CR均小于0.1。结论本研究构建的全科教学查房细化评分体系合理、完整、可操作性好,多维度反映查房教师及住院医师表现,可作为全科教学查房评价的参考依据。

基于Delphi+AHP的茶树种质资源管理评价指标体系构建

基于Delphi专家咨询法构建科学的茶树种质资源管理评价指标体系,为茶树种质资源的现代化管理提供评价工具。通过田野调研以及相关标准、管理办法等文献分析,初步拟定评价指标体系框架;以福建省为例,筛选18名专家进行2轮咨询,对专家特征、意见可靠性等进行统计分析,并采用AHP法计算权重。结果表明,2轮专家积极性系数均为100%,专家权威程度分别为0.809、0.847,最终确定4个一级指标、16个二级指标。茶树种质资源管理评价指标体系在专家库中达成了令人满意的共识,即符合中国茶树种质资源管理特色,体现交叉学科优势,适用于地方茶树种质资源管理评价工作。

Fully Completed Spherical Fuzzy Approach-Based Z Numbers(PHIModel)for Enhanced Group Expert Consensus

This study aims to establish an expert consensus and enhance the efficacy of decision-making processes by integrating Spherical Fuzzy Sets(SFSs)and Z-Numbers(SFZs).A novel group expert consensus technique,the PHImodel,is developed to address the inherent limitations of both SFSs and the traditional Delphi technique,particularly in uncertain,complex scenarios.In such contexts,the accuracy of expert knowledge and the confidence in their judgments are pivotal considerations.This study provides the fundamental operational principles and aggregation operators associated with SFSs and Z-numbers,encompassing weighted geometric and arithmetic operators alongside fully developed operators tailored for SFZs numbers.Subsequently,a case study and comparative analysis are conducted to illustrate the practicality and effectiveness of the proposed operators and methodologies.Integrating the PHI model with SFZs numbers represents a significant advancement in decision-making frameworks reliant on expert input.Further,this combination serves as a comprehensive tool for decision-makers,enabling them to achieve heightened levels of consensus while concurrently assessing the reliability of expert contributions.The case study results demonstrate the PHI model’s utility in resolving complex decision-making scenarios,showcasing its ability to improve consensus-building processes and enhance decision outcomes.Additionally,the comparative analysis highlights the superiority of the integrated approach over traditional methodologies,underscoring its potential to revolutionize decision-making practices in uncertain environments.

基于AHP-Delphi法的黄河山西段水土流失治理生态效益评价研究

针对黄河山西段水土流失问题,对山西采取的水土流失治理措施进行梳理。基于AHP法与Delphi法构建起包含三个评价层次、十二个指标层的水土流失治理生态效益综合评价体系,详细分析各指标含义及计算方法,并对该体系的一致性进行检验,计算各指标的权重,对无量纲化处理过后的各指标进行分值量化,结合评价等级标准,最终得出结论:治理后总体评分为81.61分,评价等级为Ⅳ级。说明山西多年来对省内水土流失问题的整治取得了良好效益,有效缓解了水土流失问题。

高职教师绩效考核体系设计——基于AHP和Delphi Method的综合运用

高职教师绩效考核的核心是教师工作业绩细化指标的设计,它的设计与教学改革相关性最大,基于AHP和Delphi Method的综合运用,从一级指标的权重看,教师科研工作业绩明显大于教学工作业绩;从二级指标看,教学研究与改革的重要性正逐步被认识;教学工作虽是衡量工作业绩的第一要素,但其内容已经丰富化,不再局限于课堂教学;教学政策的评定也更加多样化。

利用Delphi法和层次分析法构建医学援外培训效果评价指标体系

目的科学构建医学援外培训效果评价指标体系,为精准评价医学援外培训效果提供有效参考。方法在系统分析案例单位承办的91期援外培训项目交流座谈纪要和学员满意度调查问卷的基础上,初步制定了医学援外培训效果评价指标体系草案,再采用Delphi法进行专家咨询,通过问卷回收率和权威系数分别反映专家积极性和权威性;专家意见集中程度用条目相关性均值和CV表示,专家意见协调程度用肯德尔协调系数(Kendall’s W值)表示。最终制定的医学援外培训效果评价指标体系共包含4个一级指标(反应层、学习层、行为层和结果层),11个二级指标(培训需求、培训内容和培训师资等)和42个三级指标(驻外机构服务、基础技能考核及新技术新业务开展情况等)。结果三轮咨询均发放18份问卷,每轮均收回18份,回收率100%。第一、第二、第三轮专家咨询的判断系数(Ca)分别为0.906,0.883,0.911,熟悉程度系数(Cs)分别为0.789,0.878,0.878,三轮专家咨询的权威系数分别为0.847,0.881,0.895。以属性必要性为例,第一轮一级指标、二级指标、三级指标的专家意见协调程度的Kendall’s W值分别为0.021,0.032,0.133,显著性检验结果显示差异有统计学意义(P<0.001);第二轮一级指标、二级指标、三级指标的专家意见协调程度的Kendall’s W值分别为0.143,0.055,0.158;第三轮一级指标、二级指标、三级指标的专家意见协调程度的Kendall’s W值分别为0.149,0.099,0.171。结论采用Delphi法和层次分析法构建医学援外培训效果评价指标体系具有较高的科学性,可作为客观评价医学援外培训效果的工具。

基于Delphi法的老年健康人群体力活动健康素养评价指标体系研究

目的 构建评价老年健康人群体力活动健康素养的指标体系,以补充完善《中国公民健康素养》内容,增强老年人对体力活动相关知识的认知,推动全民健身和全民健康深度融合。方法 采用文献资料法、专题讨论构建老年健康人群体力活动健康素养评价指标体系初稿,经3轮德尔菲专家咨询后确定最终的指标体系,采用层次分析法确定各级指标权重。结果 共12名专家全程参与德尔菲专家咨询,第1轮专家积极系数为92.3%,第2、3轮专家积极系数均为100.0%。3轮专家权威系数Cr均>0.7。第1、2轮各指标的重要性、可操作性均数均>7.5,Cv≤0.25;第3轮各指标重要性均数均>4.3,Cv取值区间为0.08~0.18,专家意见趋于一致。最终构建的老年健康人群体力活动健康素养评价指标体系包含3项一级指标、9项二级指标、31项三级指标。一级指标中,体力活动方式与行为、体力活动基本技能的指标权重最高,均为0.339;二级指标中,体力活动行为、体力活动时间的指标权重最高,均为0.115;三级指标中,促进人体代谢机能、预防和降低慢性疾病风险、降低损伤和疼痛、促进心理健康、有氧练习、平衡练习、积极参与体力活动、安全有效进行体力活动、有氧练习时间和平衡与力量练习时间的指标权重最高,均为0.033。结论 应用Delphi法构建的老年健康人群体力活动健康素养评价指标体系具有一定的科学性和权威性,可为后续老年健康人群的健康素养水平调查、分析提供理论依据。

基于Delphi法的手术室植入性医疗器械管理评价指标体系构建

目的 构建手术室植入性医疗器械管理评价指标体系,旨在规范手术室植入性医疗器械管理方法和流程。方法 2022年2-4月,以结构-过程-结果三维质量评价模式理论为框架,在参考相关文献的基础上拟定手术室植入性医疗器械管理评价指标体系,并采用德尔菲法对来自护理、院感、医疗器械领域的26名专家进行两轮专家函询,采用优序图法确定指标权重系数。结果 两轮专家函询的积极系数分别为92.0%和91.7%,专家权威系数分别为0.929和0.925,变异系数(CV)均<0.25,Kendall’s W值分别为0.354和0.376(均P<0.001),信度值为0.967。最终构建了包含3项一级指标、10项二级指标和35项三级指标的手术室植入性医疗器械管理评价指标体系。结论 基于Delphi法构建的手术室植入性医疗器械管理评价指标体系有较好的科学性和可靠性,可为手术室护理管理者提供参考,有利于临床开展科学、规范、统一的质量评价。

基于Delphi法的临床学科评估指标体系构建

目的构建三级综合医院临床学科评估指标体系。方法2018年1—6月间,新疆维吾尔自治区人民医院采用专题小组讨论法德尔菲法进行三轮专家咨询调查,确定3个层级的临床学科评估指标;运用层次分析法建立层次结构模型,构建两两比较判断矩阵,确定3个层级指标权重。结果构建了涵盖5个一级指标、17个二级指标和53个三级指标的临床学科评估指标体系;其中5个一级指标医疗能力和质量、人才队伍、科研教学能力、学科声誉、运行效率的权重值分别为0.276、0.167、0.201、0.133、0.223。结论本研究的指标设置明确合理,权重系数精准稳定,评价体系全面可靠,为医院临床学科的评估、管理提供科学的量化依据。

Establishment of the benchmarking tool for evaluating the operation of biorepositories for pathogenic resource using a modified Delphi method

In recent years,as the infectious diseases caused by pathogens such as novel coronavirus and mpox(formerly called monkeypox)spread globally,the significance of identification,preservation,and sharing of pathogenic resources become prominent.Along with the rapid development of biorepositories,it is imperative to evaluate their operation in a scientific manner.By using the literature review and modified Delphi method,this study develops a benchmarking tool for the comprehensive evaluation of the operation of biorepositories for pathogenic resources.The effective response rates of both rounds of expert surveys were 100%.The authority coefficients(Cr)were 0.82 and 0.85,respectively,manifesting the reliability of consultation results.In the second‐round survey,the Kendall’s coefficient of concordance(Kendall’s W)of all indicators ranged from 0.09 to 0.31(P<0.001),the comprehensive score ranged from 4.02 to 4.94,the standard deviation ranged from 0.21 to 0.77,and the coefficient of variation(CV)ranged from 0.04 to 0.22,indicating that the expert opinions reached consensus.The final benchmarking tool was composed of 4 primary indicators,12 secondary indicators,and 65 tertiary indicators.The weights of the four primary indicators allocated through the rank‐sum ratio method,namely organizational structure,management requirements,biobanking capacity,and sharing capacity,were 30.50%,30.08%,25.45%,and 13.97%,respectively.The benchmarking tool established in this study provides references for the comprehensive evaluation of the operation and puts forward advice for the sustainable development of biorepositories for pathogenic resources.

Delphi methodology in healthcare research:How to decide its appropriateness

The Delphi technique is a systematic process of forecasting using the collective opinion of panel members.The structured method of developing consensus among panel members using Delphi methodology has gained acceptance in diverse fields of medicine.The Delphi methods assumed a pivotal role in the last few decades to develop best practice guidance using collective intelligence where research is limited,ethically/logistically difficult or evidence is conflicting.However,the attempts to assess the quality standard of Delphi studies have reported significant variance,and details of the process followed are usually unclear.We recommend systematic quality tools for evaluation of Delphi methodology;identification of problem area of research,selection of panel,anonymity of panelists,controlled feedback,iterative Delphi rounds,consensus criteria,analysis of consensus,closing criteria,and stability of the results.Based on these nine qualitative evaluation points,we assessed the quality of Delphi studies in the medical field related to coronavirus disease 2019.There was inconsistency in reporting vital elements of Delphi methods such as identification of panel members,defining consensus,closing criteria for rounds,and presenting the results.We propose our evaluation points for researchers,medical journal editorial boards,and reviewers to evaluate the quality of the Delphi methods in healthcare research.

Methodological exploration on the construction of a traditional Chinese medicine nursing expert consensus based on evidence--taking stroke as an example

Objective: To explore the methodology of the evidence-based expert consensus formulation process of traditional Chinese medicine(TCM) nursing taking stroke as an example.Methods: First, preliminary and comprehensive presentation of all stroke-related symptoms and corresponding TCM nursing techniques involved were revealed through bibliometric analysis. Then, selection of stroke symptoms and TCM nursing techniques for inclusion in the consensus was performed using an expert consultation method. Next, we determined the search strategy for a precise evidence search;conducted an evaluation of evidence quality and the grade of the evidence;and completed evidence extraction, evidence analysis, and evidence synthesis based on the included symptoms and TCM nursing techniques. The Delphi method was then applied to determine the strength of each recommendation and the choice of nursing care points by referring to the Grading of Recommendations, Assessment, Development, and Evaluations grid. Finally, we conducted an external expert validation of the Delphi results to form an expert consensus guideline.Results: Through the bibliometric analysis, 22 stroke symptoms and 18 TCM nursing techniques were identified in the literature. Then, after expert consultation, 22 symptoms and 111 pairs of symptoms combined with TCM nursing techniques were selected for the evidence search. Evidence integration yielded 10 stroke symptoms corresponding to 29 bodies of evidence;these 10 symptoms were retained through the Delphi consultation, and recommendation strength results for 26 recommendations were obtained. A total of 9 symptoms were further retained for expert external validation to form 24 recommendations, with a recommendation process score range of 7.64-9.99 points and a more scientific and standardized recommendation-formation process.Conclusion: Owing to the current limited conditions of evidence-based resources for TCM nursing, the present consensus-building process represents only a preliminary exploration of an evidence-based expert consensus for TCM nursing to provide a reference for a more scientific and standardized methodology.

基于Delphi法构建妇科腹腔镜手术室管理评价指标体系

目的:基于Delphi法构建妇科腹腔镜手术中手术室管理评价指标体系。方法:选择本地区二级乙等及以上医院的来自妇产科、手术室专业护理、手术室护理管理、医院护理管理以及医院质量管理领域的16名高级职称专家为咨询对象。在检索妇科腹腔镜手术及手术室管理等方面的国内外文献基础上制订函询表,并进行院内小范围专家预调查;采用Delphi法进行2轮专家咨询,根据专家意见对条目进行修改,确定手术室管理评价指标及权重。结果:本研究共进行2轮专家咨询,专家判断系数为0.98,专家熟悉系数为0.74,专家权威系数为0.86。2轮函询结果中,二级和三级指标的变异系数为0.092~0.114。最终构建的手术室管理评价指标体系包含3项一级指标、7项二级指标和34项三级指标。结论:本研究基于Delphi法构建了科学、合理及全面的手术室管理评价指标体系,可用于评估妇科腹腔镜手术患者的围手术期护理质量,有利于持续改进护理质量。

Study on traditional Chinese medicine syndrome of esophageal cancer based on Delphi method

Esophageal cancer is one of the common malignant tumors in humans.Traditional Chinese medicine(TCM)has unique advantages in the treatment of esophageal cancer.However,the TCM syndrome classification of esophageal cancer is not standardized.This Delphi survey aimed to explore the TCM syndrome classification and symptom characteristics of esophageal cancer.Methods:Based on literature research,an expert consultation questionnaire was developed for the study of the TCM syndrome rules of esophageal cancer.Two rounds of questionnaire surveys were conducted among 62 experts across the country.Statistical description and statistical analysis of the mean,coefficient of variation,grade sum,and unimportant percentage of the retrieved data.TCM syndrome rules and diagnostic indicators for esophageal cancer after screening and sorting out the questionnaire items,convening experts to demonstrate.Results:62 valid questionnaires were collected,and the expert positive coefficient was 100%.The Kendall's coefficient of concordance W of the first and second rounds are 0.232 and 0.2334 respectively.In addition,the Kendall's coefficient of concordance W of the second round has been improved compared with the first round,suggesting that experts have a better degree of coordination on the importance of indicators.The common TCM syndromes of esophageal cancer are obtained:"liver-stomach disharmony,phlegm and qi obstruction syndrome","liver and spleen disorders,phlegm accumulating with stagnation syndrome","deficiency of liver and kidney yin,stubborn blood syndrome","deficiency of spleen and kidney yang,stubborn blood syndrome".Conclusion:The TCM syndrome indicators of esophageal cancer has been established.It provides a basis for the standardized research of TCM syndrome diagnosis of esophageal cancer,which is of positive significance for improving the level of clinical diagnosis and treatment.

Establishing nursing adverse events’reporting content of hospital:using the Delphi method

Objective:To develop nursing adverse events’reporting content of hospital.Methods:The study included two phases.The first phase was to develop the category and definition of nursing adverse events that need to be reported through an expert meeting.The second phase was to develop every nursing adverse event’s reporting content by using the Delphi method.In total,8 experts attended the meeting and 15 experts conducted two rounds of consultation letter.Results:Nursing adverse events that need to be reported of hospital include pressure sore,fall/falling from bed,unplanned extubation,medication error,and accident.Reporting content of these events in detail had also been obtained,which was helpful for cause analysis systematically.Conclusions:The reporting content of the nursing adverse event of hospital is established,and it is a basis for further study of the development of nursing adverse event reporting and feedback system.

Construction and Application of Oral English Evaluation Index System Based on AHP

The paper confirms evaluation indexes of oral English with the application of Delphi technique and expert consultation, and then establishes hierarchical structure model of oral English evaluation index system. The weight of each evaluation index is determined with the methods of Delphi and expert consultation again. A group of students＇ oral English is subsequently evaluated by using AHP （Analytic Hierarchy Process） based on oral English evaluation index system and the weights we set up in this thesis.