国内教育技术领域元分析方法学质量研究

Research on thethe Quality of Meta-analyses Methodology in the Field of Domestic Educational Technology

元分析被视为指导教育实践与制定教育政策的“最佳证据”。然而,这并不意味着元分析的研究结论一定是可靠的。基于此,文章试图分析发表在国内教育技术领域期刊中关于元分析的研究质量,首先通过文献检索和筛选共纳入39篇元分析文献;接着编制了包含25个题项的元分析方法学质量评价工具;随后对39篇文献进行文献编码与资料提取。研究发现,虽然国内教育技术领域元分析的发表数量和研究质量呈整体上升趋势,但研究报告质量参差不齐;纳入研究的元分析文献普遍存在概念泛化、文献检索不充分、关键研究过程缺失、忽视研究结果的普遍性和局限性等问题。文章期望通过研究为规范元分析在教育技术领域的应用提供参考。

Meta-analysis is considered as the“best evidence”for guiding educational practice and formulate education policies.However,it does not mean that the research conclusion of the meta-analysis is necessarily reliable.Based on this,this paper attempted to analyze the research quality of meta-analyses published in domestic educational technology journals.Firstly,a total of 39 meta-analysis literature were included through literature search and screening.Then,a meta-analysis methodology quality evaluation tool containing 25 items was compiled.Subsequently,39 pieces of literature were coded and data extracted.It was found that although the publication number and research quality of meta-analysis in the field of domestic educational technology showed an overall upward trend,the quality of research reports was uneven,and the meta-analysis literature included in the research generally had the problems of conceptual generalization,insufficient literature retrieval,and lack of key research processes,ignoring the generalizability and limitations of the research results.This paper was expected to provide reference for the application of normative meta-analysis in the field of educational technology through research.