近年来,基于深度强化学习的综合能源系统(integrated energy system,IES)优化调度已取得阶段性进展。然而,随着IES系统结构、规模、技术等层面的持续发展,传统深度强化学习训练时间漫长和设计复杂度高等弊端逐渐显露。为此,提出一种面向...近年来,基于深度强化学习的综合能源系统(integrated energy system,IES)优化调度已取得阶段性进展。然而,随着IES系统结构、规模、技术等层面的持续发展,传统深度强化学习训练时间漫长和设计复杂度高等弊端逐渐显露。为此,提出一种面向IES能量优化调度的生成对抗模仿学习方法。首先,IES智能体通过模仿具备高奖励回馈的专家调度策略自适应学习动作探索过程,避免盲目探索造成的时间与算力浪费。其次,基于生成对抗理论,增设判别器网络辨别生成策略与专家策略之间的差异,以此作为内部奖励函数辅助神经网络参数更新,避免人工设置奖励的主观偏好和经验限制对IES调度结果的影响。最后,电-热耦合系统算例分析结果表明:训练过程中所提方法的收敛速度较传统深度强化学习算法提升了52%,收敛效果提升了10%,同时使IES智能体获得了接近专家调度经验的决策能力;在线应用时无需依赖对外界环境的准确预测和精确建模,即可实现快速实时决策。展开更多
The synergetic effect and underlying mechanism of potassium ferrate(PF)with tea saponin(TS,a biosurfactant)in producing short chain fatty acids(SCFAs)from anaerobic fermentation of waste activated sludge(WAS)were expl...The synergetic effect and underlying mechanism of potassium ferrate(PF)with tea saponin(TS,a biosurfactant)in producing short chain fatty acids(SCFAs)from anaerobic fermentation of waste activated sludge(WAS)were explored in this work.Experimental results showed that 0.2 g PF(g TSS)^(-1)(total suspended solid)combined with 0.02 g TS(g TSS)^(-1) could further improve SCFAs’production,and the maximum SCFAs content reached 2008.7 mg COD L^(-1),which is 1.2 and 4.5 times higher than those with PF and TS individually added,respectively,and 5.3 times higher than that of blank WAS on Day 12.In the model substrates experiments,the degradation rates of bovine serum albumin and dextran with combination of PF and TS were 41.3%±0.1% and 48.5%±0.06%,respectively,on Day 3,which are lower than those in blank WAS(with degradation rates of 72.3%±0.5%and 90.3%±0.3%).It was revealed that the oxidative effect of PF and the solubilization of TS caused more organic matters to be dissolved out from WAS,providing a large number of biodegradable substances for subsequent SCFAs production.While WAS pretreated with the combination of PF and TS,the relative abundances of Firmicutes increased from 6.4%(blank)to 38.6%,and that of Proteobacteria decreased from 41.8%(blank)to 21.8%.The combination of PF and TS promoted the hydrolysis process of WAS by enriching Firmicutes,and then increased acetic acid production by inhibiting Proteobacteria that consumed SCFAs.Meanwhile,at the genus level,acidogenesis bacteria(e.g.,Proteiniclasticum and Petrimonas)were enriched whereas SCFAs consuming bacteria(e.g.,Dokdonella)were inhibited.展开更多
Per-and polyfluoroalkyl substances(PFASs)are emerging persistent organic pollutants(POPs).In this study,47 surface sediment samples were collected from the Yellow River Delta wetland(YRDW)to investigate the occurrence...Per-and polyfluoroalkyl substances(PFASs)are emerging persistent organic pollutants(POPs).In this study,47 surface sediment samples were collected from the Yellow River Delta wetland(YRDW)to investigate the occurrence,spatial distribution,potential sources,and ecological risks of PFASs.Twenty-three out of 26 targeted PFASs were detected in surface sediment samples from the YRDW,with totalΣ23PFASs concentrations ranging from 0.23 to 16.30 ng g^(-1) dw and a median value of 2.27 ng g^(-1) dw.Perfluorooctanoic acid(PFOA),perfluorobutanoic acid(PFBA)and perfluorooctanesulfonic acid(PFOS)were the main contaminants.The detection frequency and concentration of perfluoroalkyl carboxylic acids(PFCAs)were higher than those of perfluoroal-kanesulfonic acids(PFSAs),while those of long-chain PFASs were higher than those of short-chain PFASs.The emerging PFASs substitutes were dominated by 6:2 chlorinated polyfluoroalkyl ether sulfonic acid(6:2 Cl-PFESA).The distribution of PFASs is significantly influenced by the total organic carbon content in the sediments.The concentration of PFASs seems to be related to human activities,with high concentration levels of PFASs near locations such as beaches and villages.By using a positive matrix factorization model,the potential sources of PFASs in the region were identified as metal plating mist inhibitor and fluoropolymer manufacturing sources,metal plating industry and firefighting foam and textile treatment sources,and food packaging material sources.The risk assessment indicated that PFASs in YRDW sediments do not pose a significant ecological risk to benthic organisms in the region overall,but PFOA and PFOS exert a low to moderate risk at individual stations.展开更多
文摘近年来,基于深度强化学习的综合能源系统(integrated energy system,IES)优化调度已取得阶段性进展。然而,随着IES系统结构、规模、技术等层面的持续发展,传统深度强化学习训练时间漫长和设计复杂度高等弊端逐渐显露。为此,提出一种面向IES能量优化调度的生成对抗模仿学习方法。首先,IES智能体通过模仿具备高奖励回馈的专家调度策略自适应学习动作探索过程,避免盲目探索造成的时间与算力浪费。其次,基于生成对抗理论,增设判别器网络辨别生成策略与专家策略之间的差异,以此作为内部奖励函数辅助神经网络参数更新,避免人工设置奖励的主观偏好和经验限制对IES调度结果的影响。最后,电-热耦合系统算例分析结果表明:训练过程中所提方法的收敛速度较传统深度强化学习算法提升了52%,收敛效果提升了10%,同时使IES智能体获得了接近专家调度经验的决策能力;在线应用时无需依赖对外界环境的准确预测和精确建模,即可实现快速实时决策。
基金supported by the National Natural Science Foundation of China(No.41276067)the Air Liquide(China)R&D Co.,Ltd.(No.20200216).
文摘The synergetic effect and underlying mechanism of potassium ferrate(PF)with tea saponin(TS,a biosurfactant)in producing short chain fatty acids(SCFAs)from anaerobic fermentation of waste activated sludge(WAS)were explored in this work.Experimental results showed that 0.2 g PF(g TSS)^(-1)(total suspended solid)combined with 0.02 g TS(g TSS)^(-1) could further improve SCFAs’production,and the maximum SCFAs content reached 2008.7 mg COD L^(-1),which is 1.2 and 4.5 times higher than those with PF and TS individually added,respectively,and 5.3 times higher than that of blank WAS on Day 12.In the model substrates experiments,the degradation rates of bovine serum albumin and dextran with combination of PF and TS were 41.3%±0.1% and 48.5%±0.06%,respectively,on Day 3,which are lower than those in blank WAS(with degradation rates of 72.3%±0.5%and 90.3%±0.3%).It was revealed that the oxidative effect of PF and the solubilization of TS caused more organic matters to be dissolved out from WAS,providing a large number of biodegradable substances for subsequent SCFAs production.While WAS pretreated with the combination of PF and TS,the relative abundances of Firmicutes increased from 6.4%(blank)to 38.6%,and that of Proteobacteria decreased from 41.8%(blank)to 21.8%.The combination of PF and TS promoted the hydrolysis process of WAS by enriching Firmicutes,and then increased acetic acid production by inhibiting Proteobacteria that consumed SCFAs.Meanwhile,at the genus level,acidogenesis bacteria(e.g.,Proteiniclasticum and Petrimonas)were enriched whereas SCFAs consuming bacteria(e.g.,Dokdonella)were inhibited.
基金financially supported by the National Natural Science Foundation of China(NSFC)(No.42377217)the Cooperation Fund between Dongying City and Universities(No.SXHZ-2023-02-6).
文摘Per-and polyfluoroalkyl substances(PFASs)are emerging persistent organic pollutants(POPs).In this study,47 surface sediment samples were collected from the Yellow River Delta wetland(YRDW)to investigate the occurrence,spatial distribution,potential sources,and ecological risks of PFASs.Twenty-three out of 26 targeted PFASs were detected in surface sediment samples from the YRDW,with totalΣ23PFASs concentrations ranging from 0.23 to 16.30 ng g^(-1) dw and a median value of 2.27 ng g^(-1) dw.Perfluorooctanoic acid(PFOA),perfluorobutanoic acid(PFBA)and perfluorooctanesulfonic acid(PFOS)were the main contaminants.The detection frequency and concentration of perfluoroalkyl carboxylic acids(PFCAs)were higher than those of perfluoroal-kanesulfonic acids(PFSAs),while those of long-chain PFASs were higher than those of short-chain PFASs.The emerging PFASs substitutes were dominated by 6:2 chlorinated polyfluoroalkyl ether sulfonic acid(6:2 Cl-PFESA).The distribution of PFASs is significantly influenced by the total organic carbon content in the sediments.The concentration of PFASs seems to be related to human activities,with high concentration levels of PFASs near locations such as beaches and villages.By using a positive matrix factorization model,the potential sources of PFASs in the region were identified as metal plating mist inhibitor and fluoropolymer manufacturing sources,metal plating industry and firefighting foam and textile treatment sources,and food packaging material sources.The risk assessment indicated that PFASs in YRDW sediments do not pose a significant ecological risk to benthic organisms in the region overall,but PFOA and PFOS exert a low to moderate risk at individual stations.
