Za’atari camp is the largest refugee camp in Jordan. It was first established in 2012 to host Syrian refugees. Currently the camp hosts more than 81,000 refugees, with no proper sanitary system which might pose a maj...Za’atari camp is the largest refugee camp in Jordan. It was first established in 2012 to host Syrian refugees. Currently the camp hosts more than 81,000 refugees, with no proper sanitary system which might pose a major threat to surface resources in the area. An investigation was done at Za’atari refugees’ camp to find the impact of refugees settling on surface and groundwater quality. Surface water quality of surface runoff generated from thirty rain fall events were collected during the winter season of 2013/2014 from the major Wadi that passes through the camp and small ponds within the camp after the rainfall event. The collected samples were analyzed for acidity (pH), the electrical connectivity (EC), total dissolved solids (TDS), nutrients (NO3<sup style='margin-left:-7px;'>- and PO4<sup style='margin-left:-7px;'>3-) and selected heavy metals (Mn, Cd, Zn, Pb and Ni) in addition to biological oxygen demand (BOD5), chemical oxygen demand (COD) and intestinal worms (Total Coliform, E. cali). The results showed that there are significant variations in the EC as well as with TDS between the sites due to fluctuating amounts of water used for different activities within the camp as it was highest in the center of the camp where most of the refugees settle decreasing away from the center. The pH values were within the specifications of the World Health Organization and the Jordanian Standards. For nutrients, nitrate concentration was low with high phosphate ions which are most probably from detergents origin.展开更多
The main idea of reinforcement learning is evaluating the chosen action depending on the current reward.According to this concept,many algorithms achieved proper performance on classic Atari 2600 games.The main challe...The main idea of reinforcement learning is evaluating the chosen action depending on the current reward.According to this concept,many algorithms achieved proper performance on classic Atari 2600 games.The main challenge is when the reward is sparse or missing.Such environments are complex exploration environments likeMontezuma’s Revenge,Pitfall,and Private Eye games.Approaches built to deal with such challenges were very demanding.This work introduced a different reward system that enables the simple classical algorithm to learn fast and achieve high performance in hard exploration environments.Moreover,we added some simple enhancements to several hyperparameters,such as the number of actions and the sampling ratio that helped improve performance.We include the extra reward within the human demonstrations.After that,we used Prioritized Double Deep Q-Networks(Prioritized DDQN)to learning from these demonstrations.Our approach enabled the Prioritized DDQNwith a short learning time to finish the first level of Montezuma’s Revenge game and to perform well in both Pitfall and Private Eye.We used the same games to compare our results with several baselines,such as the Rainbow and Deep Q-learning from demonstrations(DQfD)algorithm.The results showed that the new rewards system enabled Prioritized DDQN to out-perform the baselines in the hard exploration games with short learning time.展开更多
文摘Za’atari camp is the largest refugee camp in Jordan. It was first established in 2012 to host Syrian refugees. Currently the camp hosts more than 81,000 refugees, with no proper sanitary system which might pose a major threat to surface resources in the area. An investigation was done at Za’atari refugees’ camp to find the impact of refugees settling on surface and groundwater quality. Surface water quality of surface runoff generated from thirty rain fall events were collected during the winter season of 2013/2014 from the major Wadi that passes through the camp and small ponds within the camp after the rainfall event. The collected samples were analyzed for acidity (pH), the electrical connectivity (EC), total dissolved solids (TDS), nutrients (NO3<sup style='margin-left:-7px;'>- and PO4<sup style='margin-left:-7px;'>3-) and selected heavy metals (Mn, Cd, Zn, Pb and Ni) in addition to biological oxygen demand (BOD5), chemical oxygen demand (COD) and intestinal worms (Total Coliform, E. cali). The results showed that there are significant variations in the EC as well as with TDS between the sites due to fluctuating amounts of water used for different activities within the camp as it was highest in the center of the camp where most of the refugees settle decreasing away from the center. The pH values were within the specifications of the World Health Organization and the Jordanian Standards. For nutrients, nitrate concentration was low with high phosphate ions which are most probably from detergents origin.
文摘The main idea of reinforcement learning is evaluating the chosen action depending on the current reward.According to this concept,many algorithms achieved proper performance on classic Atari 2600 games.The main challenge is when the reward is sparse or missing.Such environments are complex exploration environments likeMontezuma’s Revenge,Pitfall,and Private Eye games.Approaches built to deal with such challenges were very demanding.This work introduced a different reward system that enables the simple classical algorithm to learn fast and achieve high performance in hard exploration environments.Moreover,we added some simple enhancements to several hyperparameters,such as the number of actions and the sampling ratio that helped improve performance.We include the extra reward within the human demonstrations.After that,we used Prioritized Double Deep Q-Networks(Prioritized DDQN)to learning from these demonstrations.Our approach enabled the Prioritized DDQNwith a short learning time to finish the first level of Montezuma’s Revenge game and to perform well in both Pitfall and Private Eye.We used the same games to compare our results with several baselines,such as the Rainbow and Deep Q-learning from demonstrations(DQfD)algorithm.The results showed that the new rewards system enabled Prioritized DDQN to out-perform the baselines in the hard exploration games with short learning time.
