With the advent of Internet services, big data and cloud computing, high-throughput computing has generated much research interest, especially on high-throughput cloud servers. However, three basic questions are still...With the advent of Internet services, big data and cloud computing, high-throughput computing has generated much research interest, especially on high-throughput cloud servers. However, three basic questions are still not satis-factorily answered: (1) What are the basic metrics (what throughput and high-throughput of what)? (2) What are the main factors most beneficial to increasing throughput? (3) Are there any fundamental constraints and how high can the throughput go? This article addresses these issues by uti- lizing the fifty-year progress in Little's law, to reveal three fundamental relations among the seven basic quantities of throughput (2), number of active threads (L), waiting time (W), system power (P), thread energy (E), Watts per thread to, threads per Joule 0. In addition to Little's law L = λW, we obtain P =λE and λ = Lto0, under reasonable assumptions. These equations help give a first order estimation of per- formance and power consumption targets for billion-thread cloud servers.展开更多
文摘With the advent of Internet services, big data and cloud computing, high-throughput computing has generated much research interest, especially on high-throughput cloud servers. However, three basic questions are still not satis-factorily answered: (1) What are the basic metrics (what throughput and high-throughput of what)? (2) What are the main factors most beneficial to increasing throughput? (3) Are there any fundamental constraints and how high can the throughput go? This article addresses these issues by uti- lizing the fifty-year progress in Little's law, to reveal three fundamental relations among the seven basic quantities of throughput (2), number of active threads (L), waiting time (W), system power (P), thread energy (E), Watts per thread to, threads per Joule 0. In addition to Little's law L = λW, we obtain P =λE and λ = Lto0, under reasonable assumptions. These equations help give a first order estimation of per- formance and power consumption targets for billion-thread cloud servers.