SearcharxivSearch

arXiv subjects

Duo Cui

Publications and source records attributed to Duo Cui.

9 recordsLinked to original sources

ReviveMoE: Fast Recovery for Hardware Failures in Large-Scale MoE LLM Inference Deployments

As LLM deployments scale over more hardware, the probability of a single failure in a system increases significantly, and cloud operators must consider robust countermeasures to handle these inevitable failures. A common recovery approach is to simply restart the LLM serving instance; however, this is costly in model-as-a-service (MaaS) inference settings, where reloading model weights and recompiling computation graphs can introduce significant delays to incoming requests. We propose ReviveMoE, a method for rapid failure recovery in large-scale LLM deployments without restarting the serving instance. ReviveMoE is designed to support both the traditional LLM architecture, which collocates MoE and attention on the same hardware, and the disaggregated architectures, which separate MoE from attention. Integrated into Huawei Cloud's MaaS, ReviveMoE is built on top of Huawei's xDeepServe serving platform and the XCCL communications library.

cs.DC

The Space Experiment of the Exo-ecosystem

The experiment of exo-ecosystem and the exploration of extraterrestrial habitability aims to explore the adaptation of terrestrial life in space conditions for the manned space program and the future interstellar migration, which shows great scientific significance and public interests. By our knowledge the early life on Earth, archaea and extremophile have the ability to adapt to extreme environmental conditions and can potentially habitat in extraterrestrial environments. Here we proposed a design and framework for the experiment on exo-ecosystem and extraterrestrial habitability. The conceptual approach involves building an ecosystem based on archaea and extremophiles in a simulated extraterrestrial environment, with a focus on assessing the exobiological potential and adaptability of terrestrial life forms in such conditions through controlled experiments. Specifically, we introduce the Chinese Exo-Ecosystem Space Experiment (CHEESE), which investigates the survivability and potential for sustained growth, reproduction, and ecological interactions of methanogens under simulated Mars and Moon environments using the China Space Station (CSS) as a platform. We highlight that the space station provides unique yet relatively comprehensive conditions for simulating extraterrestrial environments. In conclusion, space experiments involving exo-ecosystems could pave the way for long-term human habitation in space, ensuring our ability to sustain colonies and settlements beyond Earth while minimizing our ecological impact on celestial bodies.

astro-ph.EP

Carbon Monitor Europe, near-real-time daily CO$_2$ emissions for 27 EU countries and the United Kingdom

With the urgent need to implement the EU countries pledges and to monitor the effectiveness of Green Deal plan, Monitoring Reporting and Verification tools are needed to track how emissions are changing for all the sectors. Current official inventories only provide annual estimates of national CO$_2$ emissions with a lag of 1+ year which do not capture the variations of emissions due to recent shocks including COVID lockdowns and economic rebounds, war in Ukraine. Here we present a near-real-time country-level dataset of daily fossil fuel and cement emissions from January 2019 through December 2021 for 27 EU countries and UK, which called Carbon Monitor Europe. The data are calculated separately for six sectors: power, industry, ground transportation, domestic aviation, international aviation and residential. Daily CO$_2$ emissions are estimated from a large set of activity data compiled from different sources. The goal of this dataset is to improve the timeliness and temporal resolution of emissions for European countries, to inform the public and decision makers about current emissions changes in Europe.

physics.geo-ph

Near-real-time global gridded daily CO$_2$ emissions 2021

We present a near-real-time global gridded daily CO$_2$ emissions dataset (GRACED) throughout 2021. GRACED provides gridded CO$_2$ emissions at a 0.1degree*0.1degree spatial resolution and 1-day temporal resolution from cement production and fossil fuel combustion over seven sectors, including industry, power, residential consumption, ground transportation, international aviation, domestic aviation, and international shipping. GRACED is prepared from a near-real-time daily national CO$_2$ emissions estimates (Carbon Monitor), multi-source spatial activity data emissions and satellite NO$_2$ data for time variations of those spatial activity data. GRACED provides the most timely overview of emissions distribution changes, which enables more accurate and timely identification of when and where fossil CO$_2$ emissions have rebounded and decreased. Uncertainty analysis of GRACED gives a grid-level two-sigma uncertainty of value of 19.9% in 2021, indicating the reliability of GRACED was not sacrificed for the sake of higher spatiotemporal resolution that GRACED provides. Continuing to update GRACED in a timely manner could help policymakers monitor energy and climate policies' effectiveness and make adjustments quickly.

physics.ao-ph

Carbon Monitor-Power: near-real-time monitoring of global power generation on hourly to daily scales

We constructed a frequently updated, near-real-time global power generation dataset: Carbon Monitor-Power since January, 2016 at national levels with near-global coverage and hourly-to-daily time resolution. The data presented here are collected from 37 countries across all continents for eight source groups, including three types of fossil sources (coal, gas, and oil), nuclear energy and four groups of renewable energy sources (solar energy, wind energy, hydro energy and other renewables including biomass, geothermal, etc.). The global near-real-time power dataset shows the dynamics of the global power system, including its hourly, daily, weekly and seasonal patterns as influenced by daily periodical activities, weekends, seasonal cycles, regular and irregular events (i.e., holidays) and extreme events (i.e., the COVID-19 pandemic). The Carbon Monitor-Power dataset reveals that the COVID-19 pandemic caused strong disruptions in some countries (i.e., China and India), leading to a temporary or long-lasting shift to low carbon intensity, while it had only little impact in some other countries (i.e., Australia). This dataset offers a large range of opportunities for power-related scientific research and policy-making.

physics.data-an

Near-real-time estimates of daily CO2 emissions from 1500 cities worldwide

Building on near-real-time and spatially explicit estimates of daily carbon dioxide (CO2) emissions, here we present and analyze a new city-level dataset of fossil fuel and cement emissions. Carbon Monitor Cities provides daily, city-level estimates of emissions from January 2019 through December 2021 for 1500 cities in 46 countries, and disaggregates five sectors: power generation, residential (buildings), industry, ground transportation, and aviation. The goal of this dataset is to improve the timeliness and temporal resolution of city-level emission inventories and includes estimates for both functional urban areas and city administrative areas that are consistent with global and regional totals. Comparisons with other datasets (i.e. CEADs, MEIC, Vulcan, and CDP) were performed, and we estimate the overall uncertainty to be 21.7%. Carbon Monitor Cities is a near-real-time, city-level emission dataset that includes cities around the world, including the first estimates for many cities in low-income countries. A more complete description of this dataset is published in Scientific Data (https://doi.org/10.1038/s41597-022-01657-z).

physics.soc-ph

De-carbonization of global energy use during the COVID-19 pandemic

The COVID-19 pandemic has disrupted human activities, leading to unprecedented decreases in both global energy demand and GHG emissions. Yet a little known that there is also a low carbon shift of the global energy system in 2020. Here, using the near-real-time data on energy-related GHG emissions from 30 countries (about 70% of global power generation), we show that the pandemic caused an unprecedented de-carbonization of global power system, representing by a dramatic decrease in the carbon intensity of power sector that reached a historical low of 414.9 tCO2eq/GWh in 2020. Moreover, the share of energy derived from renewable and low-carbon sources (nuclear, hydro-energy, wind, solar, geothermal, and biomass) exceeded that from coal and oil for the first time in history in May of 2020. The decrease in global net energy demand (-1.3% in the first half of 2020 relative to the average of the period in 2016-2019) masks a large down-regulation of fossil-fuel-burning power plants supply (-6.1%) coincident with a surge of low-carbon sources (+6.2%). Concomitant changes in the diurnal cycle of electricity demand also favored low-carbon generators, including a flattening of the morning ramp, a lower midday peak, and delays in both the morning and midday load peaks in most countries. However, emission intensities in the power sector have since rebounded in many countries, and a key question for climate mitigation is thus to what extent countries can achieve and maintain lower, pandemic-level carbon intensities of electricity as part of a green recovery.

physics.ao-ph

Carbon Monitor: a near-real-time daily dataset of global CO2 emission from fossil fuel and cement production

We constructed a near-real-time daily CO2 emission dataset, namely the Carbon Monitor, to monitor the variations of CO2 emissions from fossil fuel combustion and cement production since January 1st 2019 at national level with near-global coverage on a daily basis, with the potential to be frequently updated. Daily CO2 emissions are estimated from a diverse range of activity data, including: hourly to daily electrical power generation data of 29 countries, monthly production data and production indices of industry processes of 62 countries/regions, daily mobility data and mobility indices of road transportation of 416 cities worldwide. Individual flight location data and monthly data were utilised for aviation and maritime transportation sectors estimates. In addition, monthly fuel consumption data that corrected for daily air temperature of 206 countries were used for estimating the emissions from commercial and residential buildings. This Carbon Monitor dataset manifests the dynamic nature of CO2 emissions through daily, weekly and seasonal variations as influenced by workdays and holidays, as well as the unfolding impacts of the COVID-19 pandemic. The Carbon Monitor near-real-time CO2 emission dataset shows a 7.8% decline of CO2 emission globally from Jan 1st to Apr 30th in 2020 when compared with the same period in 2019, and detects a re-growth of CO2 emissions by late April which are mainly attributed to the recovery of economy activities in China and partial easing of lockdowns in other countries. Further, this daily updated CO2 emission dataset could offer a range of opportunities for related scientific research and policy making.

physics.soc-ph

COVID-19 causes record decline in global CO2 emissions

The considerable cessation of human activities during the COVID-19 pandemic has affected global energy use and CO2 emissions. Here we show the unprecedented decrease in global fossil CO2 emissions from January to April 2020 was of 7.8% (938 Mt CO2 with a +6.8% of 2-{\sigma} uncertainty) when compared with the period last year. In addition other emerging estimates of COVID impacts based on monthly energy supply or estimated parameters, this study contributes to another step that constructed the near-real-time daily CO2 emission inventories based on activity from power generation (for 29 countries), industry (for 73 countries), road transportation (for 406 cities), aviation and maritime transportation and commercial and residential sectors emissions (for 206 countries). The estimates distinguished the decline of CO2 due to COVID-19 from the daily, weekly and seasonal variations as well as the holiday events. The COVID-related decreases in CO2 emissions in road transportation (340.4 Mt CO2, -15.5%), power (292.5 Mt CO2, -6.4% compared to 2019), industry (136.2 Mt CO2, -4.4%), aviation (92.8 Mt CO2, -28.9%), residential (43.4 Mt CO2, -2.7%), and international shipping (35.9Mt CO2, -15%). Regionally, decreases in China were the largest and earliest (234.5 Mt CO2,-6.9%), followed by Europe (EU-27 & UK) (138.3 Mt CO2, -12.0%) and the U.S. (162.4 Mt CO2, -9.5%). The declines of CO2 are consistent with regional nitrogen oxides concentrations observed by satellites and ground-based networks, but the calculated signal of emissions decreases (about 1Gt CO2) will have little impacts (less than 0.13ppm by April 30, 2020) on the overserved global CO2 concertation. However, with observed fast CO2 recovery in China and partial re-opening globally, our findings suggest the longer-term effects on CO2 emissions are unknown and should be carefully monitored using multiple measures.

econ.GN