Hugging Face Daily Papers·· 1 天前AI 评分46
NeMo-DCR:面向万亿参数智能体RL的bit-exact增量压缩refit
NeMo-DCR: Bit-Exact Delta-Compressed Refit for Scalable Agentic RL at Trillion-Parameter Scale
AI 导读
NeMo-DCR 通过只传输权重变化,实现万亿参数智能体RL跨集群refit的bit-exact同步。完整传输1T checkpoint在两个AWS区域间需87.5 min,而1T relay-tree refit在3%变化率下用150 s;30B-1T模型在3%和5%变化率下比全checkpoint传输快12-40×。代码已在 NVIDIA NeMo RL PR #2444 开源。
来源:Hugging Face Daily Papers · arxiv.org