Deepseek announced the Open Source Optimized Parallel Strategy on Day 4 of Open Source Week, in which DualPipe - including a bidirectional pipeline parallel algorithm for compute-communication overlap in V3/R1 training; EPLB - an expert parallel load balancer for V3/R1; and analyzing compute-communication overlap in V3/R1.