Recent analysis and discoveries imply that knowledge is stored distributedly in language models [14; 35; 36], suggesting simple yet novel model merging possibilities in the data flow space (DFS). Unlike merging in PS, model merging in DFS preserves the original weights of each layer intact. Instead, it optimizes the inference path that tokens follow as they traverse through the neural network. For example, after the \(i\)-th layer in model \(A\), a token may be directed to the \(j\)-th layer in model \(B\).