In our initial effort in this domain, we limit ourselves to serial connections and non-adaptive configurations, deferring the investigation of more flexible model merging to future work. Concretely, with a collection of \(N\) models and a budget \(T\), our method searches for a sequence of layer indices \(L_{i,j}^{(t)}\) that delineates the path all the tokens should follow for a specific task. Here \(L_{i,j}\) denotes the \(j\)-th layer in the \(i\)-th model, with \(t\in[1,T]\) marking the step in the inference path.