Flow Matching

Apple tests categorical flows as a non-autoregressive LM path Apple Machine Learning Research says it has scaled Categorical Flow Maps to a 1.7B-parameter language model trained on 2.1T tokens. The work positions continuous diffusion and flow matching as a possible alternative to autoregressive...