Model releases & benchmarks
NCP-ArchPreview Technical Report: Moving towards Latent Space Language Models through Next Concept Prediction
NCP-ArchPreview adds multi-token concept prediction to next-token training, and reports gains in training efficiency, downstream scores, and post-training uses.
Why it matters: The reported results make concept prediction relevant both to pretraining efficiency and later adaptation: the authors also describe updating a 17M-parameter VQ module for domain adaptation and improving a drafter with concept representations.