Research & academia
Latent Lattice Language Models
An arXiv abstract reports that persistent latent streams lower validation perplexity across Transformers and several recurrent-model variants.
Why it matters: For model builders, the reported results suggest persistent per-layer states can complement residual-stream changes and improve perplexity across multiple architecture families. The abstract does not establish whether those gains come with added runtime or compute costs, so that trade-off remains unclear from the supplied evidence.