What comes after attention? This startup says it already knows.

Summary

When Subquadratic launched earlier this year, it could build a sparse-attention model that could handle a 12-million token context window The post What comes after attention? This startup says it already knows. appeared first on The New Stack .

Lotu Radar provides attributed news summaries and links to the original publisher. Full reporting and copyright remain with the source.