Context Window
From EverybodyWiki Bios & Wiki
The Context Window is the maximum length of input a Large Language Model (LLM) can consider at once. In the development and maturation of LLM technology expanding the context window has been a major goal.[1][2] The length of a context window is measured in tokens. In 2025, the Gemini LLM had the largest context window with two million tokens.[3]
References
- ↑ Ratner, Nir; Levine, Yoav; Belinkov, Yonatan; Ram, Ori; Magar, Inbal; Abend, Omri; Karpas, Ehud; Shashua, Amnon; Leyton-Brown, Kevin; Shoham, Yoav (2023). "Parallel Context Windows for Large Language Models". Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers): 6383–6402. doi:10.18653/v1/2023.acl-long.352.
- ↑ Dong, Zican; Li, Junyi; Men, Xin; Zhao, Wayne Xin; Wang, Bingning; Tian, Zhen; Chen, Weipeng; Wen, Ji-Rong (10 December 2024). "Exploring context window of large language models via decomposed positional vectors". Proceedings of the 38th International Conference on Neural Information Processing Systems. Curran Associates Inc. 37: 10320–10347.
- ↑ Yeung, Ken (2024-05-14). "Google announces Gemini 1.5 Flash, a rapid multimodal model with a 1M context window". VentureBeat. Retrieved 2025-08-26.
This article "Context Window" is from Wikipedia. The list of its authors can be seen in its historical and/or the page Edithistory:Context Window. Articles copied from Draft Namespace on Wikipedia could be seen on the Draft Namespace of Wikipedia and not main one.
