Talkie
| Original author(s) | Nick Levine, David Duvenaud, Alec Radford |
|---|---|
| Initial release | April 2026 |
| Engine | |
| Available in | English |
| License | Apache license |
| Website | https://talkie-lm.com/ |
Search Talkie on Amazon.
Talkie is a small language model developed by Nick Levine, David Duvenaud, and Alec Radford. It was announced in April 2026 and described by the developers as a vintage language model. Talkie is trained solely on pre-1931 texts that are in the Public Domain.[1] Talkie consists of a 13 billion parameter model called talkie-1930-13b-base and a post-trained checkpoint designed to power a chat interface, called talkie-1930-13b-it.
Development
The model was trained on 260 billion tokens of pre-1931 English text from sources like the Institutional Data Initiative, Common Pile or the Internet Archive. The 31 December 1930 cutoff is based on copyright term rules in the United States, where works published between 1923-1977 are protected for 95 years. The data includes books, newspapers, periodicals, scientific journals, patents, and case law. The developers experimented with various optical character recognition (OCR) methods and developed a dedicated vintage OCR system.
A dedicated post-training pipeline was also developed, based on historical structured texts, such as etiquette manuals, letter-writing manuals, cookbooks, dictionaries, and encyclopedias.
The term vintage language model is attributed to Owain Evans and describes language models trained only on historical text.[2] The purpose of such models is to simulate language use from the past, and to study behavior of models not contaminated by contemporary content. Other vintage models include Ranke 4B, Mr Chatterbox or Machina Mirabilis. Talkie is also inspired by Calcifer Computing’s work on Temporal Language Models, able to represent temporal trends in language.[3]
References
- ↑ "Introducing talkie: a 13B vintage language model from 1930". talkie-lm.com. Retrieved 2026-05-19.
- ↑ Evans, Owain (2024). "Vintage Large Language Models".
- ↑ "CalCo". www.calcifercomputing.com. Retrieved 2026-05-19.
External links
- Official website
- Talkie-powered chat interface
This article "Talkie" is from Wikipedia. The list of its authors can be seen in its historical and/or the page Edithistory:Talkie. Articles copied from Draft Namespace on Wikipedia could be seen on the Draft Namespace of Wikipedia and not main one.
