The massive, bot-driven dictionary that is rewriting the rules of lexicography
Beyond the familiar pages of Wikipedia lies a multilingual behemoth: Wiktionary. Driven by a global community of volunteers and powered by sophisticated bots, this digital archive is expanding far beyond the constraints of print, offering a massive, evolving database for both humans and machines.
Launched on December 12, 2002, following proposals by Daniel Alston and Larry Sanger, Wiktionary is a collaborative, web-based project. Unlike traditional print dictionaries, it is not limited by physical space, allowing its various language editions to include extensive translations, etymologies, and even thesaurus-like information. As of July 2021, the project boasted over 30 million articles, with the English edition alone containing over 7.5 million entries.
While 'Wiktionarians' manually edit the site, much of its scale is achieved through automation. In 2007, just seven registered bots were responsible for 163,000 entries in the English edition. Specialized bots like 'ThirdPersBot' automatically generate definitions for grammatical inflections, such as 'smoulders' as a third-person singular form. This automation allows Wiktionary to surpass the coverage of major print works; for example, its English coverage is significantly larger than the 475,000 entries in Merriam-Webster's Third New International Dictionary.
The project's utility extends into the realm of artificial intelligence. Its semi-structured data is frequently used in natural language processing (NLP) tasks, including machine translation between Dutch and Afrikaans, speech recognition, and the construction of machine-readable dictionaries. Researchers have even used its data to assess vocabulary difficulty and reading levels. Despite early criticism from figures like Jill Lepore, who questioned the lack of professional editorial staff, the project remains a vital, growing resource for both linguistic study and technological innovation.
Source: Wiktionary
