A compact conversational language model that chats in plain English and writes Python

T1Covered by 1 source · first reported by Raspberry Pi / Arduino / Adafruit at 30 Oct, 14:26 UTC

Kristijonas Adomaitis has published Kadmos-1 on GitHub, a decoder-only transformer language model with 45.8 million parameters that holds a short conversation and writes small Python functions. The architecture, tokenizer and weights were built in the repository from random initialisation, not…

aidev

Sources

• T1A compact conversational language model that chats in plain English and writes PythonRaspberry Pi / Arduino / Adafruit30 Oct, 14:26