Karpathy’s latest open-source project “nanochat” goes viral, gaining nearly 5k stars overnight

Former Tesla AI Director Karpathy has launched an open-source project called “nanochat”, which reproduces the entire ChatGPT pipeline in just about 8,000 lines of code. Within less than 12 hours of its release on GitHub, the project had already surpassed 4.2k stars. With just one GPU, around 4 hours of training, and roughly $100 in cost, users can train a “mini ChatGPT” capable of writing poems and answering basic questions.