ColossalChat

ColossalChat is a free and open-source alternative to ChatGPT launched by Colossal-AI. Currently, its GitHub project has received 40K stars.

As a leading open-source large-scale artificial intelligence model solution today, Colossal AI is the first company to open source a complete RLHF (Reinforcement Learning from Human Feedback) mechanism based on the LLaMA pre-trained model. This mechanism includes supervised data collection, supervised fine-tuning, reward model training, and reinforcement learning fine-tuning. It also shares ColossalChat – an open-source project very similar to the original ChatGPT technical solution.

This open-source project includes the following content:

• Demo Demonstration: An interactive demonstration that can be tried online without registration or joining a waiting list.
• Training Code: Open-source and complete RLHF training code, including models with 7 billion and 13 billion parameters.
• Dataset: Open-source 104K Chinese-English bilingual dataset.
• Inference: Only 4GB of GPU memory is required for 4-bit quantized inference of the 7-billion-parameter model.
• Model Weights: Fast replication can be achieved on a single server with minimal computing power.