ColossalChat

Colossal-AI launched a free open source version of the ChatGPT chatbot replacement.

ColossalChat is a free and open source ChatGPT chat robot replacement launched by Colossal-AI. Currently, its GitHub project has won 26K stars.
As today’s leading open source large-scale artificial intelligence model solution, Colossal AI is the first company to open source a complete RLHF mechanism based on the LLaMA pre-training model, which includes supervised data collection, supervised fine-tuning, reward model training and reinforcement learning fine-tuning, and shared ColossalChat – Open source project very similar to the original ChatGPT technical solution.
This open source project includes the following:

• Demo demo: An interactive demo that can be tried online without registration or waiting list
• Training code: open source complete RLHF training code, including 7 billion and 13 billion models.
• Dataset: Open source 104K Chinese-English bilingual dataset.
• Inference: Only 4GB of GPU memory is required to perform 4-bit quantitative inference of a 7 billion parameter model.
• Model Weights: Fast replication with little computing power on a single server.