China Telecom say AI model with 1 trillion parameters trained with Chinese chips
The state-owned telecoms operator did not reveal what chips it used for its 1 trillion-parameter model, but it has a partnership with Huawei
The achievement “indicates that China has truly realised total self-sufficiency in domestic LLM training” and marks the start of a new phase for China’s innovation and self-reliance in LLMs, the technology behind OpenAI’s ChatGPT, the AI institute said in a statement published to WeChat.
China Telecom said the unnamed model has 1 trillion parameters – a machine-learning term for variables present in an AI system during training. The sophistication and effectiveness of an AI model depend largely on the scale of parameters involved in the training process. TeleChat2t-115B has over 100 billion parameters, the company said.