Chinese AI firms use model distillation to train domestic large language models amid U.S. chip export restrictions

Summary

Chinese developers are increasingly employing model distillation, using outputs from U.S. AI systems to train local models, as access to advanced hardware becomes more limited by export controls.

Chinese artificial-intelligence companies are turning to model distillation to develop large language models after tighter U.S. export controls have limited their access to high-end compute hardware. A review of more than 300 Chinese academic papers, patents, corporate disclosures, recruitment notices and government documents shows that firms are using outputs from leading U.S. models as training data for smaller domestic systems.

Distillation involves a powerful “teacher” model generating answers, code or problem-solving steps, which are then used to train a “student” model. Researchers at Shanghai Jiao Tong University, for example, selected about 5,000 responses from OpenAI’s o1 model, translated them with GPT-4o mini, and created 10,750 bilingual examples to fine-tune Alibaba’s Qwen2.5-72B model. Similar workflows have been reported by Alibaba and by a partnership between Shanghai Jiao Tong University and Meituan, which used GPT-4o to generate coordination plans for coding tasks.

OpenAI and Anthropic prohibit the use of their models for training competing systems in their terms of service, a restriction that could heighten tensions between the United States and China. A U.S. official familiar with recent discussions in Chengdu said Washington views “industrial-scale distillation” as a key factor narrowing the performance gap between Chinese and U.S. AI models.

While distillation is not illegal under current law, U.S. officials are considering regulatory measures that could limit the use of American AI outputs in foreign model training. The practice remains a cost-effective alternative for Chinese firms facing high prices for NVIDIA GPUs, which have risen sharply in the Chinese gray market due to export restrictions.

Source

Wccftech

Keep reading — for free

Create a free account to follow the news. No card required.