还记得deep seek被指责使用chatgpt 蒸馏吗?现在颠倒了,meta最新模型使用阿里千问蒸馏

billwanhua

本站元老
注册
2005-07-07
消息
17,644
荣誉分数
6,303
声望点数
373


Bloomberg reported Wednesday that Meta is using Alibaba's Qwen model, alongside open-source systems from Alphabet Inc.’s (NASDAQ:GOOGL) Google and OpenAI, to train a new AI model code-named Avocado, which the company aims to release in the spring.

The new Avocado model is being built inside Meta's recently formed TBD Lab, staffed with researchers Meta acquired at high cost and led by new chief AI officer Alexandr Wang, whose previous company Meta bought for $14.3 billion.

Bloomberg noted that TBD Lab is "distilling" Qwen and other open-source models to train Avocado, a controversial technique in which developers use outputs from other models to accelerate training
 
是否与chef Mr. Wang 是华裔有关系?更广泛地去发掘资源?
 
Rules-based-order的意思是,帝随便干啥都对,鳖干啥都错。
技术角度讲,互相蒸馏,最后大家结论都一样,对对得一样,错也错得一样。长此以往错的就成对的了。
 
后退
顶部
首页 论坛
消息
我的