DeepSeek本地部署测试
- 主题发起人 Riven
- 开始时间
billwanhua
本站元老
- 注册
- 2005-07-07
- 消息
- 15,772
- 荣誉分数
- 5,011
- 声望点数
- 373
View: https://www.reddit.com/r/LocalLLaMA/comments/1ic8cjf/6000_computer_to_run_deepseek_r1_670b_q8_locally/
自己玩那么多gpu就是overkill，又不是提供服务， 有人6000美元amd CPU玩起来了，如果有1,2块GPU可能更好
View: https://x.com/carrigmat/status/1884244369907278106
- 注册
- 2003-06-21
- 消息
- 32,205
- 荣誉分数
- 4,196
- 声望点数
- 373
你怎么知道我不提供服务？
用ram+cpu跑奇慢无比，100多个core的xeon加500g内存load就得好几分钟，token输出跟幻灯片一样
大部分对这玩意的了解也就是个chatbot，那有个屁用啊，你放个几百k的context试试，cpu不给你烧冒烟了...
billwanhua
本站元老
- 注册
- 2005-07-07
- 消息
- 15,772
- 荣誉分数
- 5,011
- 声望点数
- 373
- 注册
- 2003-06-21
- 消息
- 32,205
- 荣誉分数
- 4,196
- 声望点数
- 373
private cloud也是service啊
啥都上cloud，security+guardrail就够喝一壶的
以前的设备不行搞个poc都吃力
现在不一样了，n个模型一起跑，ai gateway不是梦
metropolis
本站元老
- 注册
- 2010-12-10
- 消息
- 9,366
- 荣誉分数
- 1,893
- 声望点数
- 323
法国也发布了一个叫Lucie的美女，没两天就灰头土脸地下线了，说不成熟，过早发布了，给出了很多荒唐的解答，害人不浅。比如牛奶蛋，是牛下的蛋。
French AI chatbot taken offline after wild answers led to online ridicule
By Jack Guy, CNN
2 minute read
Published 11:02 AM EST, Mon January 27, 2025
The logo for French AI model Lucie
Linagora
CNN — A French-language artificial intelligence chatbot backed by the French government has been taken offline after providing nonsensical answers to simple mathematical equations, and even recommending that one user eat cow’s eggs.
In a statement Saturday, the Linagora Group, a company that is part of a consortium developing the model, named Lucie, said it remains an “academic research project in its early stages.”
Lucie was released “prematurely,” said Linagora, adding that it should have been clearer in informing users of the limitations of the model in its current form.
“We were carried away by our own enthusiasm,” the statement reads.
Michel-Marie Maudet, general director of Linagora Group, told CNN that the team would now update its model and then test a beta version in private before a public relaunch.
After Lucie was launched Thursday, users took to social media to share its erroneous answers, including a response to a user query asking the chatbot to tell them about cow’s eggs.
Related articleA shocking Chinese AI advancement called DeepSeek is sending US stocks plunging
“Cow’s eggs, also known as chicken’s eggs, are edible eggs produced by cows,” Lucie was quoted as replying. “Cow’s eggs are a source of protein and nutrients, and are considered to be a healthy and nutritious food.”
Asked to multiply 5 by (3+2), the model gave an answer of 17, instead of 25, and Lucie also said that “the square root of a goat is one,” users reported.
Launched with ambitions of challenging the dominance of the English language in AI and providing an alternative to models such as OpenAI’s ChatGPT, Lucie is named after the oldest human ancestor, said Linagora.
Its logo is inspired by both Marianne, a national symbol of France, and the US actress Scarlett Johansson, who starred in the film “Lucy,” according to a statement from Linagora published on January 3.
“Lucie is covered by a blue, white and red shawl, demonstrating her sovereign French personality,” the statement added.
Lucie has been backed by French President Emmanuel Macron as part of his France 2030 investment program, which includes a wide range of projects worth a total of €54 billion ($56.8 billion).
And Macron is currently preparing to host the Artificial Intelligence Action Summit, which will bring world leaders and tech figures to Paris from February 10 to 11.
