Conversation
appinn@pullopen.xyz

小众软件（镜像）

『AI 正在“矿机化”：成本降 10 倍，GPU 会被淘汰吗？』
几天前，一家公司把大模型直接写入芯片（ASIC），推理速度为 17000 Token/s，相当于1秒生成30页A4纸的内容，但耗电量和使用成本比英伟达显卡降低 10 倍！比特币的故事，正在 AI 身上重演。 比特币矿工的军备竞赛 2009 年，比特币刚诞生时，使用 CPU 挖矿，大家在同一起跑线。
……
阅读全文： sys_link https://www.appinn.com/asicai-mining-machine-era-gpu-obsolete/

0
0
0
dwn

forumoji_rainbow_flag dwn forumoji_two forumoji_zero forumoji_two forumoji_six

LLM
Show content
这可能是另一种普惠 LLM 的方式，只不过首先得是开源或自研模型，然后得花大价钱定制

国产化只有华为能断层做到国内最强；目前最有可能的是昇腾把小艺模型嵌入芯片，最终可能只能靠接入华为手机呈现给 to C 用户了

RE: https://pullopen.xyz/@appinn/116119425797375546
1
0
0
dwn

forumoji_rainbow_flag dwn forumoji_two forumoji_zero forumoji_two forumoji_six

Reply to @dwn
LLM
Show content
但仍旧不适合，尤其是华为拿良品率换性能的情景（不过华为现在机型价格也能和小米等竞品抗衡了）
0
0
0
About AtmoType Discuss

Gary: Hi! This is an private Akkoma instance for contributors of AtmoType, along with some of my friends!

Contact us: cybergari at tuta dot io

SWITCH FRONTENDS

Terms of Use

You may:

  1. Post political, adult, and other content without censorship. (On the basis of proper content warnings and NSFW labels.)
  2. Publish content that does not violate the laws of the server's location. The administrator will not hand over information to government authorities.

This does not mean you may:

  1. Harass, insult, threaten, or personally attack other users.
  2. Publish content that promotes violence, discrimination, hatred, pedophilia, fraud, etc. (Please comply with the laws and regulations of the server's location.)
  3. Report the speech of other users you "disagree with" to government authorities.
  4. Upload or share child pornography in any form (including but not limited to images, text, URLs, etc.).

The above actions will result in an account ban on this site and, depending on the severity of the harm, may be publicly disclosed.

Service Commitment

Our servers are located in New Jersey, USA.
In principle, you enjoy freedom of speech here. However, generally, you only need to comply with the laws of your own country (region) and the laws of our server's location. This instance is a non-commercial project with no SLA guarantee. Please regularly back up your follow lists and posts. However, the administrator will make every effort to maintain the site's uptime rate above 99.9%.
Additionally, this instance uses high-security configurations. Please ensure you access us using HTTPS to maximize the security of your data during transmission.