- cross-posted to:
- hackernews@derp.foo
- tal ( @tal@lemmy.today ) 14•10 months ago
I’m deeply skeptical that export controls are going to work with China if the item in question is a consumer GPU unless you’re going to radically redesign the things to do something extremely obnoxious like require cryptographically-secure online activation every boot. There are just too many individuals and small businesses in random other countries who are going to be able to buy them and resell them. The chain over which a GPU travels is too far disconnected from entities that we can directly affect.
Maybe they can induce a very limited delay, or increase costs to a limited degree, but I assume that that’s not what the goal is.
You can only effectively export-control something if, all along the chain from the manufacturer to the end user, you can clearly distinguish between a legit and non-legit user. There’s no way that some random electronics store in Kazakhstan is going to know whether the person buying a 4090 with cash is going to sell it in China or use it themselves.
- baconisaveg ( @baconisaveg@lemmy.ca ) 8•10 months ago
It’s also kind of ridiculous to think that anyone using a consumer grade GPU is a threat. No one doing work with AI is using a 4090, they’re using enterprise grade cards with 80GB of vram (H100/A100, even P40’s in a pinch). The 4090 is a nice toy for running Stable Diffusion and low grade
ERPLLM models and that’s about it.- averyminya ( @averyminya@beehaw.org ) 3•10 months ago
I don’t think they’re worried about you and I doing that with 4090’s, they’re worried that China will refab the GPU’s if they can get them in the first place
- bioemerl ( @bioemerl@kbin.social ) 11•10 months ago
As it fucking should be, this is like the third time they have tried to redesign the chip to get around export restrictions
- baconisaveg ( @baconisaveg@lemmy.ca ) 8•10 months ago
And yet all of the good, open source LLM work is coming out of China. But hey, maybe this will spur some ROCm development so AMD cards don’t suck so fucking hard in that space.
- bioemerl ( @bioemerl@kbin.social ) 7•10 months ago
AMD is also subject to export restrictions.
- baconisaveg ( @baconisaveg@lemmy.ca ) 3•10 months ago
I liked your original comment before the edit, it’s true. AMD only has consumer grade hardware, which is the main reason the majority of the AI projects don’t support it. Code written for CUDA can work on a A100 just as well as a 3090, there’s no money in developing software to run on someone’s 4 year old gaming PC.
- bioemerl ( @bioemerl@kbin.social ) 1•10 months ago
AMD makes a few Mi999 cards that support pytorch with ROCM and are subject to the export ban.
- baconisaveg ( @baconisaveg@lemmy.ca ) 2•10 months ago
Not sure how I missed the MI250 series, but thanks.
- Strawberry ( @Strawberry@lemmy.blahaj.zone ) 4•10 months ago
So nice of the US to encourage the growth of our trade partner’s domestic chip manufacturing
- Juno ( @Juno@beehaw.org ) 3•10 months ago
Is this article written by an ai?
Seriously, things are “hot up” around here??? This bio seems made up as fffff
And the author has only ever posted a bunch of spammy bs
Can I get another opinion on this?